2024-04-28T13:00:46.047 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-28T13:00:46.047 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-04-28_11:41:23-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7676903 --name rishabh-2024-04-28_11:41:23-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi --verbose --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/snapshot}} -- /home/teuthworker/archive/rishabh-2024-04-28_11:41:23-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7676903/orig.config.yaml 2024-04-28T13:00:46.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-28T13:00:46.181 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-04-28_11:41:23-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7676903 branch: wip-rishabh-testing-20240426.111959 description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/snapshot}} email: null first_in_suite: false job_id: '7676903' kernel: client: sha1: distro flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-04-28_11:41:23-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240426.111959 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240426.111959 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 owner: scheduled_rishabh@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 816 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 sleep_before_teardown: 0 subset: 166/512 suite: fs suite_branch: wip-rishabh-testing-20240426.111959 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi114.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJW8/xUg2phVQuZKJ6zxnUCCEvu3UkXP4Q5NpOcdX7kLLPEh7FgjHVMSipey708EzT2bWSrG9StTm3L4GSFpbhw= smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCyN4A9RIl0Tq4nbnDumkiYtli8aUlGNzMxUsDvbiQXoX+gUmp9QipYi/CZJY5YAMqoDxVy1T4iXWJPJx4lUzcA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots - tasks.cephfs.test_volumes.TestSubvolumeSnapshots teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-28_11:41:23 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-28T13:00:46.182 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa; will attempt to use it 2024-04-28T13:00:46.182 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks 2024-04-28T13:00:46.182 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-28T13:00:46.184 INFO:teuthology.task.internal:Checking packages... 2024-04-28T13:00:46.206 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bc612ffb9c1d5bc27536bc917a705262a36d4387' 2024-04-28T13:00:46.206 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-28T13:00:46.206 INFO:teuthology.packaging:ref: None 2024-04-28T13:00:46.206 INFO:teuthology.packaging:tag: None 2024-04-28T13:00:46.206 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240426.111959 2024-04-28T13:00:46.206 INFO:teuthology.packaging:sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-28T13:00:46.207 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240426.111959 2024-04-28T13:00:46.498 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3306.gbc612ffb 2024-04-28T13:00:46.500 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-28T13:00:46.506 INFO:teuthology.task.internal:no buildpackages task found 2024-04-28T13:00:46.506 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-28T13:00:46.531 INFO:teuthology.task.internal:Saving configuration 2024-04-28T13:00:46.550 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-28T13:00:46.556 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-28T13:00:46.577 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-28_11:41:23-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7676903', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-28 12:55:50.721903', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJW8/xUg2phVQuZKJ6zxnUCCEvu3UkXP4Q5NpOcdX7kLLPEh7FgjHVMSipey708EzT2bWSrG9StTm3L4GSFpbhw='} 2024-04-28T13:00:46.596 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-28_11:41:23-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7676903', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-28 12:55:50.719942', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCyN4A9RIl0Tq4nbnDumkiYtli8aUlGNzMxUsDvbiQXoX+gUmp9QipYi/CZJY5YAMqoDxVy1T4iXWJPJx4lUzcA='} 2024-04-28T13:00:46.596 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-28T13:00:46.602 INFO:teuthology.task.internal:roles: ubuntu@smithi114.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-28T13:00:46.602 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-28T13:00:46.602 INFO:teuthology.run_tasks:Running task console_log... 2024-04-28T13:00:46.664 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f497c684160>, signals=[15]) 2024-04-28T13:00:46.665 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-28T13:00:46.673 INFO:teuthology.task.internal:Opening connections... 2024-04-28T13:00:46.673 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi114.front.sepia.ceph.com 2024-04-28T13:00:46.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-28T13:00:46.764 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2024-04-28T13:00:46.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-28T13:00:46.842 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-28T13:00:46.849 DEBUG:teuthology.orchestra.run.smithi114:> uname -m 2024-04-28T13:00:46.866 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2024-04-28T13:00:46.866 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2024-04-28T13:00:46.923 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Stream" 2024-04-28T13:00:46.923 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="9" 2024-04-28T13:00:46.924 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos" 2024-04-28T13:00:46.924 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora" 2024-04-28T13:00:46.924 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="9" 2024-04-28T13:00:46.924 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el9" 2024-04-28T13:00:46.924 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-28T13:00:46.924 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2024-04-28T13:00:46.924 INFO:teuthology.orchestra.run.smithi114.stdout:LOGO="fedora-logo-icon" 2024-04-28T13:00:46.924 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-28T13:00:46.924 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/" 2024-04-28T13:00:46.924 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-28T13:00:46.924 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-28T13:00:46.924 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-28T13:00:46.925 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2024-04-28T13:00:46.945 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2024-04-28T13:00:46.962 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2024-04-28T13:00:46.963 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2024-04-28T13:00:47.020 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2024-04-28T13:00:47.020 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="9" 2024-04-28T13:00:47.020 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2024-04-28T13:00:47.021 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2024-04-28T13:00:47.021 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="9" 2024-04-28T13:00:47.021 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el9" 2024-04-28T13:00:47.021 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-28T13:00:47.021 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2024-04-28T13:00:47.021 INFO:teuthology.orchestra.run.smithi134.stdout:LOGO="fedora-logo-icon" 2024-04-28T13:00:47.021 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-28T13:00:47.021 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2024-04-28T13:00:47.021 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-28T13:00:47.021 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-28T13:00:47.021 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-28T13:00:47.021 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2024-04-28T13:00:47.036 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-28T13:00:47.046 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-28T13:00:47.052 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-28T13:00:47.052 DEBUG:teuthology.orchestra.run.smithi114:> test '!' -e /home/ubuntu/cephtest 2024-04-28T13:00:47.055 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2024-04-28T13:00:47.077 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-28T13:00:47.082 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-28T13:00:47.082 DEBUG:teuthology.orchestra.run.smithi114:> test -z $(ls -A /var/lib/ceph) 2024-04-28T13:00:47.111 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2024-04-28T13:00:47.144 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-28T13:00:47.198 INFO:teuthology.run_tasks:Running task kernel... 2024-04-28T13:00:47.217 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-04-28T13:00:47.218 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-04-28T13:00:47.218 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-04-28T13:00:47.218 DEBUG:teuthology.orchestra.run.smithi114:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-28T13:00:47.219 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-28T13:00:47.236 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-28T13:00:47.236 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-28T13:00:47.236 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-04-28T13:00:47.237 DEBUG:teuthology.orchestra.run.smithi114:> uname -r 2024-04-28T13:00:47.293 INFO:teuthology.orchestra.run.smithi114.stdout:5.14.0-437.el9.x86_64 2024-04-28T13:00:47.293 INFO:teuthology.task.kernel:Running kernel on smithi114: 5.14.0-437.el9.x86_64 2024-04-28T13:00:47.293 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum install -y kernel 2024-04-28T13:00:47.294 INFO:teuthology.orchestra.run.smithi134.stdout:5.14.0-437.el9.x86_64 2024-04-28T13:00:47.294 INFO:teuthology.task.kernel:Running kernel on smithi134: 5.14.0-437.el9.x86_64 2024-04-28T13:00:47.295 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum install -y kernel 2024-04-28T13:00:49.442 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.0 MB 00:00 2024-04-28T13:00:51.184 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 28 MB/s | 19 MB 00:00 2024-04-28T13:00:51.363 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - BaseOS 3.3 MB/s | 8.0 MB 00:02 2024-04-28T13:00:54.297 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - AppStream 10 MB/s | 19 MB 00:01 2024-04-28T13:00:59.472 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.2 MB 00:01 2024-04-28T13:01:01.340 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 16 kB 00:00 2024-04-28T13:01:02.133 INFO:teuthology.orchestra.run.smithi114.stdout:Extra Packages for Enterprise Linux 31 MB/s | 21 MB 00:00 2024-04-28T13:01:02.576 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 810 kB/s | 6.2 MB 00:07 2024-04-28T13:01:04.668 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 16 kB 00:00 2024-04-28T13:01:06.436 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-04-28T13:01:07.144 INFO:teuthology.orchestra.run.smithi114.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-28T13:01:08.989 INFO:teuthology.orchestra.run.smithi114.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-28T13:01:08.989 INFO:teuthology.orchestra.run.smithi114.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-28T13:01:09.082 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-04-28T13:01:09.084 INFO:teuthology.orchestra.run.smithi114.stdout:Nothing to do. 2024-04-28T13:01:09.084 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-04-28T13:01:09.186 DEBUG:teuthology.orchestra.run.smithi114:> echo no | sudo yum reinstall kernel || true 2024-04-28T13:01:09.682 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:00:02 ago on Sun 28 Apr 2024 01:01:07 PM UTC. 2024-04-28T13:01:09.799 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-04-28T13:01:09.809 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-28T13:01:09.809 INFO:teuthology.orchestra.run.smithi114.stdout: Package Architecture Version Repository Size 2024-04-28T13:01:09.810 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-28T13:01:09.810 INFO:teuthology.orchestra.run.smithi114.stdout:Reinstalling: 2024-04-28T13:01:09.810 INFO:teuthology.orchestra.run.smithi114.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-28T13:01:09.810 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:01:09.810 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-04-28T13:01:09.810 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-28T13:01:09.810 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:01:09.810 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 255 k 2024-04-28T13:01:09.810 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 0 2024-04-28T13:01:09.810 INFO:teuthology.orchestra.run.smithi114.stderr:Operation aborted. 2024-04-28T13:01:09.862 INFO:teuthology.orchestra.run.smithi114.stdout:Is this ok [y/N]: 2024-04-28T13:01:09.862 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum reinstall -y kernel || true 2024-04-28T13:01:10.358 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:00:03 ago on Sun 28 Apr 2024 01:01:07 PM UTC. 2024-04-28T13:01:10.473 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-04-28T13:01:10.474 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-28T13:01:10.474 INFO:teuthology.orchestra.run.smithi114.stdout: Package Architecture Version Repository Size 2024-04-28T13:01:10.474 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-28T13:01:10.474 INFO:teuthology.orchestra.run.smithi114.stdout:Reinstalling: 2024-04-28T13:01:10.474 INFO:teuthology.orchestra.run.smithi114.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-28T13:01:10.474 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:01:10.474 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-04-28T13:01:10.474 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-28T13:01:10.474 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:01:10.474 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 255 k 2024-04-28T13:01:10.474 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 0 2024-04-28T13:01:10.474 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-04-28T13:01:10.769 INFO:teuthology.orchestra.run.smithi114.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.4 MB/s | 255 kB 00:00 2024-04-28T13:01:10.769 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-04-28T13:01:10.769 INFO:teuthology.orchestra.run.smithi114.stdout:Total 865 kB/s | 255 kB 00:00 2024-04-28T13:01:10.783 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-04-28T13:01:10.954 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-04-28T13:01:10.954 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-04-28T13:01:10.960 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-04-28T13:01:10.960 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-04-28T13:01:11.104 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-04-28T13:01:11.169 INFO:teuthology.orchestra.run.smithi114.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-28T13:01:11.170 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-28T13:01:11.577 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-04-28T13:01:11.877 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-28T13:01:11.878 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-28T13:01:12.567 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-28T13:01:12.567 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:01:12.567 INFO:teuthology.orchestra.run.smithi114.stdout:Reinstalled: 2024-04-28T13:01:12.567 INFO:teuthology.orchestra.run.smithi114.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-28T13:01:12.567 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:01:12.567 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-04-28T13:01:12.735 DEBUG:teuthology.orchestra.run.smithi114:> rpm -q kernel | sort -rV | head -n 1 2024-04-28T13:01:12.781 INFO:teuthology.orchestra.run.smithi114.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-28T13:01:12.782 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-28T13:01:12.782 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-28T13:01:12.782 DEBUG:teuthology.parallel:result is None 2024-04-28T13:01:13.450 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-28T13:01:13.451 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-28T13:01:13.531 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-28T13:01:13.532 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-04-28T13:01:13.532 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-28T13:01:13.641 DEBUG:teuthology.orchestra.run.smithi134:> echo no | sudo yum reinstall kernel || true 2024-04-28T13:01:14.140 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:03 ago on Sun 28 Apr 2024 01:01:11 PM UTC. 2024-04-28T13:01:14.258 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-28T13:01:14.275 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-28T13:01:14.275 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-04-28T13:01:14.275 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-28T13:01:14.275 INFO:teuthology.orchestra.run.smithi134.stdout:Reinstalling: 2024-04-28T13:01:14.275 INFO:teuthology.orchestra.run.smithi134.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-28T13:01:14.275 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:01:14.276 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-28T13:01:14.276 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-28T13:01:14.276 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:01:14.276 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 255 k 2024-04-28T13:01:14.276 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 0 2024-04-28T13:01:14.276 INFO:teuthology.orchestra.run.smithi134.stderr:Operation aborted. 2024-04-28T13:01:14.340 INFO:teuthology.orchestra.run.smithi134.stdout:Is this ok [y/N]: 2024-04-28T13:01:14.340 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum reinstall -y kernel || true 2024-04-28T13:01:14.837 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:03 ago on Sun 28 Apr 2024 01:01:11 PM UTC. 2024-04-28T13:01:14.954 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-28T13:01:14.955 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-28T13:01:14.955 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-04-28T13:01:14.955 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-28T13:01:14.955 INFO:teuthology.orchestra.run.smithi134.stdout:Reinstalling: 2024-04-28T13:01:14.955 INFO:teuthology.orchestra.run.smithi134.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-28T13:01:14.955 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:01:14.955 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-28T13:01:14.955 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-28T13:01:14.955 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:01:14.956 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 255 k 2024-04-28T13:01:14.956 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 0 2024-04-28T13:01:14.956 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-28T13:01:15.713 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-5.14.0-437.el9.x86_64.rpm 685 kB/s | 255 kB 00:00 2024-04-28T13:01:15.713 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-28T13:01:15.713 INFO:teuthology.orchestra.run.smithi134.stdout:Total 336 kB/s | 255 kB 00:00 2024-04-28T13:01:15.732 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-28T13:01:15.925 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-28T13:01:15.925 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-28T13:01:15.930 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-28T13:01:15.930 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-28T13:01:16.069 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-28T13:01:16.172 INFO:teuthology.orchestra.run.smithi134.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-28T13:01:16.172 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-28T13:01:16.902 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-28T13:01:16.902 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-28T13:01:17.659 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-28T13:01:17.659 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:01:17.659 INFO:teuthology.orchestra.run.smithi134.stdout:Reinstalled: 2024-04-28T13:01:17.659 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-28T13:01:17.659 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:01:17.659 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-28T13:01:17.840 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel | sort -rV | head -n 1 2024-04-28T13:01:17.888 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-28T13:01:17.888 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-28T13:01:17.889 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-28T13:01:17.889 DEBUG:teuthology.parallel:result is None 2024-04-28T13:01:17.889 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-28T13:01:17.897 INFO:teuthology.task.internal:Creating test directory... 2024-04-28T13:01:17.897 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-28T13:01:17.899 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-28T13:01:17.915 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-28T13:01:17.921 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-28T13:01:17.930 INFO:teuthology.task.internal:Creating archive directory... 2024-04-28T13:01:17.931 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-28T13:01:17.958 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-28T13:01:17.987 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-28T13:01:17.994 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-28T13:01:17.994 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-28T13:01:18.019 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-28T13:01:18.052 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-28T13:01:18.066 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-28T13:01:18.087 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-28T13:01:18.105 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-28T13:01:18.106 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-28T13:01:18.113 INFO:teuthology.task.internal:Configuring sudo... 2024-04-28T13:01:18.113 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-28T13:01:18.115 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-28T13:01:18.138 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-28T13:01:18.147 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-28T13:01:18.147 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-28T13:01:18.181 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-28T13:01:18.195 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-28T13:01:18.277 DEBUG:teuthology.orchestra.run.smithi114:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-28T13:01:18.326 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-28T13:01:18.410 DEBUG:teuthology.orchestra.run.smithi114:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-28T13:01:18.449 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:01:18.449 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-28T13:01:18.514 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-28T13:01:18.555 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-28T13:01:18.606 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-28T13:01:18.686 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-28T13:01:18.728 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:01:18.728 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-28T13:01:18.791 DEBUG:teuthology.orchestra.run.smithi114:> sudo service rsyslog restart 2024-04-28T13:01:18.794 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2024-04-28T13:01:18.826 INFO:teuthology.orchestra.run.smithi114.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-28T13:01:18.868 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-28T13:01:19.350 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-28T13:01:19.358 INFO:teuthology.task.internal:Starting timer... 2024-04-28T13:01:19.358 INFO:teuthology.run_tasks:Running task pcp... 2024-04-28T13:01:19.368 INFO:teuthology.run_tasks:Running task selinux... 2024-04-28T13:01:19.376 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-28T13:01:19.377 DEBUG:teuthology.orchestra.run.smithi114:> sudo service auditd rotate 2024-04-28T13:01:19.442 INFO:teuthology.orchestra.run.smithi114.stdout:Rotating logs: 2024-04-28T13:01:19.444 DEBUG:teuthology.orchestra.run.smithi134:> sudo service auditd rotate 2024-04-28T13:01:19.512 INFO:teuthology.orchestra.run.smithi134.stdout:Rotating logs: 2024-04-28T13:01:19.513 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-28T13:01:19.514 DEBUG:teuthology.orchestra.run.smithi114:> /usr/sbin/getenforce 2024-04-28T13:01:19.556 INFO:teuthology.orchestra.run.smithi114.stdout:Permissive 2024-04-28T13:01:19.556 DEBUG:teuthology.orchestra.run.smithi134:> /usr/sbin/getenforce 2024-04-28T13:01:19.580 INFO:teuthology.orchestra.run.smithi134.stdout:Permissive 2024-04-28T13:01:19.580 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi114.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi134.front.sepia.ceph.com': 'permissive'} 2024-04-28T13:01:19.580 DEBUG:teuthology.orchestra.run.smithi114:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-28T13:01:19.621 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-28T13:01:19.622 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-28T13:01:19.646 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-28T13:01:19.647 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-28T13:01:19.647 DEBUG:teuthology.orchestra.run.smithi114:> sudo /usr/sbin/setenforce permissive 2024-04-28T13:01:19.687 DEBUG:teuthology.orchestra.run.smithi134:> sudo /usr/sbin/setenforce permissive 2024-04-28T13:01:19.711 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-28T13:01:19.720 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-28T13:01:19.736 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-28T13:01:19.737 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi114.front.sepia.ceph.com,smithi134.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-28T13:04:44.487 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi114.front.sepia.ceph.com'), Remote(name='ubuntu@smithi134.front.sepia.ceph.com')] 2024-04-28T13:04:44.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-04-28T13:04:44.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-28T13:04:44.569 DEBUG:teuthology.orchestra.run.smithi114:> true 2024-04-28T13:04:44.645 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-04-28T13:04:44.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-28T13:04:44.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-28T13:04:44.722 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-04-28T13:04:44.797 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-28T13:04:44.797 INFO:teuthology.run_tasks:Running task clock... 2024-04-28T13:04:44.808 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-28T13:04:44.809 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-28T13:04:44.809 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-28T13:04:44.812 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-28T13:04:44.812 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-28T13:04:44.836 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-28T13:04:44.849 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-28T13:04:44.865 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-28T13:04:44.871 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: ntpd: command not found 2024-04-28T13:04:44.878 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-28T13:04:44.882 INFO:teuthology.orchestra.run.smithi114.stdout:506 Cannot talk to daemon 2024-04-28T13:04:44.895 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-28T13:04:44.901 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: ntpd: command not found 2024-04-28T13:04:44.908 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-28T13:04:44.912 INFO:teuthology.orchestra.run.smithi134.stdout:506 Cannot talk to daemon 2024-04-28T13:04:44.925 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-28T13:04:44.938 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-28T13:04:44.965 INFO:teuthology.orchestra.run.smithi114.stderr:bash: line 1: ntpq: command not found 2024-04-28T13:04:44.970 INFO:teuthology.orchestra.run.smithi114.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-28T13:04:44.970 INFO:teuthology.orchestra.run.smithi114.stdout:=============================================================================== 2024-04-28T13:04:44.970 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-28T13:04:44.970 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-28T13:04:44.970 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-28T13:04:44.970 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-28T13:04:44.999 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-04-28T13:04:45.004 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-28T13:04:45.004 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-04-28T13:04:45.004 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-28T13:04:45.004 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-28T13:04:45.004 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-28T13:04:45.004 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-28T13:04:45.004 INFO:teuthology.run_tasks:Running task install... 2024-04-28T13:04:45.014 DEBUG:teuthology.task.install:project ceph 2024-04-28T13:04:45.014 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}} 2024-04-28T13:04:45.014 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'} 2024-04-28T13:04:45.014 INFO:teuthology.task.install:Using flavor: default 2024-04-28T13:04:45.020 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-28T13:04:45.020 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-28T13:04:45.020 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'tag': None, 'wait_for_package': False} 2024-04-28T13:04:45.021 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-28T13:04:45.023 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'tag': None, 'wait_for_package': False} 2024-04-28T13:04:45.023 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-28T13:04:45.174 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/ 2024-04-28T13:04:45.174 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3306.gbc612ffb 2024-04-28T13:04:45.241 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/ 2024-04-28T13:04:45.241 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3306.gbc612ffb 2024-04-28T13:04:45.287 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-28T13:04:45.287 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:04:45.288 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-28T13:04:45.312 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-28T13:04:45.313 DEBUG:teuthology.orchestra.run.smithi134:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bc612ffb9c1d5bc27536bc917a705262a36d4387/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-28T13:04:45.362 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-28T13:04:45.362 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:04:45.362 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-28T13:04:45.377 DEBUG:teuthology.orchestra.run.smithi134:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-28T13:04:45.386 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-28T13:04:45.387 DEBUG:teuthology.orchestra.run.smithi114:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bc612ffb9c1d5bc27536bc917a705262a36d4387/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-28T13:04:45.449 DEBUG:teuthology.orchestra.run.smithi134:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-28T13:04:45.451 DEBUG:teuthology.orchestra.run.smithi114:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-28T13:04:45.512 INFO:teuthology.orchestra.run.smithi134.stdout:check_obsoletes = 1 2024-04-28T13:04:45.514 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum clean all 2024-04-28T13:04:45.525 DEBUG:teuthology.orchestra.run.smithi114:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-28T13:04:45.588 INFO:teuthology.orchestra.run.smithi114.stdout:check_obsoletes = 1 2024-04-28T13:04:45.589 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum clean all 2024-04-28T13:04:45.739 INFO:teuthology.orchestra.run.smithi134.stdout:48 files removed 2024-04-28T13:04:45.766 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-28T13:04:45.812 INFO:teuthology.orchestra.run.smithi114.stdout:48 files removed 2024-04-28T13:04:45.839 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-28T13:04:46.380 INFO:teuthology.orchestra.run.smithi134.stdout:ceph packages for x86_64 235 kB/s | 84 kB 00:00 2024-04-28T13:04:46.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph packages for x86_64 200 kB/s | 84 kB 00:00 2024-04-28T13:04:46.797 INFO:teuthology.orchestra.run.smithi134.stdout:ceph noarch packages 31 kB/s | 12 kB 00:00 2024-04-28T13:04:46.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph noarch packages 31 kB/s | 12 kB 00:00 2024-04-28T13:04:47.231 INFO:teuthology.orchestra.run.smithi134.stdout:ceph source packages 4.7 kB/s | 1.9 kB 00:00 2024-04-28T13:04:47.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph source packages 6.7 kB/s | 1.9 kB 00:00 2024-04-28T13:04:47.772 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.0 MB 00:00 2024-04-28T13:04:47.772 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.0 MB 00:00 2024-04-28T13:04:49.656 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-04-28T13:04:49.665 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-04-28T13:04:54.365 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - CRB 5.3 MB/s | 6.2 MB 00:01 2024-04-28T13:04:55.908 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 16 kB 00:00 2024-04-28T13:04:56.908 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 1.7 MB/s | 6.2 MB 00:03 2024-04-28T13:04:57.268 INFO:teuthology.orchestra.run.smithi114.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-04-28T13:04:58.367 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 49 kB/s | 16 kB 00:00 2024-04-28T13:05:01.660 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 6.6 MB/s | 21 MB 00:03 2024-04-28T13:05:02.192 INFO:teuthology.orchestra.run.smithi114.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-04-28T13:05:04.278 INFO:teuthology.orchestra.run.smithi114.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-28T13:05:04.278 INFO:teuthology.orchestra.run.smithi114.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-28T13:05:04.289 INFO:teuthology.orchestra.run.smithi114.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-28T13:05:04.290 INFO:teuthology.orchestra.run.smithi114.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-28T13:05:04.291 INFO:teuthology.orchestra.run.smithi114.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-28T13:05:04.292 INFO:teuthology.orchestra.run.smithi114.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-28T13:05:04.293 INFO:teuthology.orchestra.run.smithi114.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-28T13:05:04.296 INFO:teuthology.orchestra.run.smithi114.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-28T13:05:04.296 INFO:teuthology.orchestra.run.smithi114.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-28T13:05:04.357 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-04-28T13:05:04.365 INFO:teuthology.orchestra.run.smithi114.stdout:======================================================================================= 2024-04-28T13:05:04.366 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository Size 2024-04-28T13:05:04.366 INFO:teuthology.orchestra.run.smithi114.stdout:======================================================================================= 2024-04-28T13:05:04.366 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-04-28T13:05:04.366 INFO:teuthology.orchestra.run.smithi114.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-28T13:05:04.366 INFO:teuthology.orchestra.run.smithi114.stdout: ceph x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 6.6 k 2024-04-28T13:05:04.366 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-base x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-28T13:05:04.366 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 889 k 2024-04-28T13:05:04.366 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 145 k 2024-04-28T13:05:04.366 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 1.5 M 2024-04-28T13:05:04.366 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 142 k 2024-04-28T13:05:04.366 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 3.5 M 2024-04-28T13:05:04.367 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 7.4 M 2024-04-28T13:05:04.367 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-rook noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 49 k 2024-04-28T13:05:04.367 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-radosgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 11 M 2024-04-28T13:05:04.367 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-test x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 49 M 2024-04-28T13:05:04.367 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-volume noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 273 k 2024-04-28T13:05:04.367 INFO:teuthology.orchestra.run.smithi114.stdout: cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 762 k 2024-04-28T13:05:04.367 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 225 k 2024-04-28T13:05:04.367 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-shell x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 27 k 2024-04-28T13:05:04.367 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-top noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 18 k 2024-04-28T13:05:04.367 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-28T13:05:04.367 INFO:teuthology.orchestra.run.smithi114.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-28T13:05:04.367 INFO:teuthology.orchestra.run.smithi114.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-28T13:05:04.367 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 32 k 2024-04-28T13:05:04.368 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 747 k 2024-04-28T13:05:04.368 INFO:teuthology.orchestra.run.smithi114.stdout: librados-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 127 k 2024-04-28T13:05:04.368 INFO:teuthology.orchestra.run.smithi114.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-28T13:05:04.368 INFO:teuthology.orchestra.run.smithi114.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-28T13:05:04.368 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-28T13:05:04.368 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-28T13:05:04.368 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-28T13:05:04.368 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-28T13:05:04.368 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cephfs x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 161 k 2024-04-28T13:05:04.368 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rados x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 321 k 2024-04-28T13:05:04.368 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 298 k 2024-04-28T13:05:04.369 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 99 k 2024-04-28T13:05:04.369 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 85 k 2024-04-28T13:05:04.369 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-28T13:05:04.369 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-nbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 171 k 2024-04-28T13:05:04.369 INFO:teuthology.orchestra.run.smithi114.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-28T13:05:04.369 INFO:teuthology.orchestra.run.smithi114.stdout:Upgrading: 2024-04-28T13:05:04.369 INFO:teuthology.orchestra.run.smithi114.stdout: librados2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.4 M 2024-04-28T13:05:04.369 INFO:teuthology.orchestra.run.smithi114.stdout: librbd1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-28T13:05:04.369 INFO:teuthology.orchestra.run.smithi114.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-28T13:05:04.369 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-28T13:05:04.369 INFO:teuthology.orchestra.run.smithi114.stdout:Installing dependencies: 2024-04-28T13:05:04.369 INFO:teuthology.orchestra.run.smithi114.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-28T13:05:04.369 INFO:teuthology.orchestra.run.smithi114.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-28T13:05:04.370 INFO:teuthology.orchestra.run.smithi114.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-28T13:05:04.370 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 21 M 2024-04-28T13:05:04.370 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 34 k 2024-04-28T13:05:04.370 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mds x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 2.4 M 2024-04-28T13:05:04.370 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 249 k 2024-04-28T13:05:04.370 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mon x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 4.7 M 2024-04-28T13:05:04.370 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-osd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 17 M 2024-04-28T13:05:04.370 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 16 k 2024-04-28T13:05:04.370 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-selinux x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 25 k 2024-04-28T13:05:04.370 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-28T13:05:04.370 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-28T13:05:04.370 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-28T13:05:04.370 INFO:teuthology.orchestra.run.smithi114.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-28T13:05:04.371 INFO:teuthology.orchestra.run.smithi114.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-28T13:05:04.371 INFO:teuthology.orchestra.run.smithi114.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-28T13:05:04.371 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-28T13:05:04.371 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-28T13:05:04.371 INFO:teuthology.orchestra.run.smithi114.stdout: libcephsqlite x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 163 k 2024-04-28T13:05:04.371 INFO:teuthology.orchestra.run.smithi114.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-28T13:05:04.371 INFO:teuthology.orchestra.run.smithi114.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-28T13:05:04.371 INFO:teuthology.orchestra.run.smithi114.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-28T13:05:04.371 INFO:teuthology.orchestra.run.smithi114.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-28T13:05:04.371 INFO:teuthology.orchestra.run.smithi114.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-28T13:05:04.371 INFO:teuthology.orchestra.run.smithi114.stdout: libradosstriper1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 501 k 2024-04-28T13:05:04.371 INFO:teuthology.orchestra.run.smithi114.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-28T13:05:04.372 INFO:teuthology.orchestra.run.smithi114.stdout: librgw2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-28T13:05:04.372 INFO:teuthology.orchestra.run.smithi114.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-28T13:05:04.372 INFO:teuthology.orchestra.run.smithi114.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-28T13:05:04.372 INFO:teuthology.orchestra.run.smithi114.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-28T13:05:04.372 INFO:teuthology.orchestra.run.smithi114.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-28T13:05:04.372 INFO:teuthology.orchestra.run.smithi114.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-28T13:05:04.372 INFO:teuthology.orchestra.run.smithi114.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-28T13:05:04.372 INFO:teuthology.orchestra.run.smithi114.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-28T13:05:04.372 INFO:teuthology.orchestra.run.smithi114.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-28T13:05:04.372 INFO:teuthology.orchestra.run.smithi114.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-28T13:05:04.372 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-28T13:05:04.372 INFO:teuthology.orchestra.run.smithi114.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-28T13:05:04.372 INFO:teuthology.orchestra.run.smithi114.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-28T13:05:04.372 INFO:teuthology.orchestra.run.smithi114.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-28T13:05:04.373 INFO:teuthology.orchestra.run.smithi114.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-28T13:05:04.373 INFO:teuthology.orchestra.run.smithi114.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-28T13:05:04.373 INFO:teuthology.orchestra.run.smithi114.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-28T13:05:04.373 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-28T13:05:04.373 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-argparse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 45 k 2024-04-28T13:05:04.373 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 135 k 2024-04-28T13:05:04.373 INFO:teuthology.orchestra.run.smithi114.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-28T13:05:04.373 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-28T13:05:04.373 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-28T13:05:04.373 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-28T13:05:04.373 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-28T13:05:04.373 INFO:teuthology.orchestra.run.smithi114.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-28T13:05:04.373 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-28T13:05:04.374 INFO:teuthology.orchestra.run.smithi114.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-28T13:05:04.374 INFO:teuthology.orchestra.run.smithi114.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-28T13:05:04.374 INFO:teuthology.orchestra.run.smithi114.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-28T13:05:04.374 INFO:teuthology.orchestra.run.smithi114.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-28T13:05:04.374 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-28T13:05:04.374 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-28T13:05:04.374 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-28T13:05:04.374 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-28T13:05:04.374 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-28T13:05:04.374 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-28T13:05:04.374 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-28T13:05:04.374 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-28T13:05:04.374 INFO:teuthology.orchestra.run.smithi114.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-28T13:05:04.375 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-28T13:05:04.375 INFO:teuthology.orchestra.run.smithi114.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-28T13:05:04.375 INFO:teuthology.orchestra.run.smithi114.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-28T13:05:04.375 INFO:teuthology.orchestra.run.smithi114.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-28T13:05:04.375 INFO:teuthology.orchestra.run.smithi114.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-28T13:05:04.375 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-28T13:05:04.375 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-28T13:05:04.375 INFO:teuthology.orchestra.run.smithi114.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-28T13:05:04.375 INFO:teuthology.orchestra.run.smithi114.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-28T13:05:04.375 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-28T13:05:04.375 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-28T13:05:04.375 INFO:teuthology.orchestra.run.smithi114.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-28T13:05:04.375 INFO:teuthology.orchestra.run.smithi114.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-28T13:05:04.375 INFO:teuthology.orchestra.run.smithi114.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-28T13:05:04.376 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-28T13:05:04.376 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-28T13:05:04.376 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-28T13:05:04.376 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-28T13:05:04.376 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-28T13:05:04.376 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-28T13:05:04.376 INFO:teuthology.orchestra.run.smithi114.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-28T13:05:04.376 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-28T13:05:04.376 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-28T13:05:04.376 INFO:teuthology.orchestra.run.smithi114.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-28T13:05:04.376 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-28T13:05:04.376 INFO:teuthology.orchestra.run.smithi114.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-28T13:05:04.376 INFO:teuthology.orchestra.run.smithi114.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-28T13:05:04.376 INFO:teuthology.orchestra.run.smithi114.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-28T13:05:04.377 INFO:teuthology.orchestra.run.smithi114.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-28T13:05:04.377 INFO:teuthology.orchestra.run.smithi114.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-28T13:05:04.377 INFO:teuthology.orchestra.run.smithi114.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-28T13:05:04.377 INFO:teuthology.orchestra.run.smithi114.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-28T13:05:04.377 INFO:teuthology.orchestra.run.smithi114.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-28T13:05:04.377 INFO:teuthology.orchestra.run.smithi114.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-28T13:05:04.377 INFO:teuthology.orchestra.run.smithi114.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-28T13:05:04.377 INFO:teuthology.orchestra.run.smithi114.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-28T13:05:04.377 INFO:teuthology.orchestra.run.smithi114.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-28T13:05:04.377 INFO:teuthology.orchestra.run.smithi114.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-28T13:05:04.377 INFO:teuthology.orchestra.run.smithi114.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-28T13:05:04.377 INFO:teuthology.orchestra.run.smithi114.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-28T13:05:04.377 INFO:teuthology.orchestra.run.smithi114.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-28T13:05:04.377 INFO:teuthology.orchestra.run.smithi114.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-28T13:05:04.378 INFO:teuthology.orchestra.run.smithi114.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-28T13:05:04.378 INFO:teuthology.orchestra.run.smithi114.stdout:Installing weak dependencies: 2024-04-28T13:05:04.378 INFO:teuthology.orchestra.run.smithi114.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-28T13:05:04.378 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:05:04.378 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-04-28T13:05:04.378 INFO:teuthology.orchestra.run.smithi114.stdout:======================================================================================= 2024-04-28T13:05:04.378 INFO:teuthology.orchestra.run.smithi114.stdout:Install 148 Packages 2024-04-28T13:05:04.378 INFO:teuthology.orchestra.run.smithi114.stdout:Upgrade 4 Packages 2024-04-28T13:05:04.378 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:05:04.379 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 222 M 2024-04-28T13:05:04.379 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-04-28T13:05:04.810 INFO:teuthology.orchestra.run.smithi114.stdout:(1/152): ceph-19.0.0-3306.gbc612ffb.el9.x86_64. 33 kB/s | 6.6 kB 00:00 2024-04-28T13:05:05.136 INFO:teuthology.orchestra.run.smithi114.stdout:(2/152): ceph-fuse-19.0.0-3306.gbc612ffb.el9.x8 2.7 MB/s | 889 kB 00:00 2024-04-28T13:05:05.219 INFO:teuthology.orchestra.run.smithi114.stdout:(3/152): ceph-immutable-object-cache-19.0.0-330 1.7 MB/s | 145 kB 00:00 2024-04-28T13:05:05.694 INFO:teuthology.orchestra.run.smithi114.stdout:(4/152): ceph-mds-19.0.0-3306.gbc612ffb.el9.x86 5.0 MB/s | 2.4 MB 00:00 2024-04-28T13:05:05.770 INFO:teuthology.orchestra.run.smithi114.stdout:(5/152): ceph-base-19.0.0-3306.gbc612ffb.el9.x8 4.6 MB/s | 5.4 MB 00:01 2024-04-28T13:05:06.011 INFO:teuthology.orchestra.run.smithi114.stdout:(6/152): ceph-mgr-19.0.0-3306.gbc612ffb.el9.x86 4.8 MB/s | 1.5 MB 00:00 2024-04-28T13:05:06.262 INFO:teuthology.orchestra.run.smithi114.stdout:(7/152): ceph-common-19.0.0-3306.gbc612ffb.el9. 13 MB/s | 21 MB 00:01 2024-04-28T13:05:06.421 INFO:teuthology.orchestra.run.smithi114.stdout:(8/152): ceph-mon-19.0.0-3306.gbc612ffb.el9.x86 7.2 MB/s | 4.7 MB 00:00 2024-04-28T13:05:06.504 INFO:teuthology.orchestra.run.smithi114.stdout:(9/152): ceph-selinux-19.0.0-3306.gbc612ffb.el9 303 kB/s | 25 kB 00:00 2024-04-28T13:05:06.767 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-04-28T13:05:07.421 INFO:teuthology.orchestra.run.smithi114.stdout:(10/152): ceph-radosgw-19.0.0-3306.gbc612ffb.el 9.1 MB/s | 11 MB 00:01 2024-04-28T13:05:07.513 INFO:teuthology.orchestra.run.smithi114.stdout:(11/152): cephfs-mirror-19.0.0-3306.gbc612ffb.e 2.4 MB/s | 225 kB 00:00 2024-04-28T13:05:07.597 INFO:teuthology.orchestra.run.smithi114.stdout:(12/152): cephfs-shell-19.0.0-3306.gbc612ffb.el 325 kB/s | 27 kB 00:00 2024-04-28T13:05:07.683 INFO:teuthology.orchestra.run.smithi114.stdout:(13/152): libcephfs-devel-19.0.0-3306.gbc612ffb 382 kB/s | 32 kB 00:00 2024-04-28T13:05:07.989 INFO:teuthology.orchestra.run.smithi114.stdout:(14/152): ceph-osd-19.0.0-3306.gbc612ffb.el9.x8 8.5 MB/s | 17 MB 00:01 2024-04-28T13:05:08.022 INFO:teuthology.orchestra.run.smithi114.stdout:(15/152): libcephfs2-19.0.0-3306.gbc612ffb.el9. 2.1 MB/s | 747 kB 00:00 2024-04-28T13:05:08.056 INFO:teuthology.orchestra.run.smithi114.stdout:(16/152): libcephsqlite-19.0.0-3306.gbc612ffb.e 2.4 MB/s | 163 kB 00:00 2024-04-28T13:05:08.081 INFO:teuthology.orchestra.run.smithi114.stdout:(17/152): librados-devel-19.0.0-3306.gbc612ffb. 2.1 MB/s | 127 kB 00:00 2024-04-28T13:05:08.131 INFO:teuthology.orchestra.run.smithi114.stdout:(18/152): libradosstriper1-19.0.0-3306.gbc612ff 6.5 MB/s | 501 kB 00:00 2024-04-28T13:05:08.248 INFO:teuthology.orchestra.run.smithi114.stdout:(19/152): python3-ceph-argparse-19.0.0-3306.gbc 387 kB/s | 45 kB 00:00 2024-04-28T13:05:08.357 INFO:teuthology.orchestra.run.smithi114.stdout:(20/152): python3-ceph-common-19.0.0-3306.gbc61 1.2 MB/s | 135 kB 00:00 2024-04-28T13:05:08.457 INFO:teuthology.orchestra.run.smithi114.stdout:(21/152): python3-cephfs-19.0.0-3306.gbc612ffb. 1.6 MB/s | 161 kB 00:00 2024-04-28T13:05:08.557 INFO:teuthology.orchestra.run.smithi114.stdout:(22/152): python3-rados-19.0.0-3306.gbc612ffb.e 3.1 MB/s | 321 kB 00:00 2024-04-28T13:05:08.658 INFO:teuthology.orchestra.run.smithi114.stdout:(23/152): python3-rbd-19.0.0-3306.gbc612ffb.el9 2.9 MB/s | 298 kB 00:00 2024-04-28T13:05:08.750 INFO:teuthology.orchestra.run.smithi114.stdout:(24/152): python3-rgw-19.0.0-3306.gbc612ffb.el9 1.1 MB/s | 99 kB 00:00 2024-04-28T13:05:08.834 INFO:teuthology.orchestra.run.smithi114.stdout:(25/152): rbd-fuse-19.0.0-3306.gbc612ffb.el9.x8 1.0 MB/s | 85 kB 00:00 2024-04-28T13:05:08.859 INFO:teuthology.orchestra.run.smithi134.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-28T13:05:08.859 INFO:teuthology.orchestra.run.smithi134.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-28T13:05:08.870 INFO:teuthology.orchestra.run.smithi134.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-28T13:05:08.871 INFO:teuthology.orchestra.run.smithi134.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-28T13:05:08.871 INFO:teuthology.orchestra.run.smithi134.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-28T13:05:08.872 INFO:teuthology.orchestra.run.smithi134.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-28T13:05:08.874 INFO:teuthology.orchestra.run.smithi134.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-28T13:05:08.876 INFO:teuthology.orchestra.run.smithi134.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-28T13:05:08.877 INFO:teuthology.orchestra.run.smithi134.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-28T13:05:08.936 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-28T13:05:08.945 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-04-28T13:05:08.945 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-04-28T13:05:08.945 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-04-28T13:05:08.945 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-28T13:05:08.945 INFO:teuthology.orchestra.run.smithi134.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-28T13:05:08.945 INFO:teuthology.orchestra.run.smithi134.stdout: ceph x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 6.6 k 2024-04-28T13:05:08.946 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-28T13:05:08.946 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 889 k 2024-04-28T13:05:08.946 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 145 k 2024-04-28T13:05:08.946 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 1.5 M 2024-04-28T13:05:08.946 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 142 k 2024-04-28T13:05:08.946 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 3.5 M 2024-04-28T13:05:08.946 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 7.4 M 2024-04-28T13:05:08.946 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 49 k 2024-04-28T13:05:08.946 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 11 M 2024-04-28T13:05:08.946 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 49 M 2024-04-28T13:05:08.946 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 273 k 2024-04-28T13:05:08.946 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 762 k 2024-04-28T13:05:08.946 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 225 k 2024-04-28T13:05:08.947 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-shell x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 27 k 2024-04-28T13:05:08.947 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-top noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 18 k 2024-04-28T13:05:08.947 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-28T13:05:08.947 INFO:teuthology.orchestra.run.smithi134.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-28T13:05:08.947 INFO:teuthology.orchestra.run.smithi134.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-28T13:05:08.947 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 32 k 2024-04-28T13:05:08.947 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 747 k 2024-04-28T13:05:08.947 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 127 k 2024-04-28T13:05:08.947 INFO:teuthology.orchestra.run.smithi134.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-28T13:05:08.947 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-28T13:05:08.947 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-28T13:05:08.947 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-28T13:05:08.947 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-28T13:05:08.947 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-28T13:05:08.948 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 161 k 2024-04-28T13:05:08.948 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 321 k 2024-04-28T13:05:08.948 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 298 k 2024-04-28T13:05:08.948 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 99 k 2024-04-28T13:05:08.948 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 85 k 2024-04-28T13:05:08.948 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-28T13:05:08.948 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 171 k 2024-04-28T13:05:08.948 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-28T13:05:08.948 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrading: 2024-04-28T13:05:08.948 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.4 M 2024-04-28T13:05:08.948 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-28T13:05:08.948 INFO:teuthology.orchestra.run.smithi134.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-28T13:05:08.948 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-28T13:05:08.948 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-04-28T13:05:08.948 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-28T13:05:08.948 INFO:teuthology.orchestra.run.smithi134.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-28T13:05:08.949 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-28T13:05:08.949 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 21 M 2024-04-28T13:05:08.949 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 34 k 2024-04-28T13:05:08.949 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 2.4 M 2024-04-28T13:05:08.949 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 249 k 2024-04-28T13:05:08.949 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 4.7 M 2024-04-28T13:05:08.949 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 17 M 2024-04-28T13:05:08.949 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 16 k 2024-04-28T13:05:08.949 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 25 k 2024-04-28T13:05:08.949 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-28T13:05:08.949 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-28T13:05:08.949 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-28T13:05:08.950 INFO:teuthology.orchestra.run.smithi134.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-28T13:05:08.950 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-28T13:05:08.950 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-28T13:05:08.950 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-28T13:05:08.950 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-28T13:05:08.950 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 163 k 2024-04-28T13:05:08.950 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-28T13:05:08.950 INFO:teuthology.orchestra.run.smithi134.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-28T13:05:08.950 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-28T13:05:08.950 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-28T13:05:08.950 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-28T13:05:08.950 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 501 k 2024-04-28T13:05:08.950 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-28T13:05:08.950 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-28T13:05:08.951 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-28T13:05:08.951 INFO:teuthology.orchestra.run.smithi134.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-28T13:05:08.951 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-28T13:05:08.951 INFO:teuthology.orchestra.run.smithi134.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-28T13:05:08.951 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-28T13:05:08.951 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-28T13:05:08.951 INFO:teuthology.orchestra.run.smithi134.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-28T13:05:08.951 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-28T13:05:08.951 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-28T13:05:08.951 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-28T13:05:08.951 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-28T13:05:08.951 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-28T13:05:08.952 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-28T13:05:08.952 INFO:teuthology.orchestra.run.smithi134.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-28T13:05:08.952 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-28T13:05:08.952 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-28T13:05:08.952 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-28T13:05:08.952 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 45 k 2024-04-28T13:05:08.952 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 135 k 2024-04-28T13:05:08.952 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-28T13:05:08.952 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-28T13:05:08.952 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-28T13:05:08.952 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-28T13:05:08.952 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-28T13:05:08.953 INFO:teuthology.orchestra.run.smithi134.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-28T13:05:08.953 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-28T13:05:08.953 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-28T13:05:08.953 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-28T13:05:08.953 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-28T13:05:08.953 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-28T13:05:08.953 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-28T13:05:08.953 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-28T13:05:08.953 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-28T13:05:08.953 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-28T13:05:08.953 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-28T13:05:08.953 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-28T13:05:08.953 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-28T13:05:08.953 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-28T13:05:08.953 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-28T13:05:08.954 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-28T13:05:08.954 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-28T13:05:08.954 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-28T13:05:08.954 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-28T13:05:08.954 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-28T13:05:08.954 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-28T13:05:08.954 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-28T13:05:08.954 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-28T13:05:08.954 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-28T13:05:08.954 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-28T13:05:08.954 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-28T13:05:08.954 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-28T13:05:08.954 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-28T13:05:08.955 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-28T13:05:08.955 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-28T13:05:08.955 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-28T13:05:08.955 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-28T13:05:08.955 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-28T13:05:08.955 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-28T13:05:08.955 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-28T13:05:08.955 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-28T13:05:08.955 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-28T13:05:08.955 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-28T13:05:08.955 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-28T13:05:08.955 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-28T13:05:08.955 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-28T13:05:08.955 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-28T13:05:08.955 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-28T13:05:08.955 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-28T13:05:08.956 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-28T13:05:08.956 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-28T13:05:08.956 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-28T13:05:08.956 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-28T13:05:08.956 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-28T13:05:08.956 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-28T13:05:08.956 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-28T13:05:08.956 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-28T13:05:08.956 INFO:teuthology.orchestra.run.smithi134.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-28T13:05:08.956 INFO:teuthology.orchestra.run.smithi134.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-28T13:05:08.956 INFO:teuthology.orchestra.run.smithi134.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-28T13:05:08.956 INFO:teuthology.orchestra.run.smithi134.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-28T13:05:08.956 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-28T13:05:08.956 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-28T13:05:08.956 INFO:teuthology.orchestra.run.smithi134.stdout:Installing weak dependencies: 2024-04-28T13:05:08.956 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-28T13:05:08.957 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:05:08.957 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-28T13:05:08.957 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-04-28T13:05:08.957 INFO:teuthology.orchestra.run.smithi134.stdout:Install 148 Packages 2024-04-28T13:05:08.957 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrade 4 Packages 2024-04-28T13:05:08.957 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:05:08.957 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 222 M 2024-04-28T13:05:08.957 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-28T13:05:08.959 INFO:teuthology.orchestra.run.smithi114.stdout:(26/152): librgw2-19.0.0-3306.gbc612ffb.el9.x86 6.1 MB/s | 5.4 MB 00:00 2024-04-28T13:05:09.051 INFO:teuthology.orchestra.run.smithi114.stdout:(27/152): rbd-nbd-19.0.0-3306.gbc612ffb.el9.x86 1.8 MB/s | 171 kB 00:00 2024-04-28T13:05:09.143 INFO:teuthology.orchestra.run.smithi114.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3306.g 374 kB/s | 34 kB 00:00 2024-04-28T13:05:09.227 INFO:teuthology.orchestra.run.smithi114.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3306.gbc612ff 1.7 MB/s | 142 kB 00:00 2024-04-28T13:05:09.277 INFO:teuthology.orchestra.run.smithi114.stdout:(30/152): rbd-mirror-19.0.0-3306.gbc612ffb.el9. 7.0 MB/s | 3.1 MB 00:00 2024-04-28T13:05:09.685 INFO:teuthology.orchestra.run.smithi134.stdout:(1/152): ceph-19.0.0-3306.gbc612ffb.el9.x86_64. 36 kB/s | 6.6 kB 00:00 2024-04-28T13:05:09.869 INFO:teuthology.orchestra.run.smithi134.stdout:(2/152): ceph-fuse-19.0.0-3306.gbc612ffb.el9.x8 4.7 MB/s | 889 kB 00:00 2024-04-28T13:05:09.894 INFO:teuthology.orchestra.run.smithi114.stdout:(31/152): ceph-test-19.0.0-3306.gbc612ffb.el9.x 14 MB/s | 49 MB 00:03 2024-04-28T13:05:09.919 INFO:teuthology.orchestra.run.smithi134.stdout:(3/152): ceph-immutable-object-cache-19.0.0-330 2.8 MB/s | 145 kB 00:00 2024-04-28T13:05:09.978 INFO:teuthology.orchestra.run.smithi114.stdout:(32/152): ceph-mgr-dashboard-19.0.0-3306.gbc612 4.7 MB/s | 3.5 MB 00:00 2024-04-28T13:05:10.003 INFO:teuthology.orchestra.run.smithi114.stdout:(33/152): ceph-mgr-modules-core-19.0.0-3306.gbc 2.2 MB/s | 249 kB 00:00 2024-04-28T13:05:10.045 INFO:teuthology.orchestra.run.smithi114.stdout:(34/152): ceph-mgr-rook-19.0.0-3306.gbc612ffb.e 741 kB/s | 49 kB 00:00 2024-04-28T13:05:10.087 INFO:teuthology.orchestra.run.smithi114.stdout:(35/152): ceph-prometheus-alerts-19.0.0-3306.gb 197 kB/s | 16 kB 00:00 2024-04-28T13:05:10.120 INFO:teuthology.orchestra.run.smithi114.stdout:(36/152): ceph-volume-19.0.0-3306.gbc612ffb.el9 3.5 MB/s | 273 kB 00:00 2024-04-28T13:05:10.212 INFO:teuthology.orchestra.run.smithi114.stdout:(37/152): cephfs-top-19.0.0-3306.gbc612ffb.el9. 199 kB/s | 18 kB 00:00 2024-04-28T13:05:10.262 INFO:teuthology.orchestra.run.smithi114.stdout:(38/152): cephadm-19.0.0-3306.gbc612ffb.el9.noa 4.3 MB/s | 762 kB 00:00 2024-04-28T13:05:10.294 INFO:teuthology.orchestra.run.smithi134.stdout:(4/152): ceph-mds-19.0.0-3306.gbc612ffb.el9.x86 6.3 MB/s | 2.4 MB 00:00 2024-04-28T13:05:10.363 INFO:teuthology.orchestra.run.smithi114.stdout:(39/152): ceph-mgr-diskprediction-local-19.0.0- 6.8 MB/s | 7.4 MB 00:01 2024-04-28T13:05:10.413 INFO:teuthology.orchestra.run.smithi114.stdout:(40/152): fuse-2.9.9-15.el9.x86_64.rpm 401 kB/s | 80 kB 00:00 2024-04-28T13:05:10.461 INFO:teuthology.orchestra.run.smithi134.stdout:(5/152): ceph-mgr-19.0.0-3306.gbc612ffb.el9.x86 9.1 MB/s | 1.5 MB 00:00 2024-04-28T13:05:10.555 INFO:teuthology.orchestra.run.smithi114.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-04-28T13:05:10.580 INFO:teuthology.orchestra.run.smithi114.stdout:(42/152): libquadmath-11.4.1-3.el9.x86_64.rpm 902 kB/s | 195 kB 00:00 2024-04-28T13:05:10.622 INFO:teuthology.orchestra.run.smithi114.stdout:(43/152): libgfortran-11.4.1-3.el9.x86_64.rpm 2.2 MB/s | 803 kB 00:00 2024-04-28T13:05:10.647 INFO:teuthology.orchestra.run.smithi114.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-04-28T13:05:10.673 INFO:teuthology.orchestra.run.smithi114.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-04-28T13:05:10.706 INFO:teuthology.orchestra.run.smithi114.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-04-28T13:05:10.711 INFO:teuthology.orchestra.run.smithi134.stdout:(6/152): ceph-base-19.0.0-3306.gbc612ffb.el9.x8 4.4 MB/s | 5.4 MB 00:01 2024-04-28T13:05:10.731 INFO:teuthology.orchestra.run.smithi114.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-04-28T13:05:10.765 INFO:teuthology.orchestra.run.smithi114.stdout:(48/152): python3-cryptography-36.0.1-4.el9.x86 5.8 MB/s | 1.2 MB 00:00 2024-04-28T13:05:10.832 INFO:teuthology.orchestra.run.smithi114.stdout:(49/152): automake-1.16.2-8.el9.noarch.rpm 5.4 MB/s | 689 kB 00:00 2024-04-28T13:05:10.857 INFO:teuthology.orchestra.run.smithi114.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 107 kB 00:00 2024-04-28T13:05:10.891 INFO:teuthology.orchestra.run.smithi114.stdout:(51/152): bison-3.7.4-5.el9.x86_64.rpm 5.8 MB/s | 943 kB 00:00 2024-04-28T13:05:10.895 INFO:teuthology.orchestra.run.smithi134.stdout:(7/152): ceph-mon-19.0.0-3306.gbc612ffb.el9.x86 11 MB/s | 4.7 MB 00:00 2024-04-28T13:05:10.916 INFO:teuthology.orchestra.run.smithi114.stdout:(52/152): elfutils-libelf-devel-0.190-2.el9.x86 257 kB/s | 21 kB 00:00 2024-04-28T13:05:10.958 INFO:teuthology.orchestra.run.smithi114.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 490 kB/s | 33 kB 00:00 2024-04-28T13:05:10.983 INFO:teuthology.orchestra.run.smithi114.stdout:(54/152): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-04-28T13:05:11.025 INFO:teuthology.orchestra.run.smithi114.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 273 kB/s | 18 kB 00:00 2024-04-28T13:05:11.051 INFO:teuthology.orchestra.run.smithi114.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 166 kB/s | 11 kB 00:00 2024-04-28T13:05:11.109 INFO:teuthology.orchestra.run.smithi114.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 776 kB/s | 45 kB 00:00 2024-04-28T13:05:11.134 INFO:teuthology.orchestra.run.smithi114.stdout:(58/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-04-28T13:05:11.185 INFO:teuthology.orchestra.run.smithi114.stdout:(59/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-04-28T13:05:11.244 INFO:teuthology.orchestra.run.smithi114.stdout:(60/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 438 kB/s | 25 kB 00:00 2024-04-28T13:05:11.268 INFO:teuthology.orchestra.run.smithi114.stdout:(61/152): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-04-28T13:05:11.294 INFO:teuthology.orchestra.run.smithi114.stdout:(62/152): libtool-2.4.6-45.el9.x86_64.rpm 3.6 MB/s | 582 kB 00:00 2024-04-28T13:05:11.311 INFO:teuthology.orchestra.run.smithi114.stdout:(63/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 709 kB/s | 47 kB 00:00 2024-04-28T13:05:11.353 INFO:teuthology.orchestra.run.smithi114.stdout:(64/152): openblas-0.3.21-2.el9.x86_64.rpm 847 kB/s | 35 kB 00:00 2024-04-28T13:05:11.378 INFO:teuthology.orchestra.run.smithi114.stdout:(65/152): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-04-28T13:05:11.403 INFO:teuthology.orchestra.run.smithi114.stdout:(66/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-04-28T13:05:11.587 INFO:teuthology.orchestra.run.smithi114.stdout:(67/152): openblas-openmp-0.3.21-2.el9.x86_64.r 20 MB/s | 4.7 MB 00:00 2024-04-28T13:05:11.629 INFO:teuthology.orchestra.run.smithi114.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 7.1 MB/s | 1.6 MB 00:00 2024-04-28T13:05:11.754 INFO:teuthology.orchestra.run.smithi114.stdout:(69/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-04-28T13:05:11.779 INFO:teuthology.orchestra.run.smithi114.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 887 kB/s | 133 kB 00:00 2024-04-28T13:05:11.830 INFO:teuthology.orchestra.run.smithi114.stdout:(71/152): postgresql-contrib-13.14-1.el9.x86_64 3.7 MB/s | 911 kB 00:00 2024-04-28T13:05:11.921 INFO:teuthology.orchestra.run.smithi114.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 7.1 MB/s | 1.0 MB 00:00 2024-04-28T13:05:11.947 INFO:teuthology.orchestra.run.smithi114.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 748 kB/s | 87 kB 00:00 2024-04-28T13:05:11.970 INFO:teuthology.orchestra.run.smithi134.stdout:(8/152): ceph-radosgw-19.0.0-3306.gbc612ffb.el9 9.9 MB/s | 11 MB 00:01 2024-04-28T13:05:12.030 INFO:teuthology.orchestra.run.smithi114.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 2.9 MB/s | 244 kB 00:00 2024-04-28T13:05:12.037 INFO:teuthology.orchestra.run.smithi134.stdout:(9/152): ceph-selinux-19.0.0-3306.gbc612ffb.el9 379 kB/s | 25 kB 00:00 2024-04-28T13:05:12.156 INFO:teuthology.orchestra.run.smithi114.stdout:(75/152): postgresql-server-13.14-1.el9.x86_64. 14 MB/s | 5.8 MB 00:00 2024-04-28T13:05:12.181 INFO:teuthology.orchestra.run.smithi114.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-04-28T13:05:12.223 INFO:teuthology.orchestra.run.smithi114.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 384 kB/s | 26 kB 00:00 2024-04-28T13:05:12.248 INFO:teuthology.orchestra.run.smithi114.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 286 kB/s | 19 kB 00:00 2024-04-28T13:05:12.323 INFO:teuthology.orchestra.run.smithi114.stdout:(79/152): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-04-28T13:05:12.365 INFO:teuthology.orchestra.run.smithi114.stdout:(80/152): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-04-28T13:05:12.408 INFO:teuthology.orchestra.run.smithi114.stdout:(81/152): python3-markupsafe-1.1.1-12.el9.x86_6 218 kB/s | 35 kB 00:00 2024-04-28T13:05:12.464 INFO:teuthology.orchestra.run.smithi134.stdout:(10/152): ceph-osd-19.0.0-3306.gbc612ffb.el9.x8 9.6 MB/s | 17 MB 00:01 2024-04-28T13:05:12.474 INFO:teuthology.orchestra.run.smithi114.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-04-28T13:05:12.499 INFO:teuthology.orchestra.run.smithi114.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-04-28T13:05:12.558 INFO:teuthology.orchestra.run.smithi114.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 923 kB/s | 77 kB 00:00 2024-04-28T13:05:12.584 INFO:teuthology.orchestra.run.smithi114.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 505 kB/s | 42 kB 00:00 2024-04-28T13:05:12.658 INFO:teuthology.orchestra.run.smithi114.stdout:(86/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 15 MB/s | 5.1 MB 00:00 2024-04-28T13:05:12.664 INFO:teuthology.orchestra.run.smithi134.stdout:(11/152): ceph-common-19.0.0-3306.gbc612ffb.el9 6.7 MB/s | 21 MB 00:03 2024-04-28T13:05:12.690 INFO:teuthology.orchestra.run.smithi134.stdout:(12/152): cephfs-mirror-19.0.0-3306.gbc612ffb.e 1.0 MB/s | 225 kB 00:00 2024-04-28T13:05:12.709 INFO:teuthology.orchestra.run.smithi114.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-04-28T13:05:12.723 INFO:teuthology.orchestra.run.smithi134.stdout:(13/152): cephfs-shell-19.0.0-3306.gbc612ffb.el 464 kB/s | 27 kB 00:00 2024-04-28T13:05:12.734 INFO:teuthology.orchestra.run.smithi114.stdout:(88/152): python3-protobuf-3.14.0-13.el9.noarch 1.5 MB/s | 269 kB 00:00 2024-04-28T13:05:12.757 INFO:teuthology.orchestra.run.smithi134.stdout:(14/152): libcephfs-devel-19.0.0-3306.gbc612ffb 473 kB/s | 32 kB 00:00 2024-04-28T13:05:12.785 INFO:teuthology.orchestra.run.smithi114.stdout:(89/152): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 279 kB 00:00 2024-04-28T13:05:12.810 INFO:teuthology.orchestra.run.smithi114.stdout:(90/152): python3-pytz-2021.1-5.el9.noarch.rpm 507 kB/s | 51 kB 00:00 2024-04-28T13:05:12.832 INFO:teuthology.orchestra.run.smithi134.stdout:(15/152): libcephsqlite-19.0.0-3306.gbc612ffb.e 2.1 MB/s | 163 kB 00:00 2024-04-28T13:05:12.835 INFO:teuthology.orchestra.run.smithi114.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 534 kB/s | 54 kB 00:00 2024-04-28T13:05:12.866 INFO:teuthology.orchestra.run.smithi134.stdout:(16/152): libcephfs2-19.0.0-3306.gbc612ffb.el9. 5.1 MB/s | 747 kB 00:00 2024-04-28T13:05:12.908 INFO:teuthology.orchestra.run.smithi134.stdout:(17/152): librados-devel-19.0.0-3306.gbc612ffb. 1.6 MB/s | 127 kB 00:00 2024-04-28T13:05:12.935 INFO:teuthology.orchestra.run.smithi114.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 332 kB/s | 42 kB 00:00 2024-04-28T13:05:12.958 INFO:teuthology.orchestra.run.smithi134.stdout:(18/152): libradosstriper1-19.0.0-3306.gbc612ff 5.3 MB/s | 501 kB 00:00 2024-04-28T13:05:12.960 INFO:teuthology.orchestra.run.smithi114.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 353 kB/s | 44 kB 00:00 2024-04-28T13:05:13.011 INFO:teuthology.orchestra.run.smithi114.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 717 kB/s | 36 kB 00:00 2024-04-28T13:05:13.033 INFO:teuthology.orchestra.run.smithi134.stdout:(19/152): python3-ceph-argparse-19.0.0-3306.gbc 600 kB/s | 45 kB 00:00 2024-04-28T13:05:13.036 INFO:teuthology.orchestra.run.smithi114.stdout:(95/152): qatlib-24.02.0-1.el9.x86_64.rpm 2.1 MB/s | 221 kB 00:00 2024-04-28T13:05:13.087 INFO:teuthology.orchestra.run.smithi114.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 629 kB/s | 47 kB 00:00 2024-04-28T13:05:13.125 INFO:teuthology.orchestra.run.smithi134.stdout:(20/152): python3-ceph-common-19.0.0-3306.gbc61 1.4 MB/s | 135 kB 00:00 2024-04-28T13:05:13.137 INFO:teuthology.orchestra.run.smithi114.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 3.0 MB/s | 305 kB 00:00 2024-04-28T13:05:13.162 INFO:teuthology.orchestra.run.smithi114.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 769 kB/s | 58 kB 00:00 2024-04-28T13:05:13.201 INFO:teuthology.orchestra.run.smithi134.stdout:(21/152): python3-cephfs-19.0.0-3306.gbc612ffb. 2.1 MB/s | 161 kB 00:00 2024-04-28T13:05:13.220 INFO:teuthology.orchestra.run.smithi114.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.1 MB/s | 94 kB 00:00 2024-04-28T13:05:13.246 INFO:teuthology.orchestra.run.smithi114.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 761 kB/s | 64 kB 00:00 2024-04-28T13:05:13.292 INFO:teuthology.orchestra.run.smithi134.stdout:(22/152): python3-rados-19.0.0-3306.gbc612ffb.e 3.4 MB/s | 321 kB 00:00 2024-04-28T13:05:13.296 INFO:teuthology.orchestra.run.smithi114.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 594 kB/s | 45 kB 00:00 2024-04-28T13:05:13.330 INFO:teuthology.orchestra.run.smithi114.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2024-04-28T13:05:13.376 INFO:teuthology.orchestra.run.smithi134.stdout:(23/152): librgw2-19.0.0-3306.gbc612ffb.el9.x86 11 MB/s | 5.4 MB 00:00 2024-04-28T13:05:13.401 INFO:teuthology.orchestra.run.smithi134.stdout:(24/152): python3-rbd-19.0.0-3306.gbc612ffb.el9 2.7 MB/s | 298 kB 00:00 2024-04-28T13:05:13.443 INFO:teuthology.orchestra.run.smithi134.stdout:(25/152): python3-rgw-19.0.0-3306.gbc612ffb.el9 1.4 MB/s | 99 kB 00:00 2024-04-28T13:05:13.502 INFO:teuthology.orchestra.run.smithi134.stdout:(26/152): rbd-fuse-19.0.0-3306.gbc612ffb.el9.x8 846 kB/s | 85 kB 00:00 2024-04-28T13:05:13.588 INFO:teuthology.orchestra.run.smithi114.stdout:(103/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-04-28T13:05:13.611 INFO:teuthology.orchestra.run.smithi134.stdout:(27/152): rbd-nbd-19.0.0-3306.gbc612ffb.el9.x86 1.5 MB/s | 171 kB 00:00 2024-04-28T13:05:13.655 INFO:teuthology.orchestra.run.smithi114.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 2.4 MB/s | 863 kB 00:00 2024-04-28T13:05:13.694 INFO:teuthology.orchestra.run.smithi134.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3306.g 410 kB/s | 34 kB 00:00 2024-04-28T13:05:13.753 INFO:teuthology.orchestra.run.smithi134.stdout:(29/152): rbd-mirror-19.0.0-3306.gbc612ffb.el9. 10 MB/s | 3.1 MB 00:00 2024-04-28T13:05:13.764 INFO:teuthology.orchestra.run.smithi114.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 179 kB/s | 19 kB 00:00 2024-04-28T13:05:13.778 INFO:teuthology.orchestra.run.smithi134.stdout:(30/152): ceph-mgr-cephadm-19.0.0-3306.gbc612ff 1.7 MB/s | 142 kB 00:00 2024-04-28T13:05:13.822 INFO:teuthology.orchestra.run.smithi114.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 1.3 MB/s | 309 kB 00:00 2024-04-28T13:05:13.873 INFO:teuthology.orchestra.run.smithi114.stdout:(107/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 519 kB/s | 26 kB 00:00 2024-04-28T13:05:13.923 INFO:teuthology.orchestra.run.smithi114.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 974 kB/s | 49 kB 00:00 2024-04-28T13:05:13.948 INFO:teuthology.orchestra.run.smithi114.stdout:(109/152): abseil-cpp-20211102.0-3.el9.x86_64.r 886 kB/s | 548 kB 00:00 2024-04-28T13:05:13.982 INFO:teuthology.orchestra.run.smithi114.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-04-28T13:05:14.074 INFO:teuthology.orchestra.run.smithi114.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 1.2 MB/s | 151 kB 00:00 2024-04-28T13:05:14.107 INFO:teuthology.orchestra.run.smithi114.stdout:(112/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-04-28T13:05:14.120 INFO:teuthology.orchestra.run.smithi134.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3306.gbc612 9.7 MB/s | 3.5 MB 00:00 2024-04-28T13:05:14.166 INFO:teuthology.orchestra.run.smithi114.stdout:(113/152): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-04-28T13:05:14.191 INFO:teuthology.orchestra.run.smithi114.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 520 kB/s | 43 kB 00:00 2024-04-28T13:05:14.216 INFO:teuthology.orchestra.run.smithi114.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-04-28T13:05:14.221 INFO:teuthology.orchestra.run.smithi134.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3306.gbc 2.4 MB/s | 249 kB 00:00 2024-04-28T13:05:14.242 INFO:teuthology.orchestra.run.smithi114.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 300 kB/s | 15 kB 00:00 2024-04-28T13:05:14.284 INFO:teuthology.orchestra.run.smithi114.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-04-28T13:05:14.309 INFO:teuthology.orchestra.run.smithi114.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-04-28T13:05:14.312 INFO:teuthology.orchestra.run.smithi134.stdout:(33/152): ceph-mgr-rook-19.0.0-3306.gbc612ffb.e 539 kB/s | 49 kB 00:00 2024-04-28T13:05:14.343 INFO:teuthology.orchestra.run.smithi114.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.0 MB/s | 303 kB 00:00 2024-04-28T13:05:14.368 INFO:teuthology.orchestra.run.smithi114.stdout:(120/152): python3-asyncssh-2.13.2-5.el9.noarch 1.8 MB/s | 548 kB 00:00 2024-04-28T13:05:14.388 INFO:teuthology.orchestra.run.smithi134.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3306.gb 220 kB/s | 16 kB 00:00 2024-04-28T13:05:14.393 INFO:teuthology.orchestra.run.smithi114.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 421 kB/s | 35 kB 00:00 2024-04-28T13:05:14.419 INFO:teuthology.orchestra.run.smithi114.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-04-28T13:05:14.452 INFO:teuthology.orchestra.run.smithi114.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-04-28T13:05:14.477 INFO:teuthology.orchestra.run.smithi114.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 183 kB/s | 11 kB 00:00 2024-04-28T13:05:14.503 INFO:teuthology.orchestra.run.smithi114.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-04-28T13:05:14.513 INFO:teuthology.orchestra.run.smithi134.stdout:(35/152): ceph-volume-19.0.0-3306.gbc612ffb.el9 2.1 MB/s | 273 kB 00:00 2024-04-28T13:05:14.528 INFO:teuthology.orchestra.run.smithi114.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-04-28T13:05:14.553 INFO:teuthology.orchestra.run.smithi114.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-04-28T13:05:14.578 INFO:teuthology.orchestra.run.smithi114.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-04-28T13:05:14.596 INFO:teuthology.orchestra.run.smithi134.stdout:(36/152): ceph-mgr-diskprediction-local-19.0.0- 9.1 MB/s | 7.4 MB 00:00 2024-04-28T13:05:14.630 INFO:teuthology.orchestra.run.smithi134.stdout:(37/152): cephadm-19.0.0-3306.gbc612ffb.el9.noa 6.4 MB/s | 762 kB 00:00 2024-04-28T13:05:14.637 INFO:teuthology.orchestra.run.smithi114.stdout:(129/152): python3-kubernetes-26.1.0-2.el9.noar 12 MB/s | 1.0 MB 00:00 2024-04-28T13:05:14.656 INFO:teuthology.orchestra.run.smithi134.stdout:(38/152): cephfs-top-19.0.0-3306.gbc612ffb.el9. 311 kB/s | 18 kB 00:00 2024-04-28T13:05:14.662 INFO:teuthology.orchestra.run.smithi114.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 555 kB/s | 46 kB 00:00 2024-04-28T13:05:14.688 INFO:teuthology.orchestra.run.smithi114.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-04-28T13:05:14.721 INFO:teuthology.orchestra.run.smithi114.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 985 kB/s | 58 kB 00:00 2024-04-28T13:05:14.746 INFO:teuthology.orchestra.run.smithi114.stdout:(133/152): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-04-28T13:05:14.764 INFO:teuthology.orchestra.run.smithi134.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 600 kB/s | 80 kB 00:00 2024-04-28T13:05:14.772 INFO:teuthology.orchestra.run.smithi114.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 326 kB/s | 16 kB 00:00 2024-04-28T13:05:14.797 INFO:teuthology.orchestra.run.smithi114.stdout:(135/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-04-28T13:05:14.822 INFO:teuthology.orchestra.run.smithi114.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-04-28T13:05:14.848 INFO:teuthology.orchestra.run.smithi114.stdout:(137/152): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-04-28T13:05:14.848 INFO:teuthology.orchestra.run.smithi134.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2024-04-28T13:05:14.881 INFO:teuthology.orchestra.run.smithi114.stdout:(138/152): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-04-28T13:05:14.907 INFO:teuthology.orchestra.run.smithi114.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-04-28T13:05:14.915 INFO:teuthology.orchestra.run.smithi134.stdout:(41/152): libgfortran-11.4.1-3.el9.x86_64.rpm 3.0 MB/s | 803 kB 00:00 2024-04-28T13:05:14.932 INFO:teuthology.orchestra.run.smithi114.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-04-28T13:05:14.940 INFO:teuthology.orchestra.run.smithi134.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-04-28T13:05:14.957 INFO:teuthology.orchestra.run.smithi114.stdout:(141/152): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-04-28T13:05:14.990 INFO:teuthology.orchestra.run.smithi114.stdout:(142/152): python3-webob-1.8.7-6.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-04-28T13:05:14.999 INFO:teuthology.orchestra.run.smithi134.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-04-28T13:05:15.016 INFO:teuthology.orchestra.run.smithi114.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-04-28T13:05:15.050 INFO:teuthology.orchestra.run.smithi114.stdout:(144/152): python3-werkzeug-2.0.3-3.el9.1.noarc 7.1 MB/s | 427 kB 00:00 2024-04-28T13:05:15.057 INFO:teuthology.orchestra.run.smithi134.stdout:(44/152): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-04-28T13:05:15.075 INFO:teuthology.orchestra.run.smithi114.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 341 kB/s | 20 kB 00:00 2024-04-28T13:05:15.116 INFO:teuthology.orchestra.run.smithi134.stdout:(45/152): python3-cryptography-36.0.1-4.el9.x86 6.1 MB/s | 1.2 MB 00:00 2024-04-28T13:05:15.117 INFO:teuthology.orchestra.run.smithi114.stdout:(146/152): python3-grpcio-1.46.7-10.el9.x86_64. 2.8 MB/s | 2.0 MB 00:00 2024-04-28T13:05:15.142 INFO:teuthology.orchestra.run.smithi114.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2024-04-28T13:05:15.184 INFO:teuthology.orchestra.run.smithi114.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-04-28T13:05:15.258 INFO:teuthology.orchestra.run.smithi134.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 623 kB/s | 125 kB 00:00 2024-04-28T13:05:15.325 INFO:teuthology.orchestra.run.smithi134.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 1.0 MB/s | 215 kB 00:00 2024-04-28T13:05:15.367 INFO:teuthology.orchestra.run.smithi134.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 6.2 MB/s | 689 kB 00:00 2024-04-28T13:05:15.393 INFO:teuthology.orchestra.run.smithi114.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 6.5 MB/s | 1.3 MB 00:00 2024-04-28T13:05:15.434 INFO:teuthology.orchestra.run.smithi134.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-04-28T13:05:15.467 INFO:teuthology.orchestra.run.smithi134.stdout:(50/152): bison-3.7.4-5.el9.x86_64.rpm 6.5 MB/s | 943 kB 00:00 2024-04-28T13:05:15.509 INFO:teuthology.orchestra.run.smithi134.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 285 kB/s | 21 kB 00:00 2024-04-28T13:05:15.559 INFO:teuthology.orchestra.run.smithi134.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 657 kB/s | 33 kB 00:00 2024-04-28T13:05:15.585 INFO:teuthology.orchestra.run.smithi134.stdout:(53/152): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-04-28T13:05:15.635 INFO:teuthology.orchestra.run.smithi134.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-04-28T13:05:15.652 INFO:teuthology.orchestra.run.smithi114.stdout:(150/152): librbd1-19.0.0-3306.gbc612ffb.el9.x8 6.2 MB/s | 3.1 MB 00:00 2024-04-28T13:05:15.685 INFO:teuthology.orchestra.run.smithi134.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-04-28T13:05:15.701 INFO:teuthology.orchestra.run.smithi114.stdout:(151/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 7.8 MB/s | 2.4 MB 00:00 2024-04-28T13:05:15.752 INFO:teuthology.orchestra.run.smithi114.stdout:(152/152): librados2-19.0.0-3306.gbc612ffb.el9. 5.4 MB/s | 3.4 MB 00:00 2024-04-28T13:05:15.754 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-04-28T13:05:15.754 INFO:teuthology.orchestra.run.smithi114.stdout:Total 19 MB/s | 222 MB 00:11 2024-04-28T13:05:16.119 INFO:teuthology.orchestra.run.smithi134.stdout:(56/152): ceph-test-19.0.0-3306.gbc612ffb.el9.x 12 MB/s | 49 MB 00:04 2024-04-28T13:05:16.186 INFO:teuthology.orchestra.run.smithi134.stdout:(57/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.8 MB/s | 3.0 MB 00:00 2024-04-28T13:05:16.211 INFO:teuthology.orchestra.run.smithi134.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 495 kB/s | 45 kB 00:00 2024-04-28T13:05:16.286 INFO:teuthology.orchestra.run.smithi134.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 6.5 MB/s | 662 kB 00:00 2024-04-28T13:05:16.312 INFO:teuthology.orchestra.run.smithi134.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 5.7 MB/s | 582 kB 00:00 2024-04-28T13:05:16.353 INFO:teuthology.orchestra.run.smithi134.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 381 kB/s | 25 kB 00:00 2024-04-28T13:05:16.379 INFO:teuthology.orchestra.run.smithi134.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 710 kB/s | 47 kB 00:00 2024-04-28T13:05:16.446 INFO:teuthology.orchestra.run.smithi134.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-04-28T13:05:16.479 INFO:teuthology.orchestra.run.smithi134.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-04-28T13:05:16.513 INFO:teuthology.orchestra.run.smithi134.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 528 kB/s | 35 kB 00:00 2024-04-28T13:05:16.705 INFO:teuthology.orchestra.run.smithi134.stdout:(66/152): openblas-openmp-0.3.21-2.el9.x86_64.r 21 MB/s | 4.7 MB 00:00 2024-04-28T13:05:16.763 INFO:teuthology.orchestra.run.smithi134.stdout:(67/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-04-28T13:05:16.872 INFO:teuthology.orchestra.run.smithi134.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2024-04-28T13:05:16.874 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-04-28T13:05:16.906 INFO:teuthology.orchestra.run.smithi134.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 6.3 MB/s | 911 kB 00:00 2024-04-28T13:05:16.964 INFO:teuthology.orchestra.run.smithi134.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 1.4 MB/s | 133 kB 00:00 2024-04-28T13:05:17.018 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-04-28T13:05:17.018 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-04-28T13:05:17.073 INFO:teuthology.orchestra.run.smithi134.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-04-28T13:05:17.140 INFO:teuthology.orchestra.run.smithi134.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-04-28T13:05:17.207 INFO:teuthology.orchestra.run.smithi134.stdout:(73/152): postgresql-server-13.14-1.el9.x86_64. 19 MB/s | 5.8 MB 00:00 2024-04-28T13:05:17.282 INFO:teuthology.orchestra.run.smithi134.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 3.2 MB/s | 244 kB 00:00 2024-04-28T13:05:17.366 INFO:teuthology.orchestra.run.smithi134.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-04-28T13:05:17.457 INFO:teuthology.orchestra.run.smithi134.stdout:(76/152): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2024-04-28T13:05:17.483 INFO:teuthology.orchestra.run.smithi134.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 219 kB/s | 26 kB 00:00 2024-04-28T13:05:17.525 INFO:teuthology.orchestra.run.smithi134.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 286 kB/s | 19 kB 00:00 2024-04-28T13:05:17.575 INFO:teuthology.orchestra.run.smithi134.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-04-28T13:05:17.600 INFO:teuthology.orchestra.run.smithi134.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 462 kB/s | 35 kB 00:00 2024-04-28T13:05:17.684 INFO:teuthology.orchestra.run.smithi134.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-04-28T13:05:17.759 INFO:teuthology.orchestra.run.smithi134.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-04-28T13:05:17.834 INFO:teuthology.orchestra.run.smithi134.stdout:(83/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 5.1 MB 00:00 2024-04-28T13:05:17.885 INFO:teuthology.orchestra.run.smithi134.stdout:(84/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 73 kB/s | 160 kB 00:02 2024-04-28T13:05:17.910 INFO:teuthology.orchestra.run.smithi134.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 563 kB/s | 42 kB 00:00 2024-04-28T13:05:17.935 INFO:teuthology.orchestra.run.smithi134.stdout:(86/152): python3-packaging-20.9-5.el9.noarch.r 439 kB/s | 77 kB 00:00 2024-04-28T13:05:17.985 INFO:teuthology.orchestra.run.smithi134.stdout:(87/152): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-04-28T13:05:18.019 INFO:teuthology.orchestra.run.smithi134.stdout:(88/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-04-28T13:05:18.044 INFO:teuthology.orchestra.run.smithi134.stdout:(89/152): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-04-28T13:05:18.061 INFO:teuthology.orchestra.run.smithi134.stdout:(90/152): python3-pytz-2021.1-5.el9.noarch.rpm 676 kB/s | 51 kB 00:00 2024-04-28T13:05:18.086 INFO:teuthology.orchestra.run.smithi134.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 797 kB/s | 54 kB 00:00 2024-04-28T13:05:18.129 INFO:teuthology.orchestra.run.smithi134.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 621 kB/s | 42 kB 00:00 2024-04-28T13:05:18.145 INFO:teuthology.orchestra.run.smithi134.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 754 kB/s | 44 kB 00:00 2024-04-28T13:05:18.187 INFO:teuthology.orchestra.run.smithi134.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 865 kB/s | 36 kB 00:00 2024-04-28T13:05:18.212 INFO:teuthology.orchestra.run.smithi134.stdout:(95/152): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-04-28T13:05:18.254 INFO:teuthology.orchestra.run.smithi134.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 708 kB/s | 47 kB 00:00 2024-04-28T13:05:18.313 INFO:teuthology.orchestra.run.smithi134.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 3.0 MB/s | 305 kB 00:00 2024-04-28T13:05:18.330 INFO:teuthology.orchestra.run.smithi134.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 769 kB/s | 58 kB 00:00 2024-04-28T13:05:18.397 INFO:teuthology.orchestra.run.smithi134.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.1 MB/s | 94 kB 00:00 2024-04-28T13:05:18.431 INFO:teuthology.orchestra.run.smithi134.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 632 kB/s | 64 kB 00:00 2024-04-28T13:05:18.481 INFO:teuthology.orchestra.run.smithi134.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 534 kB/s | 45 kB 00:00 2024-04-28T13:05:18.514 INFO:teuthology.orchestra.run.smithi134.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2024-04-28T13:05:18.673 INFO:teuthology.orchestra.run.smithi134.stdout:(103/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-04-28T13:05:18.766 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-04-28T13:05:18.766 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-04-28T13:05:18.832 INFO:teuthology.orchestra.run.smithi134.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 2.4 MB/s | 863 kB 00:00 2024-04-28T13:05:18.907 INFO:teuthology.orchestra.run.smithi134.stdout:(105/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.4 MB/s | 548 kB 00:00 2024-04-28T13:05:18.932 INFO:teuthology.orchestra.run.smithi134.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 1.3 MB/s | 309 kB 00:00 2024-04-28T13:05:18.957 INFO:teuthology.orchestra.run.smithi134.stdout:(107/152): grpc-data-1.46.7-10.el9.noarch.rpm 155 kB/s | 19 kB 00:00 2024-04-28T13:05:19.083 INFO:teuthology.orchestra.run.smithi134.stdout:(108/152): libarrow-9.0.0-11.el9.x86_64.rpm 25 MB/s | 4.4 MB 00:00 2024-04-28T13:05:19.108 INFO:teuthology.orchestra.run.smithi134.stdout:(109/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 175 kB/s | 26 kB 00:00 2024-04-28T13:05:19.133 INFO:teuthology.orchestra.run.smithi134.stdout:(110/152): liboath-2.6.7-2.el9.x86_64.rpm 280 kB/s | 49 kB 00:00 2024-04-28T13:05:19.158 INFO:teuthology.orchestra.run.smithi134.stdout:(111/152): libunwind-1.6.2-1.el9.x86_64.rpm 896 kB/s | 67 kB 00:00 2024-04-28T13:05:19.183 INFO:teuthology.orchestra.run.smithi134.stdout:(112/152): luarocks-3.9.2-1.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-04-28T13:05:19.226 INFO:teuthology.orchestra.run.smithi134.stdout:(113/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-04-28T13:05:19.251 INFO:teuthology.orchestra.run.smithi134.stdout:(114/152): python3-asyncssh-2.13.2-5.el9.noarch 5.8 MB/s | 548 kB 00:00 2024-04-28T13:05:19.276 INFO:teuthology.orchestra.run.smithi134.stdout:(115/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 480 kB/s | 43 kB 00:00 2024-04-28T13:05:19.301 INFO:teuthology.orchestra.run.smithi134.stdout:(116/152): python3-cachetools-4.2.4-1.el9.noarc 428 kB/s | 32 kB 00:00 2024-04-28T13:05:19.326 INFO:teuthology.orchestra.run.smithi134.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 299 kB/s | 15 kB 00:00 2024-04-28T13:05:19.351 INFO:teuthology.orchestra.run.smithi134.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-04-28T13:05:19.377 INFO:teuthology.orchestra.run.smithi134.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-04-28T13:05:19.402 INFO:teuthology.orchestra.run.smithi134.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 6.0 MB/s | 303 kB 00:00 2024-04-28T13:05:19.427 INFO:teuthology.orchestra.run.smithi134.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 472 kB/s | 35 kB 00:00 2024-04-28T13:05:19.452 INFO:teuthology.orchestra.run.smithi134.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-04-28T13:05:19.503 INFO:teuthology.orchestra.run.smithi134.stdout:(123/152): python3-grpcio-1.46.7-10.el9.x86_64. 20 MB/s | 2.0 MB 00:00 2024-04-28T13:05:19.528 INFO:teuthology.orchestra.run.smithi134.stdout:(124/152): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-04-28T13:05:19.553 INFO:teuthology.orchestra.run.smithi134.stdout:(125/152): python3-jaraco-8.2.1-3.el9.noarch.rp 109 kB/s | 11 kB 00:00 2024-04-28T13:05:19.578 INFO:teuthology.orchestra.run.smithi134.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 235 kB/s | 18 kB 00:00 2024-04-28T13:05:19.604 INFO:teuthology.orchestra.run.smithi134.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-04-28T13:05:19.629 INFO:teuthology.orchestra.run.smithi134.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 258 kB/s | 19 kB 00:00 2024-04-28T13:05:19.654 INFO:teuthology.orchestra.run.smithi134.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-04-28T13:05:19.696 INFO:teuthology.orchestra.run.smithi134.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 15 MB/s | 1.0 MB 00:00 2024-04-28T13:05:19.721 INFO:teuthology.orchestra.run.smithi134.stdout:(131/152): python3-logutils-0.3.5-21.el9.noarch 503 kB/s | 46 kB 00:00 2024-04-28T13:05:19.746 INFO:teuthology.orchestra.run.smithi134.stdout:(132/152): python3-more-itertools-8.12.0-2.el9. 862 kB/s | 79 kB 00:00 2024-04-28T13:05:19.772 INFO:teuthology.orchestra.run.smithi134.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 768 kB/s | 58 kB 00:00 2024-04-28T13:05:19.797 INFO:teuthology.orchestra.run.smithi134.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 326 kB/s | 16 kB 00:00 2024-04-28T13:05:19.822 INFO:teuthology.orchestra.run.smithi134.stdout:(135/152): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-04-28T13:05:19.848 INFO:teuthology.orchestra.run.smithi134.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-04-28T13:05:19.873 INFO:teuthology.orchestra.run.smithi134.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 377 kB/s | 28 kB 00:00 2024-04-28T13:05:19.898 INFO:teuthology.orchestra.run.smithi134.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 615 kB/s | 31 kB 00:00 2024-04-28T13:05:19.923 INFO:teuthology.orchestra.run.smithi134.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 2.5 MB/s | 188 kB 00:00 2024-04-28T13:05:19.949 INFO:teuthology.orchestra.run.smithi134.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 790 kB/s | 59 kB 00:00 2024-04-28T13:05:19.974 INFO:teuthology.orchestra.run.smithi134.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-04-28T13:05:19.999 INFO:teuthology.orchestra.run.smithi134.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 678 kB/s | 51 kB 00:00 2024-04-28T13:05:20.024 INFO:teuthology.orchestra.run.smithi134.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-28T13:05:20.050 INFO:teuthology.orchestra.run.smithi134.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-04-28T13:05:20.075 INFO:teuthology.orchestra.run.smithi134.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 5.6 MB/s | 427 kB 00:00 2024-04-28T13:05:20.100 INFO:teuthology.orchestra.run.smithi134.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 264 kB/s | 20 kB 00:00 2024-04-28T13:05:20.125 INFO:teuthology.orchestra.run.smithi134.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-04-28T13:05:20.175 INFO:teuthology.orchestra.run.smithi134.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-04-28T13:05:20.401 INFO:teuthology.orchestra.run.smithi134.stdout:(149/152): librados2-19.0.0-3306.gbc612ffb.el9. 11 MB/s | 3.4 MB 00:00 2024-04-28T13:05:20.487 INFO:teuthology.orchestra.run.smithi134.stdout:(150/152): openssl-3.2.1-1.el9.x86_64.rpm 4.4 MB/s | 1.3 MB 00:00 2024-04-28T13:05:20.568 INFO:teuthology.orchestra.run.smithi134.stdout:(151/152): librbd1-19.0.0-3306.gbc612ffb.el9.x8 7.1 MB/s | 3.1 MB 00:00 2024-04-28T13:05:20.843 INFO:teuthology.orchestra.run.smithi134.stdout:(152/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 5.4 MB/s | 2.4 MB 00:00 2024-04-28T13:05:20.848 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-28T13:05:20.848 INFO:teuthology.orchestra.run.smithi134.stdout:Total 19 MB/s | 222 MB 00:11 2024-04-28T13:05:21.961 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-28T13:05:22.105 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-28T13:05:22.105 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-28T13:05:23.859 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-28T13:05:23.860 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-28T13:05:24.672 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-04-28T13:05:24.814 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-28T13:05:25.011 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-28T13:05:25.065 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-28T13:05:25.115 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-28T13:05:25.140 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-28T13:05:25.183 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-28T13:05:25.511 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-28T13:05:25.633 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-28T13:05:25.738 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-28T13:05:25.767 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-28T13:05:25.842 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-28T13:05:25.872 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/156 2024-04-28T13:05:26.021 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-28T13:05:26.069 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-28T13:05:26.096 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-28T13:05:26.200 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-28T13:05:26.239 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/156 2024-04-28T13:05:26.302 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/156 2024-04-28T13:05:26.323 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-28T13:05:26.348 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-28T13:05:26.533 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-28T13:05:26.567 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-28T13:05:26.674 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-28T13:05:26.770 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-28T13:05:26.812 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-28T13:05:26.851 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-28T13:05:26.925 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-28T13:05:26.958 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-28T13:05:27.002 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-28T13:05:27.035 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-28T13:05:27.071 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-28T13:05:27.141 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-28T13:05:27.194 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-28T13:05:27.232 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-28T13:05:27.276 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-28T13:05:27.351 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-28T13:05:27.386 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 31/156 2024-04-28T13:05:27.421 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 32/156 2024-04-28T13:05:27.450 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 33/156 2024-04-28T13:05:27.520 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-28T13:05:27.564 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-28T13:05:27.638 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-28T13:05:27.771 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-28T13:05:27.817 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-28T13:05:28.344 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-28T13:05:28.438 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-28T13:05:28.467 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-28T13:05:28.509 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-28T13:05:28.547 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 43/156 2024-04-28T13:05:28.589 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-28T13:05:28.737 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-28T13:05:28.792 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-28T13:05:28.846 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-28T13:05:28.920 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-28T13:05:28.951 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-28T13:05:28.987 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-28T13:05:29.034 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-28T13:05:29.070 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-28T13:05:29.113 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-28T13:05:29.155 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-28T13:05:29.292 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-28T13:05:29.344 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-28T13:05:29.374 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-28T13:05:29.416 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-28T13:05:29.510 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-28T13:05:29.540 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-28T13:05:29.581 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-28T13:05:29.606 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-28T13:05:29.631 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-28T13:05:29.706 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-28T13:05:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-28T13:05:29.834 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-28T13:05:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-28T13:05:29.876 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-28T13:05:29.929 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-28T13:05:29.972 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-28T13:05:30.006 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-28T13:05:30.046 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-28T13:05:30.048 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-28T13:05:30.074 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-28T13:05:30.108 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-28T13:05:30.148 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-28T13:05:30.179 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-28T13:05:30.209 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-28T13:05:30.244 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-28T13:05:30.277 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-28T13:05:30.310 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-28T13:05:30.369 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-28T13:05:30.474 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-28T13:05:30.512 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-28T13:05:30.596 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-28T13:05:30.600 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-28T13:05:30.625 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-28T13:05:30.642 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-28T13:05:30.673 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-28T13:05:30.716 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-28T13:05:30.720 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-28T13:05:30.754 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/156 2024-04-28T13:05:30.819 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-28T13:05:30.891 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-28T13:05:30.900 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-28T13:05:30.951 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-28T13:05:30.979 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-28T13:05:31.082 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-28T13:05:31.105 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/156 2024-04-28T13:05:31.167 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/156 2024-04-28T13:05:31.189 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-28T13:05:31.211 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-28T13:05:31.372 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-28T13:05:31.405 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-28T13:05:31.512 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-28T13:05:31.598 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-28T13:05:31.623 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-28T13:05:31.629 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-28T13:05:31.664 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-28T13:05:31.671 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-28T13:05:31.705 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-28T13:05:31.728 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-28T13:05:31.763 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-28T13:05:31.806 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-28T13:05:31.808 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-28T13:05:31.848 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-28T13:05:31.874 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-28T13:05:31.875 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-28T13:05:31.935 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-28T13:05:31.961 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-28T13:05:31.989 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-28T13:05:31.990 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-28T13:05:32.020 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-28T13:05:32.054 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-28T13:05:32.131 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-28T13:05:32.165 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 31/156 2024-04-28T13:05:32.169 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-28T13:05:32.196 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-28T13:05:32.208 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 32/156 2024-04-28T13:05:32.238 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 33/156 2024-04-28T13:05:32.283 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-28T13:05:32.306 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-28T13:05:32.360 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-28T13:05:32.435 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-28T13:05:32.573 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-28T13:05:32.630 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-28T13:05:32.937 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-28T13:05:33.054 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-28T13:05:33.216 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-28T13:05:33.333 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-28T13:05:33.366 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-28T13:05:33.413 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-28T13:05:33.458 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 43/156 2024-04-28T13:05:33.514 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-28T13:05:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-28T13:05:33.747 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-28T13:05:33.808 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-28T13:05:33.873 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-28T13:05:33.913 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-28T13:05:33.950 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-28T13:05:33.996 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-28T13:05:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-28T13:05:34.076 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-28T13:05:34.117 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-28T13:05:34.252 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-28T13:05:34.289 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-28T13:05:34.304 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-28T13:05:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-28T13:05:34.361 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-28T13:05:34.392 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-28T13:05:34.420 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-28T13:05:34.453 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-28T13:05:34.455 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-28T13:05:34.486 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-28T13:05:34.526 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-28T13:05:34.552 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-28T13:05:34.576 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-28T13:05:34.650 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-28T13:05:34.757 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-28T13:05:34.777 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-28T13:05:34.799 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 99/156 2024-04-28T13:05:34.817 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-28T13:05:34.853 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-28T13:05:34.873 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 99/156 2024-04-28T13:05:34.887 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-28T13:05:34.903 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 100/156 2024-04-28T13:05:34.926 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-28T13:05:34.939 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-28T13:05:34.958 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-28T13:05:35.080 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-28T13:05:35.198 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-28T13:05:35.231 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-28T13:05:35.273 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-28T13:05:35.307 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-28T13:05:35.395 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-28T13:05:35.422 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-28T13:05:35.446 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-28T13:05:35.460 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 103/156 2024-04-28T13:05:35.478 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-28T13:05:35.524 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-28T13:05:35.531 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 103/156 2024-04-28T13:05:35.562 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 104/156 2024-04-28T13:05:35.621 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-28T13:05:35.669 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-28T13:05:36.382 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-28T13:05:36.433 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-28T13:05:36.467 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-28T13:05:36.565 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-28T13:05:36.616 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-28T13:05:36.702 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-28T13:05:36.752 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-28T13:05:36.928 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-28T13:05:36.950 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-28T13:05:37.026 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-28T13:05:37.660 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-28T13:05:37.772 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-28T13:05:37.976 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-28T13:05:38.008 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-28T13:05:38.548 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-28T13:05:38.604 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/156 2024-04-28T13:05:38.691 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/156 2024-04-28T13:05:38.692 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-28T13:05:38.692 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-28T13:05:38.692 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:05:38.721 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 107/156 2024-04-28T13:05:38.997 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-28T13:05:39.113 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-28T13:05:39.148 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-28T13:05:39.181 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-28T13:05:39.492 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-28T13:05:39.527 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 99/156 2024-04-28T13:05:39.649 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 99/156 2024-04-28T13:05:39.674 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 100/156 2024-04-28T13:05:39.710 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-28T13:05:40.189 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-28T13:05:40.222 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 103/156 2024-04-28T13:05:40.293 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 103/156 2024-04-28T13:05:40.315 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 104/156 2024-04-28T13:05:42.657 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-28T13:05:42.695 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-28T13:05:43.239 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-28T13:05:43.290 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/156 2024-04-28T13:05:43.391 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/156 2024-04-28T13:05:43.391 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-28T13:05:43.391 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-28T13:05:43.391 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:05:43.424 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 107/156 2024-04-28T13:05:50.308 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 107/156 2024-04-28T13:05:50.308 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /sys 2024-04-28T13:05:50.308 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /proc 2024-04-28T13:05:50.308 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /mnt 2024-04-28T13:05:50.308 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /var/tmp 2024-04-28T13:05:50.308 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /home 2024-04-28T13:05:50.308 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /root 2024-04-28T13:05:50.308 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /tmp 2024-04-28T13:05:50.309 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:05:50.475 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 108/156 2024-04-28T13:05:50.490 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 108/156 2024-04-28T13:05:50.490 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-28T13:05:50.491 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-28T13:05:50.491 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:05:51.944 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/156 2024-04-28T13:05:51.970 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/156 2024-04-28T13:05:51.970 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-28T13:05:51.971 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-28T13:05:51.971 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-28T13:05:51.971 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-28T13:05:51.971 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:05:52.195 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/156 2024-04-28T13:05:52.218 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/156 2024-04-28T13:05:52.218 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-28T13:05:52.218 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-28T13:05:52.218 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-28T13:05:52.218 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-28T13:05:52.218 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:05:52.654 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 111/156 2024-04-28T13:05:52.677 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 111/156 2024-04-28T13:05:52.677 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-28T13:05:52.677 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-28T13:05:52.677 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-28T13:05:52.677 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-28T13:05:52.677 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:05:52.785 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-28T13:05:52.842 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-28T13:05:52.897 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-28T13:05:53.093 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-28T13:05:53.138 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-28T13:05:53.217 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-28T13:05:53.322 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-28T13:05:53.464 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-28T13:05:53.505 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-28T13:05:53.537 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-28T13:05:53.564 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-28T13:05:54.025 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 123/156 2024-04-28T13:05:54.054 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 123/156 2024-04-28T13:05:54.087 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 124/156 2024-04-28T13:05:54.156 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 125/156 2024-04-28T13:05:54.186 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 126/156 2024-04-28T13:05:54.691 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 107/156 2024-04-28T13:05:54.691 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /sys 2024-04-28T13:05:54.691 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /proc 2024-04-28T13:05:54.691 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /mnt 2024-04-28T13:05:54.692 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /var/tmp 2024-04-28T13:05:54.692 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /home 2024-04-28T13:05:54.692 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /root 2024-04-28T13:05:54.692 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /tmp 2024-04-28T13:05:54.692 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:05:54.869 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 108/156 2024-04-28T13:05:54.884 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 108/156 2024-04-28T13:05:54.884 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-28T13:05:54.884 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-28T13:05:54.884 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:05:55.224 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 126/156 2024-04-28T13:05:55.254 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 127/156 2024-04-28T13:05:56.216 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 127/156 2024-04-28T13:05:56.247 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 128/156 2024-04-28T13:05:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/156 2024-04-28T13:05:56.350 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 128/156 2024-04-28T13:05:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/156 2024-04-28T13:05:56.373 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-28T13:05:56.373 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-28T13:05:56.373 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-28T13:05:56.374 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-28T13:05:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:05:56.507 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 129/156 2024-04-28T13:05:56.540 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 130/156 2024-04-28T13:05:56.563 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 130/156 2024-04-28T13:05:56.563 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-28T13:05:56.563 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-28T13:05:56.564 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-28T13:05:56.564 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-28T13:05:56.564 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:05:56.606 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/156 2024-04-28T13:05:56.607 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 131/156 2024-04-28T13:05:56.619 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 131/156 2024-04-28T13:05:56.628 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/156 2024-04-28T13:05:56.629 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-28T13:05:56.629 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-28T13:05:56.629 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-28T13:05:56.629 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-28T13:05:56.629 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:05:56.716 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 132/156 2024-04-28T13:05:56.764 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 133/156 2024-04-28T13:05:57.073 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 111/156 2024-04-28T13:05:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 111/156 2024-04-28T13:05:57.096 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-28T13:05:57.096 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-28T13:05:57.096 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-28T13:05:57.096 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-28T13:05:57.096 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:05:57.195 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-28T13:05:57.244 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-28T13:05:57.299 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-28T13:05:57.486 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-28T13:05:57.532 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-28T13:05:57.610 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-28T13:05:57.686 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-28T13:05:57.698 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-28T13:05:57.718 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 135/156 2024-04-28T13:05:57.741 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 135/156 2024-04-28T13:05:57.741 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-28T13:05:57.741 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-28T13:05:57.741 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-28T13:05:57.741 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-28T13:05:57.742 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:05:57.794 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 136/156 2024-04-28T13:05:57.816 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3306.gbc612 136/156 2024-04-28T13:05:57.816 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-28T13:05:57.816 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-28T13:05:57.816 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:05:57.837 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-28T13:05:57.861 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 137/156 2024-04-28T13:05:57.882 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-28T13:05:57.884 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 137/156 2024-04-28T13:05:57.884 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-28T13:05:57.884 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-28T13:05:57.884 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-28T13:05:57.884 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-28T13:05:57.884 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:05:57.914 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-28T13:05:57.950 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-28T13:05:58.187 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/156 2024-04-28T13:05:58.210 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/156 2024-04-28T13:05:58.210 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-28T13:05:58.210 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-28T13:05:58.210 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-28T13:05:58.210 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-28T13:05:58.210 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:05:58.335 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 123/156 2024-04-28T13:05:58.365 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 123/156 2024-04-28T13:05:58.397 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 124/156 2024-04-28T13:05:58.467 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 125/156 2024-04-28T13:05:58.506 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 126/156 2024-04-28T13:05:59.539 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 126/156 2024-04-28T13:05:59.575 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 127/156 2024-04-28T13:06:00.533 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 127/156 2024-04-28T13:06:00.557 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 128/156 2024-04-28T13:06:00.660 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 128/156 2024-04-28T13:06:00.827 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 129/156 2024-04-28T13:06:00.859 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 130/156 2024-04-28T13:06:00.882 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 130/156 2024-04-28T13:06:00.882 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-28T13:06:00.883 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-28T13:06:00.883 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-28T13:06:00.883 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-28T13:06:00.883 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:00.932 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 131/156 2024-04-28T13:06:00.938 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 131/156 2024-04-28T13:06:01.035 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 132/156 2024-04-28T13:06:01.091 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 133/156 2024-04-28T13:06:02.011 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-28T13:06:02.046 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 135/156 2024-04-28T13:06:02.069 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 135/156 2024-04-28T13:06:02.069 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-28T13:06:02.069 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-28T13:06:02.069 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-28T13:06:02.069 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-28T13:06:02.070 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:02.113 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 136/156 2024-04-28T13:06:02.135 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3306.gbc612 136/156 2024-04-28T13:06:02.136 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-28T13:06:02.136 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-28T13:06:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 137/156 2024-04-28T13:06:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 137/156 2024-04-28T13:06:02.203 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-28T13:06:02.203 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-28T13:06:02.203 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-28T13:06:02.204 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-28T13:06:02.204 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:02.515 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/156 2024-04-28T13:06:02.538 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/156 2024-04-28T13:06:02.538 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-28T13:06:02.538 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-28T13:06:02.538 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-28T13:06:02.538 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-28T13:06:02.538 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:02.799 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 139/156 2024-04-28T13:06:02.840 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 140/156 2024-04-28T13:06:02.881 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 141/156 2024-04-28T13:06:02.914 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-28T13:06:02.940 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-28T13:06:03.139 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 144/156 2024-04-28T13:06:03.178 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-28T13:06:03.208 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 146/156 2024-04-28T13:06:03.811 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-28T13:06:03.847 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-28T13:06:03.867 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-28T13:06:04.696 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 148/156 2024-04-28T13:06:04.785 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-28T13:06:04.826 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-28T13:06:04.909 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-28T13:06:04.939 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-28T13:06:04.939 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-28T13:06:05.023 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-28T13:06:05.056 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-28T13:06:05.056 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-28T13:06:05.149 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-28T13:06:05.221 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-28T13:06:07.118 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 139/156 2024-04-28T13:06:07.159 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 140/156 2024-04-28T13:06:07.200 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 141/156 2024-04-28T13:06:07.233 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-28T13:06:07.285 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-28T13:06:07.463 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 144/156 2024-04-28T13:06:07.514 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-28T13:06:07.544 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 146/156 2024-04-28T13:06:08.157 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-28T13:06:08.191 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-28T13:06:08.211 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-28T13:06:09.029 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 148/156 2024-04-28T13:06:09.130 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-28T13:06:09.170 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-28T13:06:09.252 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-28T13:06:09.284 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-28T13:06:09.284 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-28T13:06:09.368 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-28T13:06:09.392 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-28T13:06:09.392 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-28T13:06:09.484 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-28T13:06:09.557 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-28T13:06:11.222 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-28T13:06:11.222 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 1/156 2024-04-28T13:06:11.222 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2/156 2024-04-28T13:06:11.222 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 3/156 2024-04-28T13:06:11.222 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 4/156 2024-04-28T13:06:11.222 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 5/156 2024-04-28T13:06:11.223 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 6/156 2024-04-28T13:06:11.223 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 7/156 2024-04-28T13:06:11.223 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-28T13:06:11.223 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-28T13:06:11.223 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/156 2024-04-28T13:06:11.223 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 11/156 2024-04-28T13:06:11.223 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 12/156 2024-04-28T13:06:11.223 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-28T13:06:11.223 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 14/156 2024-04-28T13:06:11.223 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 15/156 2024-04-28T13:06:11.223 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 16/156 2024-04-28T13:06:11.223 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 17/156 2024-04-28T13:06:11.223 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 18/156 2024-04-28T13:06:11.224 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 19/156 2024-04-28T13:06:11.224 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 20/156 2024-04-28T13:06:11.224 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 21/156 2024-04-28T13:06:11.224 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 22/156 2024-04-28T13:06:11.224 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 23/156 2024-04-28T13:06:11.224 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 24/156 2024-04-28T13:06:11.224 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 25/156 2024-04-28T13:06:11.224 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 26/156 2024-04-28T13:06:11.224 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 27/156 2024-04-28T13:06:11.224 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 28/156 2024-04-28T13:06:11.224 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 29/156 2024-04-28T13:06:11.224 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 30/156 2024-04-28T13:06:11.240 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 31/156 2024-04-28T13:06:11.240 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 32/156 2024-04-28T13:06:11.240 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 33/156 2024-04-28T13:06:11.240 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 34/156 2024-04-28T13:06:11.240 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 35/156 2024-04-28T13:06:11.241 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 36/156 2024-04-28T13:06:11.241 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 37/156 2024-04-28T13:06:11.241 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 38/156 2024-04-28T13:06:11.241 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 39/156 2024-04-28T13:06:11.241 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-28T13:06:11.241 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-28T13:06:11.241 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-28T13:06:11.241 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-28T13:06:11.241 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-28T13:06:11.241 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-28T13:06:11.241 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-28T13:06:11.242 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-28T13:06:11.242 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-28T13:06:11.242 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-28T13:06:11.242 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-28T13:06:11.242 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-28T13:06:11.242 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-28T13:06:11.242 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-28T13:06:11.242 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-28T13:06:11.242 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-28T13:06:11.242 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-28T13:06:11.242 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-28T13:06:11.242 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-28T13:06:11.243 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-28T13:06:11.243 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-28T13:06:11.243 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-28T13:06:11.243 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-28T13:06:11.243 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-28T13:06:11.243 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-28T13:06:11.243 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-28T13:06:11.243 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-28T13:06:11.243 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-28T13:06:11.243 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-28T13:06:11.243 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-28T13:06:11.243 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-28T13:06:11.243 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-28T13:06:11.243 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-28T13:06:11.244 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-28T13:06:11.244 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-28T13:06:11.244 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-28T13:06:11.244 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-28T13:06:11.244 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-28T13:06:11.244 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-28T13:06:11.244 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-28T13:06:11.244 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-28T13:06:11.244 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-28T13:06:11.244 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-28T13:06:11.244 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-28T13:06:11.244 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-28T13:06:11.244 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-28T13:06:11.244 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-28T13:06:11.245 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-28T13:06:11.245 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-28T13:06:11.245 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-28T13:06:11.245 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-28T13:06:11.245 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-28T13:06:11.245 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-28T13:06:11.245 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-28T13:06:11.245 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-28T13:06:11.245 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-28T13:06:11.245 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-28T13:06:11.245 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-28T13:06:11.245 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-28T13:06:11.245 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-28T13:06:11.246 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-28T13:06:11.246 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-28T13:06:11.246 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-28T13:06:11.246 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-28T13:06:11.246 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-28T13:06:11.246 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-28T13:06:11.246 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-28T13:06:11.246 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-28T13:06:11.246 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-28T13:06:11.246 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-28T13:06:11.246 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-28T13:06:11.246 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-28T13:06:11.246 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-28T13:06:11.246 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-28T13:06:11.247 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-28T13:06:11.247 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-28T13:06:11.247 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-28T13:06:11.247 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-28T13:06:11.247 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-28T13:06:11.247 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-28T13:06:11.247 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-28T13:06:11.247 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-28T13:06:11.247 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-28T13:06:11.247 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-28T13:06:11.247 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-28T13:06:11.247 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-28T13:06:11.247 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-28T13:06:11.247 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-28T13:06:11.247 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-28T13:06:11.247 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-28T13:06:11.248 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-28T13:06:11.248 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-28T13:06:11.248 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-28T13:06:11.248 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-28T13:06:11.248 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-28T13:06:11.248 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-28T13:06:11.248 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-28T13:06:11.248 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-28T13:06:11.248 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-28T13:06:11.248 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-28T13:06:11.248 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-28T13:06:11.248 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-28T13:06:11.248 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-28T13:06:11.248 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-28T13:06:11.248 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-28T13:06:11.249 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-28T13:06:11.249 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-28T13:06:11.249 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-28T13:06:11.249 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-28T13:06:11.249 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 149/156 2024-04-28T13:06:11.249 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-28T13:06:11.249 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 151/156 2024-04-28T13:06:11.249 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-28T13:06:11.249 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-28T13:06:11.249 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-28T13:06:11.249 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-28T13:06:13.260 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-28T13:06:13.260 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:06:13.260 INFO:teuthology.orchestra.run.smithi114.stdout:Upgraded: 2024-04-28T13:06:13.260 INFO:teuthology.orchestra.run.smithi114.stdout: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:13.260 INFO:teuthology.orchestra.run.smithi114.stdout: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:13.260 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-28T13:06:13.260 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-28T13:06:13.261 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-04-28T13:06:13.261 INFO:teuthology.orchestra.run.smithi114.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-28T13:06:13.261 INFO:teuthology.orchestra.run.smithi114.stdout: automake-1.16.2-8.el9.noarch 2024-04-28T13:06:13.261 INFO:teuthology.orchestra.run.smithi114.stdout: bison-3.7.4-5.el9.x86_64 2024-04-28T13:06:13.261 INFO:teuthology.orchestra.run.smithi114.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-28T13:06:13.261 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:13.261 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:13.261 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:13.261 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:13.261 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-28T13:06:13.261 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-immutable-object-cache-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:13.261 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:13.261 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:13.262 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-28T13:06:13.262 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-28T13:06:13.262 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-28T13:06:13.262 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-28T13:06:13.262 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-28T13:06:13.262 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:13.262 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:13.262 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-28T13:06:13.262 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:13.262 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:13.262 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:13.262 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-28T13:06:13.262 INFO:teuthology.orchestra.run.smithi114.stdout: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-28T13:06:13.262 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:13.263 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:13.263 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-28T13:06:13.263 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-28T13:06:13.263 INFO:teuthology.orchestra.run.smithi114.stdout: flex-2.6.4-9.el9.x86_64 2024-04-28T13:06:13.263 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-28T13:06:13.263 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-28T13:06:13.263 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-28T13:06:13.263 INFO:teuthology.orchestra.run.smithi114.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-28T13:06:13.263 INFO:teuthology.orchestra.run.smithi114.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-28T13:06:13.263 INFO:teuthology.orchestra.run.smithi114.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-28T13:06:13.263 INFO:teuthology.orchestra.run.smithi114.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-28T13:06:13.263 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-28T13:06:13.263 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-28T13:06:13.263 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:13.264 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:13.264 INFO:teuthology.orchestra.run.smithi114.stdout: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:13.264 INFO:teuthology.orchestra.run.smithi114.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-28T13:06:13.264 INFO:teuthology.orchestra.run.smithi114.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-28T13:06:13.264 INFO:teuthology.orchestra.run.smithi114.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-28T13:06:13.264 INFO:teuthology.orchestra.run.smithi114.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-28T13:06:13.264 INFO:teuthology.orchestra.run.smithi114.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-28T13:06:13.264 INFO:teuthology.orchestra.run.smithi114.stdout: librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:13.264 INFO:teuthology.orchestra.run.smithi114.stdout: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:13.264 INFO:teuthology.orchestra.run.smithi114.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-28T13:06:13.264 INFO:teuthology.orchestra.run.smithi114.stdout: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:13.264 INFO:teuthology.orchestra.run.smithi114.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-28T13:06:13.264 INFO:teuthology.orchestra.run.smithi114.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-28T13:06:13.264 INFO:teuthology.orchestra.run.smithi114.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-28T13:06:13.265 INFO:teuthology.orchestra.run.smithi114.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-28T13:06:13.265 INFO:teuthology.orchestra.run.smithi114.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-28T13:06:13.265 INFO:teuthology.orchestra.run.smithi114.stdout: lua-5.4.4-4.el9.x86_64 2024-04-28T13:06:13.265 INFO:teuthology.orchestra.run.smithi114.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-28T13:06:13.265 INFO:teuthology.orchestra.run.smithi114.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-28T13:06:13.265 INFO:teuthology.orchestra.run.smithi114.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-28T13:06:13.265 INFO:teuthology.orchestra.run.smithi114.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-28T13:06:13.265 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-28T13:06:13.265 INFO:teuthology.orchestra.run.smithi114.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-28T13:06:13.265 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-13.14-1.el9.x86_64 2024-04-28T13:06:13.265 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-28T13:06:13.265 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-28T13:06:13.265 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-28T13:06:13.265 INFO:teuthology.orchestra.run.smithi114.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-28T13:06:13.266 INFO:teuthology.orchestra.run.smithi114.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-28T13:06:13.266 INFO:teuthology.orchestra.run.smithi114.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-28T13:06:13.266 INFO:teuthology.orchestra.run.smithi114.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-28T13:06:13.266 INFO:teuthology.orchestra.run.smithi114.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-28T13:06:13.266 INFO:teuthology.orchestra.run.smithi114.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-28T13:06:13.266 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-28T13:06:13.266 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:13.266 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:13.266 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:13.266 INFO:teuthology.orchestra.run.smithi114.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-28T13:06:13.266 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-28T13:06:13.266 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-28T13:06:13.266 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-28T13:06:13.267 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-28T13:06:13.267 INFO:teuthology.orchestra.run.smithi114.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-28T13:06:13.267 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-28T13:06:13.267 INFO:teuthology.orchestra.run.smithi114.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-28T13:06:13.267 INFO:teuthology.orchestra.run.smithi114.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-28T13:06:13.267 INFO:teuthology.orchestra.run.smithi114.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-28T13:06:13.267 INFO:teuthology.orchestra.run.smithi114.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-28T13:06:13.267 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-28T13:06:13.267 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-28T13:06:13.267 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-28T13:06:13.267 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-28T13:06:13.268 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-28T13:06:13.268 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-28T13:06:13.268 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-28T13:06:13.268 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-28T13:06:13.268 INFO:teuthology.orchestra.run.smithi114.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-28T13:06:13.268 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-28T13:06:13.268 INFO:teuthology.orchestra.run.smithi114.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-28T13:06:13.268 INFO:teuthology.orchestra.run.smithi114.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-28T13:06:13.268 INFO:teuthology.orchestra.run.smithi114.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-28T13:06:13.268 INFO:teuthology.orchestra.run.smithi114.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-28T13:06:13.268 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-28T13:06:13.268 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-28T13:06:13.268 INFO:teuthology.orchestra.run.smithi114.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-28T13:06:13.268 INFO:teuthology.orchestra.run.smithi114.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-28T13:06:13.268 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-28T13:06:13.269 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ply-3.11-14.el9.noarch 2024-04-28T13:06:13.269 INFO:teuthology.orchestra.run.smithi114.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-28T13:06:13.269 INFO:teuthology.orchestra.run.smithi114.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-28T13:06:13.269 INFO:teuthology.orchestra.run.smithi114.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-28T13:06:13.269 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-28T13:06:13.269 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-28T13:06:13.269 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-28T13:06:13.269 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-28T13:06:13.269 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-28T13:06:13.269 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-28T13:06:13.269 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:13.269 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:13.269 INFO:teuthology.orchestra.run.smithi114.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-28T13:06:13.269 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-28T13:06:13.270 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-28T13:06:13.270 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:13.270 INFO:teuthology.orchestra.run.smithi114.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-28T13:06:13.270 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-28T13:06:13.270 INFO:teuthology.orchestra.run.smithi114.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-28T13:06:13.270 INFO:teuthology.orchestra.run.smithi114.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-28T13:06:13.270 INFO:teuthology.orchestra.run.smithi114.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-28T13:06:13.270 INFO:teuthology.orchestra.run.smithi114.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-28T13:06:13.270 INFO:teuthology.orchestra.run.smithi114.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-28T13:06:13.270 INFO:teuthology.orchestra.run.smithi114.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-28T13:06:13.270 INFO:teuthology.orchestra.run.smithi114.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-28T13:06:13.270 INFO:teuthology.orchestra.run.smithi114.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-28T13:06:13.270 INFO:teuthology.orchestra.run.smithi114.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-28T13:06:13.270 INFO:teuthology.orchestra.run.smithi114.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-28T13:06:13.271 INFO:teuthology.orchestra.run.smithi114.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-28T13:06:13.271 INFO:teuthology.orchestra.run.smithi114.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-28T13:06:13.271 INFO:teuthology.orchestra.run.smithi114.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-28T13:06:13.271 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:13.271 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:13.271 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:13.271 INFO:teuthology.orchestra.run.smithi114.stdout: re2-1:20211101-3.el9.x86_64 2024-04-28T13:06:13.271 INFO:teuthology.orchestra.run.smithi114.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-28T13:06:13.271 INFO:teuthology.orchestra.run.smithi114.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-28T13:06:13.271 INFO:teuthology.orchestra.run.smithi114.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-28T13:06:13.271 INFO:teuthology.orchestra.run.smithi114.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-28T13:06:13.271 INFO:teuthology.orchestra.run.smithi114.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-28T13:06:13.272 INFO:teuthology.orchestra.run.smithi114.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-28T13:06:13.272 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:06:13.272 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-04-28T13:06:13.648 DEBUG:teuthology.parallel:result is None 2024-04-28T13:06:15.457 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-28T13:06:15.458 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 1/156 2024-04-28T13:06:15.458 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2/156 2024-04-28T13:06:15.458 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 3/156 2024-04-28T13:06:15.458 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 4/156 2024-04-28T13:06:15.458 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 5/156 2024-04-28T13:06:15.458 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 6/156 2024-04-28T13:06:15.458 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 7/156 2024-04-28T13:06:15.458 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-28T13:06:15.458 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-28T13:06:15.458 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/156 2024-04-28T13:06:15.459 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 11/156 2024-04-28T13:06:15.459 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 12/156 2024-04-28T13:06:15.459 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-28T13:06:15.459 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 14/156 2024-04-28T13:06:15.459 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 15/156 2024-04-28T13:06:15.459 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 16/156 2024-04-28T13:06:15.459 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 17/156 2024-04-28T13:06:15.459 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 18/156 2024-04-28T13:06:15.459 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 19/156 2024-04-28T13:06:15.459 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 20/156 2024-04-28T13:06:15.459 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 21/156 2024-04-28T13:06:15.459 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 22/156 2024-04-28T13:06:15.459 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 23/156 2024-04-28T13:06:15.460 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 24/156 2024-04-28T13:06:15.460 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 25/156 2024-04-28T13:06:15.460 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 26/156 2024-04-28T13:06:15.460 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 27/156 2024-04-28T13:06:15.460 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 28/156 2024-04-28T13:06:15.460 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 29/156 2024-04-28T13:06:15.460 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 30/156 2024-04-28T13:06:15.461 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 31/156 2024-04-28T13:06:15.461 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 32/156 2024-04-28T13:06:15.461 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 33/156 2024-04-28T13:06:15.461 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 34/156 2024-04-28T13:06:15.461 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 35/156 2024-04-28T13:06:15.461 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 36/156 2024-04-28T13:06:15.461 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 37/156 2024-04-28T13:06:15.461 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 38/156 2024-04-28T13:06:15.462 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 39/156 2024-04-28T13:06:15.462 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-28T13:06:15.462 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-28T13:06:15.462 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-28T13:06:15.462 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-28T13:06:15.462 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-28T13:06:15.462 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-28T13:06:15.462 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-28T13:06:15.462 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-28T13:06:15.462 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-28T13:06:15.462 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-28T13:06:15.462 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-28T13:06:15.462 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-28T13:06:15.463 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-28T13:06:15.463 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-28T13:06:15.463 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-28T13:06:15.463 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-28T13:06:15.463 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-28T13:06:15.463 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-28T13:06:15.463 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-28T13:06:15.463 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-28T13:06:15.463 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-28T13:06:15.463 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-28T13:06:15.463 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-28T13:06:15.463 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-28T13:06:15.463 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-28T13:06:15.464 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-28T13:06:15.464 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-28T13:06:15.464 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-28T13:06:15.464 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-28T13:06:15.464 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-28T13:06:15.464 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-28T13:06:15.464 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-28T13:06:15.464 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-28T13:06:15.464 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-28T13:06:15.464 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-28T13:06:15.464 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-28T13:06:15.464 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-28T13:06:15.464 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-28T13:06:15.464 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-28T13:06:15.464 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-28T13:06:15.465 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-28T13:06:15.465 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-28T13:06:15.465 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-28T13:06:15.465 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-28T13:06:15.465 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-28T13:06:15.465 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-28T13:06:15.465 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-28T13:06:15.465 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-28T13:06:15.465 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-28T13:06:15.465 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-28T13:06:15.465 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-28T13:06:15.465 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-28T13:06:15.466 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-28T13:06:15.466 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-28T13:06:15.466 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-28T13:06:15.466 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-28T13:06:15.466 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-28T13:06:15.466 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-28T13:06:15.466 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-28T13:06:15.466 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-28T13:06:15.466 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-28T13:06:15.466 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-28T13:06:15.466 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-28T13:06:15.466 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-28T13:06:15.466 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-28T13:06:15.467 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-28T13:06:15.467 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-28T13:06:15.467 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-28T13:06:15.467 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-28T13:06:15.467 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-28T13:06:15.467 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-28T13:06:15.467 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-28T13:06:15.467 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-28T13:06:15.467 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-28T13:06:15.467 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-28T13:06:15.467 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-28T13:06:15.467 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-28T13:06:15.467 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-28T13:06:15.468 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-28T13:06:15.468 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-28T13:06:15.468 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-28T13:06:15.468 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-28T13:06:15.468 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-28T13:06:15.468 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-28T13:06:15.468 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-28T13:06:15.468 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-28T13:06:15.468 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-28T13:06:15.468 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-28T13:06:15.468 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-28T13:06:15.468 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-28T13:06:15.468 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-28T13:06:15.468 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-28T13:06:15.468 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-28T13:06:15.469 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-28T13:06:15.469 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-28T13:06:15.469 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-28T13:06:15.469 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-28T13:06:15.469 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-28T13:06:15.469 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-28T13:06:15.469 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-28T13:06:15.469 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-28T13:06:15.469 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-28T13:06:15.469 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-28T13:06:15.469 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-28T13:06:15.469 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-28T13:06:15.470 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-28T13:06:15.470 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-28T13:06:15.470 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-28T13:06:15.470 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-28T13:06:15.470 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 149/156 2024-04-28T13:06:15.470 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-28T13:06:15.470 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 151/156 2024-04-28T13:06:15.470 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-28T13:06:15.470 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-28T13:06:15.470 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-28T13:06:15.470 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-28T13:06:17.566 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-28T13:06:17.567 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:17.567 INFO:teuthology.orchestra.run.smithi134.stdout:Upgraded: 2024-04-28T13:06:17.567 INFO:teuthology.orchestra.run.smithi134.stdout: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:17.567 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:17.567 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-28T13:06:17.567 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-28T13:06:17.567 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-28T13:06:17.567 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-28T13:06:17.567 INFO:teuthology.orchestra.run.smithi134.stdout: automake-1.16.2-8.el9.noarch 2024-04-28T13:06:17.568 INFO:teuthology.orchestra.run.smithi134.stdout: bison-3.7.4-5.el9.x86_64 2024-04-28T13:06:17.568 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-28T13:06:17.568 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:17.568 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:17.568 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:17.568 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:17.568 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-28T13:06:17.568 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:17.568 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:17.568 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:17.568 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-28T13:06:17.568 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-28T13:06:17.568 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-28T13:06:17.568 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-28T13:06:17.568 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-28T13:06:17.569 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:17.569 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:17.569 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-28T13:06:17.569 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:17.569 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:17.569 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:17.569 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-28T13:06:17.569 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-28T13:06:17.569 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:17.569 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:17.569 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-28T13:06:17.569 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-28T13:06:17.569 INFO:teuthology.orchestra.run.smithi134.stdout: flex-2.6.4-9.el9.x86_64 2024-04-28T13:06:17.569 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-28T13:06:17.570 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-28T13:06:17.570 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-28T13:06:17.570 INFO:teuthology.orchestra.run.smithi134.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-28T13:06:17.570 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-28T13:06:17.570 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-28T13:06:17.570 INFO:teuthology.orchestra.run.smithi134.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-28T13:06:17.570 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-28T13:06:17.570 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-28T13:06:17.570 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:17.570 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:17.570 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:17.570 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-28T13:06:17.570 INFO:teuthology.orchestra.run.smithi134.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-28T13:06:17.571 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-28T13:06:17.571 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-28T13:06:17.571 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-28T13:06:17.571 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:17.571 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:17.571 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-28T13:06:17.571 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:17.571 INFO:teuthology.orchestra.run.smithi134.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-28T13:06:17.571 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-28T13:06:17.571 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-28T13:06:17.571 INFO:teuthology.orchestra.run.smithi134.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-28T13:06:17.571 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-28T13:06:17.571 INFO:teuthology.orchestra.run.smithi134.stdout: lua-5.4.4-4.el9.x86_64 2024-04-28T13:06:17.571 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-28T13:06:17.572 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-28T13:06:17.572 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-28T13:06:17.572 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-28T13:06:17.572 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-28T13:06:17.572 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-28T13:06:17.572 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-13.14-1.el9.x86_64 2024-04-28T13:06:17.572 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-28T13:06:17.572 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-28T13:06:17.572 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-28T13:06:17.572 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-28T13:06:17.572 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-28T13:06:17.572 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-28T13:06:17.572 INFO:teuthology.orchestra.run.smithi134.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-28T13:06:17.572 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-28T13:06:17.572 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-28T13:06:17.573 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-28T13:06:17.573 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:17.573 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:17.573 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:17.573 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-28T13:06:17.573 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-28T13:06:17.573 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-28T13:06:17.573 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-28T13:06:17.573 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-28T13:06:17.573 INFO:teuthology.orchestra.run.smithi134.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-28T13:06:17.573 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-28T13:06:17.573 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-28T13:06:17.573 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-28T13:06:17.573 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-28T13:06:17.574 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-28T13:06:17.574 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-28T13:06:17.574 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-28T13:06:17.574 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-28T13:06:17.574 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-28T13:06:17.574 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-28T13:06:17.574 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-28T13:06:17.574 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-28T13:06:17.574 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-28T13:06:17.574 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-28T13:06:17.574 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-28T13:06:17.574 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-28T13:06:17.574 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-28T13:06:17.574 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-28T13:06:17.575 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-28T13:06:17.575 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-28T13:06:17.575 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-28T13:06:17.575 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-28T13:06:17.575 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-28T13:06:17.575 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-28T13:06:17.575 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply-3.11-14.el9.noarch 2024-04-28T13:06:17.575 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-28T13:06:17.575 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-28T13:06:17.575 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-28T13:06:17.575 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-28T13:06:17.575 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-28T13:06:17.575 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-28T13:06:17.575 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-28T13:06:17.575 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-28T13:06:17.576 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-28T13:06:17.576 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:17.576 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:17.576 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-28T13:06:17.576 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-28T13:06:17.576 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-28T13:06:17.576 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:17.576 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-28T13:06:17.576 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-28T13:06:17.576 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-28T13:06:17.576 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-28T13:06:17.576 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-28T13:06:17.576 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-28T13:06:17.576 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-28T13:06:17.577 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-28T13:06:17.577 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-28T13:06:17.577 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-28T13:06:17.577 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-28T13:06:17.577 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-28T13:06:17.577 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-28T13:06:17.577 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-28T13:06:17.577 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-28T13:06:17.577 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:17.577 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:17.577 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-28T13:06:17.577 INFO:teuthology.orchestra.run.smithi134.stdout: re2-1:20211101-3.el9.x86_64 2024-04-28T13:06:17.577 INFO:teuthology.orchestra.run.smithi134.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-28T13:06:17.577 INFO:teuthology.orchestra.run.smithi134.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-28T13:06:17.578 INFO:teuthology.orchestra.run.smithi134.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-28T13:06:17.578 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-28T13:06:17.578 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-28T13:06:17.578 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-28T13:06:17.578 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:17.578 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-28T13:06:17.995 DEBUG:teuthology.parallel:result is None 2024-04-28T13:06:17.996 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-28T13:06:18.142 DEBUG:teuthology.orchestra.run.smithi114:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-28T13:06:18.167 INFO:teuthology.orchestra.run.smithi114.stdout:19.0.0-3306.gbc612ffb.el9 2024-04-28T13:06:18.168 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306.gbc612ffb.el9 2024-04-28T13:06:18.168 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306.gbc612ffb is installed. 2024-04-28T13:06:18.169 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-28T13:06:18.382 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-28T13:06:18.403 INFO:teuthology.orchestra.run.smithi134.stdout:19.0.0-3306.gbc612ffb.el9 2024-04-28T13:06:18.403 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306.gbc612ffb.el9 2024-04-28T13:06:18.403 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306.gbc612ffb is installed. 2024-04-28T13:06:18.405 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-28T13:06:18.405 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:06:18.405 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-28T13:06:18.436 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:06:18.436 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-28T13:06:18.468 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-28T13:06:18.468 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:06:18.468 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/daemon-helper 2024-04-28T13:06:18.505 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-28T13:06:18.572 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:06:18.572 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2024-04-28T13:06:18.595 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-28T13:06:18.660 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-28T13:06:18.660 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:06:18.660 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-28T13:06:18.686 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-28T13:06:18.752 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:06:18.752 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-28T13:06:18.775 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-28T13:06:18.839 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-28T13:06:18.839 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:06:18.839 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/stdin-killer 2024-04-28T13:06:18.864 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-28T13:06:18.929 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:06:18.929 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2024-04-28T13:06:18.952 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-28T13:06:19.017 INFO:teuthology.run_tasks:Running task ceph... 2024-04-28T13:06:19.097 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-28T13:06:19.097 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 777 /var/log/ceph 2024-04-28T13:06:19.100 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /var/log/ceph 2024-04-28T13:06:19.123 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-28T13:06:19.123 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-28T13:06:19.164 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-28T13:06:19.188 INFO:tasks.ceph:Creating extra log directories... 2024-04-28T13:06:19.188 DEBUG:teuthology.orchestra.run.smithi114:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-28T13:06:19.229 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-28T13:06:19.261 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-28T13:06:19.261 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-28T13:06:19.261 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-28T13:06:19.261 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:06:19.261 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-28T13:06:19.307 DEBUG:teuthology.orchestra.run.smithi114:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-28T13:06:19.415 DEBUG:teuthology.orchestra.run.smithi114:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-28T13:06:19.453 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:06:19.453 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-28T13:06:19.468 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-28T13:06:19.573 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-28T13:06:19.621 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-28T13:06:19.621 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-28T13:06:19.621 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-04-28_11:41:23-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7676903', 'branch': 'wip-rishabh-testing-20240426.111959', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/snapshot}}', 'email': None, 'first_in_suite': False, 'job_id': '7676903', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-04-28_11:41:23-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240426.111959'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240426.111959', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 816, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'sleep_before_teardown': 0, 'subset': '166/512', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240426.111959', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi114.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJW8/xUg2phVQuZKJ6zxnUCCEvu3UkXP4Q5NpOcdX7kLLPEh7FgjHVMSipey708EzT2bWSrG9StTm3L4GSFpbhw=', 'smithi134.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCyN4A9RIl0Tq4nbnDumkiYtli8aUlGNzMxUsDvbiQXoX+gUmp9QipYi/CZJY5YAMqoDxVy1T4iXWJPJx4lUzcA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots', 'tasks.cephfs.test_volumes.TestSubvolumeSnapshots']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-28_11:41:23', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-28T13:06:19.622 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-28T13:06:19.624 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-28T13:06:19.671 DEBUG:teuthology.orchestra.run.smithi114:> sudo install -d -m0777 -- /var/run/ceph 2024-04-28T13:06:19.678 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/run/ceph 2024-04-28T13:06:19.734 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:06:19.734 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/scratch_devs of=/dev/stdout 2024-04-28T13:06:19.754 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-28T13:06:19.754 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_1 2024-04-28T13:06:19.808 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-28T13:06:19.808 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-28T13:06:19.808 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-28T13:06:19.808 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-28T13:06:19.808 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2024-04-28T13:06:19.809 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-04-28 13:06:05.609275949 +0000 2024-04-28T13:06:19.809 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-04-28 13:04:26.001280763 +0000 2024-04-28T13:06:19.809 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-04-28 13:04:26.001280763 +0000 2024-04-28T13:06:19.809 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-04-28 13:04:26.001280763 +0000 2024-04-28T13:06:19.809 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-28T13:06:19.870 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-04-28T13:06:19.870 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-04-28T13:06:19.870 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000240224 s, 2.1 MB/s 2024-04-28T13:06:19.871 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-28T13:06:19.926 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_2 2024-04-28T13:06:19.982 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-28T13:06:19.982 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-28T13:06:19.982 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-28T13:06:19.982 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-28T13:06:19.982 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2024-04-28T13:06:19.982 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-04-28 13:06:05.610275927 +0000 2024-04-28T13:06:19.983 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-04-28 13:04:26.347273175 +0000 2024-04-28T13:06:19.983 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-04-28 13:04:26.347273175 +0000 2024-04-28T13:06:19.983 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-04-28 13:04:26.347273175 +0000 2024-04-28T13:06:19.983 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-28T13:06:20.043 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-04-28T13:06:20.043 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-04-28T13:06:20.043 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000207517 s, 2.5 MB/s 2024-04-28T13:06:20.045 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-28T13:06:20.100 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_3 2024-04-28T13:06:20.155 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-28T13:06:20.155 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-28T13:06:20.155 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-04-28T13:06:20.155 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-28T13:06:20.155 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2024-04-28T13:06:20.155 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-04-28 13:06:05.610275927 +0000 2024-04-28T13:06:20.155 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-04-28 13:04:26.686265745 +0000 2024-04-28T13:06:20.155 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-04-28 13:04:26.686265745 +0000 2024-04-28T13:06:20.155 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-04-28 13:04:26.686265745 +0000 2024-04-28T13:06:20.156 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-28T13:06:20.216 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-04-28T13:06:20.217 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-04-28T13:06:20.217 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000227001 s, 2.3 MB/s 2024-04-28T13:06:20.218 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-28T13:06:20.273 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_4 2024-04-28T13:06:20.327 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-28T13:06:20.328 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-28T13:06:20.328 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-04-28T13:06:20.328 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-28T13:06:20.328 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2024-04-28T13:06:20.328 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-04-28 13:06:05.610275927 +0000 2024-04-28T13:06:20.328 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-04-28 13:04:27.033258140 +0000 2024-04-28T13:06:20.328 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-04-28 13:04:27.033258140 +0000 2024-04-28T13:06:20.328 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-04-28 13:04:27.033258140 +0000 2024-04-28T13:06:20.329 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-28T13:06:20.390 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-04-28T13:06:20.390 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-04-28T13:06:20.390 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000169662 s, 3.0 MB/s 2024-04-28T13:06:20.391 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-28T13:06:20.446 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-28T13:06:20.446 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:06:20.446 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2024-04-28T13:06:20.462 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-28T13:06:20.462 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2024-04-28T13:06:20.517 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-28T13:06:20.518 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-28T13:06:20.518 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-28T13:06:20.518 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-28T13:06:20.518 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-04-28T13:06:20.518 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-04-28 13:06:09.925998614 +0000 2024-04-28T13:06:20.518 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-04-28 13:04:25.997854820 +0000 2024-04-28T13:06:20.518 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-04-28 13:04:25.997854820 +0000 2024-04-28T13:06:20.518 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-04-28 13:04:25.997854820 +0000 2024-04-28T13:06:20.518 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-28T13:06:20.580 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-04-28T13:06:20.580 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-04-28T13:06:20.581 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000245118 s, 2.1 MB/s 2024-04-28T13:06:20.582 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-28T13:06:20.637 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2024-04-28T13:06:20.691 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-28T13:06:20.691 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-28T13:06:20.691 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-28T13:06:20.691 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-28T13:06:20.691 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-04-28T13:06:20.691 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-04-28 13:06:09.925998614 +0000 2024-04-28T13:06:20.691 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-04-28 13:04:26.343845210 +0000 2024-04-28T13:06:20.692 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-04-28 13:04:26.343845210 +0000 2024-04-28T13:06:20.692 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-04-28 13:04:26.343845210 +0000 2024-04-28T13:06:20.692 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-28T13:06:20.753 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-04-28T13:06:20.754 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-04-28T13:06:20.754 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000209798 s, 2.4 MB/s 2024-04-28T13:06:20.755 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-28T13:06:20.812 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2024-04-28T13:06:20.866 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-28T13:06:20.866 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-28T13:06:20.866 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-28T13:06:20.867 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-28T13:06:20.867 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-04-28T13:06:20.867 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-04-28 13:06:09.926998589 +0000 2024-04-28T13:06:20.867 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-04-28 13:04:26.673836044 +0000 2024-04-28T13:06:20.867 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-04-28 13:04:26.673836044 +0000 2024-04-28T13:06:20.867 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-04-28 13:04:26.673836044 +0000 2024-04-28T13:06:20.867 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-28T13:06:20.928 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-04-28T13:06:20.928 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-04-28T13:06:20.928 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000188871 s, 2.7 MB/s 2024-04-28T13:06:20.930 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-28T13:06:20.985 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2024-04-28T13:06:21.039 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-28T13:06:21.039 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-28T13:06:21.039 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-28T13:06:21.039 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-28T13:06:21.039 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-04-28T13:06:21.039 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-04-28 13:06:09.926998589 +0000 2024-04-28T13:06:21.040 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-04-28 13:04:27.028826184 +0000 2024-04-28T13:06:21.040 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-04-28 13:04:27.028826184 +0000 2024-04-28T13:06:21.040 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-04-28 13:04:27.028826184 +0000 2024-04-28T13:06:21.040 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-28T13:06:21.101 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-04-28T13:06:21.101 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-04-28T13:06:21.101 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.00019048 s, 2.7 MB/s 2024-04-28T13:06:21.103 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-28T13:06:21.158 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-28T13:06:21.158 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi114.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-28T13:06:21.158 INFO:tasks.ceph:Generating config... 2024-04-28T13:06:21.159 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-28T13:06:21.159 INFO:tasks.ceph:[client] debug client = 20 2024-04-28T13:06:21.159 INFO:tasks.ceph:[client] debug ms = 1 2024-04-28T13:06:21.159 INFO:tasks.ceph:[client] pid file = 2024-04-28T13:06:21.159 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-28T13:06:21.159 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-28T13:06:21.159 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-28T13:06:21.159 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-28T13:06:21.159 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-28T13:06:21.159 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-28T13:06:21.160 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-28T13:06:21.160 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-28T13:06:21.160 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-28T13:06:21.160 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-28T13:06:21.160 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-28T13:06:21.160 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-28T13:06:21.160 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-28T13:06:21.160 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-28T13:06:21.160 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-04-28T13:06:21.160 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-28T13:06:21.160 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-28T13:06:21.160 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-28T13:06:21.160 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-28T13:06:21.160 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-28T13:06:21.161 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-28T13:06:21.161 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-28T13:06:21.161 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-28T13:06:21.161 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-28T13:06:21.161 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-28T13:06:21.161 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-28T13:06:21.161 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-28T13:06:21.161 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-28T13:06:21.161 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-28T13:06:21.161 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-28T13:06:21.161 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-28T13:06:21.161 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-28T13:06:21.162 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-28T13:06:21.162 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-28T13:06:21.162 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-28T13:06:21.162 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-28T13:06:21.162 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-28T13:06:21.162 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-28T13:06:21.162 INFO:tasks.ceph:Setting up mon.a... 2024-04-28T13:06:21.162 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-28T13:06:21.211 INFO:teuthology.orchestra.run.smithi114.stdout:creating /etc/ceph/ceph.keyring 2024-04-28T13:06:21.214 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-28T13:06:21.256 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-28T13:06:21.320 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.114'), ('mon.b', '172.21.15.134'), ('mon.c', '[v2:172.21.15.134:3301,v1:172.21.15.134:6790]')] 2024-04-28T13:06:21.321 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.114,172.21.15.134,[v2:172.21.15.134:3301,v1:172.21.15.134:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-28T13:06:21.322 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:06:21.322 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-28T13:06:21.376 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.114 --add b 172.21.15.134 --addv c '[v2:172.21.15.134:3301,v1:172.21.15.134:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-28T13:06:21.461 INFO:teuthology.orchestra.run.smithi114.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-28T13:06:21.461 INFO:teuthology.orchestra.run.smithi114.stdout:monmaptool: generated fsid 0961cca0-69c8-4b26-b89a-621e12152fc4 2024-04-28T13:06:21.461 INFO:teuthology.orchestra.run.smithi114.stdout:setting min_mon_release = quincy 2024-04-28T13:06:21.461 INFO:teuthology.orchestra.run.smithi114.stdout:epoch 0 2024-04-28T13:06:21.461 INFO:teuthology.orchestra.run.smithi114.stdout:fsid 0961cca0-69c8-4b26-b89a-621e12152fc4 2024-04-28T13:06:21.461 INFO:teuthology.orchestra.run.smithi114.stdout:last_changed 2024-04-28T13:06:21.462300+0000 2024-04-28T13:06:21.461 INFO:teuthology.orchestra.run.smithi114.stdout:created 2024-04-28T13:06:21.462300+0000 2024-04-28T13:06:21.462 INFO:teuthology.orchestra.run.smithi114.stdout:min_mon_release 17 (quincy) 2024-04-28T13:06:21.462 INFO:teuthology.orchestra.run.smithi114.stdout:election_strategy: 1 2024-04-28T13:06:21.462 INFO:teuthology.orchestra.run.smithi114.stdout:0: [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] mon.a 2024-04-28T13:06:21.462 INFO:teuthology.orchestra.run.smithi114.stdout:1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.b 2024-04-28T13:06:21.462 INFO:teuthology.orchestra.run.smithi114.stdout:2: [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] mon.c 2024-04-28T13:06:21.462 INFO:teuthology.orchestra.run.smithi114.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-28T13:06:21.463 DEBUG:teuthology.orchestra.run.smithi114:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-28T13:06:21.477 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0961cca0-69c8-4b26-b89a-621e12152fc4... 2024-04-28T13:06:21.478 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-28T13:06:21.520 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-28T13:06:21.557 INFO:teuthology.orchestra.run.smithi114.stdout:[global] 2024-04-28T13:06:21.557 INFO:teuthology.orchestra.run.smithi114.stdout: chdir = "" 2024-04-28T13:06:21.557 INFO:teuthology.orchestra.run.smithi114.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-28T13:06:21.557 INFO:teuthology.orchestra.run.smithi114.stdout: auth supported = cephx 2024-04-28T13:06:21.557 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:06:21.557 INFO:teuthology.orchestra.run.smithi114.stdout: filestore xattr use omap = true 2024-04-28T13:06:21.557 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:06:21.558 INFO:teuthology.orchestra.run.smithi114.stdout: mon clock drift allowed = 1.000 2024-04-28T13:06:21.558 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:06:21.558 INFO:teuthology.orchestra.run.smithi114.stdout: osd crush chooseleaf type = 0 2024-04-28T13:06:21.558 INFO:teuthology.orchestra.run.smithi114.stdout: auth debug = true 2024-04-28T13:06:21.558 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:06:21.558 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on old message = true 2024-04-28T13:06:21.558 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on bug = true 2024-04-28T13:06:21.558 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:06:21.558 INFO:teuthology.orchestra.run.smithi114.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-28T13:06:21.558 INFO:teuthology.orchestra.run.smithi114.stdout: mon pg warn max object skew = 0 2024-04-28T13:06:21.558 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:06:21.558 INFO:teuthology.orchestra.run.smithi114.stdout: # disable pg_autoscaler by default for new pools 2024-04-28T13:06:21.558 INFO:teuthology.orchestra.run.smithi114.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-28T13:06:21.558 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:06:21.559 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default size = 2 2024-04-28T13:06:21.559 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:06:21.559 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow primary affinity = true 2024-04-28T13:06:21.559 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow pg remap = true 2024-04-28T13:06:21.559 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on legacy crush tunables = false 2024-04-28T13:06:21.559 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on crush straw calc version zero = false 2024-04-28T13:06:21.559 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on no sortbitwise = false 2024-04-28T13:06:21.559 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on osd down out interval zero = false 2024-04-28T13:06:21.559 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on too few osds = false 2024-04-28T13:06:21.559 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-28T13:06:21.559 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-28T13:06:21.559 INFO:teuthology.orchestra.run.smithi114.stdout: mon_allow_pool_size_one = true 2024-04-28T13:06:21.559 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:06:21.559 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-28T13:06:21.559 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:06:21.560 INFO:teuthology.orchestra.run.smithi114.stdout: osd default data pool replay window = 5 2024-04-28T13:06:21.560 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:06:21.560 INFO:teuthology.orchestra.run.smithi114.stdout: mon allow pool delete = true 2024-04-28T13:06:21.560 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:06:21.560 INFO:teuthology.orchestra.run.smithi114.stdout: mon cluster log file level = debug 2024-04-28T13:06:21.560 INFO:teuthology.orchestra.run.smithi114.stdout: debug asserts on shutdown = true 2024-04-28T13:06:21.560 INFO:teuthology.orchestra.run.smithi114.stdout: mon health detail to clog = false 2024-04-28T13:06:21.560 INFO:teuthology.orchestra.run.smithi114.stdout: mon host = "172.21.15.114,172.21.15.134,[v2:172.21.15.134:3301,v1:172.21.15.134:6790]" 2024-04-28T13:06:21.560 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on skipped message = False 2024-04-28T13:06:21.560 INFO:teuthology.orchestra.run.smithi114.stdout: fsid = 0961cca0-69c8-4b26-b89a-621e12152fc4 2024-04-28T13:06:21.560 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:06:21.560 INFO:teuthology.orchestra.run.smithi114.stdout:[osd] 2024-04-28T13:06:21.560 INFO:teuthology.orchestra.run.smithi114.stdout: osd journal size = 100 2024-04-28T13:06:21.560 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:06:21.560 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub load threshold = 5.0 2024-04-28T13:06:21.560 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub max interval = 600 2024-04-28T13:06:21.561 INFO:teuthology.orchestra.run.smithi114.stdout: osd mclock profile = high_recovery_ops 2024-04-28T13:06:21.561 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:06:21.561 INFO:teuthology.orchestra.run.smithi114.stdout: osd recover clone overlap = true 2024-04-28T13:06:21.561 INFO:teuthology.orchestra.run.smithi114.stdout: osd recovery max chunk = 1048576 2024-04-28T13:06:21.561 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:06:21.561 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug shutdown = true 2024-04-28T13:06:21.561 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug op order = true 2024-04-28T13:06:21.561 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug verify stray on activate = true 2024-04-28T13:06:21.561 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug trim objects = true 2024-04-28T13:06:21.561 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:06:21.561 INFO:teuthology.orchestra.run.smithi114.stdout: osd open classes on start = true 2024-04-28T13:06:21.561 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug pg log writeout = true 2024-04-28T13:06:21.561 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:06:21.561 INFO:teuthology.orchestra.run.smithi114.stdout: osd deep scrub update digest min age = 30 2024-04-28T13:06:21.562 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:06:21.562 INFO:teuthology.orchestra.run.smithi114.stdout: osd map max advance = 10 2024-04-28T13:06:21.562 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:06:21.562 INFO:teuthology.orchestra.run.smithi114.stdout: journal zero on create = true 2024-04-28T13:06:21.562 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:06:21.562 INFO:teuthology.orchestra.run.smithi114.stdout: filestore ondisk finisher threads = 3 2024-04-28T13:06:21.562 INFO:teuthology.orchestra.run.smithi114.stdout: filestore apply finisher threads = 3 2024-04-28T13:06:21.562 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:06:21.562 INFO:teuthology.orchestra.run.smithi114.stdout: bdev debug aio = true 2024-04-28T13:06:21.562 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug misdirected ops = true 2024-04-28T13:06:21.562 INFO:teuthology.orchestra.run.smithi114.stdout: bdev async discard = True 2024-04-28T13:06:21.562 INFO:teuthology.orchestra.run.smithi114.stdout: bdev enable discard = True 2024-04-28T13:06:21.562 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore allocator = bitmap 2024-04-28T13:06:21.562 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore block size = 96636764160 2024-04-28T13:06:21.562 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore fsck on mount = True 2024-04-28T13:06:21.563 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluefs = 1/20 2024-04-28T13:06:21.563 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluestore = 1/20 2024-04-28T13:06:21.563 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-04-28T13:06:21.563 INFO:teuthology.orchestra.run.smithi114.stdout: debug osd = 20 2024-04-28T13:06:21.563 INFO:teuthology.orchestra.run.smithi114.stdout: debug rocksdb = 4/10 2024-04-28T13:06:21.563 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd backfillfull_ratio = 0.85 2024-04-28T13:06:21.563 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd full ratio = 0.9 2024-04-28T13:06:21.563 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd nearfull ratio = 0.8 2024-04-28T13:06:21.563 INFO:teuthology.orchestra.run.smithi114.stdout: osd failsafe full ratio = 0.95 2024-04-28T13:06:21.563 INFO:teuthology.orchestra.run.smithi114.stdout: osd objectstore = bluestore 2024-04-28T13:06:21.563 INFO:teuthology.orchestra.run.smithi114.stdout: osd op complaint time = 180 2024-04-28T13:06:21.563 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:06:21.563 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr] 2024-04-28T13:06:21.563 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-04-28T13:06:21.563 INFO:teuthology.orchestra.run.smithi114.stdout: debug mgr = 20 2024-04-28T13:06:21.564 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2024-04-28T13:06:21.564 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2024-04-28T13:06:21.564 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2024-04-28T13:06:21.564 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2024-04-28T13:06:21.564 INFO:teuthology.orchestra.run.smithi114.stdout: mgr/telemetry/nag = false 2024-04-28T13:06:21.564 INFO:teuthology.orchestra.run.smithi114.stdout: debug client = 20 2024-04-28T13:06:21.564 INFO:teuthology.orchestra.run.smithi114.stdout: debug finisher = 20 2024-04-28T13:06:21.564 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:06:21.564 INFO:teuthology.orchestra.run.smithi114.stdout:[mon] 2024-04-28T13:06:21.564 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-04-28T13:06:21.564 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2024-04-28T13:06:21.564 INFO:teuthology.orchestra.run.smithi114.stdout: debug paxos = 20 2024-04-28T13:06:21.564 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2024-04-28T13:06:21.564 INFO:teuthology.orchestra.run.smithi114.stdout: mon data avail warn = 5 2024-04-28T13:06:21.564 INFO:teuthology.orchestra.run.smithi114.stdout: mon mgr mkfs grace = 240 2024-04-28T13:06:21.564 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2024-04-28T13:06:21.565 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd reporter subtree level = osd 2024-04-28T13:06:21.565 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd prime pg temp = true 2024-04-28T13:06:21.565 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2024-04-28T13:06:21.565 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:06:21.565 INFO:teuthology.orchestra.run.smithi114.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-28T13:06:21.565 INFO:teuthology.orchestra.run.smithi114.stdout: auth mon ticket ttl = 660 # 11m 2024-04-28T13:06:21.565 INFO:teuthology.orchestra.run.smithi114.stdout: auth service ticket ttl = 240 # 4m 2024-04-28T13:06:21.565 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:06:21.565 INFO:teuthology.orchestra.run.smithi114.stdout: # don't complain about insecure global_id in the test suite 2024-04-28T13:06:21.565 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-28T13:06:21.565 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-28T13:06:21.565 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:06:21.565 INFO:teuthology.orchestra.run.smithi114.stdout: # 1m isn't quite enough 2024-04-28T13:06:21.565 INFO:teuthology.orchestra.run.smithi114.stdout: mon_down_mkfs_grace = 2m 2024-04-28T13:06:21.565 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:06:21.566 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_filestore_osds = false 2024-04-28T13:06:21.566 INFO:teuthology.orchestra.run.smithi114.stdout: mon down mkfs grace = 300 2024-04-28T13:06:21.566 INFO:teuthology.orchestra.run.smithi114.stdout: mon op complaint time = 120 2024-04-28T13:06:21.566 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:06:21.566 INFO:teuthology.orchestra.run.smithi114.stdout:[client] 2024-04-28T13:06:21.566 INFO:teuthology.orchestra.run.smithi114.stdout: rgw cache enabled = true 2024-04-28T13:06:21.566 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable ops log = true 2024-04-28T13:06:21.566 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable usage log = true 2024-04-28T13:06:21.566 INFO:teuthology.orchestra.run.smithi114.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-28T13:06:21.566 INFO:teuthology.orchestra.run.smithi114.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-28T13:06:21.566 INFO:teuthology.orchestra.run.smithi114.stdout: client mount timeout = 600 2024-04-28T13:06:21.566 INFO:teuthology.orchestra.run.smithi114.stdout: debug client = 20 2024-04-28T13:06:21.566 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-04-28T13:06:21.566 INFO:teuthology.orchestra.run.smithi114.stdout: pid file = "" 2024-04-28T13:06:21.567 INFO:teuthology.orchestra.run.smithi114.stdout: rados mon op timeout = 900 2024-04-28T13:06:21.567 INFO:teuthology.orchestra.run.smithi114.stdout: rados osd op timeout = 900 2024-04-28T13:06:21.567 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.a] 2024-04-28T13:06:21.567 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.b] 2024-04-28T13:06:21.567 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.c] 2024-04-28T13:06:21.567 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.a] 2024-04-28T13:06:21.567 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.c] 2024-04-28T13:06:21.567 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.b] 2024-04-28T13:06:21.567 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.d] 2024-04-28T13:06:21.567 INFO:teuthology.orchestra.run.smithi114.stdout:[mds] 2024-04-28T13:06:21.567 INFO:teuthology.orchestra.run.smithi114.stdout: debug mds = 20 2024-04-28T13:06:21.567 INFO:teuthology.orchestra.run.smithi114.stdout: debug mds balancer = 20 2024-04-28T13:06:21.567 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-04-28T13:06:21.567 INFO:teuthology.orchestra.run.smithi114.stdout: mds debug frag = True 2024-04-28T13:06:21.567 INFO:teuthology.orchestra.run.smithi114.stdout: mds debug scatterstat = True 2024-04-28T13:06:21.567 INFO:teuthology.orchestra.run.smithi114.stdout: mds op complaint time = 180 2024-04-28T13:06:21.568 INFO:teuthology.orchestra.run.smithi114.stdout: mds verify scatter = True 2024-04-28T13:06:21.568 INFO:teuthology.orchestra.run.smithi114.stdout: osd op complaint time = 180 2024-04-28T13:06:21.568 INFO:teuthology.orchestra.run.smithi114.stdout: rados mon op timeout = 900 2024-04-28T13:06:21.568 INFO:teuthology.orchestra.run.smithi114.stdout: rados osd op timeout = 900 2024-04-28T13:06:21.568 INFO:teuthology.orchestra.run.smithi134.stdout:[global] 2024-04-28T13:06:21.568 INFO:teuthology.orchestra.run.smithi134.stdout: chdir = "" 2024-04-28T13:06:21.568 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-28T13:06:21.568 INFO:teuthology.orchestra.run.smithi134.stdout: auth supported = cephx 2024-04-28T13:06:21.568 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:21.569 INFO:teuthology.orchestra.run.smithi134.stdout: filestore xattr use omap = true 2024-04-28T13:06:21.569 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:21.569 INFO:teuthology.orchestra.run.smithi134.stdout: mon clock drift allowed = 1.000 2024-04-28T13:06:21.569 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:21.569 INFO:teuthology.orchestra.run.smithi134.stdout: osd crush chooseleaf type = 0 2024-04-28T13:06:21.569 INFO:teuthology.orchestra.run.smithi134.stdout: auth debug = true 2024-04-28T13:06:21.569 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:21.569 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on old message = true 2024-04-28T13:06:21.569 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on bug = true 2024-04-28T13:06:21.569 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:21.569 INFO:teuthology.orchestra.run.smithi134.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-28T13:06:21.569 INFO:teuthology.orchestra.run.smithi134.stdout: mon pg warn max object skew = 0 2024-04-28T13:06:21.569 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:21.569 INFO:teuthology.orchestra.run.smithi134.stdout: # disable pg_autoscaler by default for new pools 2024-04-28T13:06:21.569 INFO:teuthology.orchestra.run.smithi134.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-28T13:06:21.569 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:21.570 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default size = 2 2024-04-28T13:06:21.570 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:21.570 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow primary affinity = true 2024-04-28T13:06:21.570 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow pg remap = true 2024-04-28T13:06:21.570 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on legacy crush tunables = false 2024-04-28T13:06:21.570 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on crush straw calc version zero = false 2024-04-28T13:06:21.570 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on no sortbitwise = false 2024-04-28T13:06:21.570 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on osd down out interval zero = false 2024-04-28T13:06:21.570 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on too few osds = false 2024-04-28T13:06:21.570 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-28T13:06:21.570 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-28T13:06:21.570 INFO:teuthology.orchestra.run.smithi134.stdout: mon_allow_pool_size_one = true 2024-04-28T13:06:21.570 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:21.570 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-28T13:06:21.570 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:21.570 INFO:teuthology.orchestra.run.smithi134.stdout: osd default data pool replay window = 5 2024-04-28T13:06:21.571 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:21.571 INFO:teuthology.orchestra.run.smithi134.stdout: mon allow pool delete = true 2024-04-28T13:06:21.571 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:21.571 INFO:teuthology.orchestra.run.smithi134.stdout: mon cluster log file level = debug 2024-04-28T13:06:21.571 INFO:teuthology.orchestra.run.smithi134.stdout: debug asserts on shutdown = true 2024-04-28T13:06:21.571 INFO:teuthology.orchestra.run.smithi134.stdout: mon health detail to clog = false 2024-04-28T13:06:21.571 INFO:teuthology.orchestra.run.smithi134.stdout: mon host = "172.21.15.114,172.21.15.134,[v2:172.21.15.134:3301,v1:172.21.15.134:6790]" 2024-04-28T13:06:21.571 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on skipped message = False 2024-04-28T13:06:21.571 INFO:teuthology.orchestra.run.smithi134.stdout: fsid = 0961cca0-69c8-4b26-b89a-621e12152fc4 2024-04-28T13:06:21.571 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:21.571 INFO:teuthology.orchestra.run.smithi134.stdout:[osd] 2024-04-28T13:06:21.571 INFO:teuthology.orchestra.run.smithi134.stdout: osd journal size = 100 2024-04-28T13:06:21.571 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:21.571 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub load threshold = 5.0 2024-04-28T13:06:21.571 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub max interval = 600 2024-04-28T13:06:21.571 INFO:teuthology.orchestra.run.smithi134.stdout: osd mclock profile = high_recovery_ops 2024-04-28T13:06:21.571 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:21.572 INFO:teuthology.orchestra.run.smithi134.stdout: osd recover clone overlap = true 2024-04-28T13:06:21.572 INFO:teuthology.orchestra.run.smithi134.stdout: osd recovery max chunk = 1048576 2024-04-28T13:06:21.572 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:21.572 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug shutdown = true 2024-04-28T13:06:21.572 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug op order = true 2024-04-28T13:06:21.572 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug verify stray on activate = true 2024-04-28T13:06:21.572 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug trim objects = true 2024-04-28T13:06:21.572 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:21.572 INFO:teuthology.orchestra.run.smithi134.stdout: osd open classes on start = true 2024-04-28T13:06:21.572 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug pg log writeout = true 2024-04-28T13:06:21.572 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:21.572 INFO:teuthology.orchestra.run.smithi134.stdout: osd deep scrub update digest min age = 30 2024-04-28T13:06:21.572 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:21.572 INFO:teuthology.orchestra.run.smithi134.stdout: osd map max advance = 10 2024-04-28T13:06:21.572 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:21.572 INFO:teuthology.orchestra.run.smithi134.stdout: journal zero on create = true 2024-04-28T13:06:21.573 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:21.573 INFO:teuthology.orchestra.run.smithi134.stdout: filestore ondisk finisher threads = 3 2024-04-28T13:06:21.573 INFO:teuthology.orchestra.run.smithi134.stdout: filestore apply finisher threads = 3 2024-04-28T13:06:21.573 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:21.573 INFO:teuthology.orchestra.run.smithi134.stdout: bdev debug aio = true 2024-04-28T13:06:21.573 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug misdirected ops = true 2024-04-28T13:06:21.573 INFO:teuthology.orchestra.run.smithi134.stdout: bdev async discard = True 2024-04-28T13:06:21.573 INFO:teuthology.orchestra.run.smithi134.stdout: bdev enable discard = True 2024-04-28T13:06:21.573 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore allocator = bitmap 2024-04-28T13:06:21.573 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore block size = 96636764160 2024-04-28T13:06:21.573 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore fsck on mount = True 2024-04-28T13:06:21.573 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluefs = 1/20 2024-04-28T13:06:21.573 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluestore = 1/20 2024-04-28T13:06:21.573 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-04-28T13:06:21.573 INFO:teuthology.orchestra.run.smithi134.stdout: debug osd = 20 2024-04-28T13:06:21.573 INFO:teuthology.orchestra.run.smithi134.stdout: debug rocksdb = 4/10 2024-04-28T13:06:21.574 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd backfillfull_ratio = 0.85 2024-04-28T13:06:21.574 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd full ratio = 0.9 2024-04-28T13:06:21.574 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd nearfull ratio = 0.8 2024-04-28T13:06:21.574 INFO:teuthology.orchestra.run.smithi134.stdout: osd failsafe full ratio = 0.95 2024-04-28T13:06:21.574 INFO:teuthology.orchestra.run.smithi134.stdout: osd objectstore = bluestore 2024-04-28T13:06:21.574 INFO:teuthology.orchestra.run.smithi134.stdout: osd op complaint time = 180 2024-04-28T13:06:21.574 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:21.574 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr] 2024-04-28T13:06:21.574 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-04-28T13:06:21.574 INFO:teuthology.orchestra.run.smithi134.stdout: debug mgr = 20 2024-04-28T13:06:21.574 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-04-28T13:06:21.574 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-04-28T13:06:21.574 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-04-28T13:06:21.574 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-04-28T13:06:21.574 INFO:teuthology.orchestra.run.smithi134.stdout: mgr/telemetry/nag = false 2024-04-28T13:06:21.575 INFO:teuthology.orchestra.run.smithi134.stdout: debug client = 20 2024-04-28T13:06:21.575 INFO:teuthology.orchestra.run.smithi134.stdout: debug finisher = 20 2024-04-28T13:06:21.575 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:21.575 INFO:teuthology.orchestra.run.smithi134.stdout:[mon] 2024-04-28T13:06:21.575 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-04-28T13:06:21.575 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-04-28T13:06:21.575 INFO:teuthology.orchestra.run.smithi134.stdout: debug paxos = 20 2024-04-28T13:06:21.575 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-04-28T13:06:21.575 INFO:teuthology.orchestra.run.smithi134.stdout: mon data avail warn = 5 2024-04-28T13:06:21.575 INFO:teuthology.orchestra.run.smithi134.stdout: mon mgr mkfs grace = 240 2024-04-28T13:06:21.575 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-04-28T13:06:21.575 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd reporter subtree level = osd 2024-04-28T13:06:21.575 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd prime pg temp = true 2024-04-28T13:06:21.575 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-04-28T13:06:21.575 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:21.576 INFO:teuthology.orchestra.run.smithi134.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-28T13:06:21.576 INFO:teuthology.orchestra.run.smithi134.stdout: auth mon ticket ttl = 660 # 11m 2024-04-28T13:06:21.576 INFO:teuthology.orchestra.run.smithi134.stdout: auth service ticket ttl = 240 # 4m 2024-04-28T13:06:21.576 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:21.576 INFO:teuthology.orchestra.run.smithi134.stdout: # don't complain about insecure global_id in the test suite 2024-04-28T13:06:21.576 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-28T13:06:21.576 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-28T13:06:21.576 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:21.576 INFO:teuthology.orchestra.run.smithi134.stdout: # 1m isn't quite enough 2024-04-28T13:06:21.576 INFO:teuthology.orchestra.run.smithi134.stdout: mon_down_mkfs_grace = 2m 2024-04-28T13:06:21.576 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:21.576 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_filestore_osds = false 2024-04-28T13:06:21.576 INFO:teuthology.orchestra.run.smithi134.stdout: mon down mkfs grace = 300 2024-04-28T13:06:21.576 INFO:teuthology.orchestra.run.smithi134.stdout: mon op complaint time = 120 2024-04-28T13:06:21.577 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-28T13:06:21.577 INFO:teuthology.orchestra.run.smithi134.stdout:[client] 2024-04-28T13:06:21.577 INFO:teuthology.orchestra.run.smithi134.stdout: rgw cache enabled = true 2024-04-28T13:06:21.577 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable ops log = true 2024-04-28T13:06:21.577 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable usage log = true 2024-04-28T13:06:21.577 INFO:teuthology.orchestra.run.smithi134.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-28T13:06:21.577 INFO:teuthology.orchestra.run.smithi134.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-28T13:06:21.577 INFO:teuthology.orchestra.run.smithi134.stdout: client mount timeout = 600 2024-04-28T13:06:21.577 INFO:teuthology.orchestra.run.smithi134.stdout: debug client = 20 2024-04-28T13:06:21.577 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-04-28T13:06:21.577 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = "" 2024-04-28T13:06:21.577 INFO:teuthology.orchestra.run.smithi134.stdout: rados mon op timeout = 900 2024-04-28T13:06:21.577 INFO:teuthology.orchestra.run.smithi134.stdout: rados osd op timeout = 900 2024-04-28T13:06:21.577 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.a] 2024-04-28T13:06:21.577 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.b] 2024-04-28T13:06:21.577 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.c] 2024-04-28T13:06:21.577 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.a] 2024-04-28T13:06:21.578 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.c] 2024-04-28T13:06:21.578 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.b] 2024-04-28T13:06:21.578 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.d] 2024-04-28T13:06:21.578 INFO:teuthology.orchestra.run.smithi134.stdout:[mds] 2024-04-28T13:06:21.578 INFO:teuthology.orchestra.run.smithi134.stdout: debug mds = 20 2024-04-28T13:06:21.578 INFO:teuthology.orchestra.run.smithi134.stdout: debug mds balancer = 20 2024-04-28T13:06:21.578 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-04-28T13:06:21.578 INFO:teuthology.orchestra.run.smithi134.stdout: mds debug frag = True 2024-04-28T13:06:21.578 INFO:teuthology.orchestra.run.smithi134.stdout: mds debug scatterstat = True 2024-04-28T13:06:21.578 INFO:teuthology.orchestra.run.smithi134.stdout: mds op complaint time = 180 2024-04-28T13:06:21.578 INFO:teuthology.orchestra.run.smithi134.stdout: mds verify scatter = True 2024-04-28T13:06:21.578 INFO:teuthology.orchestra.run.smithi134.stdout: osd op complaint time = 180 2024-04-28T13:06:21.578 INFO:teuthology.orchestra.run.smithi134.stdout: rados mon op timeout = 900 2024-04-28T13:06:21.578 INFO:teuthology.orchestra.run.smithi134.stdout: rados osd op timeout = 900 2024-04-28T13:06:21.580 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-28T13:06:21.580 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-28T13:06:21.674 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-28T13:06:21.841 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:06:21.841 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-28T13:06:21.856 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:06:21.856 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-28T13:06:21.910 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi114.front.sepia.ceph.com 2024-04-28T13:06:21.910 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:06:21.910 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-28T13:06:21.911 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-28T13:06:21.982 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:06:21.982 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-28T13:06:22.037 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi134.front.sepia.ceph.com 2024-04-28T13:06:22.037 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:06:22.037 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-28T13:06:22.037 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-28T13:06:22.070 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:06:22.071 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-28T13:06:22.125 INFO:tasks.ceph:Setting up mon nodes... 2024-04-28T13:06:22.125 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-28T13:06:22.126 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-28T13:06:22.173 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-28T13:06:22.175 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-28T13:06:22.226 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-28T13:06:22.229 INFO:tasks.ceph:Setting up mds nodes... 2024-04-28T13:06:22.229 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-28T13:06:22.277 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-28T13:06:22.280 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-28T13:06:22.303 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-28T13:06:22.392 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-28T13:06:22.394 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-28T13:06:22.417 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-28T13:06:22.466 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-28T13:06:22.469 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-28T13:06:22.491 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-28T13:06:22.579 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-28T13:06:22.581 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-28T13:06:22.604 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-28T13:06:22.604 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-28T13:06:22.643 INFO:teuthology.orchestra.run.smithi114.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-28T13:06:22.655 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-28T13:06:22.733 INFO:teuthology.orchestra.run.smithi114.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-28T13:06:22.745 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-28T13:06:22.784 INFO:teuthology.orchestra.run.smithi134.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-28T13:06:22.795 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-28T13:06:22.874 INFO:teuthology.orchestra.run.smithi134.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-28T13:06:22.886 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-28T13:06:22.886 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi114.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-28T13:06:22.886 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-28T13:06:22.911 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-28T13:06:22.911 INFO:tasks.ceph:role: osd.0 2024-04-28T13:06:22.911 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi114.front.sepia.ceph.com 2024-04-28T13:06:22.911 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-28T13:06:22.981 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-28T13:06:22.982 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-28T13:06:22.982 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-28T13:06:22.982 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-28T13:06:22.982 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-28T13:06:22.982 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-04-28T13:06:22.982 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-28T13:06:22.982 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-28T13:06:22.982 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-28T13:06:22.982 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-28T13:06:23.450 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-04-28T13:06:23.452 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-04-28T13:06:23.452 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-28T13:06:23.568 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-28T13:06:23.599 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-28T13:06:23.662 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-28T13:06:23.662 INFO:tasks.ceph:role: osd.1 2024-04-28T13:06:23.662 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi114.front.sepia.ceph.com 2024-04-28T13:06:23.663 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-28T13:06:23.733 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-28T13:06:23.733 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-28T13:06:23.733 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-28T13:06:23.733 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-28T13:06:23.733 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-28T13:06:23.733 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-04-28T13:06:23.733 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-28T13:06:23.733 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-28T13:06:23.733 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-28T13:06:23.733 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-28T13:06:24.194 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-04-28T13:06:24.196 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-04-28T13:06:24.196 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-28T13:06:24.268 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-28T13:06:24.337 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-28T13:06:24.401 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-28T13:06:24.401 INFO:tasks.ceph:role: osd.2 2024-04-28T13:06:24.401 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi114.front.sepia.ceph.com 2024-04-28T13:06:24.401 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-28T13:06:24.471 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-28T13:06:24.472 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-28T13:06:24.472 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-28T13:06:24.472 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-28T13:06:24.472 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-28T13:06:24.472 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-04-28T13:06:24.472 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-28T13:06:24.472 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-28T13:06:24.472 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-28T13:06:24.472 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-28T13:06:24.952 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-04-28T13:06:24.954 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-04-28T13:06:24.954 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-28T13:06:25.068 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-28T13:06:25.096 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-28T13:06:25.160 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-28T13:06:25.160 INFO:tasks.ceph:role: osd.3 2024-04-28T13:06:25.160 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi114.front.sepia.ceph.com 2024-04-28T13:06:25.160 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-28T13:06:25.231 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-28T13:06:25.232 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-28T13:06:25.232 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-28T13:06:25.232 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-28T13:06:25.232 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-28T13:06:25.232 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-04-28T13:06:25.232 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-28T13:06:25.232 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-28T13:06:25.232 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-28T13:06:25.232 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-28T13:06:25.758 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-04-28T13:06:25.760 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-04-28T13:06:25.760 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-28T13:06:25.892 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-28T13:06:25.923 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-28T13:06:26.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:26.010+0000 7f32e4c0e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-28T13:06:26.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:26.015+0000 7f32e4c0e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-28T13:06:26.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:26.015+0000 7f32e4c0e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-28T13:06:26.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:26.015+0000 7f32e4c0e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-28T13:06:26.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:26.015+0000 7f32e4c0e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-28T13:06:26.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:26.017+0000 7f32e4c0e640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-28T13:06:28.884 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-28T13:06:28.909 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-28T13:06:28.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:28.994+0000 7f9a52bfc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-28T13:06:28.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:28.994+0000 7f9a52bfc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-28T13:06:28.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:28.994+0000 7f9a52bfc640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-28T13:06:28.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:28.994+0000 7f9a52bfc640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-28T13:06:28.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:28.994+0000 7f9a52bfc640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-28T13:06:28.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:28.995+0000 7f9a52bfc640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-28T13:06:31.842 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-28T13:06:31.869 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-28T13:06:31.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:31.959+0000 7f7806225640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-28T13:06:31.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:31.960+0000 7f7806225640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-28T13:06:31.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:31.960+0000 7f7806225640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-28T13:06:31.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:31.960+0000 7f7806225640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-28T13:06:31.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:31.960+0000 7f7806225640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-28T13:06:31.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:31.960+0000 7f7806225640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-28T13:06:34.813 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-28T13:06:34.839 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-28T13:06:34.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:34.925+0000 7fe02ba2f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-28T13:06:34.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:34.925+0000 7fe02ba2f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-28T13:06:34.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:34.925+0000 7fe02ba2f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-28T13:06:34.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:34.925+0000 7fe02ba2f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-28T13:06:34.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:34.925+0000 7fe02ba2f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-28T13:06:34.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:34.925+0000 7fe02ba2f640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-28T13:06:37.777 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-28T13:06:37.805 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-28T13:06:37.833 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-28T13:06:37.833 INFO:tasks.ceph:role: osd.4 2024-04-28T13:06:37.833 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com 2024-04-28T13:06:37.834 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-28T13:06:37.909 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-28T13:06:37.909 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-28T13:06:37.909 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-28T13:06:37.909 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-28T13:06:37.909 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-28T13:06:37.909 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-04-28T13:06:37.909 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-28T13:06:37.909 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-28T13:06:37.909 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-28T13:06:37.909 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-28T13:06:38.403 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-04-28T13:06:38.405 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-04-28T13:06:38.406 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-28T13:06:38.516 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-28T13:06:38.549 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-28T13:06:38.613 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-28T13:06:38.613 INFO:tasks.ceph:role: osd.5 2024-04-28T13:06:38.613 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com 2024-04-28T13:06:38.613 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-28T13:06:38.685 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-28T13:06:38.685 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-28T13:06:38.685 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-28T13:06:38.685 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-28T13:06:38.685 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-28T13:06:38.685 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-04-28T13:06:38.685 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-28T13:06:38.685 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-28T13:06:38.685 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-28T13:06:38.685 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-28T13:06:39.135 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-04-28T13:06:39.137 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-04-28T13:06:39.137 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-28T13:06:39.208 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-28T13:06:39.277 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-28T13:06:39.340 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-28T13:06:39.340 INFO:tasks.ceph:role: osd.6 2024-04-28T13:06:39.341 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com 2024-04-28T13:06:39.341 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-28T13:06:39.411 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-28T13:06:39.411 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-28T13:06:39.411 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-28T13:06:39.412 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-28T13:06:39.412 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-28T13:06:39.412 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-04-28T13:06:39.412 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-28T13:06:39.412 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-28T13:06:39.412 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-28T13:06:39.412 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-28T13:06:39.894 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-04-28T13:06:39.896 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-04-28T13:06:39.896 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-28T13:06:39.992 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-28T13:06:40.020 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-28T13:06:40.084 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-28T13:06:40.084 INFO:tasks.ceph:role: osd.7 2024-04-28T13:06:40.084 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi134.front.sepia.ceph.com 2024-04-28T13:06:40.084 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-28T13:06:40.156 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-28T13:06:40.156 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-28T13:06:40.156 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-28T13:06:40.157 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-28T13:06:40.157 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-28T13:06:40.157 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-04-28T13:06:40.157 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-28T13:06:40.157 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-28T13:06:40.157 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-28T13:06:40.157 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-28T13:06:40.671 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-04-28T13:06:40.673 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-04-28T13:06:40.673 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-28T13:06:40.820 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-28T13:06:40.850 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-28T13:06:40.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:06:40.948+0000 7f807ac20640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-28T13:06:40.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:06:40.950+0000 7f807ac20640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-28T13:06:40.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:06:40.950+0000 7f807ac20640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-28T13:06:40.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:06:40.950+0000 7f807ac20640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-28T13:06:40.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:06:40.950+0000 7f807ac20640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-28T13:06:40.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:06:40.958+0000 7f807ac20640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-28T13:06:43.808 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-28T13:06:43.836 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-28T13:06:43.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:06:43.923+0000 7f073469a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-28T13:06:43.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:06:43.923+0000 7f073469a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-28T13:06:43.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:06:43.923+0000 7f073469a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-28T13:06:43.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:06:43.923+0000 7f073469a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-28T13:06:43.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:06:43.923+0000 7f073469a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-28T13:06:43.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:06:43.923+0000 7f073469a640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-28T13:06:46.770 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-28T13:06:46.797 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-28T13:06:46.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:06:46.885+0000 7f3acab44640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-28T13:06:46.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:06:46.886+0000 7f3acab44640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-28T13:06:46.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:06:46.886+0000 7f3acab44640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-28T13:06:46.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:06:46.886+0000 7f3acab44640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-28T13:06:46.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:06:46.886+0000 7f3acab44640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-28T13:06:46.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:06:46.886+0000 7f3acab44640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-28T13:06:49.623 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:06:49.626 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:06:49.740 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-28T13:06:49.764 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-28T13:06:49.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:06:49.846+0000 7f206b7dc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-28T13:06:49.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:06:49.847+0000 7f206b7dc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-28T13:06:49.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:06:49.847+0000 7f206b7dc640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-28T13:06:49.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:06:49.847+0000 7f206b7dc640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-28T13:06:49.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:06:49.847+0000 7f206b7dc640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-28T13:06:49.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:06:49.847+0000 7f206b7dc640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-28T13:06:52.706 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-28T13:06:52.775 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-28T13:06:52.775 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:06:52.775 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-28T13:06:52.804 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:06:52.804 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-28T13:06:52.871 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:06:52.871 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-28T13:06:52.938 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:06:52.938 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-28T13:06:53.004 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:06:53.004 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-28T13:06:53.069 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:06:53.069 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-28T13:06:53.134 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:06:53.134 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-28T13:06:53.199 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:06:53.199 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-28T13:06:53.227 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:06:53.227 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-28T13:06:53.295 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:06:53.295 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-28T13:06:53.362 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:06:53.362 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-28T13:06:53.427 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:06:53.428 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-28T13:06:53.493 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:06:53.493 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-28T13:06:53.557 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:06:53.558 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-28T13:06:53.622 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:06:53.622 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-28T13:06:53.638 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:06:53.638 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-28T13:06:53.695 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:06:53.695 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-28T13:06:53.710 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:06:53.710 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-28T13:06:53.764 INFO:tasks.ceph:Adding keys to all mons... 2024-04-28T13:06:53.764 DEBUG:teuthology.orchestra.run.smithi114:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-28T13:06:53.767 DEBUG:teuthology.orchestra.run.smithi134:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-28T13:06:53.808 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr.y] 2024-04-28T13:06:53.808 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDOSS5mWiliChAAq5hGUK1snRJRChZ09HDyhA== 2024-04-28T13:06:53.808 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.a] 2024-04-28T13:06:53.808 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDOSS5meB+bEBAArawFLsKWVvZZpyhjaeozhg== 2024-04-28T13:06:53.808 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.c] 2024-04-28T13:06:53.808 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDOSS5muFVyFxAADP42j0wWV/Qb4wajs6Vm7w== 2024-04-28T13:06:53.808 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.0] 2024-04-28T13:06:53.808 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDSSS5memG6ABAADdmTdP17zXCzkrIjMXoFWA== 2024-04-28T13:06:53.808 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.1] 2024-04-28T13:06:53.809 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDUSS5mk4xZOxAAqn4QV8CSUcVM1eA5mpIEzQ== 2024-04-28T13:06:53.809 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.2] 2024-04-28T13:06:53.809 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDXSS5mvz9LORAAkJgWHQWyCG5kJlOyhd6j1Q== 2024-04-28T13:06:53.809 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.3] 2024-04-28T13:06:53.809 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDaSS5mPr44NxAAj+Isl9uyJTcqe/8FiMqHQg== 2024-04-28T13:06:53.809 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr.x] 2024-04-28T13:06:53.809 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDOSS5m+YaTDRAAXHg0ngbju2RVDFYmXabVSg== 2024-04-28T13:06:53.810 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.b] 2024-04-28T13:06:53.810 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDOSS5mb4njGxAAx3fJpA7jCiyGvEXLNcpSaQ== 2024-04-28T13:06:53.810 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.d] 2024-04-28T13:06:53.810 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDOSS5mN0qbIhAA9S6kThv7lpqtwmFDcki8Lg== 2024-04-28T13:06:53.810 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.4] 2024-04-28T13:06:53.810 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDgSS5m2hWeOBAAIC4TiBY229V/ZZpx6LT2hg== 2024-04-28T13:06:53.810 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.5] 2024-04-28T13:06:53.811 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDjSS5mkNcSNxAAint1u9W5rXiim5A0VSNttw== 2024-04-28T13:06:53.811 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.6] 2024-04-28T13:06:53.811 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDmSS5mc/zZNBAAE3US5p+6A4Rh2d+5agGruw== 2024-04-28T13:06:53.811 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.7] 2024-04-28T13:06:53.811 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDpSS5m6BiJMhAArOmge/xKpTqoM3UyHjv1+Q== 2024-04-28T13:06:53.811 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2024-04-28T13:06:53.811 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDOSS5mzotvJhAAlis8wXdOL4WCzxzUL8L3qw== 2024-04-28T13:06:53.811 INFO:teuthology.orchestra.run.smithi114.stdout:[client.2] 2024-04-28T13:06:53.812 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDOSS5meMfOKxAA+cOkQCX3HK4IBlDG2+chig== 2024-04-28T13:06:53.812 INFO:teuthology.orchestra.run.smithi114.stdout:[client.1] 2024-04-28T13:06:53.812 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDOSS5m1XLQLhAAKfchd9USFncmg1umNNZYlQ== 2024-04-28T13:06:53.812 INFO:teuthology.orchestra.run.smithi114.stdout:[client.3] 2024-04-28T13:06:53.812 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDOSS5mmLkyNBAAzOEmmOcyB9EP6I4TkYKNWA== 2024-04-28T13:06:53.826 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.y] 2024-04-28T13:06:53.827 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDOSS5mWiliChAAq5hGUK1snRJRChZ09HDyhA== 2024-04-28T13:06:53.827 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.a] 2024-04-28T13:06:53.827 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDOSS5meB+bEBAArawFLsKWVvZZpyhjaeozhg== 2024-04-28T13:06:53.827 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.c] 2024-04-28T13:06:53.827 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDOSS5muFVyFxAADP42j0wWV/Qb4wajs6Vm7w== 2024-04-28T13:06:53.827 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.0] 2024-04-28T13:06:53.827 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDSSS5memG6ABAADdmTdP17zXCzkrIjMXoFWA== 2024-04-28T13:06:53.827 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.1] 2024-04-28T13:06:53.827 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDUSS5mk4xZOxAAqn4QV8CSUcVM1eA5mpIEzQ== 2024-04-28T13:06:53.827 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.2] 2024-04-28T13:06:53.827 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDXSS5mvz9LORAAkJgWHQWyCG5kJlOyhd6j1Q== 2024-04-28T13:06:53.828 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.3] 2024-04-28T13:06:53.828 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDaSS5mPr44NxAAj+Isl9uyJTcqe/8FiMqHQg== 2024-04-28T13:06:53.828 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.x] 2024-04-28T13:06:53.828 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDOSS5m+YaTDRAAXHg0ngbju2RVDFYmXabVSg== 2024-04-28T13:06:53.828 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.b] 2024-04-28T13:06:53.828 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDOSS5mb4njGxAAx3fJpA7jCiyGvEXLNcpSaQ== 2024-04-28T13:06:53.828 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.d] 2024-04-28T13:06:53.828 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDOSS5mN0qbIhAA9S6kThv7lpqtwmFDcki8Lg== 2024-04-28T13:06:53.828 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.4] 2024-04-28T13:06:53.828 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDgSS5m2hWeOBAAIC4TiBY229V/ZZpx6LT2hg== 2024-04-28T13:06:53.828 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.5] 2024-04-28T13:06:53.828 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDjSS5mkNcSNxAAint1u9W5rXiim5A0VSNttw== 2024-04-28T13:06:53.828 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.6] 2024-04-28T13:06:53.828 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDmSS5mc/zZNBAAE3US5p+6A4Rh2d+5agGruw== 2024-04-28T13:06:53.828 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.7] 2024-04-28T13:06:53.828 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDpSS5m6BiJMhAArOmge/xKpTqoM3UyHjv1+Q== 2024-04-28T13:06:53.828 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2024-04-28T13:06:53.829 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDOSS5mzotvJhAAlis8wXdOL4WCzxzUL8L3qw== 2024-04-28T13:06:53.829 INFO:teuthology.orchestra.run.smithi134.stdout:[client.2] 2024-04-28T13:06:53.829 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDOSS5meMfOKxAA+cOkQCX3HK4IBlDG2+chig== 2024-04-28T13:06:53.829 INFO:teuthology.orchestra.run.smithi134.stdout:[client.1] 2024-04-28T13:06:53.829 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDOSS5m1XLQLhAAKfchd9USFncmg1umNNZYlQ== 2024-04-28T13:06:53.829 INFO:teuthology.orchestra.run.smithi134.stdout:[client.3] 2024-04-28T13:06:53.829 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDOSS5mmLkyNBAAzOEmmOcyB9EP6I4TkYKNWA== 2024-04-28T13:06:53.830 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-28T13:06:53.856 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-28T13:06:53.918 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-28T13:06:53.921 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-28T13:06:53.972 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-28T13:06:53.975 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-28T13:06:54.026 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-28T13:06:54.029 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-28T13:06:54.077 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-28T13:06:54.080 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-28T13:06:54.128 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-28T13:06:54.130 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-28T13:06:54.179 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-28T13:06:54.181 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-28T13:06:54.229 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-28T13:06:54.231 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-28T13:06:54.279 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-28T13:06:54.282 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-28T13:06:54.333 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-28T13:06:54.335 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-28T13:06:54.387 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-28T13:06:54.389 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-28T13:06:54.437 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-28T13:06:54.439 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-28T13:06:54.487 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-28T13:06:54.490 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-28T13:06:54.539 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-28T13:06:54.542 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-28T13:06:54.590 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-28T13:06:54.592 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-28T13:06:54.643 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-28T13:06:54.646 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-28T13:06:54.697 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-28T13:06:54.700 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-28T13:06:54.751 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-28T13:06:54.754 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-28T13:06:54.806 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-28T13:06:54.806 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-28T13:06:54.830 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-28T13:06:54.923 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-28T13:06:54.947 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-28T13:06:54.970 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-28T13:06:55.066 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-28T13:06:55.089 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-28T13:06:55.152 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-28T13:06:55.246 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-28T13:06:55.269 DEBUG:teuthology.orchestra.run.smithi114:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-28T13:06:55.271 DEBUG:teuthology.orchestra.run.smithi134:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-28T13:06:55.323 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-28T13:06:55.323 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-28T13:06:55.324 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-28T13:06:55.326 INFO:tasks.ceph.mon.a:Started 2024-04-28T13:06:55.326 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-28T13:06:55.327 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-28T13:06:55.366 INFO:tasks.ceph.mon.b:Started 2024-04-28T13:06:55.366 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-28T13:06:55.366 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-28T13:06:55.368 INFO:tasks.ceph.mon.c:Started 2024-04-28T13:06:55.369 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-28T13:06:55.369 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-28T13:06:55.369 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-28T13:06:55.371 INFO:tasks.ceph.mgr.y:Started 2024-04-28T13:06:55.371 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-28T13:06:55.371 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-28T13:06:55.373 INFO:tasks.ceph.mgr.x:Started 2024-04-28T13:06:55.373 INFO:tasks.ceph:Setting crush tunables to default 2024-04-28T13:06:55.373 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd crush tunables default 2024-04-28T13:06:55.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:55.471+0000 7f751b0da640 1 Processor -- start 2024-04-28T13:06:55.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:55.471+0000 7f751b0da640 1 -- start start 2024-04-28T13:06:55.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:55.471+0000 7f751b0da640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7514145d00 0x7f75141670b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:06:55.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:55.471+0000 7f751b0da640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75140b6c50 con 0x7f7514073400 2024-04-28T13:06:55.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:55.471+0000 7f751b0da640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75140b60d0 con 0x7f7514070280 2024-04-28T13:06:55.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:55.471+0000 7f751b0da640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f75140b63b0 con 0x7f7514145d00 2024-04-28T13:06:55.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:55.471+0000 7f7519677640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7514145d00 0x7f75141670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:06:55.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:55.472+0000 7f7519677640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7514145d00 0x7f75141670b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56134/0 (socket says 172.21.15.114:56134) 2024-04-28T13:06:55.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:55.472+0000 7f7518e76640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f7514073400 0x7f75140b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60060/0 (socket says 172.21.15.114:60060) 2024-04-28T13:06:55.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:55.472+0000 7f7519677640 1 -- 172.21.15.114:0/1190712636 learned_addr learned my addr 172.21.15.114:0/1190712636 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:06:55.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:55.472+0000 7f7519677640 1 -- 172.21.15.114:0/1190712636 >> v2:172.21.15.114:3300/0 conn(0x7f7514145d00 msgr2=0x7f75141670b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-28T13:06:55.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:55.472+0000 7f7519677640 1 -- 172.21.15.114:0/1190712636 >> v2:172.21.15.114:3300/0 conn(0x7f7514145d00 msgr2=0x7f75141670b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-28T13:06:55.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:55.472+0000 7f7519677640 1 --2- 172.21.15.114:0/1190712636 >> v2:172.21.15.114:3300/0 conn(0x7f7514145d00 0x7f75141670b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-28T13:06:55.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:55.472+0000 7f7519677640 1 --2- 172.21.15.114:0/1190712636 >> v2:172.21.15.114:3300/0 conn(0x7f7514145d00 0x7f75141670b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-28T13:06:55.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:55.673+0000 7f7519677640 1 --2- 172.21.15.114:0/1190712636 >> v2:172.21.15.114:3300/0 conn(0x7f7514145d00 0x7f75141670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:06:55.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:55.673+0000 7f7519677640 1 -- 172.21.15.114:0/1190712636 >> v2:172.21.15.114:3300/0 conn(0x7f7514145d00 msgr2=0x7f75141670b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-28T13:06:55.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:55.673+0000 7f7519677640 1 -- 172.21.15.114:0/1190712636 >> v2:172.21.15.114:3300/0 conn(0x7f7514145d00 msgr2=0x7f75141670b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-28T13:06:55.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:55.673+0000 7f7519677640 1 --2- 172.21.15.114:0/1190712636 >> v2:172.21.15.114:3300/0 conn(0x7f7514145d00 0x7f75141670b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-28T13:06:55.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:55.673+0000 7f7519677640 1 --2- 172.21.15.114:0/1190712636 >> v2:172.21.15.114:3300/0 conn(0x7f7514145d00 0x7f75141670b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-28T13:06:56.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:56.074+0000 7f7519677640 1 --2- 172.21.15.114:0/1190712636 >> v2:172.21.15.114:3300/0 conn(0x7f7514145d00 0x7f75141670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:06:56.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:56.074+0000 7f7519677640 1 -- 172.21.15.114:0/1190712636 >> v2:172.21.15.114:3300/0 conn(0x7f7514145d00 msgr2=0x7f75141670b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-28T13:06:56.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:56.074+0000 7f7519677640 1 -- 172.21.15.114:0/1190712636 >> v2:172.21.15.114:3300/0 conn(0x7f7514145d00 msgr2=0x7f75141670b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-28T13:06:56.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:56.074+0000 7f7519677640 1 --2- 172.21.15.114:0/1190712636 >> v2:172.21.15.114:3300/0 conn(0x7f7514145d00 0x7f75141670b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-28T13:06:56.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:56.074+0000 7f7519677640 1 --2- 172.21.15.114:0/1190712636 >> v2:172.21.15.114:3300/0 conn(0x7f7514145d00 0x7f75141670b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-28T13:06:56.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:56.875+0000 7f7519677640 1 --2- 172.21.15.114:0/1190712636 >> v2:172.21.15.114:3300/0 conn(0x7f7514145d00 0x7f75141670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:06:56.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:56.875+0000 7f7519677640 1 -- 172.21.15.114:0/1190712636 >> v2:172.21.15.114:3300/0 conn(0x7f7514145d00 msgr2=0x7f75141670b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-28T13:06:56.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:56.875+0000 7f7519677640 1 -- 172.21.15.114:0/1190712636 >> v2:172.21.15.114:3300/0 conn(0x7f7514145d00 msgr2=0x7f75141670b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-28T13:06:56.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:56.875+0000 7f7519677640 1 --2- 172.21.15.114:0/1190712636 >> v2:172.21.15.114:3300/0 conn(0x7f7514145d00 0x7f75141670b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-28T13:06:56.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:56.875+0000 7f7519677640 1 --2- 172.21.15.114:0/1190712636 >> v2:172.21.15.114:3300/0 conn(0x7f7514145d00 0x7f75141670b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-28T13:06:58.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:58.472+0000 7f75127fc640 1 -- 172.21.15.114:0/1190712636 >> v2:172.21.15.114:3300/0 conn(0x7f7514145d00 msgr2=0x7f75141670b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-28T13:06:58.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:58.472+0000 7f75127fc640 1 --2- 172.21.15.114:0/1190712636 >> v2:172.21.15.114:3300/0 conn(0x7f7514145d00 0x7f75141670b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:06:58.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:58.472+0000 7f75127fc640 1 -- 172.21.15.114:0/1190712636 >> v1:172.21.15.134:6789/0 conn(0x7f7514070280 legacy=0x7f75141455f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:06:58.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:58.472+0000 7f75127fc640 1 -- 172.21.15.114:0/1190712636 >> v1:172.21.15.114:6789/0 conn(0x7f7514073400 legacy=0x7f75140b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:06:58.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:58.472+0000 7f75127fc640 1 --2- 172.21.15.114:0/1190712636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8003710 0x7f74f8005b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:06:58.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:58.472+0000 7f75127fc640 1 --2- 172.21.15.114:0/1190712636 >> v2:172.21.15.134:3300/0 conn(0x7f74f80061f0 0x7f74f80086b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:06:58.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:58.472+0000 7f75127fc640 1 -- 172.21.15.114:0/1190712636 --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f75140b63b0 con 0x7f74f80061f0 2024-04-28T13:06:58.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:58.472+0000 7f75127fc640 1 -- 172.21.15.114:0/1190712636 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f74f8008d60 con 0x7f74f8003710 2024-04-28T13:06:58.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:58.472+0000 7f7518e76640 1 --2- 172.21.15.114:0/1190712636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8003710 0x7f74f8005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:06:58.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:58.472+0000 7f7513fff640 1 --2- 172.21.15.114:0/1190712636 >> v2:172.21.15.134:3300/0 conn(0x7f74f80061f0 0x7f74f80086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:06:58.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:58.472+0000 7f7518e76640 1 -- 172.21.15.114:0/1190712636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8003710 msgr2=0x7f74f8005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-28T13:06:58.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:58.472+0000 7f7518e76640 1 -- 172.21.15.114:0/1190712636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8003710 msgr2=0x7f74f8005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-28T13:06:58.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:58.472+0000 7f7518e76640 1 --2- 172.21.15.114:0/1190712636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8003710 0x7f74f8005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-28T13:06:58.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:58.472+0000 7f7518e76640 1 --2- 172.21.15.114:0/1190712636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8003710 0x7f74f8005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-28T13:06:58.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:58.472+0000 7f7513fff640 1 -- 172.21.15.114:0/1190712636 >> v2:172.21.15.134:3300/0 conn(0x7f74f80061f0 msgr2=0x7f74f80086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-28T13:06:58.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:58.472+0000 7f7513fff640 1 -- 172.21.15.114:0/1190712636 >> v2:172.21.15.134:3300/0 conn(0x7f74f80061f0 msgr2=0x7f74f80086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-28T13:06:58.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:58.472+0000 7f7513fff640 1 --2- 172.21.15.114:0/1190712636 >> v2:172.21.15.134:3300/0 conn(0x7f74f80061f0 0x7f74f80086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-28T13:06:58.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:58.472+0000 7f7513fff640 1 --2- 172.21.15.114:0/1190712636 >> v2:172.21.15.134:3300/0 conn(0x7f74f80061f0 0x7f74f80086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-28T13:06:58.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:58.673+0000 7f7518e76640 1 --2- 172.21.15.114:0/1190712636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8003710 0x7f74f8005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:06:58.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:58.673+0000 7f7513fff640 1 --2- 172.21.15.114:0/1190712636 >> v2:172.21.15.134:3300/0 conn(0x7f74f80061f0 0x7f74f80086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:06:58.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:58.673+0000 7f7518e76640 1 -- 172.21.15.114:0/1190712636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8003710 msgr2=0x7f74f8005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-28T13:06:58.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:58.673+0000 7f7518e76640 1 -- 172.21.15.114:0/1190712636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8003710 msgr2=0x7f74f8005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-28T13:06:58.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:58.673+0000 7f7518e76640 1 --2- 172.21.15.114:0/1190712636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8003710 0x7f74f8005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-28T13:06:58.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:58.673+0000 7f7518e76640 1 --2- 172.21.15.114:0/1190712636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8003710 0x7f74f8005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-28T13:06:58.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:58.673+0000 7f7513fff640 1 -- 172.21.15.114:0/1190712636 >> v2:172.21.15.134:3300/0 conn(0x7f74f80061f0 msgr2=0x7f74f80086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-28T13:06:58.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:58.673+0000 7f7513fff640 1 -- 172.21.15.114:0/1190712636 >> v2:172.21.15.134:3300/0 conn(0x7f74f80061f0 msgr2=0x7f74f80086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-28T13:06:58.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:58.673+0000 7f7513fff640 1 --2- 172.21.15.114:0/1190712636 >> v2:172.21.15.134:3300/0 conn(0x7f74f80061f0 0x7f74f80086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-28T13:06:58.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:58.673+0000 7f7513fff640 1 --2- 172.21.15.114:0/1190712636 >> v2:172.21.15.134:3300/0 conn(0x7f74f80061f0 0x7f74f80086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-28T13:06:59.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:59.074+0000 7f7513fff640 1 --2- 172.21.15.114:0/1190712636 >> v2:172.21.15.134:3300/0 conn(0x7f74f80061f0 0x7f74f80086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:06:59.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:59.074+0000 7f7518e76640 1 --2- 172.21.15.114:0/1190712636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8003710 0x7f74f8005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:06:59.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:59.074+0000 7f7513fff640 1 -- 172.21.15.114:0/1190712636 >> v2:172.21.15.134:3300/0 conn(0x7f74f80061f0 msgr2=0x7f74f80086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-28T13:06:59.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:59.074+0000 7f7513fff640 1 -- 172.21.15.114:0/1190712636 >> v2:172.21.15.134:3300/0 conn(0x7f74f80061f0 msgr2=0x7f74f80086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-28T13:06:59.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:59.074+0000 7f7513fff640 1 --2- 172.21.15.114:0/1190712636 >> v2:172.21.15.134:3300/0 conn(0x7f74f80061f0 0x7f74f80086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-28T13:06:59.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:59.074+0000 7f7518e76640 1 -- 172.21.15.114:0/1190712636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8003710 msgr2=0x7f74f8005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-28T13:06:59.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:59.074+0000 7f7518e76640 1 -- 172.21.15.114:0/1190712636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8003710 msgr2=0x7f74f8005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-28T13:06:59.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:59.074+0000 7f7518e76640 1 --2- 172.21.15.114:0/1190712636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8003710 0x7f74f8005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-28T13:06:59.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:59.074+0000 7f7513fff640 1 --2- 172.21.15.114:0/1190712636 >> v2:172.21.15.134:3300/0 conn(0x7f74f80061f0 0x7f74f80086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-28T13:06:59.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:59.074+0000 7f7518e76640 1 --2- 172.21.15.114:0/1190712636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8003710 0x7f74f8005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-28T13:06:59.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:59.875+0000 7f7513fff640 1 --2- 172.21.15.114:0/1190712636 >> v2:172.21.15.134:3300/0 conn(0x7f74f80061f0 0x7f74f80086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:06:59.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:59.875+0000 7f7518e76640 1 --2- 172.21.15.114:0/1190712636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8003710 0x7f74f8005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:06:59.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:59.875+0000 7f7513fff640 1 -- 172.21.15.114:0/1190712636 >> v2:172.21.15.134:3300/0 conn(0x7f74f80061f0 msgr2=0x7f74f80086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-28T13:06:59.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:59.875+0000 7f7513fff640 1 -- 172.21.15.114:0/1190712636 >> v2:172.21.15.134:3300/0 conn(0x7f74f80061f0 msgr2=0x7f74f80086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-28T13:06:59.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:59.875+0000 7f7513fff640 1 --2- 172.21.15.114:0/1190712636 >> v2:172.21.15.134:3300/0 conn(0x7f74f80061f0 0x7f74f80086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-28T13:06:59.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:59.875+0000 7f7518e76640 1 -- 172.21.15.114:0/1190712636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8003710 msgr2=0x7f74f8005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-28T13:06:59.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:59.875+0000 7f7513fff640 1 --2- 172.21.15.114:0/1190712636 >> v2:172.21.15.134:3300/0 conn(0x7f74f80061f0 0x7f74f80086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-28T13:06:59.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:59.875+0000 7f7518e76640 1 -- 172.21.15.114:0/1190712636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8003710 msgr2=0x7f74f8005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-28T13:06:59.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:59.875+0000 7f7518e76640 1 --2- 172.21.15.114:0/1190712636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8003710 0x7f74f8005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-28T13:06:59.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:06:59.875+0000 7f7518e76640 1 --2- 172.21.15.114:0/1190712636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8003710 0x7f74f8005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-28T13:07:00.747 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-28T13:07:00.747+0000 7fe99136a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-28T13:07:00.764 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:07:00.765+0000 7f7eb2523040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-28T13:07:00.899 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-28T13:07:00.899+0000 7fe99136a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-28T13:07:00.927 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:07:00.928+0000 7f7eb2523040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-28T13:07:00.950 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-28T13:07:00.950+0000 7fe99136a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-28T13:07:00.980 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:07:00.980+0000 7f7eb2523040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-28T13:07:01.192 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-28T13:07:01.192+0000 7fe99136a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-28T13:07:01.221 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:07:01.222+0000 7f7eb2523040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-28T13:07:01.236 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-28T13:07:01.236+0000 7fe99136a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-28T13:07:01.266 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:07:01.267+0000 7f7eb2523040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-28T13:07:01.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.472+0000 7f75127fc640 1 -- 172.21.15.114:0/1190712636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8003710 msgr2=0x7f74f8005b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-28T13:07:01.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.472+0000 7f75127fc640 1 --2- 172.21.15.114:0/1190712636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8003710 0x7f74f8005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:01.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.472+0000 7f75127fc640 1 -- 172.21.15.114:0/1190712636 >> v2:172.21.15.134:3300/0 conn(0x7f74f80061f0 msgr2=0x7f74f80086b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-28T13:07:01.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.472+0000 7f75127fc640 1 --2- 172.21.15.114:0/1190712636 >> v2:172.21.15.134:3300/0 conn(0x7f74f80061f0 0x7f74f80086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:01.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.472+0000 7f7519677640 1 -- 172.21.15.114:0/1190712636 reap_dead start 2024-04-28T13:07:01.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.472+0000 7f75127fc640 1 --2- 172.21.15.114:0/1190712636 >> v2:172.21.15.134:3300/0 conn(0x7f74f8007dc0 0x7f74f80081d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:01.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.472+0000 7f75127fc640 1 --2- 172.21.15.114:0/1190712636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8008710 0x7f74f800d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:01.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.472+0000 7f75127fc640 1 -- 172.21.15.114:0/1190712636 --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75140b6690 con 0x7f74f8003b50 2024-04-28T13:07:01.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.472+0000 7f75127fc640 1 -- 172.21.15.114:0/1190712636 --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f75140b63b0 con 0x7f74f8007dc0 2024-04-28T13:07:01.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.472+0000 7f75127fc640 1 -- 172.21.15.114:0/1190712636 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f74f8008d60 con 0x7f74f8008710 2024-04-28T13:07:01.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.472+0000 7f7513fff640 1 --2- 172.21.15.114:0/1190712636 >> v2:172.21.15.134:3300/0 conn(0x7f74f8007dc0 0x7f74f80081d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:01.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.472+0000 7f7519677640 1 --2- 172.21.15.114:0/1190712636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8008710 0x7f74f800d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:01.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.472+0000 7f7519677640 1 -- 172.21.15.114:0/1190712636 >> v2:172.21.15.134:3300/0 conn(0x7f74f8007dc0 msgr2=0x7f74f80081d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:01.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.472+0000 7f7519677640 1 --2- 172.21.15.114:0/1190712636 >> v2:172.21.15.134:3300/0 conn(0x7f74f8007dc0 0x7f74f80081d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:01.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.472+0000 7f7519677640 1 -- 172.21.15.114:0/1190712636 >> v1:172.21.15.134:6789/0 conn(0x7f74f8003b50 legacy=0x7f74f80066a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:01.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.472+0000 7f7519677640 1 -- 172.21.15.114:0/1190712636 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f800eaf0 con 0x7f74f8008710 2024-04-28T13:07:01.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.473+0000 7f7519677640 1 --2- 172.21.15.114:0/1190712636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8008710 0x7f74f800d280 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f75140b6ef0 tx=0x7f750c02cfe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71e884a3e918007e server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:01.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.473+0000 7f75137fe640 1 -- 172.21.15.114:0/1190712636 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c033070 con 0x7f74f8008710 2024-04-28T13:07:01.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.473+0000 7f75137fe640 1 -- 172.21.15.114:0/1190712636 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f750c02daf0 con 0x7f74f8008710 2024-04-28T13:07:01.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.473+0000 7f75137fe640 1 -- 172.21.15.114:0/1190712636 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c037400 con 0x7f74f8008710 2024-04-28T13:07:01.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.474+0000 7f751b0da640 1 -- 172.21.15.114:0/1190712636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8008710 msgr2=0x7f74f800d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:01.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.474+0000 7f751b0da640 1 --2- 172.21.15.114:0/1190712636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8008710 0x7f74f800d280 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f75140b6ef0 tx=0x7f750c02cfe0 comp rx=0 tx=0).stop 2024-04-28T13:07:01.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.474+0000 7f751b0da640 1 -- 172.21.15.114:0/1190712636 shutdown_connections 2024-04-28T13:07:01.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.474+0000 7f751b0da640 1 --2- 172.21.15.114:0/1190712636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8008710 0x7f74f800d280 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:01.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.474+0000 7f751b0da640 1 --2- 172.21.15.114:0/1190712636 >> v2:172.21.15.134:3300/0 conn(0x7f74f8007dc0 0x7f74f80081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:01.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.474+0000 7f751b0da640 1 -- 172.21.15.114:0/1190712636 >> 172.21.15.114:0/1190712636 conn(0x7f751406d460 msgr2=0x7f751406d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:01.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.474+0000 7f751b0da640 1 -- 172.21.15.114:0/1190712636 shutdown_connections 2024-04-28T13:07:01.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.474+0000 7f751b0da640 1 -- 172.21.15.114:0/1190712636 wait complete. 2024-04-28T13:07:01.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.475+0000 7f751b0da640 1 Processor -- start 2024-04-28T13:07:01.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.475+0000 7f751b0da640 1 -- start start 2024-04-28T13:07:01.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.476+0000 7f751b0da640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74f8003b50 0x7f751415e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:01.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.476+0000 7f751b0da640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8007dc0 0x7f7514141ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:01.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.476+0000 7f751b0da640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f8008710 0x7f75140d1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:01.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.476+0000 7f751b0da640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7514073960 con 0x7f74f8003b50 2024-04-28T13:07:01.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.476+0000 7f751b0da640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f75140737e0 con 0x7f74f8008710 2024-04-28T13:07:01.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.476+0000 7f751b0da640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f7514073ae0 con 0x7f74f8007dc0 2024-04-28T13:07:01.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.476+0000 7f7518e76640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74f8003b50 0x7f751415e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:01.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.476+0000 7f7519677640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f8008710 0x7f75140d1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:01.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.476+0000 7f7513fff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8007dc0 0x7f7514141ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:01.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.476+0000 7f7519677640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f8008710 0x7f75140d1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:49570/0 (socket says 172.21.15.114:49570) 2024-04-28T13:07:01.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.476+0000 7f7519677640 1 -- 172.21.15.114:0/929528400 learned_addr learned my addr 172.21.15.114:0/929528400 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:01.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.477+0000 7f7519677640 1 -- 172.21.15.114:0/929528400 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8007dc0 msgr2=0x7f7514141ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:01.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.477+0000 7f7519677640 1 --2- 172.21.15.114:0/929528400 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8007dc0 0x7f7514141ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:01.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.477+0000 7f7519677640 1 -- 172.21.15.114:0/929528400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74f8003b50 msgr2=0x7f751415e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:01.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.477+0000 7f7519677640 1 --2- 172.21.15.114:0/929528400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74f8003b50 0x7f751415e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:01.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.477+0000 7f7519677640 1 -- 172.21.15.114:0/929528400 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f751415eb70 con 0x7f74f8008710 2024-04-28T13:07:01.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.477+0000 7f7513fff640 1 --2- 172.21.15.114:0/929528400 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8007dc0 0x7f7514141ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:07:01.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.477+0000 7f7518e76640 1 --2- 172.21.15.114:0/929528400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74f8003b50 0x7f751415e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:07:01.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.477+0000 7f7519677640 1 --2- 172.21.15.114:0/929528400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f8008710 0x7f75140d1b70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f750c039040 tx=0x7f750c004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:01.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.477+0000 7f75117fa640 1 -- 172.21.15.114:0/929528400 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c046070 con 0x7f74f8008710 2024-04-28T13:07:01.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.477+0000 7f75117fa640 1 -- 172.21.15.114:0/929528400 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f750c041630 con 0x7f74f8008710 2024-04-28T13:07:01.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.477+0000 7f751b0da640 1 -- 172.21.15.114:0/929528400 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f751415ee50 con 0x7f74f8008710 2024-04-28T13:07:01.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.477+0000 7f75117fa640 1 -- 172.21.15.114:0/929528400 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c041a20 con 0x7f74f8008710 2024-04-28T13:07:01.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.477+0000 7f751b0da640 1 -- 172.21.15.114:0/929528400 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f751415f410 con 0x7f74f8008710 2024-04-28T13:07:01.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.477+0000 7f75117fa640 1 -- 172.21.15.114:0/929528400 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f750c049070 con 0x7f74f8008710 2024-04-28T13:07:01.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.477+0000 7f75117fa640 1 -- 172.21.15.114:0/929528400 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f750c04a680 con 0x7f74f8008710 2024-04-28T13:07:01.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.478+0000 7f751b0da640 1 -- 172.21.15.114:0/929528400 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f751406a3d0 con 0x7f74f8008710 2024-04-28T13:07:01.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.480+0000 7f75117fa640 1 -- 172.21.15.114:0/929528400 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f750c04a8d0 con 0x7f74f8008710 2024-04-28T13:07:01.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.545+0000 7f751b0da640 1 -- 172.21.15.114:0/929528400 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f7514073ec0 con 0x7f74f8008710 2024-04-28T13:07:01.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.548+0000 7f75117fa640 1 -- 172.21.15.114:0/929528400 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f750c041bc0 con 0x7f74f8008710 2024-04-28T13:07:01.548 INFO:teuthology.orchestra.run.smithi114.stderr:adjusted tunables profile to default 2024-04-28T13:07:01.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.549+0000 7f751b0da640 1 -- 172.21.15.114:0/929528400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f8008710 msgr2=0x7f75140d1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:01.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.549+0000 7f751b0da640 1 --2- 172.21.15.114:0/929528400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f8008710 0x7f75140d1b70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f750c039040 tx=0x7f750c004ab0 comp rx=0 tx=0).stop 2024-04-28T13:07:01.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.549+0000 7f751b0da640 1 -- 172.21.15.114:0/929528400 shutdown_connections 2024-04-28T13:07:01.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.549+0000 7f751b0da640 1 --2- 172.21.15.114:0/929528400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f8008710 0x7f75140d1b70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:01.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.549+0000 7f751b0da640 1 --2- 172.21.15.114:0/929528400 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74f8007dc0 0x7f7514141ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:01.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.549+0000 7f751b0da640 1 --2- 172.21.15.114:0/929528400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74f8003b50 0x7f751415e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:01.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.549+0000 7f751b0da640 1 -- 172.21.15.114:0/929528400 >> 172.21.15.114:0/929528400 conn(0x7f751406d460 msgr2=0x7f75140af300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:01.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.549+0000 7f751b0da640 1 -- 172.21.15.114:0/929528400 shutdown_connections 2024-04-28T13:07:01.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:01.549+0000 7f751b0da640 1 -- 172.21.15.114:0/929528400 wait complete. 2024-04-28T13:07:01.560 INFO:tasks.ceph:check_enable_crimson: False 2024-04-28T13:07:01.560 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-28T13:07:01.560 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:07:01.560 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-28T13:07:01.584 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:07:01.584 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-28T13:07:01.648 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:07:01.648 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-28T13:07:01.711 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:07:01.711 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-28T13:07:01.774 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:07:01.774 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-28T13:07:01.799 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:07:01.799 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-28T13:07:01.862 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:07:01.863 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-28T13:07:01.926 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:07:01.926 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-28T13:07:01.944 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-28T13:07:01.944+0000 7fe99136a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-28T13:07:01.966 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:07:01.965+0000 7f7eb2523040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-28T13:07:01.968 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 69ca919e-5c7b-4e90-997a-0e3cc1c774c1 0 2024-04-28T13:07:02.037 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-28T13:07:02.037+0000 7fe99136a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-28T13:07:02.051 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:07:02.051+0000 7f7eb2523040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-28T13:07:02.082 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-28T13:07:02.082+0000 7fe99136a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-28T13:07:02.093 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:07:02.093+0000 7f7eb2523040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-28T13:07:02.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.105+0000 7f95ad87b640 1 Processor -- start 2024-04-28T13:07:02.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.105+0000 7f95ad87b640 1 -- start start 2024-04-28T13:07:02.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.106+0000 7f95ad87b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f95a8070da0 0x7f95a80d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:02.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.106+0000 7f95ad87b640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95a8073be0 con 0x7f95a815d210 2024-04-28T13:07:02.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.106+0000 7f95ad87b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95a80d0200 con 0x7f95a806da70 2024-04-28T13:07:02.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.106+0000 7f95ad87b640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f95a815d5f0 con 0x7f95a8070da0 2024-04-28T13:07:02.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.106+0000 7f95a67fc640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f95a806da70 0x7f95a80b4580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55782/0 (socket says 172.21.15.134:55782) 2024-04-28T13:07:02.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.106+0000 7f95a67fc640 1 -- 172.21.15.134:0/4139837738 learned_addr learned my addr 172.21.15.134:0/4139837738 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-28T13:07:02.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.106+0000 7f95a77fe640 1 --2- 172.21.15.134:0/4139837738 >> v2:172.21.15.114:3300/0 conn(0x7f95a8070da0 0x7f95a80d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:02.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.107+0000 7f95a5ffb640 1 -- 172.21.15.134:0/4139837738 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 459477259 0 0) 0x7f95a80d0200 con 0x7f95a806da70 2024-04-28T13:07:02.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.107+0000 7f95a5ffb640 1 -- 172.21.15.134:0/4139837738 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9590003520 con 0x7f95a806da70 2024-04-28T13:07:02.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.107+0000 7f95a77fe640 1 -- 172.21.15.134:0/4139837738 >> v1:172.21.15.134:6789/0 conn(0x7f95a806da70 legacy=0x7f95a80b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:02.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.107+0000 7f95a77fe640 1 -- 172.21.15.134:0/4139837738 >> v1:172.21.15.114:6789/0 conn(0x7f95a815d210 legacy=0x7f95a806d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:02.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.107+0000 7f95a77fe640 1 -- 172.21.15.134:0/4139837738 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a80d04e0 con 0x7f95a8070da0 2024-04-28T13:07:02.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.108+0000 7f95a77fe640 1 --2- 172.21.15.134:0/4139837738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95a8070da0 0x7f95a80d0fc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f95a0009d90 tx=0x7f95a002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f4d2618a6cd46fe server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:02.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.108+0000 7f95a5ffb640 1 -- 172.21.15.134:0/4139837738 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a0007740 con 0x7f95a8070da0 2024-04-28T13:07:02.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.108+0000 7f95a5ffb640 1 -- 172.21.15.134:0/4139837738 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95a00078e0 con 0x7f95a8070da0 2024-04-28T13:07:02.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.108+0000 7f95a5ffb640 1 -- 172.21.15.134:0/4139837738 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a0007cb0 con 0x7f95a8070da0 2024-04-28T13:07:02.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.108+0000 7f95ad87b640 1 -- 172.21.15.134:0/4139837738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95a8070da0 msgr2=0x7f95a80d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:02.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.108+0000 7f95ad87b640 1 --2- 172.21.15.134:0/4139837738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95a8070da0 0x7f95a80d0fc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f95a0009d90 tx=0x7f95a002a5f0 comp rx=0 tx=0).stop 2024-04-28T13:07:02.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.108+0000 7f95ad87b640 1 -- 172.21.15.134:0/4139837738 shutdown_connections 2024-04-28T13:07:02.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.108+0000 7f95ad87b640 1 --2- 172.21.15.134:0/4139837738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95a8070da0 0x7f95a80d0fc0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:02.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.108+0000 7f95ad87b640 1 -- 172.21.15.134:0/4139837738 >> 172.21.15.134:0/4139837738 conn(0x7f95a8072950 msgr2=0x7f95a8072d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:02.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.108+0000 7f95ad87b640 1 -- 172.21.15.134:0/4139837738 shutdown_connections 2024-04-28T13:07:02.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.108+0000 7f95ad87b640 1 -- 172.21.15.134:0/4139837738 wait complete. 2024-04-28T13:07:02.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.109+0000 7f95ad87b640 1 Processor -- start 2024-04-28T13:07:02.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.110+0000 7f95ad87b640 1 -- start start 2024-04-28T13:07:02.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.110+0000 7f95ad87b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95a806da70 0x7f95a8158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:02.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.110+0000 7f95ad87b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95a8070da0 0x7f95a8156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:02.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.110+0000 7f95ad87b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95a815d210 0x7f95a80b2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:02.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.110+0000 7f95ad87b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f95a8073470 con 0x7f95a806da70 2024-04-28T13:07:02.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.110+0000 7f95ad87b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f95a80d0b30 con 0x7f95a815d210 2024-04-28T13:07:02.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.110+0000 7f95ad87b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f95a80735f0 con 0x7f95a8070da0 2024-04-28T13:07:02.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.111+0000 7f95a77fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95a815d210 0x7f95a80b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:02.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.111+0000 7f95a67fc640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95a8070da0 0x7f95a8156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:02.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.111+0000 7f95a77fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95a815d210 0x7f95a80b2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49834/0 (socket says 172.21.15.134:49834) 2024-04-28T13:07:02.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.111+0000 7f95a77fe640 1 -- 172.21.15.134:0/1647039211 learned_addr learned my addr 172.21.15.134:0/1647039211 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-28T13:07:02.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.111+0000 7f95a6ffd640 1 --2- 172.21.15.134:0/1647039211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95a806da70 0x7f95a8158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:02.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.111+0000 7f95a77fe640 1 -- 172.21.15.134:0/1647039211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95a8070da0 msgr2=0x7f95a8156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:02.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.111+0000 7f95a77fe640 1 --2- 172.21.15.134:0/1647039211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95a8070da0 0x7f95a8156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:02.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.111+0000 7f95a77fe640 1 -- 172.21.15.134:0/1647039211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95a806da70 msgr2=0x7f95a8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:02.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.111+0000 7f95a77fe640 1 --2- 172.21.15.134:0/1647039211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95a806da70 0x7f95a8158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:02.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.111+0000 7f95a77fe640 1 -- 172.21.15.134:0/1647039211 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a81586f0 con 0x7f95a815d210 2024-04-28T13:07:02.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.111+0000 7f95a67fc640 1 --2- 172.21.15.134:0/1647039211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95a8070da0 0x7f95a8156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:07:02.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.111+0000 7f95a6ffd640 1 --2- 172.21.15.134:0/1647039211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95a806da70 0x7f95a8158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:07:02.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.111+0000 7f95a77fe640 1 --2- 172.21.15.134:0/1647039211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95a815d210 0x7f95a80b2240 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f95a0009d90 tx=0x7f95a0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:02.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.111+0000 7f958ffff640 1 -- 172.21.15.134:0/1647039211 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a0040070 con 0x7f95a815d210 2024-04-28T13:07:02.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.111+0000 7f958ffff640 1 -- 172.21.15.134:0/1647039211 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95a0031bc0 con 0x7f95a815d210 2024-04-28T13:07:02.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.111+0000 7f95ad87b640 1 -- 172.21.15.134:0/1647039211 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95a80aa4e0 con 0x7f95a815d210 2024-04-28T13:07:02.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.111+0000 7f958ffff640 1 -- 172.21.15.134:0/1647039211 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a0009450 con 0x7f95a815d210 2024-04-28T13:07:02.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.111+0000 7f95ad87b640 1 -- 172.21.15.134:0/1647039211 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a80aaaa0 con 0x7f95a815d210 2024-04-28T13:07:02.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.111+0000 7f958ffff640 1 -- 172.21.15.134:0/1647039211 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f95a0039040 con 0x7f95a815d210 2024-04-28T13:07:02.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.111+0000 7f958ffff640 1 -- 172.21.15.134:0/1647039211 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f95a00046c0 con 0x7f95a815d210 2024-04-28T13:07:02.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.113+0000 7f95ad87b640 1 -- 172.21.15.134:0/1647039211 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95a806a3d0 con 0x7f95a815d210 2024-04-28T13:07:02.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.115+0000 7f958ffff640 1 -- 172.21.15.134:0/1647039211 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f95a0007840 con 0x7f95a815d210 2024-04-28T13:07:02.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.206+0000 7f95ad87b640 1 -- 172.21.15.134:0/1647039211 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "69ca919e-5c7b-4e90-997a-0e3cc1c774c1", "id": 0} v 0) -- 0x7f95a80b4510 con 0x7f95a815d210 2024-04-28T13:07:02.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.210+0000 7f958ffff640 1 -- 172.21.15.134:0/1647039211 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "69ca919e-5c7b-4e90-997a-0e3cc1c774c1", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f95a0004030 con 0x7f95a815d210 2024-04-28T13:07:02.210 INFO:teuthology.orchestra.run.smithi134.stdout:0 2024-04-28T13:07:02.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.211+0000 7f95ad87b640 1 -- 172.21.15.134:0/1647039211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95a815d210 msgr2=0x7f95a80b2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:02.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.211+0000 7f95ad87b640 1 --2- 172.21.15.134:0/1647039211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95a815d210 0x7f95a80b2240 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f95a0009d90 tx=0x7f95a0004a40 comp rx=0 tx=0).stop 2024-04-28T13:07:02.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.211+0000 7f95ad87b640 1 -- 172.21.15.134:0/1647039211 shutdown_connections 2024-04-28T13:07:02.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.211+0000 7f95ad87b640 1 --2- 172.21.15.134:0/1647039211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95a815d210 0x7f95a80b2240 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:02.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.211+0000 7f95ad87b640 1 --2- 172.21.15.134:0/1647039211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95a8070da0 0x7f95a8156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:02.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.211+0000 7f95ad87b640 1 --2- 172.21.15.134:0/1647039211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95a806da70 0x7f95a8158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:02.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.211+0000 7f95ad87b640 1 -- 172.21.15.134:0/1647039211 >> 172.21.15.134:0/1647039211 conn(0x7f95a8072950 msgr2=0x7f95a806d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:02.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.211+0000 7f95ad87b640 1 -- 172.21.15.134:0/1647039211 shutdown_connections 2024-04-28T13:07:02.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.211+0000 7f95ad87b640 1 -- 172.21.15.134:0/1647039211 wait complete. 2024-04-28T13:07:02.221 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 5192cc15-7cf4-43b2-a57b-77207a8c4201 1 2024-04-28T13:07:02.260 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:07:02.261+0000 7f7eb2523040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-28T13:07:02.275 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-28T13:07:02.275+0000 7fe99136a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-28T13:07:02.307 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:07:02.307+0000 7f7eb2523040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-28T13:07:02.333 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-28T13:07:02.333+0000 7fe99136a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-28T13:07:02.359 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:07:02.359+0000 7f7eb2523040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-28T13:07:02.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.359+0000 7f13c0ba4640 1 Processor -- start 2024-04-28T13:07:02.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.359+0000 7f13c0ba4640 1 -- start start 2024-04-28T13:07:02.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.360+0000 7f13c0ba4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f13bc070280 0x7f13bc1455f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:02.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.360+0000 7f13c0ba4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13bc0b6c50 con 0x7f13bc073400 2024-04-28T13:07:02.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.360+0000 7f13c0ba4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13bc0b60d0 con 0x7f13bc0737e0 2024-04-28T13:07:02.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.360+0000 7f13c0ba4640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f13bc0b63b0 con 0x7f13bc070280 2024-04-28T13:07:02.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.360+0000 7f13b9d9b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f13bc070280 0x7f13bc1455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:02.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.360+0000 7f13bad9d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f13bc0737e0 0x7f13bc0cfb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55790/0 (socket says 172.21.15.134:55790) 2024-04-28T13:07:02.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.360+0000 7f13bad9d640 1 -- 172.21.15.134:0/2092823173 learned_addr learned my addr 172.21.15.134:0/2092823173 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-28T13:07:02.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.360+0000 7f13b959a640 1 -- 172.21.15.134:0/2092823173 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1477279117 0 0) 0x7f13bc0b60d0 con 0x7f13bc0737e0 2024-04-28T13:07:02.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.360+0000 7f13b959a640 1 -- 172.21.15.134:0/2092823173 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13a4003520 con 0x7f13bc0737e0 2024-04-28T13:07:02.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.360+0000 7f13b9d9b640 1 -- 172.21.15.134:0/2092823173 >> v1:172.21.15.134:6789/0 conn(0x7f13bc0737e0 legacy=0x7f13bc0cfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:02.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.360+0000 7f13b9d9b640 1 -- 172.21.15.134:0/2092823173 >> v1:172.21.15.114:6789/0 conn(0x7f13bc073400 legacy=0x7f13bc0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:02.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.360+0000 7f13b959a640 1 -- 172.21.15.134:0/2092823173 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2170745178 0 0) 0x7f13bc0b6c50 con 0x7f13bc073400 2024-04-28T13:07:02.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.360+0000 7f13b9d9b640 1 -- 172.21.15.134:0/2092823173 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13bc0b6690 con 0x7f13bc070280 2024-04-28T13:07:02.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.361+0000 7f13b9d9b640 1 --2- 172.21.15.134:0/2092823173 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f13bc070280 0x7f13bc1455f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f13b00097d0 tx=0x7f13b002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2455b65e5d40f7a server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:02.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.361+0000 7f13b959a640 1 -- 172.21.15.134:0/2092823173 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b0037070 con 0x7f13bc070280 2024-04-28T13:07:02.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.361+0000 7f13b959a640 1 -- 172.21.15.134:0/2092823173 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b0032440 con 0x7f13bc070280 2024-04-28T13:07:02.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.361+0000 7f13b959a640 1 -- 172.21.15.134:0/2092823173 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b0032810 con 0x7f13bc070280 2024-04-28T13:07:02.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.362+0000 7f13c0ba4640 1 -- 172.21.15.134:0/2092823173 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f13bc070280 msgr2=0x7f13bc1455f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:02.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.362+0000 7f13c0ba4640 1 --2- 172.21.15.134:0/2092823173 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f13bc070280 0x7f13bc1455f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f13b00097d0 tx=0x7f13b002a210 comp rx=0 tx=0).stop 2024-04-28T13:07:02.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.362+0000 7f13c0ba4640 1 -- 172.21.15.134:0/2092823173 shutdown_connections 2024-04-28T13:07:02.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.362+0000 7f13c0ba4640 1 --2- 172.21.15.134:0/2092823173 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f13bc070280 0x7f13bc1455f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:02.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.362+0000 7f13c0ba4640 1 -- 172.21.15.134:0/2092823173 >> 172.21.15.134:0/2092823173 conn(0x7f13bc06d460 msgr2=0x7f13bc06d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:02.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.362+0000 7f13c0ba4640 1 -- 172.21.15.134:0/2092823173 shutdown_connections 2024-04-28T13:07:02.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.362+0000 7f13c0ba4640 1 -- 172.21.15.134:0/2092823173 wait complete. 2024-04-28T13:07:02.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.363+0000 7f13c0ba4640 1 Processor -- start 2024-04-28T13:07:02.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.363+0000 7f13c0ba4640 1 -- start start 2024-04-28T13:07:02.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.364+0000 7f13c0ba4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f13bc070280 0x7f13bc0b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:02.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.364+0000 7f13c0ba4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13bc073400 0x7f13bc1e5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:02.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.364+0000 7f13c0ba4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13bc0737e0 0x7f13bc06c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:02.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.364+0000 7f13c0ba4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f13bc145cb0 con 0x7f13bc073400 2024-04-28T13:07:02.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.364+0000 7f13c0ba4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f13bc145b30 con 0x7f13bc0737e0 2024-04-28T13:07:02.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.364+0000 7f13c0ba4640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f13bc145e30 con 0x7f13bc070280 2024-04-28T13:07:02.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.364+0000 7f13ba59c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f13bc070280 0x7f13bc0b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:02.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.364+0000 7f13ba59c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f13bc070280 0x7f13bc0b0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:40306/0 (socket says 172.21.15.134:40306) 2024-04-28T13:07:02.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.364+0000 7f13bad9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13bc0737e0 0x7f13bc06c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:02.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.364+0000 7f13ba59c640 1 -- 172.21.15.134:0/2954601517 learned_addr learned my addr 172.21.15.134:0/2954601517 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-28T13:07:02.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.364+0000 7f13b9d9b640 1 --2- 172.21.15.134:0/2954601517 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13bc073400 0x7f13bc1e5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:02.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.364+0000 7f13ba59c640 1 -- 172.21.15.134:0/2954601517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13bc0737e0 msgr2=0x7f13bc06c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:02.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.364+0000 7f13ba59c640 1 --2- 172.21.15.134:0/2954601517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13bc0737e0 0x7f13bc06c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:02.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.364+0000 7f13ba59c640 1 -- 172.21.15.134:0/2954601517 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13bc073400 msgr2=0x7f13bc1e5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:02.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.364+0000 7f13ba59c640 1 --2- 172.21.15.134:0/2954601517 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13bc073400 0x7f13bc1e5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:02.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.364+0000 7f13ba59c640 1 -- 172.21.15.134:0/2954601517 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13bc1e4ae0 con 0x7f13bc070280 2024-04-28T13:07:02.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.364+0000 7f13bad9d640 1 --2- 172.21.15.134:0/2954601517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13bc0737e0 0x7f13bc06c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:07:02.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.364+0000 7f13ba59c640 1 --2- 172.21.15.134:0/2954601517 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f13bc070280 0x7f13bc0b0b60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f13ac00c410 tx=0x7f13ac00c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:02.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.365+0000 7f13aaffd640 1 -- 172.21.15.134:0/2954601517 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ac017070 con 0x7f13bc070280 2024-04-28T13:07:02.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.365+0000 7f13aaffd640 1 -- 172.21.15.134:0/2954601517 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13ac0035f0 con 0x7f13bc070280 2024-04-28T13:07:02.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.365+0000 7f13c0ba4640 1 -- 172.21.15.134:0/2954601517 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13bc0b10a0 con 0x7f13bc070280 2024-04-28T13:07:02.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.365+0000 7f13aaffd640 1 -- 172.21.15.134:0/2954601517 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ac0039e0 con 0x7f13bc070280 2024-04-28T13:07:02.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.365+0000 7f13c0ba4640 1 -- 172.21.15.134:0/2954601517 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f13bc1e4d80 con 0x7f13bc070280 2024-04-28T13:07:02.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.365+0000 7f13aaffd640 1 -- 172.21.15.134:0/2954601517 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f13ac01a070 con 0x7f13bc070280 2024-04-28T13:07:02.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.365+0000 7f13aaffd640 1 -- 172.21.15.134:0/2954601517 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f13ac0127b0 con 0x7f13bc070280 2024-04-28T13:07:02.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.366+0000 7f13c0ba4640 1 -- 172.21.15.134:0/2954601517 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13bc0693f0 con 0x7f13bc070280 2024-04-28T13:07:02.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.370+0000 7f13aaffd640 1 -- 172.21.15.134:0/2954601517 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f13bc0693f0 con 0x7f13bc070280 2024-04-28T13:07:02.390 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-28T13:07:02.390+0000 7fe99136a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-28T13:07:02.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.442+0000 7f13c0ba4640 1 -- 172.21.15.134:0/2954601517 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5192cc15-7cf4-43b2-a57b-77207a8c4201", "id": 1} v 0) -- 0x7f13bc06a3d0 con 0x7f13bc070280 2024-04-28T13:07:02.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.448+0000 7f13aaffd640 1 -- 172.21.15.134:0/2954601517 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5192cc15-7cf4-43b2-a57b-77207a8c4201", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f13ac021070 con 0x7f13bc070280 2024-04-28T13:07:02.448 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-04-28T13:07:02.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.448+0000 7f13c0ba4640 1 -- 172.21.15.134:0/2954601517 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f13bc070280 msgr2=0x7f13bc0b0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:02.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.448+0000 7f13c0ba4640 1 --2- 172.21.15.134:0/2954601517 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f13bc070280 0x7f13bc0b0b60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f13ac00c410 tx=0x7f13ac00c8d0 comp rx=0 tx=0).stop 2024-04-28T13:07:02.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.448+0000 7f13c0ba4640 1 -- 172.21.15.134:0/2954601517 shutdown_connections 2024-04-28T13:07:02.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.449+0000 7f13c0ba4640 1 --2- 172.21.15.134:0/2954601517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13bc0737e0 0x7f13bc06c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:02.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.449+0000 7f13c0ba4640 1 --2- 172.21.15.134:0/2954601517 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13bc073400 0x7f13bc1e5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:02.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.449+0000 7f13c0ba4640 1 --2- 172.21.15.134:0/2954601517 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f13bc070280 0x7f13bc0b0b60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:02.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.449+0000 7f13c0ba4640 1 -- 172.21.15.134:0/2954601517 >> 172.21.15.134:0/2954601517 conn(0x7f13bc06d460 msgr2=0x7f13bc144390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:02.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.449+0000 7f13c0ba4640 1 -- 172.21.15.134:0/2954601517 shutdown_connections 2024-04-28T13:07:02.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.449+0000 7f13c0ba4640 1 -- 172.21.15.134:0/2954601517 wait complete. 2024-04-28T13:07:02.459 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new a73196a7-2ecb-42c6-9b37-ff7927fcf8ef 2 2024-04-28T13:07:02.471 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:07:02.471+0000 7f7eb2523040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-28T13:07:02.508 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-28T13:07:02.508+0000 7fe99136a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-28T13:07:02.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.595+0000 7fc6e5de9640 1 Processor -- start 2024-04-28T13:07:02.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.595+0000 7fc6e5de9640 1 -- start start 2024-04-28T13:07:02.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.596+0000 7fc6e5de9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6e015f470 0x7fc6e006eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:02.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.596+0000 7fc6e5de9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6e00b4720 con 0x7fc6e00ae8c0 2024-04-28T13:07:02.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.596+0000 7fc6e5de9640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6e00b49c0 con 0x7fc6e006d360 2024-04-28T13:07:02.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.596+0000 7fc6e5de9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc6e00b4ca0 con 0x7fc6e015f470 2024-04-28T13:07:02.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.596+0000 7fc6df7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6e015f470 0x7fc6e006eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:02.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.596+0000 7fc6dffff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fc6e006d360 0x7fc6e00b5780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55800/0 (socket says 172.21.15.134:55800) 2024-04-28T13:07:02.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.596+0000 7fc6dffff640 1 -- 172.21.15.134:0/790105210 learned_addr learned my addr 172.21.15.134:0/790105210 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-28T13:07:02.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.596+0000 7fc6df7fe640 1 -- 172.21.15.134:0/790105210 >> v1:172.21.15.134:6789/0 conn(0x7fc6e006d360 legacy=0x7fc6e00b5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:02.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.596+0000 7fc6de7fc640 1 -- 172.21.15.134:0/790105210 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1069531589 0 0) 0x7fc6e00b49c0 con 0x7fc6e006d360 2024-04-28T13:07:02.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.596+0000 7fc6df7fe640 1 -- 172.21.15.134:0/790105210 >> v1:172.21.15.114:6789/0 conn(0x7fc6e00ae8c0 legacy=0x7fc6e0073680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:02.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.596+0000 7fc6df7fe640 1 -- 172.21.15.134:0/790105210 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e00b4f80 con 0x7fc6e015f470 2024-04-28T13:07:02.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.597+0000 7fc6df7fe640 1 --2- 172.21.15.134:0/790105210 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6e015f470 0x7fc6e006eac0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc6d40097d0 tx=0x7fc6d402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57ea9f75796c993e server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:02.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.597+0000 7fc6de7fc640 1 -- 172.21.15.134:0/790105210 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4037070 con 0x7fc6e015f470 2024-04-28T13:07:02.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.597+0000 7fc6de7fc640 1 -- 172.21.15.134:0/790105210 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d4032440 con 0x7fc6e015f470 2024-04-28T13:07:02.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.597+0000 7fc6de7fc640 1 -- 172.21.15.134:0/790105210 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4032810 con 0x7fc6e015f470 2024-04-28T13:07:02.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.598+0000 7fc6e5de9640 1 -- 172.21.15.134:0/790105210 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6e015f470 msgr2=0x7fc6e006eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:02.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.598+0000 7fc6e5de9640 1 --2- 172.21.15.134:0/790105210 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6e015f470 0x7fc6e006eac0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc6d40097d0 tx=0x7fc6d402a180 comp rx=0 tx=0).stop 2024-04-28T13:07:02.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.598+0000 7fc6e5de9640 1 -- 172.21.15.134:0/790105210 shutdown_connections 2024-04-28T13:07:02.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.598+0000 7fc6e5de9640 1 --2- 172.21.15.134:0/790105210 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6e015f470 0x7fc6e006eac0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:02.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.598+0000 7fc6e5de9640 1 -- 172.21.15.134:0/790105210 >> 172.21.15.134:0/790105210 conn(0x7fc6e0072950 msgr2=0x7fc6e0072d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:02.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.598+0000 7fc6e5de9640 1 -- 172.21.15.134:0/790105210 shutdown_connections 2024-04-28T13:07:02.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.598+0000 7fc6e5de9640 1 -- 172.21.15.134:0/790105210 wait complete. 2024-04-28T13:07:02.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.599+0000 7fc6e5de9640 1 Processor -- start 2024-04-28T13:07:02.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.599+0000 7fc6e5de9640 1 -- start start 2024-04-28T13:07:02.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.600+0000 7fc6e5de9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6e006d360 0x7fc6e01621d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:02.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.600+0000 7fc6e5de9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6e00ae8c0 0x7fc6e0160200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:02.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.600+0000 7fc6e5de9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6e015f470 0x7fc6e0153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:02.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.600+0000 7fc6e5de9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e006d950 con 0x7fc6e006d360 2024-04-28T13:07:02.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.600+0000 7fc6e5de9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e006d7d0 con 0x7fc6e015f470 2024-04-28T13:07:02.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.600+0000 7fc6e5de9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc6e006dad0 con 0x7fc6e00ae8c0 2024-04-28T13:07:02.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.600+0000 7fc6deffd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6e00ae8c0 0x7fc6e0160200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:02.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.600+0000 7fc6dffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6e015f470 0x7fc6e0153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:02.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.600+0000 7fc6deffd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6e00ae8c0 0x7fc6e0160200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:40318/0 (socket says 172.21.15.134:40318) 2024-04-28T13:07:02.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.600+0000 7fc6dffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6e015f470 0x7fc6e0153d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49854/0 (socket says 172.21.15.134:49854) 2024-04-28T13:07:02.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.600+0000 7fc6deffd640 1 -- 172.21.15.134:0/4229633314 learned_addr learned my addr 172.21.15.134:0/4229633314 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-28T13:07:02.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.600+0000 7fc6df7fe640 1 --2- 172.21.15.134:0/4229633314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6e006d360 0x7fc6e01621d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:02.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.600+0000 7fc6deffd640 1 -- 172.21.15.134:0/4229633314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6e015f470 msgr2=0x7fc6e0153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:02.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.600+0000 7fc6deffd640 1 --2- 172.21.15.134:0/4229633314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6e015f470 0x7fc6e0153d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:02.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.600+0000 7fc6deffd640 1 -- 172.21.15.134:0/4229633314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6e006d360 msgr2=0x7fc6e01621d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:02.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.600+0000 7fc6deffd640 1 --2- 172.21.15.134:0/4229633314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6e006d360 0x7fc6e01621d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:02.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.600+0000 7fc6deffd640 1 -- 172.21.15.134:0/4229633314 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e015a370 con 0x7fc6e00ae8c0 2024-04-28T13:07:02.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.600+0000 7fc6dffff640 1 --2- 172.21.15.134:0/4229633314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6e015f470 0x7fc6e0153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:07:02.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.600+0000 7fc6deffd640 1 --2- 172.21.15.134:0/4229633314 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6e00ae8c0 0x7fc6e0160200 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000c400 tx=0x7fc6d000c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:02.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.601+0000 7fc6c7fff640 1 -- 172.21.15.134:0/4229633314 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0017070 con 0x7fc6e00ae8c0 2024-04-28T13:07:02.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.601+0000 7fc6c7fff640 1 -- 172.21.15.134:0/4229633314 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d00052d0 con 0x7fc6e00ae8c0 2024-04-28T13:07:02.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.601+0000 7fc6c7fff640 1 -- 172.21.15.134:0/4229633314 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0003850 con 0x7fc6e00ae8c0 2024-04-28T13:07:02.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.601+0000 7fc6e5de9640 1 -- 172.21.15.134:0/4229633314 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6e015a650 con 0x7fc6e00ae8c0 2024-04-28T13:07:02.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.601+0000 7fc6e5de9640 1 -- 172.21.15.134:0/4229633314 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6e015ac10 con 0x7fc6e00ae8c0 2024-04-28T13:07:02.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.601+0000 7fc6c7fff640 1 -- 172.21.15.134:0/4229633314 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc6d001a070 con 0x7fc6e00ae8c0 2024-04-28T13:07:02.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.601+0000 7fc6c7fff640 1 -- 172.21.15.134:0/4229633314 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fc6d0011cf0 con 0x7fc6e00ae8c0 2024-04-28T13:07:02.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.602+0000 7fc6e5de9640 1 -- 172.21.15.134:0/4229633314 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6e006a3d0 con 0x7fc6e00ae8c0 2024-04-28T13:07:02.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.604+0000 7fc6c7fff640 1 -- 172.21.15.134:0/4229633314 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fc6d0021070 con 0x7fc6e00ae8c0 2024-04-28T13:07:02.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.676+0000 7fc6e5de9640 1 -- 172.21.15.134:0/4229633314 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a73196a7-2ecb-42c6-9b37-ff7927fcf8ef", "id": 2} v 0) -- 0x7fc6e0070980 con 0x7fc6e00ae8c0 2024-04-28T13:07:02.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.679+0000 7fc6c7fff640 1 -- 172.21.15.134:0/4229633314 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a73196a7-2ecb-42c6-9b37-ff7927fcf8ef", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fc6d00115d0 con 0x7fc6e00ae8c0 2024-04-28T13:07:02.679 INFO:teuthology.orchestra.run.smithi134.stdout:2 2024-04-28T13:07:02.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.680+0000 7fc6e5de9640 1 -- 172.21.15.134:0/4229633314 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6e00ae8c0 msgr2=0x7fc6e0160200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:02.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.680+0000 7fc6e5de9640 1 --2- 172.21.15.134:0/4229633314 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6e00ae8c0 0x7fc6e0160200 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000c400 tx=0x7fc6d000c8c0 comp rx=0 tx=0).stop 2024-04-28T13:07:02.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.680+0000 7fc6e5de9640 1 -- 172.21.15.134:0/4229633314 shutdown_connections 2024-04-28T13:07:02.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.680+0000 7fc6e5de9640 1 --2- 172.21.15.134:0/4229633314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6e015f470 0x7fc6e0153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:02.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.680+0000 7fc6e5de9640 1 --2- 172.21.15.134:0/4229633314 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6e00ae8c0 0x7fc6e0160200 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:02.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.680+0000 7fc6e5de9640 1 --2- 172.21.15.134:0/4229633314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6e006d360 0x7fc6e01621d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:02.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.680+0000 7fc6e5de9640 1 -- 172.21.15.134:0/4229633314 >> 172.21.15.134:0/4229633314 conn(0x7fc6e0072950 msgr2=0x7fc6e015e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:02.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.680+0000 7fc6e5de9640 1 -- 172.21.15.134:0/4229633314 shutdown_connections 2024-04-28T13:07:02.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.680+0000 7fc6e5de9640 1 -- 172.21.15.134:0/4229633314 wait complete. 2024-04-28T13:07:02.691 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 40509c3a-36c0-4349-a224-c535be2c2a26 3 2024-04-28T13:07:02.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.828+0000 7f0a276bd640 1 Processor -- start 2024-04-28T13:07:02.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.828+0000 7f0a276bd640 1 -- start start 2024-04-28T13:07:02.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.829+0000 7f0a276bd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0a2015d510 0x7f0a200b5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:02.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.829+0000 7f0a276bd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0a200d0c30 0x7f0a200d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:02.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.829+0000 7f0a276bd640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a200d1070 con 0x7f0a200d17a0 2024-04-28T13:07:02.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.829+0000 7f0a276bd640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f0a200d1bf0 con 0x7f0a2015d510 2024-04-28T13:07:02.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.829+0000 7f0a276bd640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f0a200cecd0 con 0x7f0a200d0c30 2024-04-28T13:07:02.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.829+0000 7f0a24c58640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0a200d0c30 0x7f0a200d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:02.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.829+0000 7f0a24c58640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0a200d0c30 0x7f0a200d1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49866/0 (socket says 172.21.15.134:49866) 2024-04-28T13:07:02.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.829+0000 7f0a24c58640 1 -- 172.21.15.134:0/1231499068 learned_addr learned my addr 172.21.15.134:0/1231499068 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-28T13:07:02.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.829+0000 7f0a25459640 1 --2- 172.21.15.134:0/1231499068 >> v2:172.21.15.114:3300/0 conn(0x7f0a2015d510 0x7f0a200b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:02.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.829+0000 7f0a24c58640 1 -- 172.21.15.134:0/1231499068 >> v2:172.21.15.114:3300/0 conn(0x7f0a2015d510 msgr2=0x7f0a200b5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:02.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.829+0000 7f0a24c58640 1 --2- 172.21.15.134:0/1231499068 >> v2:172.21.15.114:3300/0 conn(0x7f0a2015d510 0x7f0a200b5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:02.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.829+0000 7f0a24c58640 1 -- 172.21.15.134:0/1231499068 >> v1:172.21.15.114:6789/0 conn(0x7f0a200d17a0 legacy=0x7f0a2009b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:02.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.829+0000 7f0a24c58640 1 -- 172.21.15.134:0/1231499068 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a200b24f0 con 0x7f0a200d0c30 2024-04-28T13:07:02.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.830+0000 7f0a24c58640 1 --2- 172.21.15.134:0/1231499068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a200d0c30 0x7f0a200d1260 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0a2006d130 tx=0x7f0a1002a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d22b9d6c922d6eef server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:02.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.830+0000 7f0a17fff640 1 -- 172.21.15.134:0/1231499068 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a10037070 con 0x7f0a200d0c30 2024-04-28T13:07:02.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.830+0000 7f0a17fff640 1 -- 172.21.15.134:0/1231499068 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a10032440 con 0x7f0a200d0c30 2024-04-28T13:07:02.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.830+0000 7f0a17fff640 1 -- 172.21.15.134:0/1231499068 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a10032810 con 0x7f0a200d0c30 2024-04-28T13:07:02.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.831+0000 7f0a276bd640 1 -- 172.21.15.134:0/1231499068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a200d0c30 msgr2=0x7f0a200d1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:02.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.831+0000 7f0a276bd640 1 --2- 172.21.15.134:0/1231499068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a200d0c30 0x7f0a200d1260 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0a2006d130 tx=0x7f0a1002a1e0 comp rx=0 tx=0).stop 2024-04-28T13:07:02.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.831+0000 7f0a276bd640 1 -- 172.21.15.134:0/1231499068 shutdown_connections 2024-04-28T13:07:02.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.831+0000 7f0a276bd640 1 --2- 172.21.15.134:0/1231499068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a200d0c30 0x7f0a200d1260 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:02.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.831+0000 7f0a276bd640 1 --2- 172.21.15.134:0/1231499068 >> v2:172.21.15.114:3300/0 conn(0x7f0a2015d510 0x7f0a200b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:02.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.831+0000 7f0a276bd640 1 -- 172.21.15.134:0/1231499068 >> 172.21.15.134:0/1231499068 conn(0x7f0a200b4b50 msgr2=0x7f0a200b4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:02.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.831+0000 7f0a276bd640 1 -- 172.21.15.134:0/1231499068 shutdown_connections 2024-04-28T13:07:02.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.831+0000 7f0a276bd640 1 -- 172.21.15.134:0/1231499068 wait complete. 2024-04-28T13:07:02.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.832+0000 7f0a276bd640 1 Processor -- start 2024-04-28T13:07:02.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.832+0000 7f0a276bd640 1 -- start start 2024-04-28T13:07:02.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.833+0000 7f0a276bd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a200d0c30 0x7f0a200ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:02.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.833+0000 7f0a276bd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a200d17a0 0x7f0a201566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:02.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.833+0000 7f0a276bd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0a2015d510 0x7f0a200ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:02.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.833+0000 7f0a276bd640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0a200ce960 con 0x7f0a200d0c30 2024-04-28T13:07:02.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.833+0000 7f0a276bd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0a200ce680 con 0x7f0a200d17a0 2024-04-28T13:07:02.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.833+0000 7f0a276bd640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f0a200713b0 con 0x7f0a2015d510 2024-04-28T13:07:02.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.833+0000 7f0a24c58640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a200d17a0 0x7f0a201566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:02.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.833+0000 7f0a25c5a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0a2015d510 0x7f0a200ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:02.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.833+0000 7f0a24c58640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a200d17a0 0x7f0a201566a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49880/0 (socket says 172.21.15.134:49880) 2024-04-28T13:07:02.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.833+0000 7f0a24c58640 1 -- 172.21.15.134:0/3868163287 learned_addr learned my addr 172.21.15.134:0/3868163287 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-28T13:07:02.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.833+0000 7f0a25459640 1 --2- 172.21.15.134:0/3868163287 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a200d0c30 0x7f0a200ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:02.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.833+0000 7f0a24c58640 1 -- 172.21.15.134:0/3868163287 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0a2015d510 msgr2=0x7f0a200ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:02.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.833+0000 7f0a24c58640 1 --2- 172.21.15.134:0/3868163287 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0a2015d510 0x7f0a200ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:02.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.833+0000 7f0a24c58640 1 -- 172.21.15.134:0/3868163287 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a200d0c30 msgr2=0x7f0a200ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:02.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.833+0000 7f0a24c58640 1 --2- 172.21.15.134:0/3868163287 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a200d0c30 0x7f0a200ca2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:02.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.833+0000 7f0a24c58640 1 -- 172.21.15.134:0/3868163287 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a200cba50 con 0x7f0a200d17a0 2024-04-28T13:07:02.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.833+0000 7f0a24c58640 1 --2- 172.21.15.134:0/3868163287 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a200d17a0 0x7f0a201566a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0a1002a220 tx=0x7f0a100046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:02.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.833+0000 7f0a15ffb640 1 -- 172.21.15.134:0/3868163287 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a10037040 con 0x7f0a200d17a0 2024-04-28T13:07:02.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.833+0000 7f0a15ffb640 1 -- 172.21.15.134:0/3868163287 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a10042070 con 0x7f0a200d17a0 2024-04-28T13:07:02.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.833+0000 7f0a276bd640 1 -- 172.21.15.134:0/3868163287 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a200caf10 con 0x7f0a200d17a0 2024-04-28T13:07:02.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.833+0000 7f0a15ffb640 1 -- 172.21.15.134:0/3868163287 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a10030880 con 0x7f0a200d17a0 2024-04-28T13:07:02.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.834+0000 7f0a276bd640 1 -- 172.21.15.134:0/3868163287 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a200cb490 con 0x7f0a200d17a0 2024-04-28T13:07:02.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.834+0000 7f0a15ffb640 1 -- 172.21.15.134:0/3868163287 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0a10030a20 con 0x7f0a200d17a0 2024-04-28T13:07:02.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.834+0000 7f0a15ffb640 1 -- 172.21.15.134:0/3868163287 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f0a1003b430 con 0x7f0a200d17a0 2024-04-28T13:07:02.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.835+0000 7f0a276bd640 1 -- 172.21.15.134:0/3868163287 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a2015caa0 con 0x7f0a200d17a0 2024-04-28T13:07:02.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.837+0000 7f0a15ffb640 1 -- 172.21.15.134:0/3868163287 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f0a10047460 con 0x7f0a200d17a0 2024-04-28T13:07:02.847 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:07:02.848+0000 7f7eb2523040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-28T13:07:02.904 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-28T13:07:02.904+0000 7fe99136a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-28T13:07:02.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.908+0000 7f0a276bd640 1 -- 172.21.15.134:0/3868163287 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "40509c3a-36c0-4349-a224-c535be2c2a26", "id": 3} v 0) -- 0x7f0a20076120 con 0x7f0a200d17a0 2024-04-28T13:07:02.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.911+0000 7f0a15ffb640 1 -- 172.21.15.134:0/3868163287 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "40509c3a-36c0-4349-a224-c535be2c2a26", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f0a100476e0 con 0x7f0a200d17a0 2024-04-28T13:07:02.911 INFO:teuthology.orchestra.run.smithi134.stdout:3 2024-04-28T13:07:02.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.912+0000 7f0a276bd640 1 -- 172.21.15.134:0/3868163287 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a200d17a0 msgr2=0x7f0a201566a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:02.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.912+0000 7f0a276bd640 1 --2- 172.21.15.134:0/3868163287 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a200d17a0 0x7f0a201566a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0a1002a220 tx=0x7f0a100046c0 comp rx=0 tx=0).stop 2024-04-28T13:07:02.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.912+0000 7f0a276bd640 1 -- 172.21.15.134:0/3868163287 shutdown_connections 2024-04-28T13:07:02.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.912+0000 7f0a276bd640 1 --2- 172.21.15.134:0/3868163287 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0a2015d510 0x7f0a200ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:02.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.912+0000 7f0a276bd640 1 --2- 172.21.15.134:0/3868163287 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a200d17a0 0x7f0a201566a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:02.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.912+0000 7f0a276bd640 1 --2- 172.21.15.134:0/3868163287 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a200d0c30 0x7f0a200ca2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:02.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.912+0000 7f0a276bd640 1 -- 172.21.15.134:0/3868163287 >> 172.21.15.134:0/3868163287 conn(0x7f0a200b4b50 msgr2=0x7f0a200b3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:02.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.912+0000 7f0a276bd640 1 -- 172.21.15.134:0/3868163287 shutdown_connections 2024-04-28T13:07:02.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:02.912+0000 7f0a276bd640 1 -- 172.21.15.134:0/3868163287 wait complete. 2024-04-28T13:07:02.923 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 234d6f2f-d39a-41f2-a50b-012ad966201a 4 2024-04-28T13:07:03.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.018+0000 7fedb7a52640 1 Processor -- start 2024-04-28T13:07:03.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.018+0000 7fedb7a52640 1 -- start start 2024-04-28T13:07:03.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.019+0000 7fedb7a52640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fedb015d210 0x7fedb00d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:03.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.019+0000 7fedb7a52640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fedb006da70 0x7fedb0073470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:03.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.019+0000 7fedb7a52640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedb0073be0 con 0x7fedb0070da0 2024-04-28T13:07:03.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.019+0000 7fedb7a52640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fedb015d5f0 con 0x7fedb015d210 2024-04-28T13:07:03.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.019+0000 7fedb7a52640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fedb00739b0 con 0x7fedb006da70 2024-04-28T13:07:03.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.019+0000 7fedb5fef640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fedb006da70 0x7fedb0073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:03.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.019+0000 7fedb4fed640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fedb0070da0 0x7fedb006d360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:55812/0 (socket says 172.21.15.134:55812) 2024-04-28T13:07:03.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.019+0000 7fedb4fed640 1 -- 172.21.15.134:0/3224649106 learned_addr learned my addr 172.21.15.134:0/3224649106 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-28T13:07:03.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.020+0000 7fedb57ee640 1 --2- 172.21.15.134:0/3224649106 >> v2:172.21.15.114:3300/0 conn(0x7fedb015d210 0x7fedb00d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:03.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.020+0000 7fedb5fef640 1 -- 172.21.15.134:0/3224649106 >> v2:172.21.15.114:3300/0 conn(0x7fedb015d210 msgr2=0x7fedb00d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:03.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.020+0000 7fedb5fef640 1 --2- 172.21.15.134:0/3224649106 >> v2:172.21.15.114:3300/0 conn(0x7fedb015d210 0x7fedb00d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.020+0000 7fedb5fef640 1 -- 172.21.15.134:0/3224649106 >> v1:172.21.15.134:6789/0 conn(0x7fedb0070da0 legacy=0x7fedb006d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:03.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.020+0000 7feda7fff640 1 -- 172.21.15.134:0/3224649106 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 668847196 0 0) 0x7fedb0073be0 con 0x7fedb0070da0 2024-04-28T13:07:03.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.020+0000 7fedb5fef640 1 -- 172.21.15.134:0/3224649106 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb00d0200 con 0x7fedb006da70 2024-04-28T13:07:03.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.020+0000 7fedb5fef640 1 --2- 172.21.15.134:0/3224649106 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fedb006da70 0x7fedb0073470 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7feda8009d90 tx=0x7feda802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=555b01fc3e5426a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:03.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.021+0000 7feda7fff640 1 -- 172.21.15.134:0/3224649106 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda8007740 con 0x7fedb006da70 2024-04-28T13:07:03.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.021+0000 7feda7fff640 1 -- 172.21.15.134:0/3224649106 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda80078e0 con 0x7fedb006da70 2024-04-28T13:07:03.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.021+0000 7feda7fff640 1 -- 172.21.15.134:0/3224649106 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda8007cb0 con 0x7fedb006da70 2024-04-28T13:07:03.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.021+0000 7fedb7a52640 1 -- 172.21.15.134:0/3224649106 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fedb006da70 msgr2=0x7fedb0073470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:03.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.021+0000 7fedb7a52640 1 --2- 172.21.15.134:0/3224649106 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fedb006da70 0x7fedb0073470 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7feda8009d90 tx=0x7feda802a660 comp rx=0 tx=0).stop 2024-04-28T13:07:03.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.021+0000 7fedb7a52640 1 -- 172.21.15.134:0/3224649106 shutdown_connections 2024-04-28T13:07:03.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.021+0000 7fedb7a52640 1 --2- 172.21.15.134:0/3224649106 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fedb006da70 0x7fedb0073470 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.021+0000 7fedb7a52640 1 --2- 172.21.15.134:0/3224649106 >> v2:172.21.15.114:3300/0 conn(0x7fedb015d210 0x7fedb00d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.021+0000 7fedb7a52640 1 -- 172.21.15.134:0/3224649106 >> 172.21.15.134:0/3224649106 conn(0x7fedb0072950 msgr2=0x7fedb0072d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:03.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.021+0000 7fedb7a52640 1 -- 172.21.15.134:0/3224649106 shutdown_connections 2024-04-28T13:07:03.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.021+0000 7fedb7a52640 1 -- 172.21.15.134:0/3224649106 wait complete. 2024-04-28T13:07:03.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.022+0000 7fedb7a52640 1 Processor -- start 2024-04-28T13:07:03.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.023+0000 7fedb7a52640 1 -- start start 2024-04-28T13:07:03.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.023+0000 7fedb7a52640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedb006da70 0x7fedb00b01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:03.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.023+0000 7fedb7a52640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fedb0070da0 0x7fedb00cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:03.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.023+0000 7fedb7a52640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedb015d210 0x7fedb0157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:03.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.023+0000 7fedb7a52640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fedb00d07c0 con 0x7fedb006da70 2024-04-28T13:07:03.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.023+0000 7fedb7a52640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fedb00d0b30 con 0x7fedb015d210 2024-04-28T13:07:03.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.023+0000 7fedb7a52640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fedb00b4580 con 0x7fedb0070da0 2024-04-28T13:07:03.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.023+0000 7fedb4fed640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fedb0070da0 0x7fedb00cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:03.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.023+0000 7fedb5fef640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedb015d210 0x7fedb0157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:03.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.023+0000 7fedb5fef640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedb015d210 0x7fedb0157960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49894/0 (socket says 172.21.15.134:49894) 2024-04-28T13:07:03.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.023+0000 7fedb4fed640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fedb0070da0 0x7fedb00cdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:40346/0 (socket says 172.21.15.134:40346) 2024-04-28T13:07:03.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.023+0000 7fedb5fef640 1 -- 172.21.15.134:0/1417797220 learned_addr learned my addr 172.21.15.134:0/1417797220 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-28T13:07:03.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.023+0000 7fedb57ee640 1 --2- 172.21.15.134:0/1417797220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedb006da70 0x7fedb00b01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:03.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.024+0000 7fedb4fed640 1 -- 172.21.15.134:0/1417797220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedb015d210 msgr2=0x7fedb0157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:03.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.024+0000 7fedb4fed640 1 --2- 172.21.15.134:0/1417797220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedb015d210 0x7fedb0157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.024+0000 7fedb4fed640 1 -- 172.21.15.134:0/1417797220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedb006da70 msgr2=0x7fedb00b01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:03.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.024+0000 7fedb4fed640 1 --2- 172.21.15.134:0/1417797220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedb006da70 0x7fedb00b01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.024+0000 7fedb4fed640 1 -- 172.21.15.134:0/1417797220 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb0149b30 con 0x7fedb0070da0 2024-04-28T13:07:03.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.024+0000 7fedb5fef640 1 --2- 172.21.15.134:0/1417797220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedb015d210 0x7fedb0157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:07:03.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.024+0000 7fedb57ee640 1 --2- 172.21.15.134:0/1417797220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedb006da70 0x7fedb00b01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:07:03.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.024+0000 7fedb4fed640 1 --2- 172.21.15.134:0/1417797220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fedb0070da0 0x7fedb00cdec0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fedac00c450 tx=0x7fedac00c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:03.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.024+0000 7feda5ffb640 1 -- 172.21.15.134:0/1417797220 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedac018070 con 0x7fedb0070da0 2024-04-28T13:07:03.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.024+0000 7feda5ffb640 1 -- 172.21.15.134:0/1417797220 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedac0074e0 con 0x7fedb0070da0 2024-04-28T13:07:03.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.024+0000 7fedb7a52640 1 -- 172.21.15.134:0/1417797220 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedb00af700 con 0x7fedb0070da0 2024-04-28T13:07:03.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.024+0000 7feda5ffb640 1 -- 172.21.15.134:0/1417797220 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedac004a20 con 0x7fedb0070da0 2024-04-28T13:07:03.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.024+0000 7fedb7a52640 1 -- 172.21.15.134:0/1417797220 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fedb00afcc0 con 0x7fedb0070da0 2024-04-28T13:07:03.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.024+0000 7feda5ffb640 1 -- 172.21.15.134:0/1417797220 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fedac01b070 con 0x7fedb0070da0 2024-04-28T13:07:03.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.024+0000 7feda5ffb640 1 -- 172.21.15.134:0/1417797220 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fedac012910 con 0x7fedb0070da0 2024-04-28T13:07:03.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.025+0000 7fedb7a52640 1 -- 172.21.15.134:0/1417797220 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedb01469e0 con 0x7fedb0070da0 2024-04-28T13:07:03.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.027+0000 7feda5ffb640 1 -- 172.21.15.134:0/1417797220 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fedb01469e0 con 0x7fedb0070da0 2024-04-28T13:07:03.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.097+0000 7fedb7a52640 1 -- 172.21.15.134:0/1417797220 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd new", "uuid": "234d6f2f-d39a-41f2-a50b-012ad966201a", "id": 4} v 0) -- 0x7fedb00afe90 con 0x7fedb0070da0 2024-04-28T13:07:03.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.102+0000 7feda5ffb640 1 -- 172.21.15.134:0/1417797220 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "234d6f2f-d39a-41f2-a50b-012ad966201a", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fedac012cc0 con 0x7fedb0070da0 2024-04-28T13:07:03.103 INFO:teuthology.orchestra.run.smithi134.stdout:4 2024-04-28T13:07:03.103 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:07:03.104+0000 7f7eb2523040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-28T13:07:03.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.104+0000 7fedb7a52640 1 -- 172.21.15.134:0/1417797220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fedb0070da0 msgr2=0x7fedb00cdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:03.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.104+0000 7fedb7a52640 1 --2- 172.21.15.134:0/1417797220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fedb0070da0 0x7fedb00cdec0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fedac00c450 tx=0x7fedac00c910 comp rx=0 tx=0).stop 2024-04-28T13:07:03.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.104+0000 7fedb7a52640 1 -- 172.21.15.134:0/1417797220 shutdown_connections 2024-04-28T13:07:03.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.104+0000 7fedb7a52640 1 --2- 172.21.15.134:0/1417797220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedb015d210 0x7fedb0157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.104+0000 7fedb7a52640 1 --2- 172.21.15.134:0/1417797220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fedb0070da0 0x7fedb00cdec0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.104+0000 7fedb7a52640 1 --2- 172.21.15.134:0/1417797220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedb006da70 0x7fedb00b01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.104+0000 7fedb7a52640 1 -- 172.21.15.134:0/1417797220 >> 172.21.15.134:0/1417797220 conn(0x7fedb0072950 msgr2=0x7fedb00b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:03.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.104+0000 7fedb7a52640 1 -- 172.21.15.134:0/1417797220 shutdown_connections 2024-04-28T13:07:03.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.104+0000 7fedb7a52640 1 -- 172.21.15.134:0/1417797220 wait complete. 2024-04-28T13:07:03.114 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new baa42689-53c8-457b-b5ef-205595a5e47f 5 2024-04-28T13:07:03.156 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:07:03.156+0000 7f7eb2523040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-28T13:07:03.175 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-28T13:07:03.174+0000 7fe99136a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-28T13:07:03.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.210+0000 7f4f16a86640 1 Processor -- start 2024-04-28T13:07:03.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.210+0000 7f4f16a86640 1 -- start start 2024-04-28T13:07:03.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.211+0000 7f4f16a86640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f10073400 0x7f4f100b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:03.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.211+0000 7f4f16a86640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4f10070280 0x7f4f101455f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:03.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.211+0000 7f4f16a86640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4f100737e0 0x7f4f10145b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:03.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.211+0000 7f4f16a86640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f4f100b6c50 con 0x7f4f100737e0 2024-04-28T13:07:03.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.211+0000 7f4f16a86640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f4f100b60d0 con 0x7f4f10070280 2024-04-28T13:07:03.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.211+0000 7f4f16a86640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f4f100b63b0 con 0x7f4f10073400 2024-04-28T13:07:03.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.211+0000 7f4f0ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4f10070280 0x7f4f101455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:03.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.211+0000 7f4f14822640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f10073400 0x7f4f100b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:03.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.211+0000 7f4f0ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4f10070280 0x7f4f101455f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49910/0 (socket says 172.21.15.134:49910) 2024-04-28T13:07:03.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.211+0000 7f4f0ffff640 1 -- 172.21.15.134:0/1713747178 learned_addr learned my addr 172.21.15.134:0/1713747178 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-28T13:07:03.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.211+0000 7f4f14822640 1 --2- 172.21.15.134:0/1713747178 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f10073400 0x7f4f100b58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:40350/0 (socket says 172.21.15.134:40350) 2024-04-28T13:07:03.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.211+0000 7f4f15023640 1 --2- 172.21.15.134:0/1713747178 >> v2:172.21.15.114:3300/0 conn(0x7f4f100737e0 0x7f4f10145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:03.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.211+0000 7f4f14822640 1 -- 172.21.15.134:0/1713747178 >> v2:172.21.15.134:3300/0 conn(0x7f4f10070280 msgr2=0x7f4f101455f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:03.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.211+0000 7f4f14822640 1 --2- 172.21.15.134:0/1713747178 >> v2:172.21.15.134:3300/0 conn(0x7f4f10070280 0x7f4f101455f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.211+0000 7f4f14822640 1 -- 172.21.15.134:0/1713747178 >> v2:172.21.15.114:3300/0 conn(0x7f4f100737e0 msgr2=0x7f4f10145b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:03.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.211+0000 7f4f14822640 1 --2- 172.21.15.134:0/1713747178 >> v2:172.21.15.114:3300/0 conn(0x7f4f100737e0 0x7f4f10145b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.211+0000 7f4f14822640 1 -- 172.21.15.134:0/1713747178 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f100b6690 con 0x7f4f10073400 2024-04-28T13:07:03.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.211+0000 7f4f0ffff640 1 --2- 172.21.15.134:0/1713747178 >> v2:172.21.15.134:3300/0 conn(0x7f4f10070280 0x7f4f101455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:07:03.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.212+0000 7f4f14822640 1 --2- 172.21.15.134:0/1713747178 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f10073400 0x7f4f100b58a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4f100741a0 tx=0x7f4f0402a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed323da7c6164e5b server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:03.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.212+0000 7f4f0f7fe640 1 -- 172.21.15.134:0/1713747178 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f04037070 con 0x7f4f10073400 2024-04-28T13:07:03.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.212+0000 7f4f0f7fe640 1 -- 172.21.15.134:0/1713747178 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f04032440 con 0x7f4f10073400 2024-04-28T13:07:03.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.212+0000 7f4f0f7fe640 1 -- 172.21.15.134:0/1713747178 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f0402ae60 con 0x7f4f10073400 2024-04-28T13:07:03.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.213+0000 7f4f16a86640 1 -- 172.21.15.134:0/1713747178 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f10073400 msgr2=0x7f4f100b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:03.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.213+0000 7f4f16a86640 1 --2- 172.21.15.134:0/1713747178 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f10073400 0x7f4f100b58a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4f100741a0 tx=0x7f4f0402a110 comp rx=0 tx=0).stop 2024-04-28T13:07:03.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.213+0000 7f4f16a86640 1 -- 172.21.15.134:0/1713747178 shutdown_connections 2024-04-28T13:07:03.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.213+0000 7f4f16a86640 1 --2- 172.21.15.134:0/1713747178 >> v2:172.21.15.114:3300/0 conn(0x7f4f100737e0 0x7f4f10145b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.213+0000 7f4f16a86640 1 --2- 172.21.15.134:0/1713747178 >> v2:172.21.15.134:3300/0 conn(0x7f4f10070280 0x7f4f101455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.213+0000 7f4f16a86640 1 --2- 172.21.15.134:0/1713747178 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f10073400 0x7f4f100b58a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.213+0000 7f4f16a86640 1 -- 172.21.15.134:0/1713747178 >> 172.21.15.134:0/1713747178 conn(0x7f4f1006d460 msgr2=0x7f4f1006d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:03.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.213+0000 7f4f16a86640 1 -- 172.21.15.134:0/1713747178 shutdown_connections 2024-04-28T13:07:03.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.213+0000 7f4f16a86640 1 -- 172.21.15.134:0/1713747178 wait complete. 2024-04-28T13:07:03.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.214+0000 7f4f16a86640 1 Processor -- start 2024-04-28T13:07:03.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.214+0000 7f4f16a86640 1 -- start start 2024-04-28T13:07:03.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.215+0000 7f4f16a86640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f10070280 0x7f4f100ad5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:03.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.215+0000 7f4f16a86640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f10073400 0x7f4f10143b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:03.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.215+0000 7f4f16a86640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f100737e0 0x7f4f10144060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:03.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.215+0000 7f4f16a86640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1015fd80 con 0x7f4f100737e0 2024-04-28T13:07:03.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.215+0000 7f4f16a86640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4f100b5de0 con 0x7f4f10073400 2024-04-28T13:07:03.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.215+0000 7f4f16a86640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f4f1015ff00 con 0x7f4f10070280 2024-04-28T13:07:03.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.215+0000 7f4f14822640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f10070280 0x7f4f100ad5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:03.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.215+0000 7f4f14822640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f10070280 0x7f4f100ad5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:40364/0 (socket says 172.21.15.134:40364) 2024-04-28T13:07:03.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.215+0000 7f4f14822640 1 -- 172.21.15.134:0/605290633 learned_addr learned my addr 172.21.15.134:0/605290633 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-28T13:07:03.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.215+0000 7f4f0ffff640 1 --2- 172.21.15.134:0/605290633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f10073400 0x7f4f10143b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:03.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.215+0000 7f4f15023640 1 --2- 172.21.15.134:0/605290633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f100737e0 0x7f4f10144060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:03.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.215+0000 7f4f14822640 1 -- 172.21.15.134:0/605290633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f10073400 msgr2=0x7f4f10143b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:03.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.215+0000 7f4f14822640 1 --2- 172.21.15.134:0/605290633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f10073400 0x7f4f10143b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.215+0000 7f4f14822640 1 -- 172.21.15.134:0/605290633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f100737e0 msgr2=0x7f4f10144060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:03.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.215+0000 7f4f14822640 1 --2- 172.21.15.134:0/605290633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f100737e0 0x7f4f10144060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.215+0000 7f4f14822640 1 -- 172.21.15.134:0/605290633 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f101e8210 con 0x7f4f10070280 2024-04-28T13:07:03.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.216+0000 7f4f14822640 1 --2- 172.21.15.134:0/605290633 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f10070280 0x7f4f100ad5e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4f04000c00 tx=0x7f4f040046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:03.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.216+0000 7f4f0d7fa640 1 -- 172.21.15.134:0/605290633 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f04039800 con 0x7f4f10070280 2024-04-28T13:07:03.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.216+0000 7f4f0d7fa640 1 -- 172.21.15.134:0/605290633 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f040399c0 con 0x7f4f10070280 2024-04-28T13:07:03.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.216+0000 7f4f16a86640 1 -- 172.21.15.134:0/605290633 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f100aaa60 con 0x7f4f10070280 2024-04-28T13:07:03.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.216+0000 7f4f0d7fa640 1 -- 172.21.15.134:0/605290633 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f04039db0 con 0x7f4f10070280 2024-04-28T13:07:03.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.216+0000 7f4f16a86640 1 -- 172.21.15.134:0/605290633 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f100ab020 con 0x7f4f10070280 2024-04-28T13:07:03.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.216+0000 7f4f0d7fa640 1 -- 172.21.15.134:0/605290633 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4f04044480 con 0x7f4f10070280 2024-04-28T13:07:03.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.216+0000 7f4f0d7fa640 1 -- 172.21.15.134:0/605290633 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f4f0404d970 con 0x7f4f10070280 2024-04-28T13:07:03.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.217+0000 7f4f16a86640 1 -- 172.21.15.134:0/605290633 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f100693f0 con 0x7f4f10070280 2024-04-28T13:07:03.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.219+0000 7f4f0d7fa640 1 -- 172.21.15.134:0/605290633 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f4f100693f0 con 0x7f4f10070280 2024-04-28T13:07:03.229 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-28T13:07:03.229+0000 7fe99136a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-28T13:07:03.271 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:07:03.272+0000 7f7eb2523040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-28T13:07:03.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.289+0000 7f4f16a86640 1 -- 172.21.15.134:0/605290633 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd new", "uuid": "baa42689-53c8-457b-b5ef-205595a5e47f", "id": 5} v 0) -- 0x7f4f100cf0d0 con 0x7f4f10070280 2024-04-28T13:07:03.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.297+0000 7f4f0d7fa640 1 -- 172.21.15.134:0/605290633 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "baa42689-53c8-457b-b5ef-205595a5e47f", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f4f100cf0d0 con 0x7f4f10070280 2024-04-28T13:07:03.297 INFO:teuthology.orchestra.run.smithi134.stdout:5 2024-04-28T13:07:03.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.298+0000 7f4f16a86640 1 -- 172.21.15.134:0/605290633 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f10070280 msgr2=0x7f4f100ad5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:03.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.298+0000 7f4f16a86640 1 --2- 172.21.15.134:0/605290633 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f10070280 0x7f4f100ad5e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4f04000c00 tx=0x7f4f040046c0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.298+0000 7f4f16a86640 1 -- 172.21.15.134:0/605290633 shutdown_connections 2024-04-28T13:07:03.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.298+0000 7f4f16a86640 1 --2- 172.21.15.134:0/605290633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f100737e0 0x7f4f10144060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.298+0000 7f4f16a86640 1 --2- 172.21.15.134:0/605290633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f10073400 0x7f4f10143b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.298+0000 7f4f16a86640 1 --2- 172.21.15.134:0/605290633 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f10070280 0x7f4f100ad5e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.298+0000 7f4f16a86640 1 -- 172.21.15.134:0/605290633 >> 172.21.15.134:0/605290633 conn(0x7f4f1006d460 msgr2=0x7f4f1015e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:03.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.298+0000 7f4f16a86640 1 -- 172.21.15.134:0/605290633 shutdown_connections 2024-04-28T13:07:03.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.298+0000 7f4f16a86640 1 -- 172.21.15.134:0/605290633 wait complete. 2024-04-28T13:07:03.309 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new d15e8a86-6e84-491b-baca-10147cf3cfa6 6 2024-04-28T13:07:03.350 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-28T13:07:03.350+0000 7fe99136a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-28T13:07:03.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.405+0000 7f188f9c6640 1 Processor -- start 2024-04-28T13:07:03.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.405+0000 7f188f9c6640 1 -- start start 2024-04-28T13:07:03.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.406+0000 7f188f9c6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f188815d510 0x7f18880b5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:03.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.406+0000 7f188f9c6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18880d1970 0x7f18880703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:03.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.406+0000 7f188f9c6640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18880d1070 con 0x7f18880d0c30 2024-04-28T13:07:03.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.406+0000 7f188f9c6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f18880cecd0 con 0x7f188815d510 2024-04-28T13:07:03.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.406+0000 7f188f9c6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f18880b24f0 con 0x7f18880d1970 2024-04-28T13:07:03.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.406+0000 7f188d762640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f188815d510 0x7f18880b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:03.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.406+0000 7f188df63640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18880d1970 0x7f18880703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:03.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.406+0000 7f188d762640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f188815d510 0x7f18880b5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49934/0 (socket says 172.21.15.134:49934) 2024-04-28T13:07:03.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.406+0000 7f188d762640 1 -- 172.21.15.134:0/32096345 learned_addr learned my addr 172.21.15.134:0/32096345 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-28T13:07:03.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.406+0000 7f188d762640 1 -- 172.21.15.134:0/32096345 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18880d1970 msgr2=0x7f18880703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:03.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.406+0000 7f188d762640 1 --2- 172.21.15.134:0/32096345 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18880d1970 0x7f18880703a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.406+0000 7f188d762640 1 -- 172.21.15.134:0/32096345 >> v1:172.21.15.114:6789/0 conn(0x7f18880d0c30 legacy=0x7f18880d1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:03.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.406+0000 7f188d762640 1 -- 172.21.15.134:0/32096345 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18880b2790 con 0x7f188815d510 2024-04-28T13:07:03.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.407+0000 7f188d762640 1 --2- 172.21.15.134:0/32096345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f188815d510 0x7f18880b5670 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1878009870 tx=0x7f187802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd8193ce961b7d02 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:03.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.407+0000 7f187ffff640 1 -- 172.21.15.134:0/32096345 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1878037070 con 0x7f188815d510 2024-04-28T13:07:03.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.407+0000 7f187ffff640 1 -- 172.21.15.134:0/32096345 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1878032440 con 0x7f188815d510 2024-04-28T13:07:03.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.407+0000 7f187ffff640 1 -- 172.21.15.134:0/32096345 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1878032810 con 0x7f188815d510 2024-04-28T13:07:03.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.408+0000 7f188f9c6640 1 -- 172.21.15.134:0/32096345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f188815d510 msgr2=0x7f18880b5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:03.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.408+0000 7f188f9c6640 1 --2- 172.21.15.134:0/32096345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f188815d510 0x7f18880b5670 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1878009870 tx=0x7f187802a1c0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.408+0000 7f188f9c6640 1 -- 172.21.15.134:0/32096345 shutdown_connections 2024-04-28T13:07:03.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.408+0000 7f188f9c6640 1 --2- 172.21.15.134:0/32096345 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18880d1970 0x7f18880703a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.408+0000 7f188f9c6640 1 --2- 172.21.15.134:0/32096345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f188815d510 0x7f18880b5670 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.408+0000 7f188f9c6640 1 -- 172.21.15.134:0/32096345 >> 172.21.15.134:0/32096345 conn(0x7f18880b4b50 msgr2=0x7f18880b4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:03.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.408+0000 7f188f9c6640 1 -- 172.21.15.134:0/32096345 shutdown_connections 2024-04-28T13:07:03.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.408+0000 7f188f9c6640 1 -- 172.21.15.134:0/32096345 wait complete. 2024-04-28T13:07:03.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.409+0000 7f188f9c6640 1 Processor -- start 2024-04-28T13:07:03.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.409+0000 7f188f9c6640 1 -- start start 2024-04-28T13:07:03.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.409+0000 7f188f9c6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18880d0c30 0x7f188815f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:03.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.410+0000 7f188f9c6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18880d1970 0x7f18880b87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:03.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.410+0000 7f188f9c6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f188815d510 0x7f188814d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:03.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.410+0000 7f188f9c6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f18880708e0 con 0x7f18880d0c30 2024-04-28T13:07:03.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.410+0000 7f188f9c6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f18880ce960 con 0x7f188815d510 2024-04-28T13:07:03.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.410+0000 7f188f9c6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1888070a60 con 0x7f18880d1970 2024-04-28T13:07:03.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.410+0000 7f188cf61640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18880d1970 0x7f18880b87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:03.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.410+0000 7f188df63640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f188815d510 0x7f188814d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:03.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.410+0000 7f188df63640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f188815d510 0x7f188814d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49946/0 (socket says 172.21.15.134:49946) 2024-04-28T13:07:03.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.410+0000 7f188df63640 1 -- 172.21.15.134:0/1846995853 learned_addr learned my addr 172.21.15.134:0/1846995853 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-28T13:07:03.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.410+0000 7f188cf61640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18880d1970 0x7f18880b87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:40382/0 (socket says 172.21.15.134:40382) 2024-04-28T13:07:03.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.410+0000 7f188d762640 1 --2- 172.21.15.134:0/1846995853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18880d0c30 0x7f188815f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:03.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.410+0000 7f188df63640 1 -- 172.21.15.134:0/1846995853 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18880d1970 msgr2=0x7f18880b87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:03.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.410+0000 7f188df63640 1 --2- 172.21.15.134:0/1846995853 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18880d1970 0x7f18880b87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.410+0000 7f188df63640 1 -- 172.21.15.134:0/1846995853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18880d0c30 msgr2=0x7f188815f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:03.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.410+0000 7f188df63640 1 --2- 172.21.15.134:0/1846995853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18880d0c30 0x7f188815f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.410+0000 7f188df63640 1 -- 172.21.15.134:0/1846995853 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188815fec0 con 0x7f188815d510 2024-04-28T13:07:03.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.410+0000 7f188cf61640 1 --2- 172.21.15.134:0/1846995853 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18880d1970 0x7f18880b87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:07:03.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.410+0000 7f188df63640 1 --2- 172.21.15.134:0/1846995853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f188815d510 0x7f188814d410 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f188000efc0 tx=0x7f188000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:03.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.410+0000 7f187dffb640 1 -- 172.21.15.134:0/1846995853 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1880018020 con 0x7f188815d510 2024-04-28T13:07:03.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.410+0000 7f187dffb640 1 -- 172.21.15.134:0/1846995853 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1880014480 con 0x7f188815d510 2024-04-28T13:07:03.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.410+0000 7f188f9c6640 1 -- 172.21.15.134:0/1846995853 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18881601a0 con 0x7f188815d510 2024-04-28T13:07:03.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.410+0000 7f187dffb640 1 -- 172.21.15.134:0/1846995853 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1880014870 con 0x7f188815d510 2024-04-28T13:07:03.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.411+0000 7f188f9c6640 1 -- 172.21.15.134:0/1846995853 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1888160760 con 0x7f188815d510 2024-04-28T13:07:03.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.411+0000 7f187dffb640 1 -- 172.21.15.134:0/1846995853 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1880005d10 con 0x7f188815d510 2024-04-28T13:07:03.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.411+0000 7f187dffb640 1 -- 172.21.15.134:0/1846995853 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f18800139d0 con 0x7f188815d510 2024-04-28T13:07:03.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.411+0000 7f188f9c6640 1 -- 172.21.15.134:0/1846995853 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18880b59d0 con 0x7f188815d510 2024-04-28T13:07:03.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.414+0000 7f187dffb640 1 -- 172.21.15.134:0/1846995853 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f1880022030 con 0x7f188815d510 2024-04-28T13:07:03.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.484+0000 7f188f9c6640 1 -- 172.21.15.134:0/1846995853 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d15e8a86-6e84-491b-baca-10147cf3cfa6", "id": 6} v 0) -- 0x7f188815bd20 con 0x7f188815d510 2024-04-28T13:07:03.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.493+0000 7f187dffb640 1 -- 172.21.15.134:0/1846995853 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d15e8a86-6e84-491b-baca-10147cf3cfa6", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f1880010040 con 0x7f188815d510 2024-04-28T13:07:03.493 INFO:teuthology.orchestra.run.smithi134.stdout:6 2024-04-28T13:07:03.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.494+0000 7f188f9c6640 1 -- 172.21.15.134:0/1846995853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f188815d510 msgr2=0x7f188814d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:03.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.494+0000 7f188f9c6640 1 --2- 172.21.15.134:0/1846995853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f188815d510 0x7f188814d410 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f188000efc0 tx=0x7f188000c490 comp rx=0 tx=0).stop 2024-04-28T13:07:03.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.494+0000 7f188f9c6640 1 -- 172.21.15.134:0/1846995853 shutdown_connections 2024-04-28T13:07:03.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.494+0000 7f188f9c6640 1 --2- 172.21.15.134:0/1846995853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f188815d510 0x7f188814d410 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.494+0000 7f188f9c6640 1 --2- 172.21.15.134:0/1846995853 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18880d1970 0x7f18880b87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.494+0000 7f188f9c6640 1 --2- 172.21.15.134:0/1846995853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18880d0c30 0x7f188815f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.494+0000 7f188f9c6640 1 -- 172.21.15.134:0/1846995853 >> 172.21.15.134:0/1846995853 conn(0x7f18880b4b50 msgr2=0x7f18880b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:03.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.494+0000 7f188f9c6640 1 -- 172.21.15.134:0/1846995853 shutdown_connections 2024-04-28T13:07:03.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.494+0000 7f188f9c6640 1 -- 172.21.15.134:0/1846995853 wait complete. 2024-04-28T13:07:03.505 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 9e421188-4268-4e18-919b-b8fc7aa2d532 7 2024-04-28T13:07:03.550 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:07:03.550+0000 7f7eb2523040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-28T13:07:03.597 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:07:03.597+0000 7f7eb2523040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-28T13:07:03.641 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-28T13:07:03.641+0000 7fe99136a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-28T13:07:03.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.643+0000 7fc95bf39640 1 Processor -- start 2024-04-28T13:07:03.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.643+0000 7fc95bf39640 1 -- start start 2024-04-28T13:07:03.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.644+0000 7fc95bf39640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc954073400 0x7fc9540b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:03.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.644+0000 7fc95bf39640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc954070280 0x7fc9541455f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:03.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.644+0000 7fc95bf39640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc9540737e0 0x7fc954145b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:03.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.644+0000 7fc95bf39640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fc9540b6c50 con 0x7fc9540737e0 2024-04-28T13:07:03.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.644+0000 7fc95bf39640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc9540b60d0 con 0x7fc954070280 2024-04-28T13:07:03.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.644+0000 7fc95bf39640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc9540b63b0 con 0x7fc954073400 2024-04-28T13:07:03.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.644+0000 7fc959cd5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc954073400 0x7fc9540b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:03.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.644+0000 7fc9594d4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc954070280 0x7fc9541455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:03.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.644+0000 7fc9594d4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc954070280 0x7fc9541455f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49948/0 (socket says 172.21.15.134:49948) 2024-04-28T13:07:03.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.644+0000 7fc959cd5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc954073400 0x7fc9540b58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:40398/0 (socket says 172.21.15.134:40398) 2024-04-28T13:07:03.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.644+0000 7fc9594d4640 1 -- 172.21.15.134:0/1765260217 learned_addr learned my addr 172.21.15.134:0/1765260217 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-28T13:07:03.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.644+0000 7fc95a4d6640 1 --2- 172.21.15.134:0/1765260217 >> v2:172.21.15.114:3300/0 conn(0x7fc9540737e0 0x7fc954145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:03.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.644+0000 7fc9594d4640 1 -- 172.21.15.134:0/1765260217 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc954073400 msgr2=0x7fc9540b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:03.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.644+0000 7fc9594d4640 1 --2- 172.21.15.134:0/1765260217 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc954073400 0x7fc9540b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.644+0000 7fc9594d4640 1 -- 172.21.15.134:0/1765260217 >> v2:172.21.15.114:3300/0 conn(0x7fc9540737e0 msgr2=0x7fc954145b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:03.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.644+0000 7fc9594d4640 1 --2- 172.21.15.134:0/1765260217 >> v2:172.21.15.114:3300/0 conn(0x7fc9540737e0 0x7fc954145b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.644+0000 7fc9594d4640 1 -- 172.21.15.134:0/1765260217 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9540b6690 con 0x7fc954070280 2024-04-28T13:07:03.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.644+0000 7fc959cd5640 1 --2- 172.21.15.134:0/1765260217 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc954073400 0x7fc9540b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:07:03.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.645+0000 7fc9594d4640 1 --2- 172.21.15.134:0/1765260217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc954070280 0x7fc9541455f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc9540741a0 tx=0x7fc95002c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cecc05a5ade0b6f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:03.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.650+0000 7fc958cd3640 1 -- 172.21.15.134:0/1765260217 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc950032790 con 0x7fc954070280 2024-04-28T13:07:03.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.650+0000 7fc958cd3640 1 -- 172.21.15.134:0/1765260217 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc950038070 con 0x7fc954070280 2024-04-28T13:07:03.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.650+0000 7fc958cd3640 1 -- 172.21.15.134:0/1765260217 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc950032b50 con 0x7fc954070280 2024-04-28T13:07:03.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.650+0000 7fc95bf39640 1 -- 172.21.15.134:0/1765260217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc954070280 msgr2=0x7fc9541455f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:03.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.650+0000 7fc95bf39640 1 --2- 172.21.15.134:0/1765260217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc954070280 0x7fc9541455f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc9540741a0 tx=0x7fc95002c890 comp rx=0 tx=0).stop 2024-04-28T13:07:03.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.650+0000 7fc95bf39640 1 -- 172.21.15.134:0/1765260217 shutdown_connections 2024-04-28T13:07:03.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.650+0000 7fc95bf39640 1 --2- 172.21.15.134:0/1765260217 >> v2:172.21.15.114:3300/0 conn(0x7fc9540737e0 0x7fc954145b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.650+0000 7fc95bf39640 1 --2- 172.21.15.134:0/1765260217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc954070280 0x7fc9541455f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.650+0000 7fc95bf39640 1 --2- 172.21.15.134:0/1765260217 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc954073400 0x7fc9540b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.650+0000 7fc95bf39640 1 -- 172.21.15.134:0/1765260217 >> 172.21.15.134:0/1765260217 conn(0x7fc95406d460 msgr2=0x7fc95406d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:03.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.651+0000 7fc95bf39640 1 -- 172.21.15.134:0/1765260217 shutdown_connections 2024-04-28T13:07:03.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.651+0000 7fc95bf39640 1 -- 172.21.15.134:0/1765260217 wait complete. 2024-04-28T13:07:03.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.652+0000 7fc95bf39640 1 Processor -- start 2024-04-28T13:07:03.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.652+0000 7fc95bf39640 1 -- start start 2024-04-28T13:07:03.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.652+0000 7fc95bf39640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc954070280 0x7fc95413ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:03.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.652+0000 7fc95bf39640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc954073400 0x7fc95415aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:03.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.652+0000 7fc95bf39640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9540737e0 0x7fc95413cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:03.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.652+0000 7fc95bf39640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc95415fd80 con 0x7fc954070280 2024-04-28T13:07:03.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.652+0000 7fc95bf39640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc9540b5de0 con 0x7fc954073400 2024-04-28T13:07:03.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.653+0000 7fc95bf39640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc95415ff00 con 0x7fc9540737e0 2024-04-28T13:07:03.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.653+0000 7fc9594d4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc954073400 0x7fc95415aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:03.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.653+0000 7fc95a4d6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9540737e0 0x7fc95413cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:03.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.653+0000 7fc95a4d6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9540737e0 0x7fc95413cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:40404/0 (socket says 172.21.15.134:40404) 2024-04-28T13:07:03.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.653+0000 7fc9594d4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc954073400 0x7fc95415aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49952/0 (socket says 172.21.15.134:49952) 2024-04-28T13:07:03.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.653+0000 7fc95a4d6640 1 -- 172.21.15.134:0/3577611193 learned_addr learned my addr 172.21.15.134:0/3577611193 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-28T13:07:03.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.653+0000 7fc959cd5640 1 --2- 172.21.15.134:0/3577611193 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc954070280 0x7fc95413ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:03.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.653+0000 7fc9594d4640 1 -- 172.21.15.134:0/3577611193 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9540737e0 msgr2=0x7fc95413cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:03.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.653+0000 7fc9594d4640 1 --2- 172.21.15.134:0/3577611193 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9540737e0 0x7fc95413cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.653+0000 7fc9594d4640 1 -- 172.21.15.134:0/3577611193 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc954070280 msgr2=0x7fc95413ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:03.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.653+0000 7fc9594d4640 1 --2- 172.21.15.134:0/3577611193 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc954070280 0x7fc95413ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.653+0000 7fc9594d4640 1 -- 172.21.15.134:0/3577611193 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95413faf0 con 0x7fc954073400 2024-04-28T13:07:03.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.653+0000 7fc95a4d6640 1 --2- 172.21.15.134:0/3577611193 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9540737e0 0x7fc95413cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:07:03.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.653+0000 7fc959cd5640 1 --2- 172.21.15.134:0/3577611193 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc954070280 0x7fc95413ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:07:03.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.653+0000 7fc9594d4640 1 --2- 172.21.15.134:0/3577611193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc954073400 0x7fc95415aa50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc950034000 tx=0x7fc9500046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:03.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.653+0000 7fc94a7fc640 1 -- 172.21.15.134:0/3577611193 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc950033620 con 0x7fc954073400 2024-04-28T13:07:03.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.653+0000 7fc94a7fc640 1 -- 172.21.15.134:0/3577611193 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc950033800 con 0x7fc954073400 2024-04-28T13:07:03.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.653+0000 7fc94a7fc640 1 -- 172.21.15.134:0/3577611193 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc950033bf0 con 0x7fc954073400 2024-04-28T13:07:03.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.653+0000 7fc95bf39640 1 -- 172.21.15.134:0/3577611193 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc95415af90 con 0x7fc954073400 2024-04-28T13:07:03.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.653+0000 7fc95bf39640 1 -- 172.21.15.134:0/3577611193 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc95413f810 con 0x7fc954073400 2024-04-28T13:07:03.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.653+0000 7fc94a7fc640 1 -- 172.21.15.134:0/3577611193 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc95004d060 con 0x7fc954073400 2024-04-28T13:07:03.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.654+0000 7fc94a7fc640 1 -- 172.21.15.134:0/3577611193 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fc950046a50 con 0x7fc954073400 2024-04-28T13:07:03.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.654+0000 7fc95bf39640 1 -- 172.21.15.134:0/3577611193 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc95406a3d0 con 0x7fc954073400 2024-04-28T13:07:03.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.656+0000 7fc94a7fc640 1 -- 172.21.15.134:0/3577611193 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fc95413faf0 con 0x7fc954073400 2024-04-28T13:07:03.691 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-28T13:07:03.691+0000 7fe99136a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-28T13:07:03.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.728+0000 7fc95bf39640 1 -- 172.21.15.134:0/3577611193 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9e421188-4268-4e18-919b-b8fc7aa2d532", "id": 7} v 0) -- 0x7fc954073ec0 con 0x7fc954073400 2024-04-28T13:07:03.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.736+0000 7fc94a7fc640 1 -- 172.21.15.134:0/3577611193 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9e421188-4268-4e18-919b-b8fc7aa2d532", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fc950041070 con 0x7fc954073400 2024-04-28T13:07:03.736 INFO:teuthology.orchestra.run.smithi134.stdout:7 2024-04-28T13:07:03.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.736+0000 7fc95bf39640 1 -- 172.21.15.134:0/3577611193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc954073400 msgr2=0x7fc95415aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:03.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.736+0000 7fc95bf39640 1 --2- 172.21.15.134:0/3577611193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc954073400 0x7fc95415aa50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc950034000 tx=0x7fc9500046c0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.736+0000 7fc95bf39640 1 -- 172.21.15.134:0/3577611193 shutdown_connections 2024-04-28T13:07:03.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.736+0000 7fc95bf39640 1 --2- 172.21.15.134:0/3577611193 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9540737e0 0x7fc95413cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.736+0000 7fc95bf39640 1 --2- 172.21.15.134:0/3577611193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc954073400 0x7fc95415aa50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.736+0000 7fc95bf39640 1 --2- 172.21.15.134:0/3577611193 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc954070280 0x7fc95413ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.736+0000 7fc95bf39640 1 -- 172.21.15.134:0/3577611193 >> 172.21.15.134:0/3577611193 conn(0x7fc95406d460 msgr2=0x7fc954144b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:03.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.737+0000 7fc95bf39640 1 -- 172.21.15.134:0/3577611193 shutdown_connections 2024-04-28T13:07:03.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:03.737+0000 7fc95bf39640 1 -- 172.21.15.134:0/3577611193 wait complete. 2024-04-28T13:07:03.747 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-28T13:07:03.747 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-28T13:07:03.749 INFO:tasks.ceph.osd.0:Started 2024-04-28T13:07:03.749 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-28T13:07:03.750 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-28T13:07:03.752 INFO:tasks.ceph.osd.1:Started 2024-04-28T13:07:03.752 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-28T13:07:03.752 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-28T13:07:03.754 INFO:tasks.ceph.osd.2:Started 2024-04-28T13:07:03.754 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-28T13:07:03.754 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-28T13:07:03.755 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:07:03.756+0000 7f7eb2523040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-28T13:07:03.757 INFO:tasks.ceph.osd.3:Started 2024-04-28T13:07:03.757 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-28T13:07:03.757 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-28T13:07:03.759 INFO:tasks.ceph.osd.4:Started 2024-04-28T13:07:03.759 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-28T13:07:03.759 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-28T13:07:03.761 INFO:tasks.ceph.osd.5:Started 2024-04-28T13:07:03.761 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-28T13:07:03.761 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-28T13:07:03.763 INFO:tasks.ceph.osd.6:Started 2024-04-28T13:07:03.763 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-28T13:07:03.763 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-28T13:07:03.767 INFO:tasks.ceph.osd.7:Started 2024-04-28T13:07:03.767 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:07:03.873 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-28T13:07:03.873+0000 7fe99136a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-28T13:07:03.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.885+0000 7f9eae1f9640 1 Processor -- start 2024-04-28T13:07:03.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.886+0000 7f9eae1f9640 1 -- start start 2024-04-28T13:07:03.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.886+0000 7f9eae1f9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ea80b4380 0x7f9ea80baaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:03.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.886+0000 7f9eae1f9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ea80d3650 con 0x7f9ea80d0670 2024-04-28T13:07:03.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.886+0000 7f9eae1f9640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ea815f7f0 con 0x7f9ea815f410 2024-04-28T13:07:03.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.886+0000 7f9eae1f9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea80d3f10 con 0x7f9ea80b4380 2024-04-28T13:07:03.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.886+0000 7f9ea6ffd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9ea80d0670 0x7f9ea80d43a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:40948/0 (socket says 172.21.15.114:40948) 2024-04-28T13:07:03.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.886+0000 7f9ea6ffd640 1 -- 172.21.15.114:0/3398734987 learned_addr learned my addr 172.21.15.114:0/3398734987 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:03.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.887+0000 7f9ea7fff640 1 --2- 172.21.15.114:0/3398734987 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ea80b4380 0x7f9ea80baaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:03.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.887+0000 7f9ea67fc640 1 -- 172.21.15.114:0/3398734987 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2519607850 0 0) 0x7f9ea80d3650 con 0x7f9ea80d0670 2024-04-28T13:07:03.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.887+0000 7f9ea67fc640 1 -- 172.21.15.114:0/3398734987 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e94003520 con 0x7f9ea80d0670 2024-04-28T13:07:03.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.887+0000 7f9ea7fff640 1 -- 172.21.15.114:0/3398734987 >> v1:172.21.15.134:6789/0 conn(0x7f9ea815f410 legacy=0x7f9ea80cff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:03.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.887+0000 7f9ea7fff640 1 -- 172.21.15.114:0/3398734987 >> v1:172.21.15.114:6789/0 conn(0x7f9ea80d0670 legacy=0x7f9ea80d43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:03.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.887+0000 7f9ea67fc640 1 -- 172.21.15.114:0/3398734987 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3805063590 0 0) 0x7f9e94003520 con 0x7f9ea80d0670 2024-04-28T13:07:03.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.887+0000 7f9ea7fff640 1 -- 172.21.15.114:0/3398734987 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea80d2570 con 0x7f9ea80b4380 2024-04-28T13:07:03.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.888+0000 7f9ea7fff640 1 --2- 172.21.15.114:0/3398734987 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ea80b4380 0x7f9ea80baaf0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9ea815f9c0 tx=0x7f9ea002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efe219358a457229 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:03.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.888+0000 7f9ea67fc640 1 -- 172.21.15.114:0/3398734987 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0037070 con 0x7f9ea80b4380 2024-04-28T13:07:03.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.888+0000 7f9ea67fc640 1 -- 172.21.15.114:0/3398734987 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ea002aca0 con 0x7f9ea80b4380 2024-04-28T13:07:03.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.888+0000 7f9ea67fc640 1 -- 172.21.15.114:0/3398734987 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e90001670 con 0x7f9ea80b4380 2024-04-28T13:07:03.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.888+0000 7f9eae1f9640 1 -- 172.21.15.114:0/3398734987 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ea80b4380 msgr2=0x7f9ea80baaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:03.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.888+0000 7f9eae1f9640 1 --2- 172.21.15.114:0/3398734987 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ea80b4380 0x7f9ea80baaf0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9ea815f9c0 tx=0x7f9ea002a210 comp rx=0 tx=0).stop 2024-04-28T13:07:03.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.888+0000 7f9eae1f9640 1 -- 172.21.15.114:0/3398734987 shutdown_connections 2024-04-28T13:07:03.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.888+0000 7f9eae1f9640 1 --2- 172.21.15.114:0/3398734987 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ea80b4380 0x7f9ea80baaf0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.888+0000 7f9eae1f9640 1 -- 172.21.15.114:0/3398734987 >> 172.21.15.114:0/3398734987 conn(0x7f9ea80633a0 msgr2=0x7f9ea80d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:03.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.889+0000 7f9eae1f9640 1 -- 172.21.15.114:0/3398734987 shutdown_connections 2024-04-28T13:07:03.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.889+0000 7f9eae1f9640 1 -- 172.21.15.114:0/3398734987 wait complete. 2024-04-28T13:07:03.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.890+0000 7f9eae1f9640 1 Processor -- start 2024-04-28T13:07:03.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.890+0000 7f9eae1f9640 1 -- start start 2024-04-28T13:07:03.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.890+0000 7f9eae1f9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ea80b4380 0x7f9ea80cf850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:03.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.890+0000 7f9eae1f9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ea80d0670 0x7f9ea8156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:03.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.891+0000 7f9eae1f9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ea815f410 0x7f9ea8160080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:03.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.891+0000 7f9ea6ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ea80d0670 0x7f9ea8156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:03.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.891+0000 7f9ea6ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ea80d0670 0x7f9ea8156af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49322/0 (socket says 172.21.15.114:49322) 2024-04-28T13:07:03.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.891+0000 7f9ea6ffd640 1 -- 172.21.15.114:0/4048534495 learned_addr learned my addr 172.21.15.114:0/4048534495 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:03.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.891+0000 7f9ea77fe640 1 --2- 172.21.15.114:0/4048534495 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ea80b4380 0x7f9ea80cf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:03.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.891+0000 7f9eae1f9640 1 -- 172.21.15.114:0/4048534495 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea80bb180 con 0x7f9ea80d0670 2024-04-28T13:07:03.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.891+0000 7f9eae1f9640 1 -- 172.21.15.114:0/4048534495 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea80d3ba0 con 0x7f9ea815f410 2024-04-28T13:07:03.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.891+0000 7f9eae1f9640 1 -- 172.21.15.114:0/4048534495 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea80b8300 con 0x7f9ea80b4380 2024-04-28T13:07:03.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.891+0000 7f9ea7fff640 1 --2- 172.21.15.114:0/4048534495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ea815f410 0x7f9ea8160080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:03.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.891+0000 7f9ea6ffd640 1 -- 172.21.15.114:0/4048534495 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ea80b4380 msgr2=0x7f9ea80cf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:03.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.891+0000 7f9ea6ffd640 1 --2- 172.21.15.114:0/4048534495 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ea80b4380 0x7f9ea80cf850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.891+0000 7f9ea6ffd640 1 -- 172.21.15.114:0/4048534495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ea815f410 msgr2=0x7f9ea8160080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:03.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.891+0000 7f9ea6ffd640 1 --2- 172.21.15.114:0/4048534495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ea815f410 0x7f9ea8160080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.891+0000 7f9ea6ffd640 1 -- 172.21.15.114:0/4048534495 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea8160ae0 con 0x7f9ea80d0670 2024-04-28T13:07:03.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.891+0000 7f9ea6ffd640 1 --2- 172.21.15.114:0/4048534495 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ea80d0670 0x7f9ea8156af0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9e9000c780 tx=0x7f9e9000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:03.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.891+0000 7f9e9ffff640 1 -- 172.21.15.114:0/4048534495 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e90017070 con 0x7f9ea80d0670 2024-04-28T13:07:03.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.891+0000 7f9e9ffff640 1 -- 172.21.15.114:0/4048534495 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e90005ad0 con 0x7f9ea80d0670 2024-04-28T13:07:03.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.892+0000 7f9e9ffff640 1 -- 172.21.15.114:0/4048534495 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e90007070 con 0x7f9ea80d0670 2024-04-28T13:07:03.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.892+0000 7f9eae1f9640 1 -- 172.21.15.114:0/4048534495 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ea8160d80 con 0x7f9ea80d0670 2024-04-28T13:07:03.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.892+0000 7f9eae1f9640 1 -- 172.21.15.114:0/4048534495 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ea8161340 con 0x7f9ea80d0670 2024-04-28T13:07:03.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.892+0000 7f9e9ffff640 1 -- 172.21.15.114:0/4048534495 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9e9001a070 con 0x7f9ea80d0670 2024-04-28T13:07:03.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.892+0000 7f9e9ffff640 1 -- 172.21.15.114:0/4048534495 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f9e9000abd0 con 0x7f9ea80d0670 2024-04-28T13:07:03.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.893+0000 7f9eae1f9640 1 -- 172.21.15.114:0/4048534495 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ea806a3d0 con 0x7f9ea80d0670 2024-04-28T13:07:03.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.895+0000 7f9e9ffff640 1 -- 172.21.15.114:0/4048534495 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f9e90021020 con 0x7f9ea80d0670 2024-04-28T13:07:03.930 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:07:03.930+0000 7f7eb2523040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-28T13:07:03.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.956+0000 7f9eae1f9640 1 -- 172.21.15.114:0/4048534495 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9ea80d2350 con 0x7f9ea80d0670 2024-04-28T13:07:03.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.956+0000 7f9e9ffff640 1 -- 172.21.15.114:0/4048534495 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f9e9000ae20 con 0x7f9ea80d0670 2024-04-28T13:07:03.956 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:03.956 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":10,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:07:03.729802+0000","last_up_change":"0.000000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:07:03.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.957+0000 7f9eae1f9640 1 -- 172.21.15.114:0/4048534495 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ea80d0670 msgr2=0x7f9ea8156af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:03.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.957+0000 7f9eae1f9640 1 --2- 172.21.15.114:0/4048534495 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ea80d0670 0x7f9ea8156af0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9e9000c780 tx=0x7f9e9000cc40 comp rx=0 tx=0).stop 2024-04-28T13:07:03.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.957+0000 7f9eae1f9640 1 -- 172.21.15.114:0/4048534495 shutdown_connections 2024-04-28T13:07:03.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.957+0000 7f9eae1f9640 1 --2- 172.21.15.114:0/4048534495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ea815f410 0x7f9ea8160080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.957+0000 7f9eae1f9640 1 --2- 172.21.15.114:0/4048534495 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ea80d0670 0x7f9ea8156af0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.957+0000 7f9eae1f9640 1 --2- 172.21.15.114:0/4048534495 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ea80b4380 0x7f9ea80cf850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:03.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.957+0000 7f9eae1f9640 1 -- 172.21.15.114:0/4048534495 >> 172.21.15.114:0/4048534495 conn(0x7f9ea80633a0 msgr2=0x7f9ea80d43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:03.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.957+0000 7f9eae1f9640 1 -- 172.21.15.114:0/4048534495 shutdown_connections 2024-04-28T13:07:03.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:03.957+0000 7f9eae1f9640 1 -- 172.21.15.114:0/4048534495 wait complete. 2024-04-28T13:07:03.968 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-28T13:07:03.969 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-28T13:07:03.982 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:07:03.982+0000 7f7eb2523040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-28T13:07:04.008 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-28T13:07:04.008+0000 7fe99136a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-28T13:07:04.053 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:07:04.053+0000 7f7eb2523040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-28T13:07:04.056 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-28T13:07:04.056+0000 7fe99136a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-28T13:07:04.098 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:07:04.097+0000 7f7eb2523040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-28T13:07:04.126 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-28T13:07:04.126+0000 7fe99136a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-28T13:07:04.172 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-28T13:07:04.172+0000 7fe99136a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-28T13:07:04.358 INFO:tasks.ceph.osd.3.smithi114.stderr:2024-04-28T13:07:04.357+0000 7f8b9460d640 -1 Falling back to public interface 2024-04-28T13:07:04.359 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-04-28T13:07:04.357+0000 7fd56121d640 -1 Falling back to public interface 2024-04-28T13:07:04.359 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-04-28T13:07:04.358+0000 7fd5601cc640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6802/0: (98) Address already in use 2024-04-28T13:07:04.359 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-04-28T13:07:04.358+0000 7fd5601cc640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6811/0: (98) Address already in use 2024-04-28T13:07:04.362 INFO:tasks.ceph.osd.1.smithi114.stderr:2024-04-28T13:07:04.362+0000 7f4b5041a640 -1 Falling back to public interface 2024-04-28T13:07:04.366 INFO:tasks.ceph.osd.2.smithi114.stderr:2024-04-28T13:07:04.366+0000 7f01f0e86640 -1 Falling back to public interface 2024-04-28T13:07:04.369 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-04-28T13:07:04.369+0000 7f91d86df640 -1 Falling back to public interface 2024-04-28T13:07:04.370 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-28T13:07:04.369+0000 7feb3dc1e640 -1 Falling back to public interface 2024-04-28T13:07:04.370 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-28T13:07:04.369+0000 7feb3c620640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-04-28T13:07:04.370 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-28T13:07:04.369+0000 7feb3c620640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2024-04-28T13:07:04.378 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-04-28T13:07:04.378+0000 7fb54f863640 -1 Falling back to public interface 2024-04-28T13:07:04.394 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-04-28T13:07:04.395+0000 7fda3e4e3640 -1 Falling back to public interface 2024-04-28T13:07:04.578 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:07:04.578+0000 7f7eb2523040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-28T13:07:04.646 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-28T13:07:04.646+0000 7fe99136a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-28T13:07:04.696 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:07:04.696+0000 7f7eb2523040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-28T13:07:04.765 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-28T13:07:04.765+0000 7fe99136a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-28T13:07:04.775 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-28T13:07:04.862 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.861+0000 7f354802a640 1 Processor -- start 2024-04-28T13:07:04.862 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.861+0000 7f354802a640 1 -- start start 2024-04-28T13:07:04.864 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.862+0000 7f354802a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3540070540 0x7f35400709b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:04.864 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.862+0000 7f354802a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f35400d1980 0x7f35400d1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:04.864 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.862+0000 7f354802a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f354015e510 con 0x7f3540140180 2024-04-28T13:07:04.864 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.862+0000 7f354802a640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f3540070ef0 con 0x7f3540070540 2024-04-28T13:07:04.864 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.862+0000 7f354802a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f3540142800 con 0x7f35400d1980 2024-04-28T13:07:04.864 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.862+0000 7f35455c5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3540070540 0x7f35400709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:04.864 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.862+0000 7f35455c5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3540070540 0x7f35400709b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49382/0 (socket says 172.21.15.114:49382) 2024-04-28T13:07:04.864 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.862+0000 7f35455c5640 1 -- 172.21.15.114:0/113396632 learned_addr learned my addr 172.21.15.114:0/113396632 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:04.864 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.863+0000 7f35455c5640 1 -- 172.21.15.114:0/113396632 >> v2:172.21.15.134:3300/0 conn(0x7f35400d1980 msgr2=0x7f35400d1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:04.865 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.863+0000 7f35465c7640 1 --2- 172.21.15.114:0/113396632 >> v2:172.21.15.134:3300/0 conn(0x7f35400d1980 0x7f35400d1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:04.865 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.863+0000 7f35455c5640 1 --2- 172.21.15.114:0/113396632 >> v2:172.21.15.134:3300/0 conn(0x7f35400d1980 0x7f35400d1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:04.865 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.863+0000 7f35455c5640 1 -- 172.21.15.114:0/113396632 >> v1:172.21.15.134:6789/0 conn(0x7f3540140180 legacy=0x7f354015de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:04.865 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.863+0000 7f35455c5640 1 -- 172.21.15.114:0/113396632 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3540142ae0 con 0x7f3540070540 2024-04-28T13:07:04.865 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.863+0000 7f35455c5640 1 --2- 172.21.15.114:0/113396632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3540070540 0x7f35400709b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f35400b5a40 tx=0x7f353002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=474082e01b9fc46f server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:04.865 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.863+0000 7f3544dc4640 1 -- 172.21.15.114:0/113396632 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3530037070 con 0x7f3540070540 2024-04-28T13:07:04.865 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.863+0000 7f3544dc4640 1 -- 172.21.15.114:0/113396632 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3530032440 con 0x7f3540070540 2024-04-28T13:07:04.865 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.863+0000 7f3544dc4640 1 -- 172.21.15.114:0/113396632 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3530032810 con 0x7f3540070540 2024-04-28T13:07:04.868 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.864+0000 7f354802a640 1 -- 172.21.15.114:0/113396632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3540070540 msgr2=0x7f35400709b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:04.868 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.864+0000 7f354802a640 1 --2- 172.21.15.114:0/113396632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3540070540 0x7f35400709b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f35400b5a40 tx=0x7f353002a1a0 comp rx=0 tx=0).stop 2024-04-28T13:07:04.868 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.864+0000 7f354802a640 1 -- 172.21.15.114:0/113396632 shutdown_connections 2024-04-28T13:07:04.868 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.864+0000 7f354802a640 1 --2- 172.21.15.114:0/113396632 >> v2:172.21.15.134:3300/0 conn(0x7f35400d1980 0x7f35400d1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:04.868 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.864+0000 7f354802a640 1 --2- 172.21.15.114:0/113396632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3540070540 0x7f35400709b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:04.869 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.864+0000 7f354802a640 1 -- 172.21.15.114:0/113396632 >> 172.21.15.114:0/113396632 conn(0x7f35400684b0 msgr2=0x7f35400688c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:04.869 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.864+0000 7f354802a640 1 -- 172.21.15.114:0/113396632 shutdown_connections 2024-04-28T13:07:04.869 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.864+0000 7f354802a640 1 -- 172.21.15.114:0/113396632 wait complete. 2024-04-28T13:07:04.869 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.865+0000 7f354802a640 1 Processor -- start 2024-04-28T13:07:04.869 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.865+0000 7f354802a640 1 -- start start 2024-04-28T13:07:04.869 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.866+0000 7f354802a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3540070540 0x7f35401f4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:04.869 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.866+0000 7f354802a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35400d1980 0x7f354013bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:04.869 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.866+0000 7f354802a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3540140180 0x7f35400b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:04.869 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.866+0000 7f354802a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f354015d840 con 0x7f3540140180 2024-04-28T13:07:04.869 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.866+0000 7f354802a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f35401430a0 con 0x7f35400d1980 2024-04-28T13:07:04.869 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.866+0000 7f354802a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f354015d9c0 con 0x7f3540070540 2024-04-28T13:07:04.869 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.866+0000 7f35465c7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3540140180 0x7f35400b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:04.869 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.866+0000 7f35465c7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3540140180 0x7f35400b7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49394/0 (socket says 172.21.15.114:49394) 2024-04-28T13:07:04.869 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.866+0000 7f35465c7640 1 -- 172.21.15.114:0/1500335590 learned_addr learned my addr 172.21.15.114:0/1500335590 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:04.870 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.866+0000 7f35455c5640 1 --2- 172.21.15.114:0/1500335590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35400d1980 0x7f354013bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:04.870 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.866+0000 7f3545dc6640 1 --2- 172.21.15.114:0/1500335590 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3540070540 0x7f35401f4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:04.870 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.866+0000 7f35465c7640 1 -- 172.21.15.114:0/1500335590 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3540070540 msgr2=0x7f35401f4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:04.870 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.866+0000 7f35465c7640 1 --2- 172.21.15.114:0/1500335590 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3540070540 0x7f35401f4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:04.870 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.866+0000 7f35465c7640 1 -- 172.21.15.114:0/1500335590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35400d1980 msgr2=0x7f354013bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:04.870 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.866+0000 7f35465c7640 1 --2- 172.21.15.114:0/1500335590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35400d1980 0x7f354013bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:04.870 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.866+0000 7f35465c7640 1 -- 172.21.15.114:0/1500335590 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35401f52b0 con 0x7f3540140180 2024-04-28T13:07:04.870 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.866+0000 7f35455c5640 1 --2- 172.21.15.114:0/1500335590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35400d1980 0x7f354013bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:04.870 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.866+0000 7f3545dc6640 1 --2- 172.21.15.114:0/1500335590 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3540070540 0x7f35401f4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:04.870 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.866+0000 7f35465c7640 1 --2- 172.21.15.114:0/1500335590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3540140180 0x7f35400b7090 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f353800c7f0 tx=0x7f353800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:04.870 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.866+0000 7f35367fc640 1 -- 172.21.15.114:0/1500335590 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3538015070 con 0x7f3540140180 2024-04-28T13:07:04.870 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.867+0000 7f35367fc640 1 -- 172.21.15.114:0/1500335590 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3538004220 con 0x7f3540140180 2024-04-28T13:07:04.870 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.867+0000 7f35367fc640 1 -- 172.21.15.114:0/1500335590 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3538007620 con 0x7f3540140180 2024-04-28T13:07:04.870 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.867+0000 7f354802a640 1 -- 172.21.15.114:0/1500335590 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f354015fd10 con 0x7f3540140180 2024-04-28T13:07:04.871 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.867+0000 7f354802a640 1 -- 172.21.15.114:0/1500335590 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35401602d0 con 0x7f3540140180 2024-04-28T13:07:04.871 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.867+0000 7f35367fc640 1 -- 172.21.15.114:0/1500335590 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 2) ==== 45545+0+0 (secure 0 0 0) 0x7f35380079d0 con 0x7f3540140180 2024-04-28T13:07:04.871 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.868+0000 7f35367fc640 1 -- 172.21.15.114:0/1500335590 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f353804aba0 con 0x7f3540140180 2024-04-28T13:07:04.871 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.868+0000 7f354802a640 1 -- 172.21.15.114:0/1500335590 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3540076880 con 0x7f3540140180 2024-04-28T13:07:04.871 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.870+0000 7f35367fc640 1 -- 172.21.15.114:0/1500335590 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f3538011de0 con 0x7f3540140180 2024-04-28T13:07:04.932 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.931+0000 7f354802a640 1 -- 172.21.15.114:0/1500335590 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f35400b6000 con 0x7f3540140180 2024-04-28T13:07:04.932 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.932+0000 7f35367fc640 1 -- 172.21.15.114:0/1500335590 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f3538021dc0 con 0x7f3540140180 2024-04-28T13:07:04.932 INFO:teuthology.misc.health.smithi114.stdout: 2024-04-28T13:07:04.932 INFO:teuthology.misc.health.smithi114.stdout:{"epoch":10,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:07:03.729802+0000","last_up_change":"0.000000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:07:04.933 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.932+0000 7f354802a640 1 -- 172.21.15.114:0/1500335590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3540140180 msgr2=0x7f35400b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:04.933 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.932+0000 7f354802a640 1 --2- 172.21.15.114:0/1500335590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3540140180 0x7f35400b7090 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f353800c7f0 tx=0x7f353800ccb0 comp rx=0 tx=0).stop 2024-04-28T13:07:04.933 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.932+0000 7f354802a640 1 -- 172.21.15.114:0/1500335590 shutdown_connections 2024-04-28T13:07:04.934 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.932+0000 7f354802a640 1 --2- 172.21.15.114:0/1500335590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3540140180 0x7f35400b7090 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:04.934 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.932+0000 7f354802a640 1 --2- 172.21.15.114:0/1500335590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35400d1980 0x7f354013bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:04.934 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.932+0000 7f354802a640 1 --2- 172.21.15.114:0/1500335590 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3540070540 0x7f35401f4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:04.934 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.932+0000 7f354802a640 1 -- 172.21.15.114:0/1500335590 >> 172.21.15.114:0/1500335590 conn(0x7f35400684b0 msgr2=0x7f3540068890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:04.934 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.932+0000 7f354802a640 1 -- 172.21.15.114:0/1500335590 shutdown_connections 2024-04-28T13:07:04.934 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:04.933+0000 7f354802a640 1 -- 172.21.15.114:0/1500335590 wait complete. 2024-04-28T13:07:04.942 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-28T13:07:05.710 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:07:05.709+0000 7f7e5282c640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-28T13:07:05.710 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:07:05.709+0000 7f7e5282c640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-28T13:07:07.813 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-04-28T13:07:07.812+0000 7fd56121d640 -1 osd.0 0 log_to_monitors true 2024-04-28T13:07:07.821 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-04-28T13:07:07.821+0000 7f91d86df640 -1 osd.4 0 log_to_monitors true 2024-04-28T13:07:07.865 INFO:tasks.ceph.osd.1.smithi114.stderr:2024-04-28T13:07:07.864+0000 7f4b5041a640 -1 osd.1 0 log_to_monitors true 2024-04-28T13:07:07.875 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-28T13:07:07.875+0000 7feb3dc1e640 -1 osd.7 0 log_to_monitors true 2024-04-28T13:07:07.880 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-04-28T13:07:07.881+0000 7fb54f863640 -1 osd.6 0 log_to_monitors true 2024-04-28T13:07:07.885 INFO:tasks.ceph.osd.3.smithi114.stderr:2024-04-28T13:07:07.885+0000 7f8b9460d640 -1 osd.3 0 log_to_monitors true 2024-04-28T13:07:07.893 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-04-28T13:07:07.893+0000 7fda3e4e3640 -1 osd.5 0 log_to_monitors true 2024-04-28T13:07:07.897 INFO:tasks.ceph.osd.2.smithi114.stderr:2024-04-28T13:07:07.897+0000 7f01f0e86640 -1 osd.2 0 log_to_monitors true 2024-04-28T13:07:11.749 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-28T13:07:11.763 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-04-28T13:07:11.763+0000 7fd55d1b3640 -1 osd.0 0 waiting for initial osdmap 2024-04-28T13:07:11.778 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-04-28T13:07:11.778+0000 7fd554fd3640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-28T13:07:11.796 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-04-28T13:07:11.796+0000 7fb54b7f9640 -1 osd.6 0 waiting for initial osdmap 2024-04-28T13:07:11.805 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-28T13:07:11.805+0000 7feb39607640 -1 osd.7 0 waiting for initial osdmap 2024-04-28T13:07:11.808 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-04-28T13:07:11.808+0000 7fb543619640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-28T13:07:11.811 INFO:tasks.ceph.osd.2.smithi114.stderr:2024-04-28T13:07:11.811+0000 7f01ece1c640 -1 osd.2 0 waiting for initial osdmap 2024-04-28T13:07:11.818 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-28T13:07:11.818+0000 7feb31438640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-28T13:07:11.819 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-04-28T13:07:11.819+0000 7f91d4675640 -1 osd.4 0 waiting for initial osdmap 2024-04-28T13:07:11.825 INFO:tasks.ceph.osd.2.smithi114.stderr:2024-04-28T13:07:11.825+0000 7f01e4c3c640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-28T13:07:11.833 INFO:tasks.ceph.osd.3.smithi114.stderr:2024-04-28T13:07:11.833+0000 7f8b8ff98640 -1 osd.3 0 waiting for initial osdmap 2024-04-28T13:07:11.836 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-04-28T13:07:11.836+0000 7f91cc495640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-28T13:07:11.841 INFO:tasks.ceph.osd.1.smithi114.stderr:2024-04-28T13:07:11.841+0000 7f4b4c5fb640 -1 osd.1 0 waiting for initial osdmap 2024-04-28T13:07:11.847 INFO:tasks.ceph.osd.3.smithi114.stderr:2024-04-28T13:07:11.847+0000 7f8b87db8640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-28T13:07:11.847 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-04-28T13:07:11.848+0000 7fda3a479640 -1 osd.5 0 waiting for initial osdmap 2024-04-28T13:07:11.855 INFO:tasks.ceph.osd.1.smithi114.stderr:2024-04-28T13:07:11.855+0000 7f4b43c07640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-28T13:07:11.864 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-04-28T13:07:11.864+0000 7fda32299640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-28T13:07:11.869 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.869+0000 7fa5b4459640 1 Processor -- start 2024-04-28T13:07:11.870 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.869+0000 7fa5b4459640 1 -- start start 2024-04-28T13:07:11.872 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.870+0000 7fa5b4459640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5ac0b55f0 0x7fa5ac0b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:11.872 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.870+0000 7fa5b4459640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa5ac0b8000 0x7fa5ac0d2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:11.872 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.870+0000 7fa5b4459640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5ac0d31e0 con 0x7fa5ac0d3790 2024-04-28T13:07:11.872 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.870+0000 7fa5b4459640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fa5ac0d2f90 con 0x7fa5ac0b8000 2024-04-28T13:07:11.872 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.870+0000 7fa5b4459640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fa5ac0d5ce0 con 0x7fa5ac0b55f0 2024-04-28T13:07:11.872 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.870+0000 7fa5b19f4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa5ac0b8000 0x7fa5ac0d2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:11.872 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.870+0000 7fa5b19f4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa5ac0b8000 0x7fa5ac0d2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42760/0 (socket says 172.21.15.114:42760) 2024-04-28T13:07:11.872 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.870+0000 7fa5b29f6640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa5ac0d3790 0x7fa5ac0d0380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48894/0 (socket says 172.21.15.114:48894) 2024-04-28T13:07:11.873 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.870+0000 7fa5b19f4640 1 -- 172.21.15.114:0/1877293573 learned_addr learned my addr 172.21.15.114:0/1877293573 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:11.873 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.870+0000 7fa5b21f5640 1 --2- 172.21.15.114:0/1877293573 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5ac0b55f0 0x7fa5ac0b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:11.873 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.871+0000 7fa5b19f4640 1 -- 172.21.15.114:0/1877293573 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5ac0b55f0 msgr2=0x7fa5ac0b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:11.873 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.871+0000 7fa5b19f4640 1 --2- 172.21.15.114:0/1877293573 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5ac0b55f0 0x7fa5ac0b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:11.873 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.871+0000 7fa5b19f4640 1 -- 172.21.15.114:0/1877293573 >> v1:172.21.15.114:6789/0 conn(0x7fa5ac0d3790 legacy=0x7fa5ac0d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:11.873 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.871+0000 7fa5b19f4640 1 -- 172.21.15.114:0/1877293573 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5ac0d5fc0 con 0x7fa5ac0b8000 2024-04-28T13:07:11.873 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.871+0000 7fa5b21f5640 1 --2- 172.21.15.114:0/1877293573 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5ac0b55f0 0x7fa5ac0b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:07:11.873 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.871+0000 7fa5b19f4640 1 --2- 172.21.15.114:0/1877293573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5ac0b8000 0x7fa5ac0d2260 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa59c009870 tx=0x7fa59c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fdbc3f6aaceae7 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:11.873 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.871+0000 7fa5b11f3640 1 -- 172.21.15.114:0/1877293573 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59c037070 con 0x7fa5ac0b8000 2024-04-28T13:07:11.873 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.871+0000 7fa5b11f3640 1 -- 172.21.15.114:0/1877293573 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa59c032440 con 0x7fa5ac0b8000 2024-04-28T13:07:11.873 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.871+0000 7fa5b11f3640 1 -- 172.21.15.114:0/1877293573 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59c032810 con 0x7fa5ac0b8000 2024-04-28T13:07:11.876 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.872+0000 7fa5b4459640 1 -- 172.21.15.114:0/1877293573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5ac0b8000 msgr2=0x7fa5ac0d2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:11.876 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.872+0000 7fa5b4459640 1 --2- 172.21.15.114:0/1877293573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5ac0b8000 0x7fa5ac0d2260 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa59c009870 tx=0x7fa59c02a1c0 comp rx=0 tx=0).stop 2024-04-28T13:07:11.877 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.872+0000 7fa5b4459640 1 -- 172.21.15.114:0/1877293573 shutdown_connections 2024-04-28T13:07:11.877 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.872+0000 7fa5b4459640 1 --2- 172.21.15.114:0/1877293573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5ac0b8000 0x7fa5ac0d2260 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:11.877 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.872+0000 7fa5b4459640 1 --2- 172.21.15.114:0/1877293573 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5ac0b55f0 0x7fa5ac0b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:11.877 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.872+0000 7fa5b4459640 1 -- 172.21.15.114:0/1877293573 >> 172.21.15.114:0/1877293573 conn(0x7fa5ac09e4f0 msgr2=0x7fa5ac0d51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:11.877 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.872+0000 7fa5b4459640 1 -- 172.21.15.114:0/1877293573 shutdown_connections 2024-04-28T13:07:11.877 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.872+0000 7fa5b4459640 1 -- 172.21.15.114:0/1877293573 wait complete. 2024-04-28T13:07:11.877 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.873+0000 7fa5b4459640 1 Processor -- start 2024-04-28T13:07:11.877 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.873+0000 7fa5b4459640 1 -- start start 2024-04-28T13:07:11.877 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.874+0000 7fa5b4459640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5ac0b55f0 0x7fa5ac0cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:11.877 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.874+0000 7fa5b4459640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5ac0b8000 0x7fa5ac15d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:11.877 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.874+0000 7fa5b4459640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5ac0d3790 0x7fa5ac15c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:11.877 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.874+0000 7fa5b4459640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ac0d3c20 con 0x7fa5ac0b55f0 2024-04-28T13:07:11.877 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.874+0000 7fa5b4459640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ac0cfdc0 con 0x7fa5ac0d3790 2024-04-28T13:07:11.877 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.874+0000 7fa5b4459640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fa5ac0d3da0 con 0x7fa5ac0b8000 2024-04-28T13:07:11.878 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.874+0000 7fa5b21f5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5ac0b55f0 0x7fa5ac0cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:11.878 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.874+0000 7fa5b21f5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5ac0b55f0 0x7fa5ac0cebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42776/0 (socket says 172.21.15.114:42776) 2024-04-28T13:07:11.878 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.874+0000 7fa5b21f5640 1 -- 172.21.15.114:0/1749155849 learned_addr learned my addr 172.21.15.114:0/1749155849 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:11.878 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.874+0000 7fa5b29f6640 1 --2- 172.21.15.114:0/1749155849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5ac0d3790 0x7fa5ac15c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:11.878 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.874+0000 7fa5b19f4640 1 --2- 172.21.15.114:0/1749155849 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5ac0b8000 0x7fa5ac15d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:11.878 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.874+0000 7fa5b21f5640 1 -- 172.21.15.114:0/1749155849 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5ac0b8000 msgr2=0x7fa5ac15d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:11.878 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.874+0000 7fa5b21f5640 1 --2- 172.21.15.114:0/1749155849 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5ac0b8000 0x7fa5ac15d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:11.878 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.874+0000 7fa5b21f5640 1 -- 172.21.15.114:0/1749155849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5ac0d3790 msgr2=0x7fa5ac15c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:11.878 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.874+0000 7fa5b21f5640 1 --2- 172.21.15.114:0/1749155849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5ac0d3790 0x7fa5ac15c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:11.878 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.874+0000 7fa5b21f5640 1 -- 172.21.15.114:0/1749155849 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5ac0b3380 con 0x7fa5ac0b55f0 2024-04-28T13:07:11.878 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.874+0000 7fa5b19f4640 1 --2- 172.21.15.114:0/1749155849 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5ac0b8000 0x7fa5ac15d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:11.878 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.874+0000 7fa5b29f6640 1 --2- 172.21.15.114:0/1749155849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5ac0d3790 0x7fa5ac15c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:11.879 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.874+0000 7fa5b21f5640 1 --2- 172.21.15.114:0/1749155849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5ac0b55f0 0x7fa5ac0cebd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800c820 tx=0x7fa5a800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:11.879 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.874+0000 7fa5a2ffd640 1 -- 172.21.15.114:0/1749155849 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a8015070 con 0x7fa5ac0b55f0 2024-04-28T13:07:11.879 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.874+0000 7fa5a2ffd640 1 -- 172.21.15.114:0/1749155849 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5a8007a30 con 0x7fa5ac0b55f0 2024-04-28T13:07:11.879 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.874+0000 7fa5b4459640 1 -- 172.21.15.114:0/1749155849 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5ac0b3620 con 0x7fa5ac0b55f0 2024-04-28T13:07:11.879 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.874+0000 7fa5a2ffd640 1 -- 172.21.15.114:0/1749155849 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a8007e00 con 0x7fa5ac0b55f0 2024-04-28T13:07:11.879 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.875+0000 7fa5b4459640 1 -- 172.21.15.114:0/1749155849 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5ac0b3be0 con 0x7fa5ac0b55f0 2024-04-28T13:07:11.879 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.876+0000 7fa5b4459640 1 -- 172.21.15.114:0/1749155849 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5ac076880 con 0x7fa5ac0b55f0 2024-04-28T13:07:11.879 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.876+0000 7fa5a2ffd640 1 -- 172.21.15.114:0/1749155849 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7fa5a8018070 con 0x7fa5ac0b55f0 2024-04-28T13:07:11.880 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.876+0000 7fa5a2ffd640 1 --2- 172.21.15.114:0/1749155849 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa59006c860 0x7fa59006ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:11.880 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.877+0000 7fa5b19f4640 1 --2- 172.21.15.114:0/1749155849 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa59006c860 0x7fa59006ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:11.880 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.877+0000 7fa5a2ffd640 1 -- 172.21.15.114:0/1749155849 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7fa5a808abf0 con 0x7fa5ac0b55f0 2024-04-28T13:07:11.880 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.877+0000 7fa5b19f4640 1 --2- 172.21.15.114:0/1749155849 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa59006c860 0x7fa59006ed20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa59c034000 tx=0x7fa59c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:11.881 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:11.881+0000 7fa5a2ffd640 1 -- 172.21.15.114:0/1749155849 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa5a8059f20 con 0x7fa5ac0b55f0 2024-04-28T13:07:12.060 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:12.059+0000 7fa5b4459640 1 -- 172.21.15.114:0/1749155849 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa5ac0d3570 con 0x7fa5ac0b55f0 2024-04-28T13:07:12.060 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:12.059+0000 7fa5a2ffd640 1 -- 172.21.15.114:0/1749155849 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7fa5a8059820 con 0x7fa5ac0b55f0 2024-04-28T13:07:12.060 INFO:teuthology.misc.health.smithi114.stdout: 2024-04-28T13:07:12.060 INFO:teuthology.misc.health.smithi114.stdout:{"epoch":12,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:07:09.719660+0000","last_up_change":"0.000000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:07:12.062 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:12.061+0000 7fa5b4459640 1 -- 172.21.15.114:0/1749155849 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa59006c860 msgr2=0x7fa59006ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:12.062 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:12.061+0000 7fa5b4459640 1 --2- 172.21.15.114:0/1749155849 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa59006c860 0x7fa59006ed20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa59c034000 tx=0x7fa59c02e000 comp rx=0 tx=0).stop 2024-04-28T13:07:12.063 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:12.061+0000 7fa5b4459640 1 -- 172.21.15.114:0/1749155849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5ac0b55f0 msgr2=0x7fa5ac0cebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:12.063 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:12.061+0000 7fa5b4459640 1 --2- 172.21.15.114:0/1749155849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5ac0b55f0 0x7fa5ac0cebd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800c820 tx=0x7fa5a800cc20 comp rx=0 tx=0).stop 2024-04-28T13:07:12.063 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:12.061+0000 7fa5b4459640 1 -- 172.21.15.114:0/1749155849 shutdown_connections 2024-04-28T13:07:12.063 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:12.061+0000 7fa5b4459640 1 --2- 172.21.15.114:0/1749155849 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa59006c860 0x7fa59006ed20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:12.063 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:12.061+0000 7fa5b4459640 1 --2- 172.21.15.114:0/1749155849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5ac0d3790 0x7fa5ac15c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:12.063 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:12.061+0000 7fa5b4459640 1 --2- 172.21.15.114:0/1749155849 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5ac0b8000 0x7fa5ac15d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:12.063 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:12.061+0000 7fa5b4459640 1 --2- 172.21.15.114:0/1749155849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5ac0b55f0 0x7fa5ac0cebd0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:12.063 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:12.061+0000 7fa5b4459640 1 -- 172.21.15.114:0/1749155849 >> 172.21.15.114:0/1749155849 conn(0x7fa5ac09e4f0 msgr2=0x7fa5ac0b93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:12.063 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:12.062+0000 7fa5b4459640 1 -- 172.21.15.114:0/1749155849 shutdown_connections 2024-04-28T13:07:12.063 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:12.062+0000 7fa5b4459640 1 -- 172.21.15.114:0/1749155849 wait complete. 2024-04-28T13:07:12.071 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-28T13:07:18.880 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-28T13:07:18.978 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.978+0000 7f05e67ac640 1 Processor -- start 2024-04-28T13:07:18.979 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.978+0000 7f05e67ac640 1 -- start start 2024-04-28T13:07:18.980 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.978+0000 7f05e67ac640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05e00cb620 0x7f05e00d1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:18.981 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.978+0000 7f05e67ac640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f05e00b6240 0x7f05e00d1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:18.981 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.978+0000 7f05e67ac640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05e00d2fd0 con 0x7f05e00b5cf0 2024-04-28T13:07:18.981 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.978+0000 7f05e67ac640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f05e00c8d40 con 0x7f05e00b6240 2024-04-28T13:07:18.981 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.978+0000 7f05e67ac640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f05e00d3f50 con 0x7f05e00cb620 2024-04-28T13:07:18.981 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.979+0000 7f05df7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f05e00b5cf0 0x7f05e01632e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48902/0 (socket says 172.21.15.114:48902) 2024-04-28T13:07:18.981 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.979+0000 7f05df7fe640 1 -- 172.21.15.114:0/2389847781 learned_addr learned my addr 172.21.15.114:0/2389847781 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:18.981 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.979+0000 7f05e4d49640 1 --2- 172.21.15.114:0/2389847781 >> v2:172.21.15.134:3300/0 conn(0x7f05e00b6240 0x7f05e00d1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:18.981 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.979+0000 7f05dffff640 1 --2- 172.21.15.114:0/2389847781 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05e00cb620 0x7f05e00d1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:18.981 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.979+0000 7f05deffd640 1 -- 172.21.15.114:0/2389847781 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 711412862 0 0) 0x7f05e00d2fd0 con 0x7f05e00b5cf0 2024-04-28T13:07:18.981 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.979+0000 7f05deffd640 1 -- 172.21.15.114:0/2389847781 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05c8003520 con 0x7f05e00b5cf0 2024-04-28T13:07:18.981 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.979+0000 7f05dffff640 1 -- 172.21.15.114:0/2389847781 >> v2:172.21.15.134:3300/0 conn(0x7f05e00b6240 msgr2=0x7f05e00d1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:18.981 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.979+0000 7f05dffff640 1 --2- 172.21.15.114:0/2389847781 >> v2:172.21.15.134:3300/0 conn(0x7f05e00b6240 0x7f05e00d1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:18.981 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.979+0000 7f05dffff640 1 -- 172.21.15.114:0/2389847781 >> v1:172.21.15.114:6789/0 conn(0x7f05e00b5cf0 legacy=0x7f05e01632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:18.981 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.979+0000 7f05dffff640 1 -- 172.21.15.114:0/2389847781 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e00d32b0 con 0x7f05e00cb620 2024-04-28T13:07:18.982 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.979+0000 7f05e4d49640 1 --2- 172.21.15.114:0/2389847781 >> v2:172.21.15.134:3300/0 conn(0x7f05e00b6240 0x7f05e00d1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:07:18.982 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.980+0000 7f05dffff640 1 --2- 172.21.15.114:0/2389847781 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05e00cb620 0x7f05e00d1820 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f05d00097a0 tx=0x7f05d002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0c9fa88b599ab9c server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:18.982 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.980+0000 7f05deffd640 1 -- 172.21.15.114:0/2389847781 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d0037070 con 0x7f05e00cb620 2024-04-28T13:07:18.982 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.980+0000 7f05deffd640 1 -- 172.21.15.114:0/2389847781 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d0032440 con 0x7f05e00cb620 2024-04-28T13:07:18.982 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.980+0000 7f05deffd640 1 -- 172.21.15.114:0/2389847781 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d00327f0 con 0x7f05e00cb620 2024-04-28T13:07:18.985 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.980+0000 7f05e67ac640 1 -- 172.21.15.114:0/2389847781 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05e00cb620 msgr2=0x7f05e00d1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:18.985 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.980+0000 7f05e67ac640 1 --2- 172.21.15.114:0/2389847781 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05e00cb620 0x7f05e00d1820 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f05d00097a0 tx=0x7f05d002a180 comp rx=0 tx=0).stop 2024-04-28T13:07:18.985 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.981+0000 7f05e67ac640 1 -- 172.21.15.114:0/2389847781 shutdown_connections 2024-04-28T13:07:18.985 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.981+0000 7f05e67ac640 1 --2- 172.21.15.114:0/2389847781 >> v2:172.21.15.134:3300/0 conn(0x7f05e00b6240 0x7f05e00d1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:18.985 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.981+0000 7f05e67ac640 1 --2- 172.21.15.114:0/2389847781 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05e00cb620 0x7f05e00d1820 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:18.985 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.981+0000 7f05e67ac640 1 -- 172.21.15.114:0/2389847781 >> 172.21.15.114:0/2389847781 conn(0x7f05e009e530 msgr2=0x7f05e00d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:18.985 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.981+0000 7f05e67ac640 1 -- 172.21.15.114:0/2389847781 shutdown_connections 2024-04-28T13:07:18.985 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.981+0000 7f05e67ac640 1 -- 172.21.15.114:0/2389847781 wait complete. 2024-04-28T13:07:18.985 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.982+0000 7f05e67ac640 1 Processor -- start 2024-04-28T13:07:18.985 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.982+0000 7f05e67ac640 1 -- start start 2024-04-28T13:07:18.985 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.983+0000 7f05e67ac640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05e00b5cf0 0x7f05e00b87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:18.986 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.983+0000 7f05e67ac640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05e00b6240 0x7f05e00b7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:18.986 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.983+0000 7f05e67ac640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05e00cb620 0x7f05e01565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:18.986 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.983+0000 7f05e67ac640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f05e00d3be0 con 0x7f05e00b5cf0 2024-04-28T13:07:18.986 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.983+0000 7f05e67ac640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f05e00d3590 con 0x7f05e00cb620 2024-04-28T13:07:18.986 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.983+0000 7f05e67ac640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f05e00d0fc0 con 0x7f05e00b6240 2024-04-28T13:07:18.986 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.983+0000 7f05dffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05e00b5cf0 0x7f05e00b87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:18.986 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.983+0000 7f05dffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05e00b5cf0 0x7f05e00b87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42814/0 (socket says 172.21.15.114:42814) 2024-04-28T13:07:18.986 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.983+0000 7f05dffff640 1 -- 172.21.15.114:0/532429202 learned_addr learned my addr 172.21.15.114:0/532429202 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:18.986 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.983+0000 7f05df7fe640 1 --2- 172.21.15.114:0/532429202 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05e00b6240 0x7f05e00b7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:18.986 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.983+0000 7f05e4d49640 1 --2- 172.21.15.114:0/532429202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05e00cb620 0x7f05e01565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:18.986 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.983+0000 7f05dffff640 1 -- 172.21.15.114:0/532429202 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05e00b6240 msgr2=0x7f05e00b7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:18.986 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.983+0000 7f05dffff640 1 --2- 172.21.15.114:0/532429202 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05e00b6240 0x7f05e00b7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:18.986 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.983+0000 7f05dffff640 1 -- 172.21.15.114:0/532429202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05e00cb620 msgr2=0x7f05e01565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:18.987 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.983+0000 7f05dffff640 1 --2- 172.21.15.114:0/532429202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05e00cb620 0x7f05e01565f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:18.987 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.983+0000 7f05dffff640 1 -- 172.21.15.114:0/532429202 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e00b32d0 con 0x7f05e00b5cf0 2024-04-28T13:07:18.987 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.983+0000 7f05dffff640 1 --2- 172.21.15.114:0/532429202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05e00b5cf0 0x7f05e00b87a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f05d0035040 tx=0x7f05d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:18.987 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.983+0000 7f05dcff9640 1 -- 172.21.15.114:0/532429202 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d0037040 con 0x7f05e00b5cf0 2024-04-28T13:07:18.987 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.983+0000 7f05dcff9640 1 -- 172.21.15.114:0/532429202 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d0042070 con 0x7f05e00b5cf0 2024-04-28T13:07:18.987 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.983+0000 7f05e67ac640 1 -- 172.21.15.114:0/532429202 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05e00b8e10 con 0x7f05e00b5cf0 2024-04-28T13:07:18.987 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.983+0000 7f05dcff9640 1 -- 172.21.15.114:0/532429202 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d003b930 con 0x7f05e00b5cf0 2024-04-28T13:07:18.987 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.984+0000 7f05e67ac640 1 -- 172.21.15.114:0/532429202 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05e00b4b90 con 0x7f05e00b5cf0 2024-04-28T13:07:18.987 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.984+0000 7f05e67ac640 1 -- 172.21.15.114:0/532429202 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05e0076880 con 0x7f05e00b5cf0 2024-04-28T13:07:18.988 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.985+0000 7f05dcff9640 1 -- 172.21.15.114:0/532429202 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f05d003bad0 con 0x7f05e00b5cf0 2024-04-28T13:07:18.988 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.985+0000 7f05dcff9640 1 --2- 172.21.15.114:0/532429202 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f05cc06c8f0 0x7f05cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:18.988 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.986+0000 7f05df7fe640 1 --2- 172.21.15.114:0/532429202 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f05cc06c8f0 0x7f05cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:18.988 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.986+0000 7f05dcff9640 1 -- 172.21.15.114:0/532429202 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f05d00abfe0 con 0x7f05e00b5cf0 2024-04-28T13:07:18.988 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.986+0000 7f05df7fe640 1 --2- 172.21.15.114:0/532429202 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f05cc06c8f0 0x7f05cc06edb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f05e0162c40 tx=0x7f05d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:18.991 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:18.990+0000 7f05dcff9640 1 -- 172.21.15.114:0/532429202 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f05d007a7f0 con 0x7f05e00b5cf0 2024-04-28T13:07:19.164 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:19.164+0000 7f05e67ac640 1 -- 172.21.15.114:0/532429202 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05e006d930 con 0x7f05e00b5cf0 2024-04-28T13:07:19.165 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:19.165+0000 7f05dcff9640 1 -- 172.21.15.114:0/532429202 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12932 (secure 0 0 0) 0x7f05d007a0f0 con 0x7f05e00b5cf0 2024-04-28T13:07:19.165 INFO:teuthology.misc.health.smithi114.stdout: 2024-04-28T13:07:19.166 INFO:teuthology.misc.health.smithi114.stdout:{"epoch":17,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:07:16.781417+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:07:19.167 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:19.167+0000 7f05e67ac640 1 -- 172.21.15.114:0/532429202 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f05cc06c8f0 msgr2=0x7f05cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:19.168 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:19.167+0000 7f05e67ac640 1 --2- 172.21.15.114:0/532429202 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f05cc06c8f0 0x7f05cc06edb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f05e0162c40 tx=0x7f05d4009040 comp rx=0 tx=0).stop 2024-04-28T13:07:19.168 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:19.167+0000 7f05e67ac640 1 -- 172.21.15.114:0/532429202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05e00b5cf0 msgr2=0x7f05e00b87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:19.168 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:19.167+0000 7f05e67ac640 1 --2- 172.21.15.114:0/532429202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05e00b5cf0 0x7f05e00b87a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f05d0035040 tx=0x7f05d00046c0 comp rx=0 tx=0).stop 2024-04-28T13:07:19.168 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:19.167+0000 7f05e67ac640 1 -- 172.21.15.114:0/532429202 shutdown_connections 2024-04-28T13:07:19.168 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:19.167+0000 7f05e67ac640 1 --2- 172.21.15.114:0/532429202 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f05cc06c8f0 0x7f05cc06edb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:19.168 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:19.167+0000 7f05e67ac640 1 --2- 172.21.15.114:0/532429202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05e00cb620 0x7f05e01565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:19.168 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:19.167+0000 7f05e67ac640 1 --2- 172.21.15.114:0/532429202 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05e00b6240 0x7f05e00b7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:19.168 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:19.167+0000 7f05e67ac640 1 --2- 172.21.15.114:0/532429202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05e00b5cf0 0x7f05e00b87a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:19.168 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:19.167+0000 7f05e67ac640 1 -- 172.21.15.114:0/532429202 >> 172.21.15.114:0/532429202 conn(0x7f05e009e530 msgr2=0x7f05e006e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:19.168 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:19.167+0000 7f05e67ac640 1 -- 172.21.15.114:0/532429202 shutdown_connections 2024-04-28T13:07:19.168 INFO:teuthology.misc.health.smithi114.stderr:2024-04-28T13:07:19.167+0000 7f05e67ac640 1 -- 172.21.15.114:0/532429202 wait complete. 2024-04-28T13:07:19.177 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-28T13:07:19.177 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-28T13:07:19.177 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-28T13:07:19.178 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-28T13:07:19.180 INFO:tasks.ceph.mds.a:Started 2024-04-28T13:07:19.180 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-28T13:07:19.180 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-28T13:07:19.182 INFO:tasks.ceph.mds.c:Started 2024-04-28T13:07:19.182 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-28T13:07:19.182 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-28T13:07:19.185 INFO:tasks.ceph.mds.b:Started 2024-04-28T13:07:19.185 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-28T13:07:19.185 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-28T13:07:19.187 INFO:tasks.ceph.mds.d:Started 2024-04-28T13:07:19.188 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-28T13:07:19.188 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:07:19.253 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-04-28T13:07:19.253 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-04-28T13:07:19.254 INFO:tasks.ceph.mds.c.smithi114.stderr:2024-04-28T13:07:19.253+0000 7f2065f36640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-04-28T13:07:19.262 INFO:tasks.ceph.mds.d.smithi134.stdout:starting mds.d at 2024-04-28T13:07:19.266 INFO:tasks.ceph.mds.b.smithi134.stdout:starting mds.b at 2024-04-28T13:07:19.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.290+0000 7fd6ba979640 1 Processor -- start 2024-04-28T13:07:19.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.290+0000 7fd6ba979640 1 -- start start 2024-04-28T13:07:19.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.291+0000 7fd6ba979640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6b40d0670 0x7fd6b40baaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:19.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.291+0000 7fd6ba979640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6b40d3650 con 0x7fd6b40b4380 2024-04-28T13:07:19.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.291+0000 7fd6ba979640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6b415f7f0 con 0x7fd6b415f410 2024-04-28T13:07:19.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.291+0000 7fd6ba979640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fd6b40d3f10 con 0x7fd6b40d0670 2024-04-28T13:07:19.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.291+0000 7fd6b8f16640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd6b40b4380 0x7fd6b40d43a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48928/0 (socket says 172.21.15.114:48928) 2024-04-28T13:07:19.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.291+0000 7fd6b8f16640 1 -- 172.21.15.114:0/3880249160 learned_addr learned my addr 172.21.15.114:0/3880249160 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:19.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.291+0000 7fd6b37fe640 1 --2- 172.21.15.114:0/3880249160 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6b40d0670 0x7fd6b40baaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:19.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.291+0000 7fd6b2ffd640 1 -- 172.21.15.114:0/3880249160 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3250782612 0 0) 0x7fd6b40d3650 con 0x7fd6b40b4380 2024-04-28T13:07:19.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.292+0000 7fd6b2ffd640 1 -- 172.21.15.114:0/3880249160 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd69c003520 con 0x7fd6b40b4380 2024-04-28T13:07:19.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.292+0000 7fd6b2ffd640 1 -- 172.21.15.114:0/3880249160 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1148189828 0 0) 0x7fd6b415f7f0 con 0x7fd6b415f410 2024-04-28T13:07:19.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.292+0000 7fd6b2ffd640 1 -- 172.21.15.114:0/3880249160 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6b40d3650 con 0x7fd6b415f410 2024-04-28T13:07:19.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.292+0000 7fd6b37fe640 1 -- 172.21.15.114:0/3880249160 >> v1:172.21.15.134:6789/0 conn(0x7fd6b415f410 legacy=0x7fd6b40cff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:19.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.292+0000 7fd6b37fe640 1 -- 172.21.15.114:0/3880249160 >> v1:172.21.15.114:6789/0 conn(0x7fd6b40b4380 legacy=0x7fd6b40d43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:19.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.292+0000 7fd6b37fe640 1 -- 172.21.15.114:0/3880249160 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b40d2570 con 0x7fd6b40d0670 2024-04-28T13:07:19.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.292+0000 7fd6b37fe640 1 --2- 172.21.15.114:0/3880249160 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6b40d0670 0x7fd6b40baaf0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd6a80097d0 tx=0x7fd6a802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc0b5cef2bdb4067 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:19.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.292+0000 7fd6b2ffd640 1 -- 172.21.15.114:0/3880249160 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8037070 con 0x7fd6b40d0670 2024-04-28T13:07:19.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.293+0000 7fd6b2ffd640 1 -- 172.21.15.114:0/3880249160 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6a8032440 con 0x7fd6b40d0670 2024-04-28T13:07:19.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.293+0000 7fd6b2ffd640 1 -- 172.21.15.114:0/3880249160 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8032810 con 0x7fd6b40d0670 2024-04-28T13:07:19.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.293+0000 7fd6ba979640 1 -- 172.21.15.114:0/3880249160 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6b40d0670 msgr2=0x7fd6b40baaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:19.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.293+0000 7fd6ba979640 1 --2- 172.21.15.114:0/3880249160 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6b40d0670 0x7fd6b40baaf0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd6a80097d0 tx=0x7fd6a802a210 comp rx=0 tx=0).stop 2024-04-28T13:07:19.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.293+0000 7fd6ba979640 1 -- 172.21.15.114:0/3880249160 shutdown_connections 2024-04-28T13:07:19.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.293+0000 7fd6ba979640 1 --2- 172.21.15.114:0/3880249160 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6b40d0670 0x7fd6b40baaf0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:19.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.293+0000 7fd6ba979640 1 -- 172.21.15.114:0/3880249160 >> 172.21.15.114:0/3880249160 conn(0x7fd6b40633a0 msgr2=0x7fd6b40d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:19.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.293+0000 7fd6ba979640 1 -- 172.21.15.114:0/3880249160 shutdown_connections 2024-04-28T13:07:19.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.293+0000 7fd6ba979640 1 -- 172.21.15.114:0/3880249160 wait complete. 2024-04-28T13:07:19.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.294+0000 7fd6ba979640 1 Processor -- start 2024-04-28T13:07:19.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.294+0000 7fd6ba979640 1 -- start start 2024-04-28T13:07:19.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.295+0000 7fd6ba979640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6b40b4380 0x7fd6b41562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:19.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.295+0000 7fd6ba979640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6b40d0670 0x7fd6b41597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:19.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.295+0000 7fd6ba979640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6b415f410 0x7fd6b415f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:19.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.295+0000 7fd6ba979640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b40bb180 con 0x7fd6b415f410 2024-04-28T13:07:19.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.295+0000 7fd6ba979640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b40d3ba0 con 0x7fd6b40b4380 2024-04-28T13:07:19.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.295+0000 7fd6ba979640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fd6b40b8300 con 0x7fd6b40d0670 2024-04-28T13:07:19.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.295+0000 7fd6b8f16640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6b415f410 0x7fd6b415f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:19.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.295+0000 7fd6b3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6b40b4380 0x7fd6b41562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:19.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.295+0000 7fd6b8f16640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6b415f410 0x7fd6b415f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42858/0 (socket says 172.21.15.114:42858) 2024-04-28T13:07:19.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.295+0000 7fd6b8f16640 1 -- 172.21.15.114:0/1538426687 learned_addr learned my addr 172.21.15.114:0/1538426687 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:19.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.295+0000 7fd6b37fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6b40d0670 0x7fd6b41597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:19.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.295+0000 7fd6b8f16640 1 -- 172.21.15.114:0/1538426687 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6b40d0670 msgr2=0x7fd6b41597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:19.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.295+0000 7fd6b8f16640 1 --2- 172.21.15.114:0/1538426687 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6b40d0670 0x7fd6b41597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:19.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.295+0000 7fd6b8f16640 1 -- 172.21.15.114:0/1538426687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6b40b4380 msgr2=0x7fd6b41562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:19.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.295+0000 7fd6b8f16640 1 --2- 172.21.15.114:0/1538426687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6b40b4380 0x7fd6b41562f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:19.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.296+0000 7fd6b8f16640 1 -- 172.21.15.114:0/1538426687 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b41584a0 con 0x7fd6b415f410 2024-04-28T13:07:19.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.296+0000 7fd6b8f16640 1 --2- 172.21.15.114:0/1538426687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6b415f410 0x7fd6b415f9f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac00cb70 tx=0x7fd6ac00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:19.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.296+0000 7fd6b0ff9640 1 -- 172.21.15.114:0/1538426687 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac017070 con 0x7fd6b415f410 2024-04-28T13:07:19.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.296+0000 7fd6b0ff9640 1 -- 172.21.15.114:0/1538426687 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6ac00ad60 con 0x7fd6b415f410 2024-04-28T13:07:19.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.296+0000 7fd6ba979640 1 -- 172.21.15.114:0/1538426687 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6b4158740 con 0x7fd6b415f410 2024-04-28T13:07:19.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.296+0000 7fd6b0ff9640 1 -- 172.21.15.114:0/1538426687 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac012640 con 0x7fd6b415f410 2024-04-28T13:07:19.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.296+0000 7fd6ba979640 1 -- 172.21.15.114:0/1538426687 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6b4158d00 con 0x7fd6b415f410 2024-04-28T13:07:19.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.297+0000 7fd6ba979640 1 -- 172.21.15.114:0/1538426687 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6b406a3d0 con 0x7fd6b415f410 2024-04-28T13:07:19.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.297+0000 7fd6b0ff9640 1 -- 172.21.15.114:0/1538426687 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd6ac01a070 con 0x7fd6b415f410 2024-04-28T13:07:19.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.298+0000 7fd6b0ff9640 1 --2- 172.21.15.114:0/1538426687 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd6a006c8f0 0x7fd6a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:19.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.298+0000 7fd6b0ff9640 1 -- 172.21.15.114:0/1538426687 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fd6ac08b640 con 0x7fd6b415f410 2024-04-28T13:07:19.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.298+0000 7fd6b3fff640 1 --2- 172.21.15.114:0/1538426687 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd6a006c8f0 0x7fd6a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:19.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.298+0000 7fd6b3fff640 1 --2- 172.21.15.114:0/1538426687 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd6a006c8f0 0x7fd6a006edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4007fd0 tx=0x7fd6a4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:19.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.302+0000 7fd6b0ff9640 1 -- 172.21.15.114:0/1538426687 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd6ac0596e0 con 0x7fd6b415f410 2024-04-28T13:07:19.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.476+0000 7fd6ba979640 1 -- 172.21.15.114:0/1538426687 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd6b40b51c0 con 0x7fd6b415f410 2024-04-28T13:07:19.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.477+0000 7fd6b0ff9640 1 -- 172.21.15.114:0/1538426687 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12932 (secure 0 0 0) 0x7fd6ac05d9e0 con 0x7fd6b415f410 2024-04-28T13:07:19.478 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:19.478 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":17,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:07:16.781417+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:07:19.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.479+0000 7fd6ba979640 1 -- 172.21.15.114:0/1538426687 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd6a006c8f0 msgr2=0x7fd6a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:19.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.479+0000 7fd6ba979640 1 --2- 172.21.15.114:0/1538426687 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd6a006c8f0 0x7fd6a006edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4007fd0 tx=0x7fd6a4009040 comp rx=0 tx=0).stop 2024-04-28T13:07:19.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.479+0000 7fd6ba979640 1 -- 172.21.15.114:0/1538426687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6b415f410 msgr2=0x7fd6b415f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:19.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.479+0000 7fd6ba979640 1 --2- 172.21.15.114:0/1538426687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6b415f410 0x7fd6b415f9f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac00cb70 tx=0x7fd6ac00a430 comp rx=0 tx=0).stop 2024-04-28T13:07:19.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.479+0000 7fd6ba979640 1 -- 172.21.15.114:0/1538426687 shutdown_connections 2024-04-28T13:07:19.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.479+0000 7fd6ba979640 1 --2- 172.21.15.114:0/1538426687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6b415f410 0x7fd6b415f9f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:19.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.479+0000 7fd6ba979640 1 --2- 172.21.15.114:0/1538426687 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6b40d0670 0x7fd6b41597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:19.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.479+0000 7fd6ba979640 1 --2- 172.21.15.114:0/1538426687 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd6a006c8f0 0x7fd6a006edb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:19.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.479+0000 7fd6ba979640 1 --2- 172.21.15.114:0/1538426687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6b40b4380 0x7fd6b41562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:19.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.479+0000 7fd6ba979640 1 -- 172.21.15.114:0/1538426687 >> 172.21.15.114:0/1538426687 conn(0x7fd6b40633a0 msgr2=0x7fd6b40b6520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:19.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.479+0000 7fd6ba979640 1 -- 172.21.15.114:0/1538426687 shutdown_connections 2024-04-28T13:07:19.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.479+0000 7fd6ba979640 1 -- 172.21.15.114:0/1538426687 wait complete. 2024-04-28T13:07:19.490 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-28T13:07:14.721860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-28T13:07:19.491 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-28T13:07:19.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.589+0000 7f8f27e83640 1 Processor -- start 2024-04-28T13:07:19.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.589+0000 7f8f27e83640 1 -- start start 2024-04-28T13:07:19.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.590+0000 7f8f27e83640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8f200d1970 0x7f8f200b5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:19.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.590+0000 7f8f27e83640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8f200d0c30 0x7f8f200703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:19.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.590+0000 7f8f27e83640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f200b24f0 con 0x7f8f2015d510 2024-04-28T13:07:19.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.590+0000 7f8f27e83640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f8f200cecd0 con 0x7f8f200d0c30 2024-04-28T13:07:19.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.590+0000 7f8f27e83640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f8f200b2790 con 0x7f8f200d1970 2024-04-28T13:07:19.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.590+0000 7f8f26420640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8f200d0c30 0x7f8f200703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:19.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.591+0000 7f8f25c1f640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f8f2015d510 0x7f8f200d1260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:56144/0 (socket says 172.21.15.114:56144) 2024-04-28T13:07:19.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.591+0000 7f8f25c1f640 1 -- 172.21.15.114:0/1481458859 learned_addr learned my addr 172.21.15.114:0/1481458859 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:19.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.591+0000 7f8f2541e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8f200d1970 0x7f8f200b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:19.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.591+0000 7f8f26420640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8f200d0c30 0x7f8f200703a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:36130/0 (socket says 172.21.15.114:36130) 2024-04-28T13:07:19.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.591+0000 7f8f26420640 1 -- 172.21.15.114:0/1481458859 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8f200d1970 msgr2=0x7f8f200b5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:19.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.591+0000 7f8f26420640 1 --2- 172.21.15.114:0/1481458859 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8f200d1970 0x7f8f200b5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:19.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.591+0000 7f8f26420640 1 -- 172.21.15.114:0/1481458859 >> v1:172.21.15.134:6789/0 conn(0x7f8f2015d510 legacy=0x7f8f200d1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:19.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.591+0000 7f8f26420640 1 -- 172.21.15.114:0/1481458859 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f200ce680 con 0x7f8f200d0c30 2024-04-28T13:07:19.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.591+0000 7f8f24c1d640 1 -- 172.21.15.114:0/1481458859 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1031940388 0 0) 0x7f8f200b24f0 con 0x7f8f2015d510 2024-04-28T13:07:19.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.591+0000 7f8f2541e640 1 --2- 172.21.15.114:0/1481458859 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8f200d1970 0x7f8f200b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:07:19.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.592+0000 7f8f26420640 1 --2- 172.21.15.114:0/1481458859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f200d0c30 0x7f8f200703a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8f18009d90 tx=0x7f8f1802a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d01af79bf4a93dc server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:19.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.592+0000 7f8f24c1d640 1 -- 172.21.15.114:0/1481458859 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f18031600 con 0x7f8f200d0c30 2024-04-28T13:07:19.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.592+0000 7f8f24c1d640 1 -- 172.21.15.114:0/1481458859 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f180317a0 con 0x7f8f200d0c30 2024-04-28T13:07:19.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.592+0000 7f8f24c1d640 1 -- 172.21.15.114:0/1481458859 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f18031b70 con 0x7f8f200d0c30 2024-04-28T13:07:19.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.592+0000 7f8f27e83640 1 -- 172.21.15.114:0/1481458859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f200d0c30 msgr2=0x7f8f200703a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:19.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.592+0000 7f8f27e83640 1 --2- 172.21.15.114:0/1481458859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f200d0c30 0x7f8f200703a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8f18009d90 tx=0x7f8f1802a5d0 comp rx=0 tx=0).stop 2024-04-28T13:07:19.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.592+0000 7f8f27e83640 1 -- 172.21.15.114:0/1481458859 shutdown_connections 2024-04-28T13:07:19.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.592+0000 7f8f27e83640 1 --2- 172.21.15.114:0/1481458859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f200d0c30 0x7f8f200703a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:19.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.592+0000 7f8f27e83640 1 --2- 172.21.15.114:0/1481458859 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8f200d1970 0x7f8f200b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:19.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.592+0000 7f8f27e83640 1 -- 172.21.15.114:0/1481458859 >> 172.21.15.114:0/1481458859 conn(0x7f8f200b4b50 msgr2=0x7f8f200b4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:19.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.592+0000 7f8f27e83640 1 -- 172.21.15.114:0/1481458859 shutdown_connections 2024-04-28T13:07:19.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.592+0000 7f8f27e83640 1 -- 172.21.15.114:0/1481458859 wait complete. 2024-04-28T13:07:19.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.593+0000 7f8f27e83640 1 Processor -- start 2024-04-28T13:07:19.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.593+0000 7f8f27e83640 1 -- start start 2024-04-28T13:07:19.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.594+0000 7f8f27e83640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f200d0c30 0x7f8f201526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:19.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.594+0000 7f8f27e83640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f200d1970 0x7f8f2015dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:19.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.594+0000 7f8f27e83640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8f2015d510 0x7f8f2009be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:19.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.594+0000 7f8f27e83640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8f20070a60 con 0x7f8f200d1970 2024-04-28T13:07:19.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.594+0000 7f8f27e83640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8f200708e0 con 0x7f8f200d0c30 2024-04-28T13:07:19.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.594+0000 7f8f27e83640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f8f20070be0 con 0x7f8f2015d510 2024-04-28T13:07:19.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.594+0000 7f8f2541e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f200d1970 0x7f8f2015dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:19.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.594+0000 7f8f25c1f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f200d0c30 0x7f8f201526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:19.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.594+0000 7f8f26420640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8f2015d510 0x7f8f2009be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:19.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.594+0000 7f8f2541e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f200d1970 0x7f8f2015dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42860/0 (socket says 172.21.15.114:42860) 2024-04-28T13:07:19.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.594+0000 7f8f2541e640 1 -- 172.21.15.114:0/3400926598 learned_addr learned my addr 172.21.15.114:0/3400926598 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:19.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.595+0000 7f8f2541e640 1 -- 172.21.15.114:0/3400926598 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8f2015d510 msgr2=0x7f8f2009be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:19.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.595+0000 7f8f2541e640 1 --2- 172.21.15.114:0/3400926598 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8f2015d510 0x7f8f2009be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:19.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.595+0000 7f8f2541e640 1 -- 172.21.15.114:0/3400926598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f200d0c30 msgr2=0x7f8f201526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:19.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.595+0000 7f8f2541e640 1 --2- 172.21.15.114:0/3400926598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f200d0c30 0x7f8f201526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:19.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.595+0000 7f8f2541e640 1 -- 172.21.15.114:0/3400926598 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f200b5e40 con 0x7f8f200d1970 2024-04-28T13:07:19.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.595+0000 7f8f26420640 1 --2- 172.21.15.114:0/3400926598 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8f2015d510 0x7f8f2009be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:07:19.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.595+0000 7f8f2541e640 1 --2- 172.21.15.114:0/3400926598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f200d1970 0x7f8f2015dee0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8f1400ec10 tx=0x7f8f1400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:19.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.595+0000 7f8f1e7fc640 1 -- 172.21.15.114:0/3400926598 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f14017070 con 0x7f8f200d1970 2024-04-28T13:07:19.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.595+0000 7f8f1e7fc640 1 -- 172.21.15.114:0/3400926598 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f1400cc30 con 0x7f8f200d1970 2024-04-28T13:07:19.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.595+0000 7f8f27e83640 1 -- 172.21.15.114:0/3400926598 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f200b6120 con 0x7f8f200d1970 2024-04-28T13:07:19.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.595+0000 7f8f1e7fc640 1 -- 172.21.15.114:0/3400926598 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f14013470 con 0x7f8f200d1970 2024-04-28T13:07:19.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.595+0000 7f8f27e83640 1 -- 172.21.15.114:0/3400926598 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f200b66e0 con 0x7f8f200d1970 2024-04-28T13:07:19.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.596+0000 7f8f27e83640 1 -- 172.21.15.114:0/3400926598 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f2015cba0 con 0x7f8f200d1970 2024-04-28T13:07:19.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.596+0000 7f8f1e7fc640 1 -- 172.21.15.114:0/3400926598 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8f1401a070 con 0x7f8f200d1970 2024-04-28T13:07:19.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.597+0000 7f8f1e7fc640 1 --2- 172.21.15.114:0/3400926598 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f8f0c06c920 0x7f8f0c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:19.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.597+0000 7f8f1e7fc640 1 -- 172.21.15.114:0/3400926598 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f8f1408b970 con 0x7f8f200d1970 2024-04-28T13:07:19.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.597+0000 7f8f25c1f640 1 --2- 172.21.15.114:0/3400926598 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f8f0c06c920 0x7f8f0c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:19.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.597+0000 7f8f25c1f640 1 --2- 172.21.15.114:0/3400926598 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f8f0c06c920 0x7f8f0c06ede0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8f10007fd0 tx=0x7f8f10007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:19.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.601+0000 7f8f1e7fc640 1 -- 172.21.15.114:0/3400926598 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8f14059b30 con 0x7f8f200d1970 2024-04-28T13:07:19.680 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:07:19.682 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:07:19.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.780+0000 7f8f27e83640 1 -- 172.21.15.114:0/3400926598 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8f2015c5e0 con 0x7f8f200d1970 2024-04-28T13:07:19.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.781+0000 7f8f1e7fc640 1 -- 172.21.15.114:0/3400926598 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f8f1405de30 con 0x7f8f200d1970 2024-04-28T13:07:19.781 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-28T13:07:19.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.782+0000 7f8f27e83640 1 -- 172.21.15.114:0/3400926598 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f8f0c06c920 msgr2=0x7f8f0c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:19.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.782+0000 7f8f27e83640 1 --2- 172.21.15.114:0/3400926598 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f8f0c06c920 0x7f8f0c06ede0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8f10007fd0 tx=0x7f8f10007de0 comp rx=0 tx=0).stop 2024-04-28T13:07:19.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.782+0000 7f8f27e83640 1 -- 172.21.15.114:0/3400926598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f200d1970 msgr2=0x7f8f2015dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:19.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.782+0000 7f8f27e83640 1 --2- 172.21.15.114:0/3400926598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f200d1970 0x7f8f2015dee0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8f1400ec10 tx=0x7f8f1400c520 comp rx=0 tx=0).stop 2024-04-28T13:07:19.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.783+0000 7f8f27e83640 1 -- 172.21.15.114:0/3400926598 shutdown_connections 2024-04-28T13:07:19.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.783+0000 7f8f27e83640 1 --2- 172.21.15.114:0/3400926598 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8f2015d510 0x7f8f2009be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:19.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.783+0000 7f8f27e83640 1 --2- 172.21.15.114:0/3400926598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f200d1970 0x7f8f2015dee0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:19.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.783+0000 7f8f27e83640 1 --2- 172.21.15.114:0/3400926598 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f8f0c06c920 0x7f8f0c06ede0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:19.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.783+0000 7f8f27e83640 1 --2- 172.21.15.114:0/3400926598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f200d0c30 0x7f8f201526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:19.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.783+0000 7f8f27e83640 1 -- 172.21.15.114:0/3400926598 >> 172.21.15.114:0/3400926598 conn(0x7f8f200b4b50 msgr2=0x7f8f200b1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:19.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.783+0000 7f8f27e83640 1 -- 172.21.15.114:0/3400926598 shutdown_connections 2024-04-28T13:07:19.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.783+0000 7f8f27e83640 1 -- 172.21.15.114:0/3400926598 wait complete. 2024-04-28T13:07:19.794 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-28T13:07:19.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.930+0000 7f225f259640 1 Processor -- start 2024-04-28T13:07:19.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.931+0000 7f225f259640 1 -- start start 2024-04-28T13:07:19.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.931+0000 7f225f259640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2258159b00 0x7f22581602b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:19.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.931+0000 7f225f259640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f22580d32b0 0x7f22580d48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:19.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.931+0000 7f225f259640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f22580d4e30 0x7f2258160a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:19.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.931+0000 7f225f259640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f22580b8250 con 0x7f22580d4e30 2024-04-28T13:07:19.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.931+0000 7f225f259640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f22581607f0 con 0x7f22580d32b0 2024-04-28T13:07:19.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.931+0000 7f225f259640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f22580d3850 con 0x7f2258159b00 2024-04-28T13:07:19.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.931+0000 7f225d7f6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f22580d4e30 0x7f2258160a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:19.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.931+0000 7f225d7f6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f22580d4e30 0x7f2258160a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42872/0 (socket says 172.21.15.114:42872) 2024-04-28T13:07:19.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.931+0000 7f225d7f6640 1 -- 172.21.15.114:0/127678200 learned_addr learned my addr 172.21.15.114:0/127678200 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:19.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.932+0000 7f225cff5640 1 --2- 172.21.15.114:0/127678200 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2258159b00 0x7f22581602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:19.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.932+0000 7f2257fff640 1 --2- 172.21.15.114:0/127678200 >> v2:172.21.15.134:3300/0 conn(0x7f22580d32b0 0x7f22580d48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:19.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.932+0000 7f225d7f6640 1 -- 172.21.15.114:0/127678200 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2258159b00 msgr2=0x7f22581602b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:19.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.932+0000 7f225d7f6640 1 --2- 172.21.15.114:0/127678200 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2258159b00 0x7f22581602b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:19.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.932+0000 7f225d7f6640 1 -- 172.21.15.114:0/127678200 >> v2:172.21.15.134:3300/0 conn(0x7f22580d32b0 msgr2=0x7f22580d48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:19.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.932+0000 7f225d7f6640 1 --2- 172.21.15.114:0/127678200 >> v2:172.21.15.134:3300/0 conn(0x7f22580d32b0 0x7f22580d48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:19.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.932+0000 7f225d7f6640 1 -- 172.21.15.114:0/127678200 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22580d3b30 con 0x7f22580d4e30 2024-04-28T13:07:19.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.932+0000 7f225d7f6640 1 --2- 172.21.15.114:0/127678200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22580d4e30 0x7f2258160a20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f22580d6370 tx=0x7f225002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20076ad10df052 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:19.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.932+0000 7f22577fe640 1 -- 172.21.15.114:0/127678200 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2250036070 con 0x7f22580d4e30 2024-04-28T13:07:19.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.932+0000 7f22577fe640 1 -- 172.21.15.114:0/127678200 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2250031600 con 0x7f22580d4e30 2024-04-28T13:07:19.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.932+0000 7f22577fe640 1 -- 172.21.15.114:0/127678200 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22500319d0 con 0x7f22580d4e30 2024-04-28T13:07:19.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.933+0000 7f225f259640 1 -- 172.21.15.114:0/127678200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22580d4e30 msgr2=0x7f2258160a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:19.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.933+0000 7f225f259640 1 --2- 172.21.15.114:0/127678200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22580d4e30 0x7f2258160a20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f22580d6370 tx=0x7f225002a730 comp rx=0 tx=0).stop 2024-04-28T13:07:19.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.933+0000 7f225f259640 1 -- 172.21.15.114:0/127678200 shutdown_connections 2024-04-28T13:07:19.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.933+0000 7f225f259640 1 --2- 172.21.15.114:0/127678200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22580d4e30 0x7f2258160a20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:19.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.933+0000 7f225f259640 1 --2- 172.21.15.114:0/127678200 >> v2:172.21.15.134:3300/0 conn(0x7f22580d32b0 0x7f22580d48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:19.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.933+0000 7f225f259640 1 --2- 172.21.15.114:0/127678200 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2258159b00 0x7f22581602b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:19.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.933+0000 7f225f259640 1 -- 172.21.15.114:0/127678200 >> 172.21.15.114:0/127678200 conn(0x7f22580633a0 msgr2=0x7f22580d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:19.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.933+0000 7f225f259640 1 -- 172.21.15.114:0/127678200 shutdown_connections 2024-04-28T13:07:19.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.933+0000 7f225f259640 1 -- 172.21.15.114:0/127678200 wait complete. 2024-04-28T13:07:19.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.934+0000 7f225f259640 1 Processor -- start 2024-04-28T13:07:19.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.934+0000 7f225f259640 1 -- start start 2024-04-28T13:07:19.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.935+0000 7f225f259640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22580d32b0 0x7f2258155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:19.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.935+0000 7f225f259640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22580d4e30 0x7f22580abea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:19.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.935+0000 7f225f259640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2258159b00 0x7f225814dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:19.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.935+0000 7f225f259640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f22580d43d0 con 0x7f2258159b00 2024-04-28T13:07:19.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.935+0000 7f225f259640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f22580d40f0 con 0x7f22580d4e30 2024-04-28T13:07:19.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.935+0000 7f225f259640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2258160f60 con 0x7f22580d32b0 2024-04-28T13:07:19.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.935+0000 7f225d7f6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2258159b00 0x7f225814dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:19.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.935+0000 7f225d7f6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2258159b00 0x7f225814dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42878/0 (socket says 172.21.15.114:42878) 2024-04-28T13:07:19.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.935+0000 7f225d7f6640 1 -- 172.21.15.114:0/1487511619 learned_addr learned my addr 172.21.15.114:0/1487511619 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:19.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.935+0000 7f2257fff640 1 --2- 172.21.15.114:0/1487511619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22580d4e30 0x7f22580abea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:19.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.935+0000 7f225cff5640 1 --2- 172.21.15.114:0/1487511619 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22580d32b0 0x7f2258155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:19.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.935+0000 7f225d7f6640 1 -- 172.21.15.114:0/1487511619 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22580d32b0 msgr2=0x7f2258155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:19.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.935+0000 7f225d7f6640 1 --2- 172.21.15.114:0/1487511619 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22580d32b0 0x7f2258155c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:19.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.935+0000 7f225d7f6640 1 -- 172.21.15.114:0/1487511619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22580d4e30 msgr2=0x7f22580abea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:19.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.935+0000 7f225d7f6640 1 --2- 172.21.15.114:0/1487511619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22580d4e30 0x7f22580abea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:19.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.935+0000 7f225d7f6640 1 -- 172.21.15.114:0/1487511619 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22580ac3e0 con 0x7f2258159b00 2024-04-28T13:07:19.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.936+0000 7f225d7f6640 1 --2- 172.21.15.114:0/1487511619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2258159b00 0x7f225814dd60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2250009f40 tx=0x7f2250004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:19.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.936+0000 7f22557fa640 1 -- 172.21.15.114:0/1487511619 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2250036050 con 0x7f2258159b00 2024-04-28T13:07:19.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.936+0000 7f22557fa640 1 -- 172.21.15.114:0/1487511619 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2250042070 con 0x7f2258159b00 2024-04-28T13:07:19.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.936+0000 7f225f259640 1 -- 172.21.15.114:0/1487511619 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22580ac6b0 con 0x7f2258159b00 2024-04-28T13:07:19.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.936+0000 7f22557fa640 1 -- 172.21.15.114:0/1487511619 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2250009510 con 0x7f2258159b00 2024-04-28T13:07:19.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.936+0000 7f225f259640 1 -- 172.21.15.114:0/1487511619 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f225814b810 con 0x7f2258159b00 2024-04-28T13:07:19.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.937+0000 7f225f259640 1 -- 172.21.15.114:0/1487511619 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f225814bcf0 con 0x7f2258159b00 2024-04-28T13:07:19.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.937+0000 7f22557fa640 1 -- 172.21.15.114:0/1487511619 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2250007bf0 con 0x7f2258159b00 2024-04-28T13:07:19.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.937+0000 7f22557fa640 1 --2- 172.21.15.114:0/1487511619 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f223c06c920 0x7f223c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:19.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.938+0000 7f22557fa640 1 -- 172.21.15.114:0/1487511619 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f22500ac4a0 con 0x7f2258159b00 2024-04-28T13:07:19.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.938+0000 7f225cff5640 1 --2- 172.21.15.114:0/1487511619 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f223c06c920 0x7f223c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:19.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.938+0000 7f225cff5640 1 --2- 172.21.15.114:0/1487511619 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f223c06c920 0x7f223c06ede0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f224c0079a0 tx=0x7f224c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:19.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:19.942+0000 7f22557fa640 1 -- 172.21.15.114:0/1487511619 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f225814bcf0 con 0x7f2258159b00 2024-04-28T13:07:20.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:20.158+0000 7f225f259640 1 -- 172.21.15.114:0/1487511619 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22580d2ca0 con 0x7f2258159b00 2024-04-28T13:07:20.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:20.158+0000 7f22557fa640 1 -- 172.21.15.114:0/1487511619 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f225007a5d0 con 0x7f2258159b00 2024-04-28T13:07:20.159 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:20.159 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/888574435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":888574435},{"type":"v1","addr":"172.21.15.114:6836","nonce":888574435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-28T13:07:20.160 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 2 2024-04-28T13:07:20.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:20.160+0000 7f225f259640 1 -- 172.21.15.114:0/1487511619 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f223c06c920 msgr2=0x7f223c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:20.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:20.160+0000 7f225f259640 1 --2- 172.21.15.114:0/1487511619 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f223c06c920 0x7f223c06ede0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f224c0079a0 tx=0x7f224c008040 comp rx=0 tx=0).stop 2024-04-28T13:07:20.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:20.160+0000 7f225f259640 1 -- 172.21.15.114:0/1487511619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2258159b00 msgr2=0x7f225814dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:20.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:20.160+0000 7f225f259640 1 --2- 172.21.15.114:0/1487511619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2258159b00 0x7f225814dd60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2250009f40 tx=0x7f2250004a40 comp rx=0 tx=0).stop 2024-04-28T13:07:20.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:20.161+0000 7f225f259640 1 -- 172.21.15.114:0/1487511619 shutdown_connections 2024-04-28T13:07:20.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:20.161+0000 7f225f259640 1 --2- 172.21.15.114:0/1487511619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2258159b00 0x7f225814dd60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:20.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:20.161+0000 7f225f259640 1 --2- 172.21.15.114:0/1487511619 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f223c06c920 0x7f223c06ede0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:20.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:20.161+0000 7f225f259640 1 --2- 172.21.15.114:0/1487511619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22580d4e30 0x7f22580abea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:20.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:20.161+0000 7f225f259640 1 --2- 172.21.15.114:0/1487511619 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22580d32b0 0x7f2258155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:20.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:20.161+0000 7f225f259640 1 -- 172.21.15.114:0/1487511619 >> 172.21.15.114:0/1487511619 conn(0x7f22580633a0 msgr2=0x7f2258157890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:20.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:20.161+0000 7f225f259640 1 -- 172.21.15.114:0/1487511619 shutdown_connections 2024-04-28T13:07:20.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:20.161+0000 7f225f259640 1 -- 172.21.15.114:0/1487511619 wait complete. 2024-04-28T13:07:22.173 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-28T13:07:22.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.281+0000 7f6b3b4d1640 1 Processor -- start 2024-04-28T13:07:22.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.281+0000 7f6b3b4d1640 1 -- start start 2024-04-28T13:07:22.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.282+0000 7f6b3b4d1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6b340b7480 0x7f6b3416a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:22.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.282+0000 7f6b3b4d1640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b340bb280 con 0x7f6b340b9390 2024-04-28T13:07:22.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.282+0000 7f6b3b4d1640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b340b9850 con 0x7f6b3415f3c0 2024-04-28T13:07:22.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.282+0000 7f6b3b4d1640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f6b340b9b30 con 0x7f6b340b7480 2024-04-28T13:07:22.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.282+0000 7f6b38a6c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6b340b9390 0x7f6b340b6d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46946/0 (socket says 172.21.15.114:46946) 2024-04-28T13:07:22.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.282+0000 7f6b38a6c640 1 -- 172.21.15.114:0/2355771252 learned_addr learned my addr 172.21.15.114:0/2355771252 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:22.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.282+0000 7f6b2bfff640 1 -- 172.21.15.114:0/2355771252 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2969037149 0 0) 0x7f6b340bb280 con 0x7f6b340b9390 2024-04-28T13:07:22.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.282+0000 7f6b39a6e640 1 --2- 172.21.15.114:0/2355771252 >> v2:172.21.15.134:3300/0 conn(0x7f6b340b7480 0x7f6b3416a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:22.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.282+0000 7f6b2bfff640 1 -- 172.21.15.114:0/2355771252 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b20003520 con 0x7f6b340b9390 2024-04-28T13:07:22.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.282+0000 7f6b2bfff640 1 -- 172.21.15.114:0/2355771252 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3786944429 0 0) 0x7f6b20003520 con 0x7f6b340b9390 2024-04-28T13:07:22.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.282+0000 7f6b2bfff640 1 -- 172.21.15.114:0/2355771252 >> v2:172.21.15.134:3300/0 conn(0x7f6b340b7480 msgr2=0x7f6b3416a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:22.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.282+0000 7f6b2bfff640 1 --2- 172.21.15.114:0/2355771252 >> v2:172.21.15.134:3300/0 conn(0x7f6b340b7480 0x7f6b3416a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:22.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.282+0000 7f6b2bfff640 1 -- 172.21.15.114:0/2355771252 >> v1:172.21.15.134:6789/0 conn(0x7f6b3415f3c0 legacy=0x7f6b340bab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:22.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.282+0000 7f6b2bfff640 1 -- 172.21.15.114:0/2355771252 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b340b9e10 con 0x7f6b340b9390 2024-04-28T13:07:22.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.283+0000 7f6b2bfff640 1 -- 172.21.15.114:0/2355771252 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f6b24001670 con 0x7f6b340b9390 2024-04-28T13:07:22.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.283+0000 7f6b2bfff640 1 -- 172.21.15.114:0/2355771252 >> v1:172.21.15.114:6789/0 conn(0x7f6b340b9390 legacy=0x7f6b340b6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:22.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.283+0000 7f6b2bfff640 1 --2- 172.21.15.114:0/2355771252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b200039b0 0x7f6b20003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:22.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.283+0000 7f6b2bfff640 1 --2- 172.21.15.114:0/2355771252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b20004800 0x7f6b20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:22.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.283+0000 7f6b2bfff640 1 --2- 172.21.15.114:0/2355771252 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b200051c0 0x7f6b2000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:22.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.283+0000 7f6b2bfff640 1 -- 172.21.15.114:0/2355771252 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6b340b9b30 con 0x7f6b20004800 2024-04-28T13:07:22.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.283+0000 7f6b2bfff640 1 -- 172.21.15.114:0/2355771252 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2000c160 con 0x7f6b200039b0 2024-04-28T13:07:22.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.283+0000 7f6b2bfff640 1 -- 172.21.15.114:0/2355771252 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f6b2000c360 con 0x7f6b200051c0 2024-04-28T13:07:22.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.283+0000 7f6b38a6c640 1 --2- 172.21.15.114:0/2355771252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b20004800 0x7f6b20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:22.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.283+0000 7f6b3926d640 1 --2- 172.21.15.114:0/2355771252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b200039b0 0x7f6b20003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:22.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.283+0000 7f6b39a6e640 1 --2- 172.21.15.114:0/2355771252 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b200051c0 0x7f6b2000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:22.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.283+0000 7f6b38a6c640 1 -- 172.21.15.114:0/2355771252 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b200051c0 msgr2=0x7f6b2000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:22.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.283+0000 7f6b38a6c640 1 --2- 172.21.15.114:0/2355771252 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b200051c0 0x7f6b2000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:22.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.283+0000 7f6b38a6c640 1 -- 172.21.15.114:0/2355771252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b200039b0 msgr2=0x7f6b20003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:22.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.283+0000 7f6b38a6c640 1 --2- 172.21.15.114:0/2355771252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b200039b0 0x7f6b20003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:22.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.283+0000 7f6b38a6c640 1 -- 172.21.15.114:0/2355771252 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b20003520 con 0x7f6b20004800 2024-04-28T13:07:22.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.283+0000 7f6b39a6e640 1 --2- 172.21.15.114:0/2355771252 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b200051c0 0x7f6b2000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:22.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.283+0000 7f6b39a6e640 1 -- 172.21.15.114:0/2355771252 reap_dead start 2024-04-28T13:07:22.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.284+0000 7f6b38a6c640 1 --2- 172.21.15.114:0/2355771252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b20004800 0x7f6b20004c80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6b2400c240 tx=0x7f6b20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311ee1e28084e8a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:22.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.284+0000 7f6b2bfff640 1 -- 172.21.15.114:0/2355771252 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b24007cf0 con 0x7f6b20004800 2024-04-28T13:07:22.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.284+0000 7f6b2bfff640 1 -- 172.21.15.114:0/2355771252 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b24005af0 con 0x7f6b20004800 2024-04-28T13:07:22.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.284+0000 7f6b2bfff640 1 -- 172.21.15.114:0/2355771252 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b24007070 con 0x7f6b20004800 2024-04-28T13:07:22.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.284+0000 7f6b3b4d1640 1 -- 172.21.15.114:0/2355771252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b20004800 msgr2=0x7f6b20004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:22.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.284+0000 7f6b3b4d1640 1 --2- 172.21.15.114:0/2355771252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b20004800 0x7f6b20004c80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6b2400c240 tx=0x7f6b20005830 comp rx=0 tx=0).stop 2024-04-28T13:07:22.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.284+0000 7f6b3b4d1640 1 -- 172.21.15.114:0/2355771252 shutdown_connections 2024-04-28T13:07:22.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.284+0000 7f6b3b4d1640 1 --2- 172.21.15.114:0/2355771252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b20004800 0x7f6b20004c80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:22.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.284+0000 7f6b3b4d1640 1 -- 172.21.15.114:0/2355771252 >> 172.21.15.114:0/2355771252 conn(0x7f6b34063190 msgr2=0x7f6b340635a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:22.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.285+0000 7f6b3b4d1640 1 -- 172.21.15.114:0/2355771252 shutdown_connections 2024-04-28T13:07:22.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.285+0000 7f6b3b4d1640 1 -- 172.21.15.114:0/2355771252 wait complete. 2024-04-28T13:07:22.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.286+0000 7f6b3b4d1640 1 Processor -- start 2024-04-28T13:07:22.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.286+0000 7f6b3b4d1640 1 -- start start 2024-04-28T13:07:22.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.286+0000 7f6b3b4d1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b20004800 0x7f6b340cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:22.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.286+0000 7f6b3b4d1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b341561d0 0x7f6b3414c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:22.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.286+0000 7f6b3b4d1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b3415d400 0x7f6b3415d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:22.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.286+0000 7f6b3b4d1640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3415f7a0 con 0x7f6b3415d400 2024-04-28T13:07:22.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.286+0000 7f6b3b4d1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6b340ba3d0 con 0x7f6b341561d0 2024-04-28T13:07:22.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.286+0000 7f6b3b4d1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f6b3415f920 con 0x7f6b20004800 2024-04-28T13:07:22.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.286+0000 7f6b39a6e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b3415d400 0x7f6b3415d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:22.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.287+0000 7f6b39a6e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b3415d400 0x7f6b3415d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38070/0 (socket says 172.21.15.114:38070) 2024-04-28T13:07:22.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.287+0000 7f6b39a6e640 1 -- 172.21.15.114:0/755108682 learned_addr learned my addr 172.21.15.114:0/755108682 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:22.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.287+0000 7f6b39a6e640 1 -- 172.21.15.114:0/755108682 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b20004800 msgr2=0x7f6b340cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:22.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.287+0000 7f6b3926d640 1 --2- 172.21.15.114:0/755108682 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b20004800 0x7f6b340cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:22.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.287+0000 7f6b38a6c640 1 --2- 172.21.15.114:0/755108682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b341561d0 0x7f6b3414c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:22.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.287+0000 7f6b39a6e640 1 --2- 172.21.15.114:0/755108682 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b20004800 0x7f6b340cf4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:22.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.287+0000 7f6b39a6e640 1 -- 172.21.15.114:0/755108682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b341561d0 msgr2=0x7f6b3414c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:22.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.287+0000 7f6b39a6e640 1 --2- 172.21.15.114:0/755108682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b341561d0 0x7f6b3414c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:22.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.287+0000 7f6b39a6e640 1 -- 172.21.15.114:0/755108682 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b3414cdd0 con 0x7f6b3415d400 2024-04-28T13:07:22.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.287+0000 7f6b39a6e640 1 --2- 172.21.15.114:0/755108682 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b3415d400 0x7f6b3415d880 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6b340d1710 tx=0x7f6b2c010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:22.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.287+0000 7f6b29ffb640 1 -- 172.21.15.114:0/755108682 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c010da0 con 0x7f6b3415d400 2024-04-28T13:07:22.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.287+0000 7f6b29ffb640 1 -- 172.21.15.114:0/755108682 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b2c003990 con 0x7f6b3415d400 2024-04-28T13:07:22.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.287+0000 7f6b3b4d1640 1 -- 172.21.15.114:0/755108682 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b34156630 con 0x7f6b3415d400 2024-04-28T13:07:22.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.287+0000 7f6b29ffb640 1 -- 172.21.15.114:0/755108682 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c003d80 con 0x7f6b3415d400 2024-04-28T13:07:22.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.287+0000 7f6b3b4d1640 1 -- 172.21.15.114:0/755108682 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b34156bc0 con 0x7f6b3415d400 2024-04-28T13:07:22.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.288+0000 7f6b3b4d1640 1 -- 172.21.15.114:0/755108682 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b3406a3d0 con 0x7f6b3415d400 2024-04-28T13:07:22.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.289+0000 7f6b29ffb640 1 -- 172.21.15.114:0/755108682 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6b2c01e020 con 0x7f6b3415d400 2024-04-28T13:07:22.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.289+0000 7f6b29ffb640 1 --2- 172.21.15.114:0/755108682 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6b1806c920 0x7f6b1806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:22.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.289+0000 7f6b29ffb640 1 -- 172.21.15.114:0/755108682 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f6b2c08bef0 con 0x7f6b3415d400 2024-04-28T13:07:22.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.289+0000 7f6b3926d640 1 --2- 172.21.15.114:0/755108682 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6b1806c920 0x7f6b1806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:22.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.290+0000 7f6b3926d640 1 --2- 172.21.15.114:0/755108682 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6b1806c920 0x7f6b1806ede0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6b30000c00 tx=0x7f6b30009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:22.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.294+0000 7f6b29ffb640 1 -- 172.21.15.114:0/755108682 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6b3414cdd0 con 0x7f6b3415d400 2024-04-28T13:07:22.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.506+0000 7f6b3b4d1640 1 -- 172.21.15.114:0/755108682 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b3415a650 con 0x7f6b3415d400 2024-04-28T13:07:22.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.507+0000 7f6b29ffb640 1 -- 172.21.15.114:0/755108682 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3870 (secure 0 0 0) 0x7f6b2c05a670 con 0x7f6b3415d400 2024-04-28T13:07:22.508 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:22.508 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2660339514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2660339514},{"type":"v1","addr":"172.21.15.114:6837","nonce":2660339514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3536977085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3536977085},{"type":"v1","addr":"172.21.15.134:6833","nonce":3536977085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/869609014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":869609014},{"type":"v1","addr":"172.21.15.134:6835","nonce":869609014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/888574435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":888574435},{"type":"v1","addr":"172.21.15.114:6836","nonce":888574435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-28T13:07:22.508 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 3 2024-04-28T13:07:22.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.509+0000 7f6b3b4d1640 1 -- 172.21.15.114:0/755108682 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6b1806c920 msgr2=0x7f6b1806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:22.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.509+0000 7f6b3b4d1640 1 --2- 172.21.15.114:0/755108682 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6b1806c920 0x7f6b1806ede0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6b30000c00 tx=0x7f6b30009040 comp rx=0 tx=0).stop 2024-04-28T13:07:22.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.509+0000 7f6b3b4d1640 1 -- 172.21.15.114:0/755108682 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b3415d400 msgr2=0x7f6b3415d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:22.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.509+0000 7f6b3b4d1640 1 --2- 172.21.15.114:0/755108682 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b3415d400 0x7f6b3415d880 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6b340d1710 tx=0x7f6b2c010590 comp rx=0 tx=0).stop 2024-04-28T13:07:22.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.509+0000 7f6b3b4d1640 1 -- 172.21.15.114:0/755108682 shutdown_connections 2024-04-28T13:07:22.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.509+0000 7f6b3b4d1640 1 --2- 172.21.15.114:0/755108682 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b3415d400 0x7f6b3415d880 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:22.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.509+0000 7f6b3b4d1640 1 --2- 172.21.15.114:0/755108682 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6b1806c920 0x7f6b1806ede0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:22.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.509+0000 7f6b3b4d1640 1 --2- 172.21.15.114:0/755108682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b341561d0 0x7f6b3414c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:22.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.509+0000 7f6b3b4d1640 1 --2- 172.21.15.114:0/755108682 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b20004800 0x7f6b340cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:22.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.509+0000 7f6b3b4d1640 1 -- 172.21.15.114:0/755108682 >> 172.21.15.114:0/755108682 conn(0x7f6b34063190 msgr2=0x7f6b340d3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:22.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.509+0000 7f6b3b4d1640 1 -- 172.21.15.114:0/755108682 shutdown_connections 2024-04-28T13:07:22.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.509+0000 7f6b3b4d1640 1 -- 172.21.15.114:0/755108682 wait complete. 2024-04-28T13:07:22.521 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:07:22.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.616+0000 7f1ccf751640 1 Processor -- start 2024-04-28T13:07:22.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.616+0000 7f1ccf751640 1 -- start start 2024-04-28T13:07:22.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.617+0000 7f1ccf751640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1cc80b9390 0x7f1cc80b6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:22.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.617+0000 7f1ccf751640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1cc80b72b0 0x7f1cc80d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:22.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.617+0000 7f1ccf751640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cc80bb280 con 0x7f1cc815f3c0 2024-04-28T13:07:22.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.617+0000 7f1ccf751640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f1cc80b7720 con 0x7f1cc80b72b0 2024-04-28T13:07:22.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.617+0000 7f1ccf751640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1cc80b9850 con 0x7f1cc80b9390 2024-04-28T13:07:22.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.617+0000 7f1ccd4ed640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1cc815f3c0 0x7f1cc80bab70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46958/0 (socket says 172.21.15.114:46958) 2024-04-28T13:07:22.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.617+0000 7f1ccd4ed640 1 -- 172.21.15.114:0/2920803611 learned_addr learned my addr 172.21.15.114:0/2920803611 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:22.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.617+0000 7f1ccccec640 1 --2- 172.21.15.114:0/2920803611 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1cc80b9390 0x7f1cc80b6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:22.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.617+0000 7f1ccdcee640 1 --2- 172.21.15.114:0/2920803611 >> v2:172.21.15.134:3300/0 conn(0x7f1cc80b72b0 0x7f1cc80d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:22.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.617+0000 7f1cbffff640 1 -- 172.21.15.114:0/2920803611 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2578276130 0 0) 0x7f1cc80bb280 con 0x7f1cc815f3c0 2024-04-28T13:07:22.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.617+0000 7f1cbffff640 1 -- 172.21.15.114:0/2920803611 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1cb4003520 con 0x7f1cc815f3c0 2024-04-28T13:07:22.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.617+0000 7f1ccccec640 1 -- 172.21.15.114:0/2920803611 >> v2:172.21.15.134:3300/0 conn(0x7f1cc80b72b0 msgr2=0x7f1cc80d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:22.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.617+0000 7f1ccccec640 1 --2- 172.21.15.114:0/2920803611 >> v2:172.21.15.134:3300/0 conn(0x7f1cc80b72b0 0x7f1cc80d3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:22.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.617+0000 7f1ccccec640 1 -- 172.21.15.114:0/2920803611 >> v1:172.21.15.114:6789/0 conn(0x7f1cc815f3c0 legacy=0x7f1cc80bab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:22.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.617+0000 7f1ccccec640 1 -- 172.21.15.114:0/2920803611 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc80b9b30 con 0x7f1cc80b9390 2024-04-28T13:07:22.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.618+0000 7f1ccccec640 1 --2- 172.21.15.114:0/2920803611 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1cc80b9390 0x7f1cc80b6d70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1cb80097a0 tx=0x7f1cb802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e79f653704e2269f server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:22.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.618+0000 7f1cbffff640 1 -- 172.21.15.114:0/2920803611 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8037070 con 0x7f1cc80b9390 2024-04-28T13:07:22.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.618+0000 7f1cbffff640 1 -- 172.21.15.114:0/2920803611 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cb8032440 con 0x7f1cc80b9390 2024-04-28T13:07:22.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.618+0000 7f1cbffff640 1 -- 172.21.15.114:0/2920803611 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb80327f0 con 0x7f1cc80b9390 2024-04-28T13:07:22.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.619+0000 7f1ccf751640 1 -- 172.21.15.114:0/2920803611 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1cc80b9390 msgr2=0x7f1cc80b6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:22.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.619+0000 7f1ccf751640 1 --2- 172.21.15.114:0/2920803611 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1cc80b9390 0x7f1cc80b6d70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1cb80097a0 tx=0x7f1cb802a180 comp rx=0 tx=0).stop 2024-04-28T13:07:22.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.619+0000 7f1ccf751640 1 -- 172.21.15.114:0/2920803611 shutdown_connections 2024-04-28T13:07:22.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.619+0000 7f1ccf751640 1 --2- 172.21.15.114:0/2920803611 >> v2:172.21.15.134:3300/0 conn(0x7f1cc80b72b0 0x7f1cc80d3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:22.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.619+0000 7f1ccf751640 1 --2- 172.21.15.114:0/2920803611 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1cc80b9390 0x7f1cc80b6d70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:22.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.619+0000 7f1ccf751640 1 -- 172.21.15.114:0/2920803611 >> 172.21.15.114:0/2920803611 conn(0x7f1cc8063190 msgr2=0x7f1cc80635a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:22.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.619+0000 7f1ccf751640 1 -- 172.21.15.114:0/2920803611 shutdown_connections 2024-04-28T13:07:22.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.619+0000 7f1ccf751640 1 -- 172.21.15.114:0/2920803611 wait complete. 2024-04-28T13:07:22.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.620+0000 7f1ccf751640 1 Processor -- start 2024-04-28T13:07:22.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.620+0000 7f1ccf751640 1 -- start start 2024-04-28T13:07:22.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.620+0000 7f1ccf751640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1cc80b72b0 0x7f1cc80cd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:22.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.620+0000 7f1ccf751640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cc80b9390 0x7f1cc80cef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:22.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.621+0000 7f1ccf751640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1cc815f3c0 0x7f1cc80cb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:22.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.621+0000 7f1ccf751640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc80ba3d0 con 0x7f1cc80b9390 2024-04-28T13:07:22.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.621+0000 7f1ccf751640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc80ba0f0 con 0x7f1cc80b72b0 2024-04-28T13:07:22.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.621+0000 7f1ccf751640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1cc815f7a0 con 0x7f1cc815f3c0 2024-04-28T13:07:22.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.621+0000 7f1ccccec640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cc80b9390 0x7f1cc80cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:22.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.621+0000 7f1ccccec640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cc80b9390 0x7f1cc80cef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38078/0 (socket says 172.21.15.114:38078) 2024-04-28T13:07:22.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.621+0000 7f1ccccec640 1 -- 172.21.15.114:0/2772950149 learned_addr learned my addr 172.21.15.114:0/2772950149 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:22.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.621+0000 7f1ccdcee640 1 --2- 172.21.15.114:0/2772950149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1cc815f3c0 0x7f1cc80cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:22.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.621+0000 7f1ccd4ed640 1 --2- 172.21.15.114:0/2772950149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1cc80b72b0 0x7f1cc80cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:22.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.621+0000 7f1ccccec640 1 -- 172.21.15.114:0/2772950149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1cc815f3c0 msgr2=0x7f1cc80cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:22.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.621+0000 7f1ccccec640 1 --2- 172.21.15.114:0/2772950149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1cc815f3c0 0x7f1cc80cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:22.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.621+0000 7f1ccccec640 1 -- 172.21.15.114:0/2772950149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1cc80b72b0 msgr2=0x7f1cc80cd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:22.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.621+0000 7f1ccccec640 1 --2- 172.21.15.114:0/2772950149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1cc80b72b0 0x7f1cc80cd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:22.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.621+0000 7f1ccccec640 1 -- 172.21.15.114:0/2772950149 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc814bb60 con 0x7f1cc80b9390 2024-04-28T13:07:22.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.621+0000 7f1ccdcee640 1 --2- 172.21.15.114:0/2772950149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1cc815f3c0 0x7f1cc80cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:07:22.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.621+0000 7f1ccd4ed640 1 --2- 172.21.15.114:0/2772950149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1cc80b72b0 0x7f1cc80cd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:07:22.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.621+0000 7f1ccccec640 1 --2- 172.21.15.114:0/2772950149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cc80b9390 0x7f1cc80cef40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1cb802a1c0 tx=0x7f1cb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:22.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.621+0000 7f1cbdffb640 1 -- 172.21.15.114:0/2772950149 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8037040 con 0x7f1cc80b9390 2024-04-28T13:07:22.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.621+0000 7f1ccf751640 1 -- 172.21.15.114:0/2772950149 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cc81e9160 con 0x7f1cc80b9390 2024-04-28T13:07:22.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.621+0000 7f1ccf751640 1 -- 172.21.15.114:0/2772950149 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cc80ce180 con 0x7f1cc80b9390 2024-04-28T13:07:22.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.621+0000 7f1cbdffb640 1 -- 172.21.15.114:0/2772950149 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cb8042070 con 0x7f1cc80b9390 2024-04-28T13:07:22.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.621+0000 7f1cbdffb640 1 -- 172.21.15.114:0/2772950149 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb803b8f0 con 0x7f1cc80b9390 2024-04-28T13:07:22.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.622+0000 7f1ccf751640 1 -- 172.21.15.114:0/2772950149 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cc806a3d0 con 0x7f1cc80b9390 2024-04-28T13:07:22.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.623+0000 7f1cbdffb640 1 -- 172.21.15.114:0/2772950149 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1cb803ba90 con 0x7f1cc80b9390 2024-04-28T13:07:22.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.623+0000 7f1cbdffb640 1 --2- 172.21.15.114:0/2772950149 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1cac06c8f0 0x7f1cac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:22.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.623+0000 7f1cbdffb640 1 -- 172.21.15.114:0/2772950149 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f1cb80ac0f0 con 0x7f1cc80b9390 2024-04-28T13:07:22.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.623+0000 7f1ccd4ed640 1 --2- 172.21.15.114:0/2772950149 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1cac06c8f0 0x7f1cac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:22.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.624+0000 7f1ccd4ed640 1 --2- 172.21.15.114:0/2772950149 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1cac06c8f0 0x7f1cac06edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4005880 tx=0x7f1cc4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:22.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.627+0000 7f1cbdffb640 1 -- 172.21.15.114:0/2772950149 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1cb807a7f0 con 0x7f1cc80b9390 2024-04-28T13:07:22.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.804+0000 7f1ccf751640 1 -- 172.21.15.114:0/2772950149 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1cc815c080 con 0x7f1cc80b9390 2024-04-28T13:07:22.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.805+0000 7f1cbdffb640 1 -- 172.21.15.114:0/2772950149 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12932 (secure 0 0 0) 0x7f1cb807a0f0 con 0x7f1cc80b9390 2024-04-28T13:07:22.806 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:22.806 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":17,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:07:16.781417+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:07:22.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.807+0000 7f1ccf751640 1 -- 172.21.15.114:0/2772950149 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1cac06c8f0 msgr2=0x7f1cac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:22.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.807+0000 7f1ccf751640 1 --2- 172.21.15.114:0/2772950149 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1cac06c8f0 0x7f1cac06edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4005880 tx=0x7f1cc4009040 comp rx=0 tx=0).stop 2024-04-28T13:07:22.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.807+0000 7f1ccf751640 1 -- 172.21.15.114:0/2772950149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cc80b9390 msgr2=0x7f1cc80cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:22.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.807+0000 7f1ccf751640 1 --2- 172.21.15.114:0/2772950149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cc80b9390 0x7f1cc80cef40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1cb802a1c0 tx=0x7f1cb80046c0 comp rx=0 tx=0).stop 2024-04-28T13:07:22.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.807+0000 7f1ccf751640 1 -- 172.21.15.114:0/2772950149 shutdown_connections 2024-04-28T13:07:22.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.807+0000 7f1ccf751640 1 --2- 172.21.15.114:0/2772950149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1cc815f3c0 0x7f1cc80cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:22.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.807+0000 7f1ccf751640 1 --2- 172.21.15.114:0/2772950149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cc80b9390 0x7f1cc80cef40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:22.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.807+0000 7f1ccf751640 1 --2- 172.21.15.114:0/2772950149 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1cac06c8f0 0x7f1cac06edb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:22.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.807+0000 7f1ccf751640 1 --2- 172.21.15.114:0/2772950149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1cc80b72b0 0x7f1cc80cd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:22.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.807+0000 7f1ccf751640 1 -- 172.21.15.114:0/2772950149 >> 172.21.15.114:0/2772950149 conn(0x7f1cc8063190 msgr2=0x7f1cc815b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:22.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.807+0000 7f1ccf751640 1 -- 172.21.15.114:0/2772950149 shutdown_connections 2024-04-28T13:07:22.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.807+0000 7f1ccf751640 1 -- 172.21.15.114:0/2772950149 wait complete. 2024-04-28T13:07:22.818 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-28T13:07:14.721860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-28T13:07:22.819 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-28T13:07:22.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.918+0000 7f2f9231b640 1 Processor -- start 2024-04-28T13:07:22.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.918+0000 7f2f9231b640 1 -- start start 2024-04-28T13:07:22.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.919+0000 7f2f9231b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2f8c0b4850 0x7f2f8c0b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:22.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.919+0000 7f2f9231b640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f8c0cedc0 con 0x7f2f8c072e30 2024-04-28T13:07:22.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.919+0000 7f2f9231b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f8c0b5170 con 0x7f2f8c0732b0 2024-04-28T13:07:22.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.919+0000 7f2f9231b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2f8c073720 con 0x7f2f8c0b4850 2024-04-28T13:07:22.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.919+0000 7f2f8b7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2f8c072e30 0x7f2f8c0cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46968/0 (socket says 172.21.15.114:46968) 2024-04-28T13:07:22.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.919+0000 7f2f8b7fe640 1 -- 172.21.15.114:0/2938932300 learned_addr learned my addr 172.21.15.114:0/2938932300 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:22.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.919+0000 7f2f8affd640 1 -- 172.21.15.114:0/2938932300 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1679080849 0 0) 0x7f2f8c0cedc0 con 0x7f2f8c072e30 2024-04-28T13:07:22.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.919+0000 7f2f8bfff640 1 --2- 172.21.15.114:0/2938932300 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2f8c0b4850 0x7f2f8c0b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:22.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.919+0000 7f2f8affd640 1 -- 172.21.15.114:0/2938932300 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f74003520 con 0x7f2f8c072e30 2024-04-28T13:07:22.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.919+0000 7f2f8affd640 1 -- 172.21.15.114:0/2938932300 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 960587015 0 0) 0x7f2f74003520 con 0x7f2f8c072e30 2024-04-28T13:07:22.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.919+0000 7f2f8affd640 1 -- 172.21.15.114:0/2938932300 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2f8c0b4850 msgr2=0x7f2f8c0b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:22.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.919+0000 7f2f8affd640 1 --2- 172.21.15.114:0/2938932300 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2f8c0b4850 0x7f2f8c0b4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:22.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.919+0000 7f2f8affd640 1 -- 172.21.15.114:0/2938932300 >> v1:172.21.15.134:6789/0 conn(0x7f2f8c0732b0 legacy=0x7f2f8c0cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:22.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.919+0000 7f2f8affd640 1 -- 172.21.15.114:0/2938932300 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f8c073cc0 con 0x7f2f8c072e30 2024-04-28T13:07:22.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.919+0000 7f2f8affd640 1 -- 172.21.15.114:0/2938932300 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f2f80001670 con 0x7f2f8c072e30 2024-04-28T13:07:22.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.919+0000 7f2f8affd640 1 -- 172.21.15.114:0/2938932300 >> v1:172.21.15.114:6789/0 conn(0x7f2f8c072e30 legacy=0x7f2f8c0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:22.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.919+0000 7f2f8affd640 1 --2- 172.21.15.114:0/2938932300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f740039e0 0x7f2f74003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:22.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.919+0000 7f2f8affd640 1 --2- 172.21.15.114:0/2938932300 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2f8c0b4850 0x7f2f74004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:22.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.919+0000 7f2f8affd640 1 --2- 172.21.15.114:0/2938932300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f74004d40 0x7f2f740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:22.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.919+0000 7f2f8affd640 1 -- 172.21.15.114:0/2938932300 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2f8c073720 con 0x7f2f740039e0 2024-04-28T13:07:22.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.919+0000 7f2f8affd640 1 -- 172.21.15.114:0/2938932300 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7400ba70 con 0x7f2f74004d40 2024-04-28T13:07:22.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.919+0000 7f2f8affd640 1 -- 172.21.15.114:0/2938932300 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2f7400bc70 con 0x7f2f8c0b4850 2024-04-28T13:07:22.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.919+0000 7f2f8bfff640 1 --2- 172.21.15.114:0/2938932300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f740039e0 0x7f2f74003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:22.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.919+0000 7f2f8b7fe640 1 --2- 172.21.15.114:0/2938932300 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2f8c0b4850 0x7f2f74004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:22.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.919+0000 7f2f908b8640 1 --2- 172.21.15.114:0/2938932300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f74004d40 0x7f2f740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:22.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.920+0000 7f2f8bfff640 1 -- 172.21.15.114:0/2938932300 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2f8c0b4850 msgr2=0x7f2f74004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:22.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.920+0000 7f2f8bfff640 1 --2- 172.21.15.114:0/2938932300 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2f8c0b4850 0x7f2f74004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:22.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.920+0000 7f2f8bfff640 1 -- 172.21.15.114:0/2938932300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f74004d40 msgr2=0x7f2f740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:22.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.920+0000 7f2f8bfff640 1 --2- 172.21.15.114:0/2938932300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f74004d40 0x7f2f740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:22.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.920+0000 7f2f8bfff640 1 -- 172.21.15.114:0/2938932300 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f74003520 con 0x7f2f740039e0 2024-04-28T13:07:22.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.920+0000 7f2f8bfff640 1 --2- 172.21.15.114:0/2938932300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f740039e0 0x7f2f74003dc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c009aa0 tx=0x7f2f74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2120e659e96307a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:22.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.920+0000 7f2f8affd640 1 -- 172.21.15.114:0/2938932300 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c036070 con 0x7f2f740039e0 2024-04-28T13:07:22.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.920+0000 7f2f8affd640 1 -- 172.21.15.114:0/2938932300 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f7c031400 con 0x7f2f740039e0 2024-04-28T13:07:22.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.920+0000 7f2f8affd640 1 -- 172.21.15.114:0/2938932300 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c009670 con 0x7f2f740039e0 2024-04-28T13:07:22.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.921+0000 7f2f9231b640 1 -- 172.21.15.114:0/2938932300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f740039e0 msgr2=0x7f2f74003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:22.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.921+0000 7f2f9231b640 1 --2- 172.21.15.114:0/2938932300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f740039e0 0x7f2f74003dc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c009aa0 tx=0x7f2f74005830 comp rx=0 tx=0).stop 2024-04-28T13:07:22.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.921+0000 7f2f908b8640 1 -- 172.21.15.114:0/2938932300 reap_dead start 2024-04-28T13:07:22.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.921+0000 7f2f9231b640 1 -- 172.21.15.114:0/2938932300 shutdown_connections 2024-04-28T13:07:22.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.921+0000 7f2f9231b640 1 -- 172.21.15.114:0/2938932300 >> 172.21.15.114:0/2938932300 conn(0x7f2f8c06c980 msgr2=0x7f2f8c0b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:22.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.921+0000 7f2f9231b640 1 -- 172.21.15.114:0/2938932300 shutdown_connections 2024-04-28T13:07:22.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.921+0000 7f2f9231b640 1 -- 172.21.15.114:0/2938932300 wait complete. 2024-04-28T13:07:22.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.922+0000 7f2f9231b640 1 Processor -- start 2024-04-28T13:07:22.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.922+0000 7f2f9231b640 1 -- start start 2024-04-28T13:07:22.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.923+0000 7f2f9231b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2f740039e0 0x7f2f8c153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:22.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.923+0000 7f2f9231b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f8c155740 0x7f2f8c1436e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:22.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.923+0000 7f2f9231b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f8c15b1b0 0x7f2f8c15b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:22.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.923+0000 7f2f9231b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2f8c074560 con 0x7f2f8c15b1b0 2024-04-28T13:07:22.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.923+0000 7f2f9231b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2f8c074280 con 0x7f2f8c155740 2024-04-28T13:07:22.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.923+0000 7f2f9231b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2f8c06e3e0 con 0x7f2f740039e0 2024-04-28T13:07:22.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.923+0000 7f2f908b8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f8c15b1b0 0x7f2f8c15b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:22.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.923+0000 7f2f908b8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f8c15b1b0 0x7f2f8c15b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38096/0 (socket says 172.21.15.114:38096) 2024-04-28T13:07:22.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.923+0000 7f2f908b8640 1 -- 172.21.15.114:0/2751621457 learned_addr learned my addr 172.21.15.114:0/2751621457 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:22.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.923+0000 7f2f8bfff640 1 --2- 172.21.15.114:0/2751621457 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2f740039e0 0x7f2f8c153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:22.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.923+0000 7f2f8b7fe640 1 --2- 172.21.15.114:0/2751621457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f8c155740 0x7f2f8c1436e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:22.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.923+0000 7f2f908b8640 1 -- 172.21.15.114:0/2751621457 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2f740039e0 msgr2=0x7f2f8c153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:22.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.923+0000 7f2f908b8640 1 --2- 172.21.15.114:0/2751621457 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2f740039e0 0x7f2f8c153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:22.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.923+0000 7f2f908b8640 1 -- 172.21.15.114:0/2751621457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f8c155740 msgr2=0x7f2f8c1436e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:22.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.923+0000 7f2f908b8640 1 --2- 172.21.15.114:0/2751621457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f8c155740 0x7f2f8c1436e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:22.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.923+0000 7f2f908b8640 1 -- 172.21.15.114:0/2751621457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f8c155cb0 con 0x7f2f8c15b1b0 2024-04-28T13:07:22.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.923+0000 7f2f8bfff640 1 --2- 172.21.15.114:0/2751621457 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2f740039e0 0x7f2f8c153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:22.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.923+0000 7f2f8b7fe640 1 --2- 172.21.15.114:0/2751621457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f8c155740 0x7f2f8c1436e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:22.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.924+0000 7f2f908b8640 1 --2- 172.21.15.114:0/2751621457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f8c15b1b0 0x7f2f8c15b640 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c0b0af0 tx=0x7f2f8400ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:22.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.924+0000 7f2f88ff9640 1 -- 172.21.15.114:0/2751621457 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f84019070 con 0x7f2f8c15b1b0 2024-04-28T13:07:22.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.924+0000 7f2f88ff9640 1 -- 172.21.15.114:0/2751621457 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f84006d60 con 0x7f2f8c15b1b0 2024-04-28T13:07:22.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.924+0000 7f2f9231b640 1 -- 172.21.15.114:0/2751621457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f8c155f90 con 0x7f2f8c15b1b0 2024-04-28T13:07:22.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.924+0000 7f2f88ff9640 1 -- 172.21.15.114:0/2751621457 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f84003bb0 con 0x7f2f8c15b1b0 2024-04-28T13:07:22.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.924+0000 7f2f9231b640 1 -- 172.21.15.114:0/2751621457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f8c150860 con 0x7f2f8c15b1b0 2024-04-28T13:07:22.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.925+0000 7f2f9231b640 1 -- 172.21.15.114:0/2751621457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f8c1564b0 con 0x7f2f8c15b1b0 2024-04-28T13:07:22.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.925+0000 7f2f88ff9640 1 -- 172.21.15.114:0/2751621457 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2f8401c070 con 0x7f2f8c15b1b0 2024-04-28T13:07:22.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.925+0000 7f2f88ff9640 1 --2- 172.21.15.114:0/2751621457 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2f7806c8f0 0x7f2f7806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:22.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.926+0000 7f2f88ff9640 1 -- 172.21.15.114:0/2751621457 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f2f8408ab80 con 0x7f2f8c15b1b0 2024-04-28T13:07:22.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.926+0000 7f2f8bfff640 1 --2- 172.21.15.114:0/2751621457 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2f7806c8f0 0x7f2f7806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:22.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.926+0000 7f2f8bfff640 1 --2- 172.21.15.114:0/2751621457 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2f7806c8f0 0x7f2f7806edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c033000 tx=0x7f2f7c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:22.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:22.930+0000 7f2f88ff9640 1 -- 172.21.15.114:0/2751621457 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2f8c1564b0 con 0x7f2f8c15b1b0 2024-04-28T13:07:23.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.103+0000 7f2f9231b640 1 -- 172.21.15.114:0/2751621457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2f8c06a3d0 con 0x7f2f8c15b1b0 2024-04-28T13:07:23.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.103+0000 7f2f88ff9640 1 -- 172.21.15.114:0/2751621457 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f2f84059300 con 0x7f2f8c15b1b0 2024-04-28T13:07:23.104 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-28T13:07:23.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.105+0000 7f2f9231b640 1 -- 172.21.15.114:0/2751621457 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2f7806c8f0 msgr2=0x7f2f7806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:23.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.105+0000 7f2f9231b640 1 --2- 172.21.15.114:0/2751621457 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2f7806c8f0 0x7f2f7806edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c033000 tx=0x7f2f7c008030 comp rx=0 tx=0).stop 2024-04-28T13:07:23.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.105+0000 7f2f9231b640 1 -- 172.21.15.114:0/2751621457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f8c15b1b0 msgr2=0x7f2f8c15b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:23.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.105+0000 7f2f9231b640 1 --2- 172.21.15.114:0/2751621457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f8c15b1b0 0x7f2f8c15b640 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c0b0af0 tx=0x7f2f8400ff70 comp rx=0 tx=0).stop 2024-04-28T13:07:23.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.105+0000 7f2f9231b640 1 -- 172.21.15.114:0/2751621457 shutdown_connections 2024-04-28T13:07:23.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.105+0000 7f2f9231b640 1 --2- 172.21.15.114:0/2751621457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f8c15b1b0 0x7f2f8c15b640 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:23.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.105+0000 7f2f9231b640 1 --2- 172.21.15.114:0/2751621457 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2f7806c8f0 0x7f2f7806edb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:23.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.105+0000 7f2f9231b640 1 --2- 172.21.15.114:0/2751621457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f8c155740 0x7f2f8c1436e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:23.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.105+0000 7f2f9231b640 1 --2- 172.21.15.114:0/2751621457 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2f740039e0 0x7f2f8c153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:23.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.105+0000 7f2f9231b640 1 -- 172.21.15.114:0/2751621457 >> 172.21.15.114:0/2751621457 conn(0x7f2f8c06c980 msgr2=0x7f2f8c0b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:23.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.105+0000 7f2f9231b640 1 -- 172.21.15.114:0/2751621457 shutdown_connections 2024-04-28T13:07:23.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.105+0000 7f2f9231b640 1 -- 172.21.15.114:0/2751621457 wait complete. 2024-04-28T13:07:23.116 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-28T13:07:23.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.212+0000 7fa884262640 1 Processor -- start 2024-04-28T13:07:23.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.212+0000 7fa884262640 1 -- start start 2024-04-28T13:07:23.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.213+0000 7fa884262640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa87c0cdfa0 0x7fa87c15c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:23.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.213+0000 7fa884262640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa87c0cfda0 con 0x7fa87c1595c0 2024-04-28T13:07:23.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.213+0000 7fa884262640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa87c1599a0 con 0x7fa87c15bf30 2024-04-28T13:07:23.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.213+0000 7fa884262640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fa87c15cf80 con 0x7fa87c0cdfa0 2024-04-28T13:07:23.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.213+0000 7fa881ffe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa87c1595c0 0x7fa87c0cf690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46976/0 (socket says 172.21.15.114:46976) 2024-04-28T13:07:23.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.213+0000 7fa881ffe640 1 -- 172.21.15.114:0/3017289622 learned_addr learned my addr 172.21.15.114:0/3017289622 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:23.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.213+0000 7fa8827ff640 1 --2- 172.21.15.114:0/3017289622 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa87c0cdfa0 0x7fa87c15c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:23.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.213+0000 7fa880ffc640 1 -- 172.21.15.114:0/3017289622 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2775725531 0 0) 0x7fa87c0cfda0 con 0x7fa87c1595c0 2024-04-28T13:07:23.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.213+0000 7fa880ffc640 1 -- 172.21.15.114:0/3017289622 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa868003520 con 0x7fa87c1595c0 2024-04-28T13:07:23.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.214+0000 7fa880ffc640 1 -- 172.21.15.114:0/3017289622 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 820909615 0 0) 0x7fa87c1599a0 con 0x7fa87c15bf30 2024-04-28T13:07:23.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.214+0000 7fa880ffc640 1 -- 172.21.15.114:0/3017289622 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa87c0cfda0 con 0x7fa87c15bf30 2024-04-28T13:07:23.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.214+0000 7fa8827ff640 1 -- 172.21.15.114:0/3017289622 >> v1:172.21.15.134:6789/0 conn(0x7fa87c15bf30 legacy=0x7fa87c0cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:23.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.214+0000 7fa880ffc640 1 -- 172.21.15.114:0/3017289622 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3014165631 0 0) 0x7fa868003520 con 0x7fa87c1595c0 2024-04-28T13:07:23.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.214+0000 7fa8827ff640 1 -- 172.21.15.114:0/3017289622 >> v1:172.21.15.114:6789/0 conn(0x7fa87c1595c0 legacy=0x7fa87c0cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:23.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.214+0000 7fa8827ff640 1 -- 172.21.15.114:0/3017289622 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa87c15c9c0 con 0x7fa87c0cdfa0 2024-04-28T13:07:23.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.214+0000 7fa8827ff640 1 --2- 172.21.15.114:0/3017289622 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa87c0cdfa0 0x7fa87c15c3b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa874009dc0 tx=0x7fa87402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a68c80248a327014 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:23.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.214+0000 7fa880ffc640 1 -- 172.21.15.114:0/3017289622 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa878001670 con 0x7fa87c0cdfa0 2024-04-28T13:07:23.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.215+0000 7fa880ffc640 1 -- 172.21.15.114:0/3017289622 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa874007540 con 0x7fa87c0cdfa0 2024-04-28T13:07:23.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.215+0000 7fa880ffc640 1 -- 172.21.15.114:0/3017289622 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa874007910 con 0x7fa87c0cdfa0 2024-04-28T13:07:23.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.215+0000 7fa884262640 1 -- 172.21.15.114:0/3017289622 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa87c0cdfa0 msgr2=0x7fa87c15c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:23.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.215+0000 7fa884262640 1 --2- 172.21.15.114:0/3017289622 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa87c0cdfa0 0x7fa87c15c3b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa874009dc0 tx=0x7fa87402a5d0 comp rx=0 tx=0).stop 2024-04-28T13:07:23.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.215+0000 7fa884262640 1 -- 172.21.15.114:0/3017289622 shutdown_connections 2024-04-28T13:07:23.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.215+0000 7fa884262640 1 --2- 172.21.15.114:0/3017289622 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa87c0cdfa0 0x7fa87c15c3b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:23.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.215+0000 7fa884262640 1 -- 172.21.15.114:0/3017289622 >> 172.21.15.114:0/3017289622 conn(0x7fa87c06c980 msgr2=0x7fa87c0b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:23.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.215+0000 7fa884262640 1 -- 172.21.15.114:0/3017289622 shutdown_connections 2024-04-28T13:07:23.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.215+0000 7fa884262640 1 -- 172.21.15.114:0/3017289622 wait complete. 2024-04-28T13:07:23.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.216+0000 7fa884262640 1 Processor -- start 2024-04-28T13:07:23.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.216+0000 7fa884262640 1 -- start start 2024-04-28T13:07:23.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.217+0000 7fa884262640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa87c0cdfa0 0x7fa87c153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:23.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.217+0000 7fa884262640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa87c1595c0 0x7fa87c1529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:23.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.217+0000 7fa884262640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa87c15bf30 0x7fa87c14ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:23.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.217+0000 7fa884262640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa87c0cf170 con 0x7fa87c15bf30 2024-04-28T13:07:23.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.217+0000 7fa884262640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa87c0cee90 con 0x7fa87c0cdfa0 2024-04-28T13:07:23.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.217+0000 7fa884262640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fa87c0b6150 con 0x7fa87c1595c0 2024-04-28T13:07:23.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.217+0000 7fa8827ff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa87c15bf30 0x7fa87c14ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:23.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.217+0000 7fa8827ff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa87c15bf30 0x7fa87c14ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38112/0 (socket says 172.21.15.114:38112) 2024-04-28T13:07:23.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.217+0000 7fa8827ff640 1 -- 172.21.15.114:0/1450370672 learned_addr learned my addr 172.21.15.114:0/1450370672 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:23.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.217+0000 7fa881ffe640 1 --2- 172.21.15.114:0/1450370672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa87c0cdfa0 0x7fa87c153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:23.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.217+0000 7fa8817fd640 1 --2- 172.21.15.114:0/1450370672 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa87c1595c0 0x7fa87c1529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:23.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.218+0000 7fa8827ff640 1 -- 172.21.15.114:0/1450370672 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa87c1595c0 msgr2=0x7fa87c1529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:23.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.218+0000 7fa8827ff640 1 --2- 172.21.15.114:0/1450370672 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa87c1595c0 0x7fa87c1529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:23.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.218+0000 7fa8827ff640 1 -- 172.21.15.114:0/1450370672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa87c0cdfa0 msgr2=0x7fa87c153940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:23.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.218+0000 7fa8827ff640 1 --2- 172.21.15.114:0/1450370672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa87c0cdfa0 0x7fa87c153940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:23.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.218+0000 7fa8827ff640 1 -- 172.21.15.114:0/1450370672 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa87c1530f0 con 0x7fa87c15bf30 2024-04-28T13:07:23.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.218+0000 7fa8827ff640 1 --2- 172.21.15.114:0/1450370672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa87c15bf30 0x7fa87c14ab40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa874009dc0 tx=0x7fa874004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:23.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.218+0000 7fa8727fc640 1 -- 172.21.15.114:0/1450370672 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa874040070 con 0x7fa87c15bf30 2024-04-28T13:07:23.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.218+0000 7fa8727fc640 1 -- 172.21.15.114:0/1450370672 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa874031bc0 con 0x7fa87c15bf30 2024-04-28T13:07:23.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.218+0000 7fa884262640 1 -- 172.21.15.114:0/1450370672 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa87c14f3d0 con 0x7fa87c15bf30 2024-04-28T13:07:23.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.218+0000 7fa8727fc640 1 -- 172.21.15.114:0/1450370672 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa874007e90 con 0x7fa87c15bf30 2024-04-28T13:07:23.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.218+0000 7fa884262640 1 -- 172.21.15.114:0/1450370672 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa87c14f990 con 0x7fa87c15bf30 2024-04-28T13:07:23.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.219+0000 7fa884262640 1 -- 172.21.15.114:0/1450370672 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa87c06a3d0 con 0x7fa87c15bf30 2024-04-28T13:07:23.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.219+0000 7fa8727fc640 1 -- 172.21.15.114:0/1450370672 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa874039040 con 0x7fa87c15bf30 2024-04-28T13:07:23.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.220+0000 7fa8727fc640 1 --2- 172.21.15.114:0/1450370672 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa86006c8f0 0x7fa86006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:23.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.220+0000 7fa8727fc640 1 -- 172.21.15.114:0/1450370672 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fa8740aca10 con 0x7fa87c15bf30 2024-04-28T13:07:23.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.220+0000 7fa881ffe640 1 --2- 172.21.15.114:0/1450370672 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa86006c8f0 0x7fa86006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:23.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.220+0000 7fa881ffe640 1 --2- 172.21.15.114:0/1450370672 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa86006c8f0 0x7fa86006edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa8780017e0 tx=0x7fa878001610 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:23.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.224+0000 7fa8727fc640 1 -- 172.21.15.114:0/1450370672 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa87407ab50 con 0x7fa87c15bf30 2024-04-28T13:07:23.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.404+0000 7fa884262640 1 -- 172.21.15.114:0/1450370672 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa87c0b4740 con 0x7fa87c15bf30 2024-04-28T13:07:23.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.405+0000 7fa8727fc640 1 -- 172.21.15.114:0/1450370672 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7fa87407ee50 con 0x7fa87c15bf30 2024-04-28T13:07:23.406 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:23.406 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-04-28T13:07:23.406 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:07:23.406 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2024-04-28T13:07:23.406 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2024-04-28T13:07:23.406 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:07:23.406 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-04-28T13:07:23.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.407+0000 7fa884262640 1 -- 172.21.15.114:0/1450370672 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa86006c8f0 msgr2=0x7fa86006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:23.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.407+0000 7fa884262640 1 --2- 172.21.15.114:0/1450370672 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa86006c8f0 0x7fa86006edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa8780017e0 tx=0x7fa878001610 comp rx=0 tx=0).stop 2024-04-28T13:07:23.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.407+0000 7fa884262640 1 -- 172.21.15.114:0/1450370672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa87c15bf30 msgr2=0x7fa87c14ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:23.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.407+0000 7fa884262640 1 --2- 172.21.15.114:0/1450370672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa87c15bf30 0x7fa87c14ab40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa874009dc0 tx=0x7fa874004a40 comp rx=0 tx=0).stop 2024-04-28T13:07:23.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.407+0000 7fa884262640 1 -- 172.21.15.114:0/1450370672 shutdown_connections 2024-04-28T13:07:23.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.407+0000 7fa884262640 1 --2- 172.21.15.114:0/1450370672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa87c15bf30 0x7fa87c14ab40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:23.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.407+0000 7fa884262640 1 --2- 172.21.15.114:0/1450370672 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa87c1595c0 0x7fa87c1529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:23.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.407+0000 7fa884262640 1 --2- 172.21.15.114:0/1450370672 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa86006c8f0 0x7fa86006edb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:23.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.407+0000 7fa884262640 1 --2- 172.21.15.114:0/1450370672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa87c0cdfa0 0x7fa87c153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:23.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.407+0000 7fa884262640 1 -- 172.21.15.114:0/1450370672 >> 172.21.15.114:0/1450370672 conn(0x7fa87c06c980 msgr2=0x7fa87c0cd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:23.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.407+0000 7fa884262640 1 -- 172.21.15.114:0/1450370672 shutdown_connections 2024-04-28T13:07:23.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.407+0000 7fa884262640 1 -- 172.21.15.114:0/1450370672 wait complete. 2024-04-28T13:07:23.418 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-28T13:07:23.418 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-28T13:07:23.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.517+0000 7f70ef371640 1 Processor -- start 2024-04-28T13:07:23.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.517+0000 7f70ef371640 1 -- start start 2024-04-28T13:07:23.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.518+0000 7f70ef371640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f70e8142560 0x7f70e80c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:23.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.518+0000 7f70ef371640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70e8144bd0 0x7f70e80c8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:23.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.518+0000 7f70ef371640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70e81459c0 con 0x7f70e8142180 2024-04-28T13:07:23.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.518+0000 7f70ef371640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f70e815faf0 con 0x7f70e8142560 2024-04-28T13:07:23.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.518+0000 7f70ef371640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f70e815fdd0 con 0x7f70e8144bd0 2024-04-28T13:07:23.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.518+0000 7f70ec90c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f70e8142560 0x7f70e80c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:23.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.518+0000 7f70ec90c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f70e8142560 0x7f70e80c7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38124/0 (socket says 172.21.15.114:38124) 2024-04-28T13:07:23.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.518+0000 7f70ec90c640 1 -- 172.21.15.114:0/4128834920 learned_addr learned my addr 172.21.15.114:0/4128834920 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:23.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.518+0000 7f70ec90c640 1 -- 172.21.15.114:0/4128834920 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70e8144bd0 msgr2=0x7f70e80c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:23.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.518+0000 7f70ec90c640 1 --2- 172.21.15.114:0/4128834920 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70e8144bd0 0x7f70e80c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:23.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.518+0000 7f70ec90c640 1 -- 172.21.15.114:0/4128834920 >> v1:172.21.15.134:6789/0 conn(0x7f70e8142180 legacy=0x7f70e81452b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:23.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.518+0000 7f70ec90c640 1 -- 172.21.15.114:0/4128834920 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e81600b0 con 0x7f70e8142560 2024-04-28T13:07:23.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.519+0000 7f70ec90c640 1 --2- 172.21.15.114:0/4128834920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70e8142560 0x7f70e80c7ed0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f70d8009870 tx=0x7f70d802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17db1b69045d0179 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:23.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.519+0000 7f70dffff640 1 -- 172.21.15.114:0/4128834920 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d8037070 con 0x7f70e8142560 2024-04-28T13:07:23.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.519+0000 7f70dffff640 1 -- 172.21.15.114:0/4128834920 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d8032440 con 0x7f70e8142560 2024-04-28T13:07:23.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.519+0000 7f70dffff640 1 -- 172.21.15.114:0/4128834920 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d8032810 con 0x7f70e8142560 2024-04-28T13:07:23.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.519+0000 7f70ef371640 1 -- 172.21.15.114:0/4128834920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70e8142560 msgr2=0x7f70e80c7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:23.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.519+0000 7f70ef371640 1 --2- 172.21.15.114:0/4128834920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70e8142560 0x7f70e80c7ed0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f70d8009870 tx=0x7f70d802a210 comp rx=0 tx=0).stop 2024-04-28T13:07:23.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.519+0000 7f70ef371640 1 -- 172.21.15.114:0/4128834920 shutdown_connections 2024-04-28T13:07:23.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.519+0000 7f70ef371640 1 --2- 172.21.15.114:0/4128834920 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70e8144bd0 0x7f70e80c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:23.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.519+0000 7f70ef371640 1 --2- 172.21.15.114:0/4128834920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70e8142560 0x7f70e80c7ed0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:23.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.519+0000 7f70ef371640 1 -- 172.21.15.114:0/4128834920 >> 172.21.15.114:0/4128834920 conn(0x7f70e80d3050 msgr2=0x7f70e80d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:23.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.519+0000 7f70ef371640 1 -- 172.21.15.114:0/4128834920 shutdown_connections 2024-04-28T13:07:23.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.519+0000 7f70ef371640 1 -- 172.21.15.114:0/4128834920 wait complete. 2024-04-28T13:07:23.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.521+0000 7f70ef371640 1 Processor -- start 2024-04-28T13:07:23.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.521+0000 7f70ef371640 1 -- start start 2024-04-28T13:07:23.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.521+0000 7f70ef371640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70e8142180 0x7f70e80d1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:23.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.521+0000 7f70ef371640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70e8142560 0x7f70e80d24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:23.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.521+0000 7f70ef371640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70e8144bd0 0x7f70e8160b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:23.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.521+0000 7f70ef371640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f70e8142a40 con 0x7f70e8142560 2024-04-28T13:07:23.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.521+0000 7f70ef371640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f70e8160670 con 0x7f70e8144bd0 2024-04-28T13:07:23.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.521+0000 7f70ef371640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f70e8142bc0 con 0x7f70e8142180 2024-04-28T13:07:23.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.521+0000 7f70ec90c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70e8142560 0x7f70e80d24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:23.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.521+0000 7f70ec90c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70e8142560 0x7f70e80d24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38136/0 (socket says 172.21.15.114:38136) 2024-04-28T13:07:23.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.521+0000 7f70ec90c640 1 -- 172.21.15.114:0/2087057031 learned_addr learned my addr 172.21.15.114:0/2087057031 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:23.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.522+0000 7f70ed10d640 1 --2- 172.21.15.114:0/2087057031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70e8142180 0x7f70e80d1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:23.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.522+0000 7f70ed90e640 1 --2- 172.21.15.114:0/2087057031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70e8144bd0 0x7f70e8160b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:23.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.522+0000 7f70ec90c640 1 -- 172.21.15.114:0/2087057031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70e8142180 msgr2=0x7f70e80d1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:23.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.522+0000 7f70ec90c640 1 --2- 172.21.15.114:0/2087057031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70e8142180 0x7f70e80d1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:23.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.522+0000 7f70ec90c640 1 -- 172.21.15.114:0/2087057031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70e8144bd0 msgr2=0x7f70e8160b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:23.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.522+0000 7f70ec90c640 1 --2- 172.21.15.114:0/2087057031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70e8144bd0 0x7f70e8160b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:23.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.522+0000 7f70ec90c640 1 -- 172.21.15.114:0/2087057031 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e8161850 con 0x7f70e8142560 2024-04-28T13:07:23.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.522+0000 7f70ec90c640 1 --2- 172.21.15.114:0/2087057031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70e8142560 0x7f70e80d24e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f70d8009870 tx=0x7f70d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:23.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.522+0000 7f70ddffb640 1 -- 172.21.15.114:0/2087057031 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d8041070 con 0x7f70e8142560 2024-04-28T13:07:23.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.522+0000 7f70ddffb640 1 -- 172.21.15.114:0/2087057031 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d803c870 con 0x7f70e8142560 2024-04-28T13:07:23.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.522+0000 7f70ef371640 1 -- 172.21.15.114:0/2087057031 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e806d200 con 0x7f70e8142560 2024-04-28T13:07:23.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.522+0000 7f70ddffb640 1 -- 172.21.15.114:0/2087057031 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d8037040 con 0x7f70e8142560 2024-04-28T13:07:23.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.522+0000 7f70ef371640 1 -- 172.21.15.114:0/2087057031 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e806d7c0 con 0x7f70e8142560 2024-04-28T13:07:23.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.523+0000 7f70ef371640 1 -- 172.21.15.114:0/2087057031 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70e806a440 con 0x7f70e8142560 2024-04-28T13:07:23.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.523+0000 7f70ddffb640 1 -- 172.21.15.114:0/2087057031 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f70d8044070 con 0x7f70e8142560 2024-04-28T13:07:23.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.524+0000 7f70ddffb640 1 --2- 172.21.15.114:0/2087057031 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f70cc06c8f0 0x7f70cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:23.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.524+0000 7f70ed10d640 1 --2- 172.21.15.114:0/2087057031 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f70cc06c8f0 0x7f70cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:23.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.524+0000 7f70ddffb640 1 -- 172.21.15.114:0/2087057031 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f70d80ac2a0 con 0x7f70e8142560 2024-04-28T13:07:23.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.524+0000 7f70ed10d640 1 --2- 172.21.15.114:0/2087057031 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f70cc06c8f0 0x7f70cc06edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f70e4006fd0 tx=0x7f70e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:23.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.528+0000 7f70ddffb640 1 -- 172.21.15.114:0/2087057031 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f70d807aa20 con 0x7f70e8142560 2024-04-28T13:07:23.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:23.701+0000 7f70ef371640 1 -- 172.21.15.114:0/2087057031 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f70e80b3230 con 0x7f70e8142560 2024-04-28T13:07:24.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.277+0000 7f70ddffb640 1 -- 172.21.15.114:0/2087057031 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f70d807a320 con 0x7f70e8142560 2024-04-28T13:07:24.278 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2024-04-28T13:07:24.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.280+0000 7f70ef371640 1 -- 172.21.15.114:0/2087057031 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f70cc06c8f0 msgr2=0x7f70cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:24.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.280+0000 7f70ef371640 1 --2- 172.21.15.114:0/2087057031 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f70cc06c8f0 0x7f70cc06edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f70e4006fd0 tx=0x7f70e4008040 comp rx=0 tx=0).stop 2024-04-28T13:07:24.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.280+0000 7f70ef371640 1 -- 172.21.15.114:0/2087057031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70e8142560 msgr2=0x7f70e80d24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:24.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.280+0000 7f70ef371640 1 --2- 172.21.15.114:0/2087057031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70e8142560 0x7f70e80d24e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f70d8009870 tx=0x7f70d80046c0 comp rx=0 tx=0).stop 2024-04-28T13:07:24.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.280+0000 7f70ef371640 1 -- 172.21.15.114:0/2087057031 shutdown_connections 2024-04-28T13:07:24.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.280+0000 7f70ef371640 1 --2- 172.21.15.114:0/2087057031 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f70cc06c8f0 0x7f70cc06edb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:24.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.280+0000 7f70ef371640 1 --2- 172.21.15.114:0/2087057031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70e8144bd0 0x7f70e8160b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:24.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.280+0000 7f70ef371640 1 --2- 172.21.15.114:0/2087057031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70e8142560 0x7f70e80d24e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:24.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.280+0000 7f70ef371640 1 --2- 172.21.15.114:0/2087057031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70e8142180 0x7f70e80d1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:24.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.280+0000 7f70ef371640 1 -- 172.21.15.114:0/2087057031 >> 172.21.15.114:0/2087057031 conn(0x7f70e80d3050 msgr2=0x7f70e8143520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:24.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.280+0000 7f70ef371640 1 -- 172.21.15.114:0/2087057031 shutdown_connections 2024-04-28T13:07:24.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.280+0000 7f70ef371640 1 -- 172.21.15.114:0/2087057031 wait complete. 2024-04-28T13:07:24.297 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-28T13:07:24.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.403+0000 7f3e6e074640 1 Processor -- start 2024-04-28T13:07:24.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.403+0000 7f3e6e074640 1 -- start start 2024-04-28T13:07:24.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.404+0000 7f3e6e074640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3e680d1440 0x7f3e680c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:24.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.404+0000 7f3e6e074640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e680c8e70 con 0x7f3e68148dc0 2024-04-28T13:07:24.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.404+0000 7f3e6e074640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e680c9150 con 0x7f3e680c8610 2024-04-28T13:07:24.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.404+0000 7f3e6e074640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f3e680c9430 con 0x7f3e680d1440 2024-04-28T13:07:24.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.404+0000 7f3e677fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3e68148dc0 0x7f3e680d0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46978/0 (socket says 172.21.15.114:46978) 2024-04-28T13:07:24.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.404+0000 7f3e677fe640 1 -- 172.21.15.114:0/4107689078 learned_addr learned my addr 172.21.15.114:0/4107689078 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:24.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.404+0000 7f3e667fc640 1 -- 172.21.15.114:0/4107689078 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1194724195 0 0) 0x7f3e680c8e70 con 0x7f3e68148dc0 2024-04-28T13:07:24.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.404+0000 7f3e667fc640 1 -- 172.21.15.114:0/4107689078 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e50003520 con 0x7f3e68148dc0 2024-04-28T13:07:24.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.404+0000 7f3e66ffd640 1 --2- 172.21.15.114:0/4107689078 >> v2:172.21.15.134:3300/0 conn(0x7f3e680d1440 0x7f3e680c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:24.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.404+0000 7f3e667fc640 1 -- 172.21.15.114:0/4107689078 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1737555270 0 0) 0x7f3e50003520 con 0x7f3e68148dc0 2024-04-28T13:07:24.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.405+0000 7f3e667fc640 1 -- 172.21.15.114:0/4107689078 >> v2:172.21.15.134:3300/0 conn(0x7f3e680d1440 msgr2=0x7f3e680c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:24.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.405+0000 7f3e667fc640 1 --2- 172.21.15.114:0/4107689078 >> v2:172.21.15.134:3300/0 conn(0x7f3e680d1440 0x7f3e680c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:24.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.405+0000 7f3e667fc640 1 -- 172.21.15.114:0/4107689078 >> v1:172.21.15.134:6789/0 conn(0x7f3e680c8610 legacy=0x7f3e680cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:24.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.405+0000 7f3e667fc640 1 -- 172.21.15.114:0/4107689078 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e680c9710 con 0x7f3e68148dc0 2024-04-28T13:07:24.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.405+0000 7f3e667fc640 1 -- 172.21.15.114:0/4107689078 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f3e58001670 con 0x7f3e68148dc0 2024-04-28T13:07:24.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.405+0000 7f3e667fc640 1 -- 172.21.15.114:0/4107689078 >> v1:172.21.15.114:6789/0 conn(0x7f3e68148dc0 legacy=0x7f3e680d0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:24.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.405+0000 7f3e667fc640 1 --2- 172.21.15.114:0/4107689078 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e500039b0 0x7f3e50003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:24.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.405+0000 7f3e667fc640 1 --2- 172.21.15.114:0/4107689078 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e50004800 0x7f3e50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:24.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.405+0000 7f3e667fc640 1 --2- 172.21.15.114:0/4107689078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e500051c0 0x7f3e5000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:24.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.405+0000 7f3e667fc640 1 -- 172.21.15.114:0/4107689078 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3e680c9430 con 0x7f3e50004800 2024-04-28T13:07:24.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.405+0000 7f3e667fc640 1 -- 172.21.15.114:0/4107689078 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5000c160 con 0x7f3e500051c0 2024-04-28T13:07:24.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.405+0000 7f3e667fc640 1 -- 172.21.15.114:0/4107689078 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3e5000c360 con 0x7f3e500039b0 2024-04-28T13:07:24.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.405+0000 7f3e66ffd640 1 --2- 172.21.15.114:0/4107689078 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e50004800 0x7f3e50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:24.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.405+0000 7f3e677fe640 1 --2- 172.21.15.114:0/4107689078 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e500039b0 0x7f3e50003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:24.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.405+0000 7f3e67fff640 1 --2- 172.21.15.114:0/4107689078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e500051c0 0x7f3e5000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:24.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.405+0000 7f3e66ffd640 1 -- 172.21.15.114:0/4107689078 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e500039b0 msgr2=0x7f3e50003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:24.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.405+0000 7f3e66ffd640 1 --2- 172.21.15.114:0/4107689078 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e500039b0 0x7f3e50003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:24.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.405+0000 7f3e66ffd640 1 -- 172.21.15.114:0/4107689078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e500051c0 msgr2=0x7f3e5000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:24.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.405+0000 7f3e66ffd640 1 --2- 172.21.15.114:0/4107689078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e500051c0 0x7f3e5000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:24.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.405+0000 7f3e67fff640 1 -- 172.21.15.114:0/4107689078 reap_dead start 2024-04-28T13:07:24.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.405+0000 7f3e66ffd640 1 -- 172.21.15.114:0/4107689078 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e50003520 con 0x7f3e50004800 2024-04-28T13:07:24.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.406+0000 7f3e66ffd640 1 --2- 172.21.15.114:0/4107689078 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e50004800 0x7f3e50004c80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c009ac0 tx=0x7f3e50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88961c46cbde9786 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:24.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.406+0000 7f3e667fc640 1 -- 172.21.15.114:0/4107689078 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c036070 con 0x7f3e50004800 2024-04-28T13:07:24.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.406+0000 7f3e667fc640 1 -- 172.21.15.114:0/4107689078 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e5c031400 con 0x7f3e50004800 2024-04-28T13:07:24.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.406+0000 7f3e667fc640 1 -- 172.21.15.114:0/4107689078 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c009690 con 0x7f3e50004800 2024-04-28T13:07:24.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.406+0000 7f3e6e074640 1 -- 172.21.15.114:0/4107689078 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e50004800 msgr2=0x7f3e50004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:24.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.406+0000 7f3e6e074640 1 --2- 172.21.15.114:0/4107689078 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e50004800 0x7f3e50004c80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c009ac0 tx=0x7f3e50005830 comp rx=0 tx=0).stop 2024-04-28T13:07:24.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.406+0000 7f3e6e074640 1 -- 172.21.15.114:0/4107689078 shutdown_connections 2024-04-28T13:07:24.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.406+0000 7f3e6e074640 1 --2- 172.21.15.114:0/4107689078 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e50004800 0x7f3e50004c80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:24.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.406+0000 7f3e6e074640 1 -- 172.21.15.114:0/4107689078 >> 172.21.15.114:0/4107689078 conn(0x7f3e680706f0 msgr2=0x7f3e68070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:24.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.406+0000 7f3e6e074640 1 -- 172.21.15.114:0/4107689078 shutdown_connections 2024-04-28T13:07:24.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.406+0000 7f3e6e074640 1 -- 172.21.15.114:0/4107689078 wait complete. 2024-04-28T13:07:24.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.407+0000 7f3e6e074640 1 Processor -- start 2024-04-28T13:07:24.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.408+0000 7f3e6e074640 1 -- start start 2024-04-28T13:07:24.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.408+0000 7f3e6e074640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e50004800 0x7f3e680ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:24.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.408+0000 7f3e6e074640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e680cac40 0x7f3e680b8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:24.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.408+0000 7f3e6e074640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e680cfc80 0x7f3e680d0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:24.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.408+0000 7f3e6e074640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3e680c8be0 con 0x7f3e680cac40 2024-04-28T13:07:24.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.408+0000 7f3e6e074640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3e680c8a60 con 0x7f3e680cfc80 2024-04-28T13:07:24.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.408+0000 7f3e6e074640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3e680c80d0 con 0x7f3e50004800 2024-04-28T13:07:24.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.408+0000 7f3e66ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e680cac40 0x7f3e680b8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:24.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.408+0000 7f3e66ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e680cac40 0x7f3e680b8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38150/0 (socket says 172.21.15.114:38150) 2024-04-28T13:07:24.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.408+0000 7f3e66ffd640 1 -- 172.21.15.114:0/508497687 learned_addr learned my addr 172.21.15.114:0/508497687 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:24.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.409+0000 7f3e677fe640 1 --2- 172.21.15.114:0/508497687 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e50004800 0x7f3e680ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:24.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.409+0000 7f3e67fff640 1 --2- 172.21.15.114:0/508497687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e680cfc80 0x7f3e680d0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:24.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.409+0000 7f3e66ffd640 1 -- 172.21.15.114:0/508497687 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e50004800 msgr2=0x7f3e680ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:24.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.409+0000 7f3e66ffd640 1 --2- 172.21.15.114:0/508497687 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e50004800 0x7f3e680ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:24.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.409+0000 7f3e66ffd640 1 -- 172.21.15.114:0/508497687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e680cfc80 msgr2=0x7f3e680d0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:24.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.409+0000 7f3e66ffd640 1 --2- 172.21.15.114:0/508497687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e680cfc80 0x7f3e680d0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:24.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.409+0000 7f3e66ffd640 1 -- 172.21.15.114:0/508497687 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e680b8dd0 con 0x7f3e680cac40 2024-04-28T13:07:24.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.409+0000 7f3e67fff640 1 --2- 172.21.15.114:0/508497687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e680cfc80 0x7f3e680d0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:07:24.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.409+0000 7f3e66ffd640 1 --2- 172.21.15.114:0/508497687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e680cac40 0x7f3e680b8890 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c02abb0 tx=0x7f3e5c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:24.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.409+0000 7f3e4ffff640 1 -- 172.21.15.114:0/508497687 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c03f020 con 0x7f3e680cac40 2024-04-28T13:07:24.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.409+0000 7f3e4ffff640 1 -- 172.21.15.114:0/508497687 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e5c037040 con 0x7f3e680cac40 2024-04-28T13:07:24.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.409+0000 7f3e6e074640 1 -- 172.21.15.114:0/508497687 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e680cb170 con 0x7f3e680cac40 2024-04-28T13:07:24.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.409+0000 7f3e4ffff640 1 -- 172.21.15.114:0/508497687 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c036070 con 0x7f3e680cac40 2024-04-28T13:07:24.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.409+0000 7f3e6e074640 1 -- 172.21.15.114:0/508497687 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e680b6360 con 0x7f3e680cac40 2024-04-28T13:07:24.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.410+0000 7f3e6e074640 1 -- 172.21.15.114:0/508497687 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e6806a3d0 con 0x7f3e680cac40 2024-04-28T13:07:24.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.411+0000 7f3e4ffff640 1 -- 172.21.15.114:0/508497687 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3e5c042020 con 0x7f3e680cac40 2024-04-28T13:07:24.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.411+0000 7f3e4ffff640 1 --2- 172.21.15.114:0/508497687 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3e5406c8f0 0x7f3e5406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:24.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.411+0000 7f3e4ffff640 1 -- 172.21.15.114:0/508497687 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f3e5c0abd70 con 0x7f3e680cac40 2024-04-28T13:07:24.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.411+0000 7f3e677fe640 1 --2- 172.21.15.114:0/508497687 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3e5406c8f0 0x7f3e5406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:24.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.411+0000 7f3e677fe640 1 --2- 172.21.15.114:0/508497687 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3e5406c8f0 0x7f3e5406edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3e58001eb0 tx=0x7f3e58009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:24.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.415+0000 7f3e4ffff640 1 -- 172.21.15.114:0/508497687 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3e5c049030 con 0x7f3e680cac40 2024-04-28T13:07:24.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:24.591+0000 7f3e6e074640 1 -- 172.21.15.114:0/508497687 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f3e680d0a30 con 0x7f3e680cac40 2024-04-28T13:07:25.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.282+0000 7f3e4ffff640 1 -- 172.21.15.114:0/508497687 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7f3e5c07a6d0 con 0x7f3e680cac40 2024-04-28T13:07:25.283 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2024-04-28T13:07:25.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.285+0000 7f3e6e074640 1 -- 172.21.15.114:0/508497687 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3e5406c8f0 msgr2=0x7f3e5406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:25.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.285+0000 7f3e6e074640 1 --2- 172.21.15.114:0/508497687 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3e5406c8f0 0x7f3e5406edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3e58001eb0 tx=0x7f3e58009040 comp rx=0 tx=0).stop 2024-04-28T13:07:25.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.285+0000 7f3e6e074640 1 -- 172.21.15.114:0/508497687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e680cac40 msgr2=0x7f3e680b8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:25.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.285+0000 7f3e6e074640 1 --2- 172.21.15.114:0/508497687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e680cac40 0x7f3e680b8890 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c02abb0 tx=0x7f3e5c004730 comp rx=0 tx=0).stop 2024-04-28T13:07:25.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.285+0000 7f3e6e074640 1 -- 172.21.15.114:0/508497687 shutdown_connections 2024-04-28T13:07:25.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.285+0000 7f3e6e074640 1 --2- 172.21.15.114:0/508497687 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3e5406c8f0 0x7f3e5406edb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:25.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.285+0000 7f3e6e074640 1 --2- 172.21.15.114:0/508497687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e680cfc80 0x7f3e680d0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:25.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.285+0000 7f3e6e074640 1 --2- 172.21.15.114:0/508497687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e680cac40 0x7f3e680b8890 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:25.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.285+0000 7f3e6e074640 1 --2- 172.21.15.114:0/508497687 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e50004800 0x7f3e680ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:25.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.285+0000 7f3e6e074640 1 -- 172.21.15.114:0/508497687 >> 172.21.15.114:0/508497687 conn(0x7f3e680706f0 msgr2=0x7f3e680b2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:25.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.285+0000 7f3e6e074640 1 -- 172.21.15.114:0/508497687 shutdown_connections 2024-04-28T13:07:25.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.285+0000 7f3e6e074640 1 -- 172.21.15.114:0/508497687 wait complete. 2024-04-28T13:07:25.310 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-28T13:07:25.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.409+0000 7f7ff8e7e640 1 Processor -- start 2024-04-28T13:07:25.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.409+0000 7f7ff8e7e640 1 -- start start 2024-04-28T13:07:25.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.410+0000 7f7ff8e7e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7ff40d0270 0x7f7ff406dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:25.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.410+0000 7f7ff8e7e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7ff415f4d0 0x7f7ff40b82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:25.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.410+0000 7f7ff8e7e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ff40d0710 con 0x7f7ff40b6cb0 2024-04-28T13:07:25.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.410+0000 7f7ff8e7e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f7ff40d3e80 con 0x7f7ff415f4d0 2024-04-28T13:07:25.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.410+0000 7f7ff8e7e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f7ff40d3550 con 0x7f7ff40d0270 2024-04-28T13:07:25.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.410+0000 7f7ff2d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7ff415f4d0 0x7f7ff40b82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:25.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.410+0000 7f7ff259c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f7ff40b6cb0 0x7f7ff40b7090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46994/0 (socket says 172.21.15.114:46994) 2024-04-28T13:07:25.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.410+0000 7f7ff259c640 1 -- 172.21.15.114:0/3317490035 learned_addr learned my addr 172.21.15.114:0/3317490035 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:25.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.410+0000 7f7ff2d9d640 1 -- 172.21.15.114:0/3317490035 >> v2:172.21.15.134:3300/0 conn(0x7f7ff40d0270 msgr2=0x7f7ff406dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:25.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.410+0000 7f7ff2d9d640 1 --2- 172.21.15.114:0/3317490035 >> v2:172.21.15.134:3300/0 conn(0x7f7ff40d0270 0x7f7ff406dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:25.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.410+0000 7f7ff2d9d640 1 -- 172.21.15.114:0/3317490035 >> v1:172.21.15.114:6789/0 conn(0x7f7ff40b6cb0 legacy=0x7f7ff40b7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:25.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.410+0000 7f7ff2d9d640 1 -- 172.21.15.114:0/3317490035 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff40d3830 con 0x7f7ff415f4d0 2024-04-28T13:07:25.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.410+0000 7f7ff159a640 1 -- 172.21.15.114:0/3317490035 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1494785331 0 0) 0x7f7ff40d0710 con 0x7f7ff40b6cb0 2024-04-28T13:07:25.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.411+0000 7f7ff2d9d640 1 --2- 172.21.15.114:0/3317490035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ff415f4d0 0x7f7ff40b82a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7ff40d2ae0 tx=0x7f7fec02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f845f1d78f151a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:25.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.411+0000 7f7ff159a640 1 -- 172.21.15.114:0/3317490035 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fec007740 con 0x7f7ff415f4d0 2024-04-28T13:07:25.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.411+0000 7f7ff159a640 1 -- 172.21.15.114:0/3317490035 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fec0078e0 con 0x7f7ff415f4d0 2024-04-28T13:07:25.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.411+0000 7f7ff159a640 1 -- 172.21.15.114:0/3317490035 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fec007cb0 con 0x7f7ff415f4d0 2024-04-28T13:07:25.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.411+0000 7f7ff8e7e640 1 -- 172.21.15.114:0/3317490035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ff415f4d0 msgr2=0x7f7ff40b82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:25.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.411+0000 7f7ff8e7e640 1 --2- 172.21.15.114:0/3317490035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ff415f4d0 0x7f7ff40b82a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7ff40d2ae0 tx=0x7f7fec02a710 comp rx=0 tx=0).stop 2024-04-28T13:07:25.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.412+0000 7f7ff8e7e640 1 -- 172.21.15.114:0/3317490035 shutdown_connections 2024-04-28T13:07:25.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.412+0000 7f7ff8e7e640 1 --2- 172.21.15.114:0/3317490035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ff415f4d0 0x7f7ff40b82a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:25.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.412+0000 7f7ff8e7e640 1 --2- 172.21.15.114:0/3317490035 >> v2:172.21.15.134:3300/0 conn(0x7f7ff40d0270 0x7f7ff406dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:25.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.412+0000 7f7ff8e7e640 1 -- 172.21.15.114:0/3317490035 >> 172.21.15.114:0/3317490035 conn(0x7f7ff40633a0 msgr2=0x7f7ff40d1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:25.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.412+0000 7f7ff8e7e640 1 -- 172.21.15.114:0/3317490035 shutdown_connections 2024-04-28T13:07:25.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.412+0000 7f7ff8e7e640 1 -- 172.21.15.114:0/3317490035 wait complete. 2024-04-28T13:07:25.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.413+0000 7f7ff8e7e640 1 Processor -- start 2024-04-28T13:07:25.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.413+0000 7f7ff8e7e640 1 -- start start 2024-04-28T13:07:25.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.414+0000 7f7ff8e7e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ff40b6cb0 0x7f7ff41f7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:25.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.414+0000 7f7ff8e7e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ff40d0270 0x7f7ff4160b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:25.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.414+0000 7f7ff8e7e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ff415f4d0 0x7f7ff41610c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:25.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.414+0000 7f7ff8e7e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff40d4310 con 0x7f7ff40b6cb0 2024-04-28T13:07:25.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.414+0000 7f7ff8e7e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff40b48e0 con 0x7f7ff415f4d0 2024-04-28T13:07:25.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.414+0000 7f7ff8e7e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f7ff40d4490 con 0x7f7ff40d0270 2024-04-28T13:07:25.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.414+0000 7f7ff259c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ff40b6cb0 0x7f7ff41f7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:25.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.414+0000 7f7ff259c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ff40b6cb0 0x7f7ff41f7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38170/0 (socket says 172.21.15.114:38170) 2024-04-28T13:07:25.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.414+0000 7f7ff259c640 1 -- 172.21.15.114:0/946841065 learned_addr learned my addr 172.21.15.114:0/946841065 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:25.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.414+0000 7f7ff2d9d640 1 --2- 172.21.15.114:0/946841065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ff415f4d0 0x7f7ff41610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:25.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.414+0000 7f7ff1d9b640 1 --2- 172.21.15.114:0/946841065 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ff40d0270 0x7f7ff4160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:25.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.414+0000 7f7ff259c640 1 -- 172.21.15.114:0/946841065 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ff40d0270 msgr2=0x7f7ff4160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:25.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.414+0000 7f7ff259c640 1 --2- 172.21.15.114:0/946841065 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ff40d0270 0x7f7ff4160b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:25.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.414+0000 7f7ff259c640 1 -- 172.21.15.114:0/946841065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ff415f4d0 msgr2=0x7f7ff41610c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:25.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.414+0000 7f7ff259c640 1 --2- 172.21.15.114:0/946841065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ff415f4d0 0x7f7ff41610c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:25.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.414+0000 7f7ff259c640 1 -- 172.21.15.114:0/946841065 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff40cd3f0 con 0x7f7ff40b6cb0 2024-04-28T13:07:25.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.414+0000 7f7ff1d9b640 1 --2- 172.21.15.114:0/946841065 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ff40d0270 0x7f7ff4160b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:07:25.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.414+0000 7f7ff259c640 1 --2- 172.21.15.114:0/946841065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ff40b6cb0 0x7f7ff41f7b90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7fe400c4a0 tx=0x7f7fe400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:25.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.414+0000 7f7fe2ffd640 1 -- 172.21.15.114:0/946841065 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4017070 con 0x7f7ff40b6cb0 2024-04-28T13:07:25.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.414+0000 7f7fe2ffd640 1 -- 172.21.15.114:0/946841065 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fe4005ce0 con 0x7f7ff40b6cb0 2024-04-28T13:07:25.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.414+0000 7f7fe2ffd640 1 -- 172.21.15.114:0/946841065 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe40072b0 con 0x7f7ff40b6cb0 2024-04-28T13:07:25.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.414+0000 7f7ff8e7e640 1 -- 172.21.15.114:0/946841065 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ff40cd6d0 con 0x7f7ff40b6cb0 2024-04-28T13:07:25.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.414+0000 7f7ff8e7e640 1 -- 172.21.15.114:0/946841065 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ff40cdc90 con 0x7f7ff40b6cb0 2024-04-28T13:07:25.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.415+0000 7f7ff8e7e640 1 -- 172.21.15.114:0/946841065 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ff406a3d0 con 0x7f7ff40b6cb0 2024-04-28T13:07:25.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.416+0000 7f7fe2ffd640 1 -- 172.21.15.114:0/946841065 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7fe401a070 con 0x7f7ff40b6cb0 2024-04-28T13:07:25.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.416+0000 7f7fe2ffd640 1 --2- 172.21.15.114:0/946841065 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7fd406c8f0 0x7f7fd406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:25.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.416+0000 7f7fe2ffd640 1 -- 172.21.15.114:0/946841065 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f7fe408aeb0 con 0x7f7ff40b6cb0 2024-04-28T13:07:25.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.416+0000 7f7ff1d9b640 1 --2- 172.21.15.114:0/946841065 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7fd406c8f0 0x7f7fd406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:25.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.417+0000 7f7ff1d9b640 1 --2- 172.21.15.114:0/946841065 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7fd406c8f0 0x7f7fd406edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8006fd0 tx=0x7f7fe8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:25.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.421+0000 7f7fe2ffd640 1 -- 172.21.15.114:0/946841065 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7fe4059340 con 0x7f7ff40b6cb0 2024-04-28T13:07:25.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:25.633+0000 7f7ff8e7e640 1 -- 172.21.15.114:0/946841065 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f7ff406c350 con 0x7f7ff40b6cb0 2024-04-28T13:07:26.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.284+0000 7f7fe2ffd640 1 -- 172.21.15.114:0/946841065 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f7fe4058c40 con 0x7f7ff40b6cb0 2024-04-28T13:07:26.284 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 2 and data pool 3 2024-04-28T13:07:26.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.288+0000 7f7ff8e7e640 1 -- 172.21.15.114:0/946841065 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7fd406c8f0 msgr2=0x7f7fd406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:26.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.288+0000 7f7ff8e7e640 1 --2- 172.21.15.114:0/946841065 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7fd406c8f0 0x7f7fd406edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8006fd0 tx=0x7f7fe8008040 comp rx=0 tx=0).stop 2024-04-28T13:07:26.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.288+0000 7f7ff8e7e640 1 -- 172.21.15.114:0/946841065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ff40b6cb0 msgr2=0x7f7ff41f7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:26.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.288+0000 7f7ff8e7e640 1 --2- 172.21.15.114:0/946841065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ff40b6cb0 0x7f7ff41f7b90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7fe400c4a0 tx=0x7f7fe400c960 comp rx=0 tx=0).stop 2024-04-28T13:07:26.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.289+0000 7f7ff8e7e640 1 -- 172.21.15.114:0/946841065 shutdown_connections 2024-04-28T13:07:26.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.289+0000 7f7ff8e7e640 1 --2- 172.21.15.114:0/946841065 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7fd406c8f0 0x7f7fd406edb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:26.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.289+0000 7f7ff8e7e640 1 --2- 172.21.15.114:0/946841065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ff415f4d0 0x7f7ff41610c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:26.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.289+0000 7f7ff8e7e640 1 --2- 172.21.15.114:0/946841065 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ff40d0270 0x7f7ff4160b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:26.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.289+0000 7f7ff8e7e640 1 --2- 172.21.15.114:0/946841065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ff40b6cb0 0x7f7ff41f7b90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:26.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.289+0000 7f7ff8e7e640 1 -- 172.21.15.114:0/946841065 >> 172.21.15.114:0/946841065 conn(0x7f7ff40633a0 msgr2=0x7f7ff415e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:26.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.289+0000 7f7ff8e7e640 1 -- 172.21.15.114:0/946841065 shutdown_connections 2024-04-28T13:07:26.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.289+0000 7f7ff8e7e640 1 -- 172.21.15.114:0/946841065 wait complete. 2024-04-28T13:07:26.321 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:07:26.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.420+0000 7f5521f89640 1 Processor -- start 2024-04-28T13:07:26.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.420+0000 7f5521f89640 1 -- start start 2024-04-28T13:07:26.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.421+0000 7f5521f89640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f551c15e2a0 0x7f551c070650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:26.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.421+0000 7f5521f89640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f551c070b90 0x7f551c160c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:26.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.421+0000 7f5521f89640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f551c142730 con 0x7f551c161170 2024-04-28T13:07:26.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.421+0000 7f5521f89640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f551c161960 con 0x7f551c070b90 2024-04-28T13:07:26.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.421+0000 7f5521f89640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f551c1429d0 con 0x7f551c15e2a0 2024-04-28T13:07:26.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.421+0000 7f551affd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f551c070b90 0x7f551c160c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:26.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.421+0000 7f551bfff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f551c161170 0x7f551c071b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47004/0 (socket says 172.21.15.114:47004) 2024-04-28T13:07:26.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.421+0000 7f551bfff640 1 -- 172.21.15.114:0/1518563732 learned_addr learned my addr 172.21.15.114:0/1518563732 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:26.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.422+0000 7f551affd640 1 -- 172.21.15.114:0/1518563732 >> v2:172.21.15.134:3300/0 conn(0x7f551c15e2a0 msgr2=0x7f551c070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:26.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.422+0000 7f551affd640 1 --2- 172.21.15.114:0/1518563732 >> v2:172.21.15.134:3300/0 conn(0x7f551c15e2a0 0x7f551c070650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:26.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.422+0000 7f551affd640 1 -- 172.21.15.114:0/1518563732 >> v1:172.21.15.114:6789/0 conn(0x7f551c161170 legacy=0x7f551c071b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:26.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.422+0000 7f551affd640 1 -- 172.21.15.114:0/1518563732 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f551c142cb0 con 0x7f551c070b90 2024-04-28T13:07:26.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.422+0000 7f551a7fc640 1 -- 172.21.15.114:0/1518563732 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2710892688 0 0) 0x7f551c142730 con 0x7f551c161170 2024-04-28T13:07:26.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.422+0000 7f551affd640 1 --2- 172.21.15.114:0/1518563732 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f551c070b90 0x7f551c160c30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f551c063d30 tx=0x7f551002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5368b2f82fd9ffd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:26.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.422+0000 7f551a7fc640 1 -- 172.21.15.114:0/1518563732 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5510037070 con 0x7f551c070b90 2024-04-28T13:07:26.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.422+0000 7f551a7fc640 1 -- 172.21.15.114:0/1518563732 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5510032440 con 0x7f551c070b90 2024-04-28T13:07:26.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.422+0000 7f551a7fc640 1 -- 172.21.15.114:0/1518563732 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f551002ae60 con 0x7f551c070b90 2024-04-28T13:07:26.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.423+0000 7f5521f89640 1 -- 172.21.15.114:0/1518563732 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f551c070b90 msgr2=0x7f551c160c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:26.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.423+0000 7f5521f89640 1 --2- 172.21.15.114:0/1518563732 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f551c070b90 0x7f551c160c30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f551c063d30 tx=0x7f551002a110 comp rx=0 tx=0).stop 2024-04-28T13:07:26.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.423+0000 7f5521f89640 1 -- 172.21.15.114:0/1518563732 shutdown_connections 2024-04-28T13:07:26.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.423+0000 7f5521f89640 1 --2- 172.21.15.114:0/1518563732 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f551c070b90 0x7f551c160c30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:26.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.423+0000 7f5521f89640 1 --2- 172.21.15.114:0/1518563732 >> v2:172.21.15.134:3300/0 conn(0x7f551c15e2a0 0x7f551c070650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:26.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.423+0000 7f5521f89640 1 -- 172.21.15.114:0/1518563732 >> 172.21.15.114:0/1518563732 conn(0x7f551c0633a0 msgr2=0x7f551c0b4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:26.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.423+0000 7f5521f89640 1 -- 172.21.15.114:0/1518563732 shutdown_connections 2024-04-28T13:07:26.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.423+0000 7f5521f89640 1 -- 172.21.15.114:0/1518563732 wait complete. 2024-04-28T13:07:26.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.424+0000 7f5521f89640 1 Processor -- start 2024-04-28T13:07:26.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.424+0000 7f5521f89640 1 -- start start 2024-04-28T13:07:26.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.425+0000 7f5521f89640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f551c070b90 0x7f551c152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:26.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.425+0000 7f5521f89640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f551c15e2a0 0x7f551c159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:26.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.425+0000 7f5521f89640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f551c161170 0x7f551c071b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:26.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.425+0000 7f5521f89640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f551c1616f0 con 0x7f551c070b90 2024-04-28T13:07:26.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.425+0000 7f5521f89640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f551c161570 con 0x7f551c161170 2024-04-28T13:07:26.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.425+0000 7f5521f89640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f551c1434b0 con 0x7f551c15e2a0 2024-04-28T13:07:26.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.425+0000 7f551b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f551c070b90 0x7f551c152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:26.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.425+0000 7f551b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f551c070b90 0x7f551c152d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38182/0 (socket says 172.21.15.114:38182) 2024-04-28T13:07:26.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.425+0000 7f551b7fe640 1 -- 172.21.15.114:0/572130973 learned_addr learned my addr 172.21.15.114:0/572130973 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:26.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.425+0000 7f551bfff640 1 --2- 172.21.15.114:0/572130973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f551c161170 0x7f551c071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:26.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.425+0000 7f551affd640 1 --2- 172.21.15.114:0/572130973 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f551c15e2a0 0x7f551c159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:26.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.425+0000 7f551b7fe640 1 -- 172.21.15.114:0/572130973 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f551c15e2a0 msgr2=0x7f551c159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:26.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.425+0000 7f551b7fe640 1 --2- 172.21.15.114:0/572130973 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f551c15e2a0 0x7f551c159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:26.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.425+0000 7f551b7fe640 1 -- 172.21.15.114:0/572130973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f551c161170 msgr2=0x7f551c071b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:26.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.425+0000 7f551b7fe640 1 --2- 172.21.15.114:0/572130973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f551c161170 0x7f551c071b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:26.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.425+0000 7f551b7fe640 1 -- 172.21.15.114:0/572130973 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f551c1532b0 con 0x7f551c070b90 2024-04-28T13:07:26.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.425+0000 7f551b7fe640 1 --2- 172.21.15.114:0/572130973 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f551c070b90 0x7f551c152d70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f550c00b410 tx=0x7f550c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:26.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.426+0000 7f5503fff640 1 -- 172.21.15.114:0/572130973 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550c015020 con 0x7f551c070b90 2024-04-28T13:07:26.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.426+0000 7f5503fff640 1 -- 172.21.15.114:0/572130973 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f550c011850 con 0x7f551c070b90 2024-04-28T13:07:26.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.426+0000 7f5521f89640 1 -- 172.21.15.114:0/572130973 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f551c15a7b0 con 0x7f551c070b90 2024-04-28T13:07:26.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.426+0000 7f5503fff640 1 -- 172.21.15.114:0/572130973 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550c011c40 con 0x7f551c070b90 2024-04-28T13:07:26.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.426+0000 7f5521f89640 1 -- 172.21.15.114:0/572130973 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f551c154940 con 0x7f551c070b90 2024-04-28T13:07:26.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.427+0000 7f5521f89640 1 -- 172.21.15.114:0/572130973 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f551c06a3d0 con 0x7f551c070b90 2024-04-28T13:07:26.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.427+0000 7f5503fff640 1 -- 172.21.15.114:0/572130973 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f550c018020 con 0x7f551c070b90 2024-04-28T13:07:26.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.427+0000 7f5503fff640 1 --2- 172.21.15.114:0/572130973 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f550806c8f0 0x7f550806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:26.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.427+0000 7f5503fff640 1 -- 172.21.15.114:0/572130973 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f550c08ba70 con 0x7f551c070b90 2024-04-28T13:07:26.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.427+0000 7f551affd640 1 --2- 172.21.15.114:0/572130973 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f550806c8f0 0x7f550806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:26.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.428+0000 7f551affd640 1 --2- 172.21.15.114:0/572130973 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f550806c8f0 0x7f550806edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5510034000 tx=0x7f551002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:26.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.432+0000 7f5503fff640 1 -- 172.21.15.114:0/572130973 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f550c01f020 con 0x7f551c070b90 2024-04-28T13:07:26.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.609+0000 7f5521f89640 1 -- 172.21.15.114:0/572130973 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f551c1578c0 con 0x7f551c070b90 2024-04-28T13:07:26.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.610+0000 7f5503fff640 1 -- 172.21.15.114:0/572130973 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16666 (secure 0 0 0) 0x7f551c1532b0 con 0x7f551c070b90 2024-04-28T13:07:26.611 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:26.611 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:07:25.635340+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-28T13:07:23.706359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-28T13:07:24.596188+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:07:26.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.612+0000 7f5521f89640 1 -- 172.21.15.114:0/572130973 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f550806c8f0 msgr2=0x7f550806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:26.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.612+0000 7f5521f89640 1 --2- 172.21.15.114:0/572130973 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f550806c8f0 0x7f550806edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5510034000 tx=0x7f551002e000 comp rx=0 tx=0).stop 2024-04-28T13:07:26.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.612+0000 7f5521f89640 1 -- 172.21.15.114:0/572130973 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f551c070b90 msgr2=0x7f551c152d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:26.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.612+0000 7f5521f89640 1 --2- 172.21.15.114:0/572130973 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f551c070b90 0x7f551c152d70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f550c00b410 tx=0x7f550c00b8d0 comp rx=0 tx=0).stop 2024-04-28T13:07:26.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.612+0000 7f5521f89640 1 -- 172.21.15.114:0/572130973 shutdown_connections 2024-04-28T13:07:26.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.612+0000 7f5521f89640 1 --2- 172.21.15.114:0/572130973 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f550806c8f0 0x7f550806edb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:26.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.612+0000 7f5521f89640 1 --2- 172.21.15.114:0/572130973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f551c161170 0x7f551c071b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:26.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.612+0000 7f5521f89640 1 --2- 172.21.15.114:0/572130973 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f551c15e2a0 0x7f551c159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:26.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.612+0000 7f5521f89640 1 --2- 172.21.15.114:0/572130973 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f551c070b90 0x7f551c152d70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:26.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.612+0000 7f5521f89640 1 -- 172.21.15.114:0/572130973 >> 172.21.15.114:0/572130973 conn(0x7f551c0633a0 msgr2=0x7f551c141540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:26.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.612+0000 7f5521f89640 1 -- 172.21.15.114:0/572130973 shutdown_connections 2024-04-28T13:07:26.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.612+0000 7f5521f89640 1 -- 172.21.15.114:0/572130973 wait complete. 2024-04-28T13:07:26.623 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:07:26.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.719+0000 7f1bd8eea640 1 Processor -- start 2024-04-28T13:07:26.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.719+0000 7f1bd8eea640 1 -- start start 2024-04-28T13:07:26.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.720+0000 7f1bd8eea640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bd415ce00 0x7f1bd415fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:26.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.720+0000 7f1bd8eea640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1bd41635d0 0x7f1bd4163a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:26.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.720+0000 7f1bd8eea640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bd40b5f30 con 0x7f1bd40b5ad0 2024-04-28T13:07:26.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.720+0000 7f1bd8eea640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f1bd4163140 con 0x7f1bd41635d0 2024-04-28T13:07:26.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.720+0000 7f1bd8eea640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1bd40b3ff0 con 0x7f1bd415ce00 2024-04-28T13:07:26.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.721+0000 7f1bd1d9b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1bd40b5ad0 0x7f1bd40732b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47016/0 (socket says 172.21.15.114:47016) 2024-04-28T13:07:26.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.721+0000 7f1bd1d9b640 1 -- 172.21.15.114:0/158064311 learned_addr learned my addr 172.21.15.114:0/158064311 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:26.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.721+0000 7f1bd159a640 1 -- 172.21.15.114:0/158064311 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1102916726 0 0) 0x7f1bd40b5f30 con 0x7f1bd40b5ad0 2024-04-28T13:07:26.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.721+0000 7f1bd159a640 1 -- 172.21.15.114:0/158064311 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bbc003520 con 0x7f1bd40b5ad0 2024-04-28T13:07:26.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.721+0000 7f1bd2d9d640 1 --2- 172.21.15.114:0/158064311 >> v2:172.21.15.134:3300/0 conn(0x7f1bd41635d0 0x7f1bd4163a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:26.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.721+0000 7f1bd259c640 1 --2- 172.21.15.114:0/158064311 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bd415ce00 0x7f1bd415fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:26.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.721+0000 7f1bd159a640 1 -- 172.21.15.114:0/158064311 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4007293255 0 0) 0x7f1bbc003520 con 0x7f1bd40b5ad0 2024-04-28T13:07:26.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.721+0000 7f1bd159a640 1 -- 172.21.15.114:0/158064311 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bd415ce00 msgr2=0x7f1bd415fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:26.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.721+0000 7f1bd159a640 1 --2- 172.21.15.114:0/158064311 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bd415ce00 0x7f1bd415fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:26.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.721+0000 7f1bd159a640 1 -- 172.21.15.114:0/158064311 >> v2:172.21.15.134:3300/0 conn(0x7f1bd41635d0 msgr2=0x7f1bd4163a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:26.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.721+0000 7f1bd159a640 1 --2- 172.21.15.114:0/158064311 >> v2:172.21.15.134:3300/0 conn(0x7f1bd41635d0 0x7f1bd4163a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:26.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.721+0000 7f1bd159a640 1 -- 172.21.15.114:0/158064311 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd4160070 con 0x7f1bd40b5ad0 2024-04-28T13:07:26.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.721+0000 7f1bd159a640 1 -- 172.21.15.114:0/158064311 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f1bc80019f0 con 0x7f1bd40b5ad0 2024-04-28T13:07:26.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.721+0000 7f1bd159a640 1 -- 172.21.15.114:0/158064311 >> v1:172.21.15.114:6789/0 conn(0x7f1bd40b5ad0 legacy=0x7f1bd40732b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:26.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.721+0000 7f1bd159a640 1 --2- 172.21.15.114:0/158064311 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bd415ce00 0x7f1bbc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:26.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.721+0000 7f1bd159a640 1 --2- 172.21.15.114:0/158064311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bbc003fe0 0x7f1bbc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:26.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.721+0000 7f1bd159a640 1 --2- 172.21.15.114:0/158064311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bbc004d40 0x7f1bbc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:26.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.721+0000 7f1bd159a640 1 -- 172.21.15.114:0/158064311 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd4163140 con 0x7f1bbc004d40 2024-04-28T13:07:26.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.721+0000 7f1bd159a640 1 -- 172.21.15.114:0/158064311 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd40b3ff0 con 0x7f1bbc003fe0 2024-04-28T13:07:26.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.721+0000 7f1bd159a640 1 -- 172.21.15.114:0/158064311 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1bbc00bac0 con 0x7f1bd415ce00 2024-04-28T13:07:26.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.721+0000 7f1bd2d9d640 1 --2- 172.21.15.114:0/158064311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bbc004d40 0x7f1bbc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:26.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.721+0000 7f1bd1d9b640 1 --2- 172.21.15.114:0/158064311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bbc003fe0 0x7f1bbc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:26.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.721+0000 7f1bd259c640 1 --2- 172.21.15.114:0/158064311 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bd415ce00 0x7f1bbc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:26.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.721+0000 7f1bd2d9d640 1 -- 172.21.15.114:0/158064311 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bd415ce00 msgr2=0x7f1bbc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:26.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.721+0000 7f1bd2d9d640 1 --2- 172.21.15.114:0/158064311 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bd415ce00 0x7f1bbc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:26.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.721+0000 7f1bd2d9d640 1 -- 172.21.15.114:0/158064311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bbc003fe0 msgr2=0x7f1bbc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:26.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.721+0000 7f1bd2d9d640 1 --2- 172.21.15.114:0/158064311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bbc003fe0 0x7f1bbc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:26.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.721+0000 7f1bd2d9d640 1 -- 172.21.15.114:0/158064311 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bbc003520 con 0x7f1bbc004d40 2024-04-28T13:07:26.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.722+0000 7f1bd2d9d640 1 --2- 172.21.15.114:0/158064311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bbc004d40 0x7f1bbc0051c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1bc400ba30 tx=0x7f1bbc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba2e6951917f560 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:26.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.722+0000 7f1bd159a640 1 -- 172.21.15.114:0/158064311 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4030070 con 0x7f1bbc004d40 2024-04-28T13:07:26.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.722+0000 7f1bd159a640 1 -- 172.21.15.114:0/158064311 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc402ae10 con 0x7f1bbc004d40 2024-04-28T13:07:26.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.722+0000 7f1bd159a640 1 -- 172.21.15.114:0/158064311 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc400b600 con 0x7f1bbc004d40 2024-04-28T13:07:26.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.723+0000 7f1bd8eea640 1 -- 172.21.15.114:0/158064311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bbc004d40 msgr2=0x7f1bbc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:26.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.723+0000 7f1bd8eea640 1 --2- 172.21.15.114:0/158064311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bbc004d40 0x7f1bbc0051c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1bc400ba30 tx=0x7f1bbc005830 comp rx=0 tx=0).stop 2024-04-28T13:07:26.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.723+0000 7f1bd2d9d640 1 -- 172.21.15.114:0/158064311 reap_dead start 2024-04-28T13:07:26.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.723+0000 7f1bd8eea640 1 -- 172.21.15.114:0/158064311 shutdown_connections 2024-04-28T13:07:26.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.723+0000 7f1bd8eea640 1 -- 172.21.15.114:0/158064311 >> 172.21.15.114:0/158064311 conn(0x7f1bd406d460 msgr2=0x7f1bd406d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:26.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.723+0000 7f1bd8eea640 1 -- 172.21.15.114:0/158064311 shutdown_connections 2024-04-28T13:07:26.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.723+0000 7f1bd8eea640 1 -- 172.21.15.114:0/158064311 wait complete. 2024-04-28T13:07:26.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.724+0000 7f1bd8eea640 1 Processor -- start 2024-04-28T13:07:26.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.724+0000 7f1bd8eea640 1 -- start start 2024-04-28T13:07:26.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.725+0000 7f1bd8eea640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bbc004d40 0x7f1bd41f5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:26.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.725+0000 7f1bd8eea640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bd40cd8f0 0x7f1bd40b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:26.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.725+0000 7f1bd8eea640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bd40b53f0 0x7f1bd415d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:26.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.725+0000 7f1bd8eea640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd4160910 con 0x7f1bd40b53f0 2024-04-28T13:07:26.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.725+0000 7f1bd8eea640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd4160630 con 0x7f1bd40cd8f0 2024-04-28T13:07:26.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.725+0000 7f1bd8eea640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1bd40739c0 con 0x7f1bbc004d40 2024-04-28T13:07:26.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.725+0000 7f1bd2d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bd40b53f0 0x7f1bd415d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:26.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.725+0000 7f1bd2d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bd40b53f0 0x7f1bd415d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38206/0 (socket says 172.21.15.114:38206) 2024-04-28T13:07:26.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.725+0000 7f1bd2d9d640 1 -- 172.21.15.114:0/229907468 learned_addr learned my addr 172.21.15.114:0/229907468 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:26.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.725+0000 7f1bd259c640 1 --2- 172.21.15.114:0/229907468 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bbc004d40 0x7f1bd41f5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:26.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.725+0000 7f1bd1d9b640 1 --2- 172.21.15.114:0/229907468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bd40cd8f0 0x7f1bd40b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:26.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.725+0000 7f1bd2d9d640 1 -- 172.21.15.114:0/229907468 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bbc004d40 msgr2=0x7f1bd41f5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:26.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.725+0000 7f1bd2d9d640 1 --2- 172.21.15.114:0/229907468 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bbc004d40 0x7f1bd41f5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:26.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.725+0000 7f1bd2d9d640 1 -- 172.21.15.114:0/229907468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bd40cd8f0 msgr2=0x7f1bd40b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:26.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.725+0000 7f1bd2d9d640 1 --2- 172.21.15.114:0/229907468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bd40cd8f0 0x7f1bd40b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:26.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.725+0000 7f1bd2d9d640 1 -- 172.21.15.114:0/229907468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd415df10 con 0x7f1bd40b53f0 2024-04-28T13:07:26.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.725+0000 7f1bd259c640 1 --2- 172.21.15.114:0/229907468 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bbc004d40 0x7f1bd41f5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:26.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.726+0000 7f1bd2d9d640 1 --2- 172.21.15.114:0/229907468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bd40b53f0 0x7f1bd415d1e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1bc402a900 tx=0x7f1bc4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:26.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.726+0000 7f1bc2ffd640 1 -- 172.21.15.114:0/229907468 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc400b600 con 0x7f1bd40b53f0 2024-04-28T13:07:26.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.726+0000 7f1bc2ffd640 1 -- 172.21.15.114:0/229907468 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc402ac10 con 0x7f1bd40b53f0 2024-04-28T13:07:26.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.726+0000 7f1bd8eea640 1 -- 172.21.15.114:0/229907468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bd415e1f0 con 0x7f1bd40b53f0 2024-04-28T13:07:26.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.726+0000 7f1bc2ffd640 1 -- 172.21.15.114:0/229907468 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4004020 con 0x7f1bd40b53f0 2024-04-28T13:07:26.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.726+0000 7f1bd8eea640 1 -- 172.21.15.114:0/229907468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bd40af290 con 0x7f1bd40b53f0 2024-04-28T13:07:26.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.727+0000 7f1bd8eea640 1 -- 172.21.15.114:0/229907468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bd40b5870 con 0x7f1bd40b53f0 2024-04-28T13:07:26.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.727+0000 7f1bc2ffd640 1 -- 172.21.15.114:0/229907468 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1bc40041c0 con 0x7f1bd40b53f0 2024-04-28T13:07:26.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.728+0000 7f1bc2ffd640 1 --2- 172.21.15.114:0/229907468 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1bb406c920 0x7f1bb406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:26.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.728+0000 7f1bc2ffd640 1 -- 172.21.15.114:0/229907468 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1bc40ab970 con 0x7f1bd40b53f0 2024-04-28T13:07:26.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.728+0000 7f1bd259c640 1 --2- 172.21.15.114:0/229907468 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1bb406c920 0x7f1bb406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:26.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.728+0000 7f1bd259c640 1 --2- 172.21.15.114:0/229907468 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1bb406c920 0x7f1bb406ede0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc006fd0 tx=0x7f1bcc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:26.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.732+0000 7f1bc2ffd640 1 -- 172.21.15.114:0/229907468 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1bc4079da0 con 0x7f1bd40b53f0 2024-04-28T13:07:26.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.908+0000 7f1bd8eea640 1 -- 172.21.15.114:0/229907468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1bd406a3d0 con 0x7f1bd40b53f0 2024-04-28T13:07:26.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.909+0000 7f1bc2ffd640 1 -- 172.21.15.114:0/229907468 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16666 (secure 0 0 0) 0x7f1bc40796a0 con 0x7f1bd40b53f0 2024-04-28T13:07:26.909 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:26.910 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:07:25.635340+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-28T13:07:23.706359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-28T13:07:24.596188+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:07:26.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.910+0000 7f1bd8eea640 1 -- 172.21.15.114:0/229907468 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1bb406c920 msgr2=0x7f1bb406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:26.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.910+0000 7f1bd8eea640 1 --2- 172.21.15.114:0/229907468 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1bb406c920 0x7f1bb406ede0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc006fd0 tx=0x7f1bcc008040 comp rx=0 tx=0).stop 2024-04-28T13:07:26.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.910+0000 7f1bd8eea640 1 -- 172.21.15.114:0/229907468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bd40b53f0 msgr2=0x7f1bd415d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:26.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.910+0000 7f1bd8eea640 1 --2- 172.21.15.114:0/229907468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bd40b53f0 0x7f1bd415d1e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1bc402a900 tx=0x7f1bc4004730 comp rx=0 tx=0).stop 2024-04-28T13:07:26.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.911+0000 7f1bd8eea640 1 -- 172.21.15.114:0/229907468 shutdown_connections 2024-04-28T13:07:26.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.911+0000 7f1bd8eea640 1 --2- 172.21.15.114:0/229907468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bd40b53f0 0x7f1bd415d1e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:26.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.911+0000 7f1bd8eea640 1 --2- 172.21.15.114:0/229907468 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1bb406c920 0x7f1bb406ede0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:26.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.911+0000 7f1bd8eea640 1 --2- 172.21.15.114:0/229907468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bd40cd8f0 0x7f1bd40b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:26.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.911+0000 7f1bd8eea640 1 --2- 172.21.15.114:0/229907468 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bbc004d40 0x7f1bd41f5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:26.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.911+0000 7f1bd8eea640 1 -- 172.21.15.114:0/229907468 >> 172.21.15.114:0/229907468 conn(0x7f1bd406d460 msgr2=0x7f1bd406f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:26.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.911+0000 7f1bd8eea640 1 -- 172.21.15.114:0/229907468 shutdown_connections 2024-04-28T13:07:26.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:26.911+0000 7f1bd8eea640 1 -- 172.21.15.114:0/229907468 wait complete. 2024-04-28T13:07:26.922 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-28T13:07:27.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.021+0000 7f4ff1319640 1 Processor -- start 2024-04-28T13:07:27.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.021+0000 7f4ff1319640 1 -- start start 2024-04-28T13:07:27.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.022+0000 7f4ff1319640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4fec15f430 0x7f4fec0d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:27.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.022+0000 7f4ff1319640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4fec0d5870 0x7f4fec0d3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:27.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.022+0000 7f4ff1319640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fec0d2a40 con 0x7f4fec0d1fc0 2024-04-28T13:07:27.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.022+0000 7f4ff1319640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f4fec15f810 con 0x7f4fec0d5870 2024-04-28T13:07:27.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.022+0000 7f4ff1319640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f4fec0d36d0 con 0x7f4fec15f430 2024-04-28T13:07:27.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.022+0000 7f4feb7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4fec0d5870 0x7f4fec0d3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:27.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.022+0000 7f4fea7fc640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f4fec0d1fc0 0x7f4fec0d5160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47024/0 (socket says 172.21.15.114:47024) 2024-04-28T13:07:27.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.022+0000 7f4fea7fc640 1 -- 172.21.15.114:0/1389949999 learned_addr learned my addr 172.21.15.114:0/1389949999 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:27.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.022+0000 7f4feaffd640 1 --2- 172.21.15.114:0/1389949999 >> v2:172.21.15.134:3300/0 conn(0x7f4fec15f430 0x7f4fec0d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:27.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.022+0000 7f4feb7fe640 1 -- 172.21.15.114:0/1389949999 >> v2:172.21.15.134:3300/0 conn(0x7f4fec15f430 msgr2=0x7f4fec0d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:27.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.022+0000 7f4feb7fe640 1 --2- 172.21.15.114:0/1389949999 >> v2:172.21.15.134:3300/0 conn(0x7f4fec15f430 0x7f4fec0d1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:27.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.022+0000 7f4feb7fe640 1 -- 172.21.15.114:0/1389949999 >> v1:172.21.15.114:6789/0 conn(0x7f4fec0d1fc0 legacy=0x7f4fec0d5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:27.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.022+0000 7f4feb7fe640 1 -- 172.21.15.114:0/1389949999 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fec0d2480 con 0x7f4fec0d5870 2024-04-28T13:07:27.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.022+0000 7f4fe9ffb640 1 -- 172.21.15.114:0/1389949999 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2471866034 0 0) 0x7f4fec0d2a40 con 0x7f4fec0d1fc0 2024-04-28T13:07:27.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.023+0000 7f4feb7fe640 1 --2- 172.21.15.114:0/1389949999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fec0d5870 0x7f4fec0d3b60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4fec06e1d0 tx=0x7f4fe402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b173f35ba11450d server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:27.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.023+0000 7f4fe9ffb640 1 -- 172.21.15.114:0/1389949999 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4007740 con 0x7f4fec0d5870 2024-04-28T13:07:27.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.023+0000 7f4fe9ffb640 1 -- 172.21.15.114:0/1389949999 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe40078e0 con 0x7f4fec0d5870 2024-04-28T13:07:27.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.023+0000 7f4fe9ffb640 1 -- 172.21.15.114:0/1389949999 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4007cb0 con 0x7f4fec0d5870 2024-04-28T13:07:27.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.023+0000 7f4ff1319640 1 -- 172.21.15.114:0/1389949999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fec0d5870 msgr2=0x7f4fec0d3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:27.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.023+0000 7f4ff1319640 1 --2- 172.21.15.114:0/1389949999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fec0d5870 0x7f4fec0d3b60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4fec06e1d0 tx=0x7f4fe402a680 comp rx=0 tx=0).stop 2024-04-28T13:07:27.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.023+0000 7f4ff1319640 1 -- 172.21.15.114:0/1389949999 shutdown_connections 2024-04-28T13:07:27.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.023+0000 7f4ff1319640 1 --2- 172.21.15.114:0/1389949999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fec0d5870 0x7f4fec0d3b60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:27.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.023+0000 7f4ff1319640 1 --2- 172.21.15.114:0/1389949999 >> v2:172.21.15.134:3300/0 conn(0x7f4fec15f430 0x7f4fec0d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:27.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.023+0000 7f4ff1319640 1 -- 172.21.15.114:0/1389949999 >> 172.21.15.114:0/1389949999 conn(0x7f4fec0633a0 msgr2=0x7f4fec06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:27.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.024+0000 7f4ff1319640 1 -- 172.21.15.114:0/1389949999 shutdown_connections 2024-04-28T13:07:27.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.024+0000 7f4ff1319640 1 -- 172.21.15.114:0/1389949999 wait complete. 2024-04-28T13:07:27.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.025+0000 7f4ff1319640 1 Processor -- start 2024-04-28T13:07:27.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.025+0000 7f4ff1319640 1 -- start start 2024-04-28T13:07:27.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.025+0000 7f4ff1319640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fec0d1fc0 0x7f4fec14a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:27.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.025+0000 7f4ff1319640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4fec0d5870 0x7f4fec15af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:27.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.025+0000 7f4ff1319640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fec15f430 0x7f4fec0ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:27.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.025+0000 7f4ff1319640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4fec0baf40 con 0x7f4fec15f430 2024-04-28T13:07:27.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.025+0000 7f4ff1319640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4fec0d3360 con 0x7f4fec0d1fc0 2024-04-28T13:07:27.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.025+0000 7f4ff1319640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f4fec0bb0c0 con 0x7f4fec0d5870 2024-04-28T13:07:27.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.026+0000 7f4feb7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fec15f430 0x7f4fec0ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:27.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.026+0000 7f4feb7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fec15f430 0x7f4fec0ccf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38214/0 (socket says 172.21.15.114:38214) 2024-04-28T13:07:27.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.026+0000 7f4feb7fe640 1 -- 172.21.15.114:0/2782600183 learned_addr learned my addr 172.21.15.114:0/2782600183 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:27.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.026+0000 7f4feaffd640 1 --2- 172.21.15.114:0/2782600183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fec0d1fc0 0x7f4fec14a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:27.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.026+0000 7f4fea7fc640 1 --2- 172.21.15.114:0/2782600183 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4fec0d5870 0x7f4fec15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:27.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.026+0000 7f4feb7fe640 1 -- 172.21.15.114:0/2782600183 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4fec0d5870 msgr2=0x7f4fec15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:27.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.026+0000 7f4feb7fe640 1 --2- 172.21.15.114:0/2782600183 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4fec0d5870 0x7f4fec15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:27.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.026+0000 7f4feb7fe640 1 -- 172.21.15.114:0/2782600183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fec0d1fc0 msgr2=0x7f4fec14a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:27.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.026+0000 7f4feb7fe640 1 --2- 172.21.15.114:0/2782600183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fec0d1fc0 0x7f4fec14a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:27.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.026+0000 7f4feb7fe640 1 -- 172.21.15.114:0/2782600183 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fec15b850 con 0x7f4fec15f430 2024-04-28T13:07:27.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.026+0000 7f4feaffd640 1 --2- 172.21.15.114:0/2782600183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fec0d1fc0 0x7f4fec14a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:27.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.026+0000 7f4feb7fe640 1 --2- 172.21.15.114:0/2782600183 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fec15f430 0x7f4fec0ccf60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4fe402ac70 tx=0x7f4fe4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:27.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.026+0000 7f4fd37fe640 1 -- 172.21.15.114:0/2782600183 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4040070 con 0x7f4fec15f430 2024-04-28T13:07:27.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.026+0000 7f4fd37fe640 1 -- 172.21.15.114:0/2782600183 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe4031bc0 con 0x7f4fec15f430 2024-04-28T13:07:27.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.026+0000 7f4ff1319640 1 -- 172.21.15.114:0/2782600183 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fec15bb30 con 0x7f4fec15f430 2024-04-28T13:07:27.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.026+0000 7f4fd37fe640 1 -- 172.21.15.114:0/2782600183 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4045460 con 0x7f4fec15f430 2024-04-28T13:07:27.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.026+0000 7f4ff1319640 1 -- 172.21.15.114:0/2782600183 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fec15c3d0 con 0x7f4fec15f430 2024-04-28T13:07:27.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.027+0000 7f4ff1319640 1 -- 172.21.15.114:0/2782600183 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fec15bf20 con 0x7f4fec15f430 2024-04-28T13:07:27.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.028+0000 7f4fd37fe640 1 -- 172.21.15.114:0/2782600183 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4fe4039040 con 0x7f4fec15f430 2024-04-28T13:07:27.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.028+0000 7f4fd37fe640 1 --2- 172.21.15.114:0/2782600183 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f4fd806c8f0 0x7f4fd806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:27.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.028+0000 7f4feaffd640 1 --2- 172.21.15.114:0/2782600183 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f4fd806c8f0 0x7f4fd806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:27.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.028+0000 7f4fd37fe640 1 -- 172.21.15.114:0/2782600183 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4fe40ad3d0 con 0x7f4fec15f430 2024-04-28T13:07:27.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.029+0000 7f4feaffd640 1 --2- 172.21.15.114:0/2782600183 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f4fd806c8f0 0x7f4fd806edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc006fd0 tx=0x7f4fdc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:27.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.033+0000 7f4fd37fe640 1 -- 172.21.15.114:0/2782600183 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4fe4043360 con 0x7f4fec15f430 2024-04-28T13:07:27.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.245+0000 7f4ff1319640 1 -- 172.21.15.114:0/2782600183 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f4fec075c40 con 0x7f4fec15f430 2024-04-28T13:07:27.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.295+0000 7f4fd37fe640 1 -- 172.21.15.114:0/2782600183 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7f4fe407b890 con 0x7f4fec15f430 2024-04-28T13:07:27.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.297+0000 7f4ff1319640 1 -- 172.21.15.114:0/2782600183 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f4fd806c8f0 msgr2=0x7f4fd806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:27.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.297+0000 7f4ff1319640 1 --2- 172.21.15.114:0/2782600183 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f4fd806c8f0 0x7f4fd806edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc006fd0 tx=0x7f4fdc008040 comp rx=0 tx=0).stop 2024-04-28T13:07:27.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.297+0000 7f4ff1319640 1 -- 172.21.15.114:0/2782600183 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fec15f430 msgr2=0x7f4fec0ccf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:27.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.297+0000 7f4ff1319640 1 --2- 172.21.15.114:0/2782600183 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fec15f430 0x7f4fec0ccf60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4fe402ac70 tx=0x7f4fe4004a40 comp rx=0 tx=0).stop 2024-04-28T13:07:27.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.297+0000 7f4ff1319640 1 -- 172.21.15.114:0/2782600183 shutdown_connections 2024-04-28T13:07:27.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.297+0000 7f4ff1319640 1 --2- 172.21.15.114:0/2782600183 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fec15f430 0x7f4fec0ccf60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:27.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.297+0000 7f4ff1319640 1 --2- 172.21.15.114:0/2782600183 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4fec0d5870 0x7f4fec15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:27.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.297+0000 7f4ff1319640 1 --2- 172.21.15.114:0/2782600183 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f4fd806c8f0 0x7f4fd806edb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:27.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.297+0000 7f4ff1319640 1 --2- 172.21.15.114:0/2782600183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fec0d1fc0 0x7f4fec14a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:27.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.298+0000 7f4ff1319640 1 -- 172.21.15.114:0/2782600183 >> 172.21.15.114:0/2782600183 conn(0x7f4fec0633a0 msgr2=0x7f4fec06d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:27.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.298+0000 7f4ff1319640 1 -- 172.21.15.114:0/2782600183 shutdown_connections 2024-04-28T13:07:27.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.298+0000 7f4ff1319640 1 -- 172.21.15.114:0/2782600183 wait complete. 2024-04-28T13:07:27.309 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-28T13:07:27.309 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-28T13:07:27.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.407+0000 7f62f9baf640 1 Processor -- start 2024-04-28T13:07:27.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.407+0000 7f62f9baf640 1 -- start start 2024-04-28T13:07:27.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.408+0000 7f62f9baf640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f62f40baf40 0x7f62f40d5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:27.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.408+0000 7f62f9baf640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62f40d2a40 con 0x7f62f40d56a0 2024-04-28T13:07:27.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.408+0000 7f62f9baf640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62f40d2480 con 0x7f62f415f430 2024-04-28T13:07:27.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.408+0000 7f62f9baf640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f62f415f810 con 0x7f62f40baf40 2024-04-28T13:07:27.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.408+0000 7f62f3fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f62f40d56a0 0x7f62f40d3b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47028/0 (socket says 172.21.15.114:47028) 2024-04-28T13:07:27.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.408+0000 7f62f3fff640 1 -- 172.21.15.114:0/1296994426 learned_addr learned my addr 172.21.15.114:0/1296994426 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:27.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.408+0000 7f62f27fc640 1 -- 172.21.15.114:0/1296994426 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3754898732 0 0) 0x7f62f40d2a40 con 0x7f62f40d56a0 2024-04-28T13:07:27.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.408+0000 7f62f27fc640 1 -- 172.21.15.114:0/1296994426 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62dc003520 con 0x7f62f40d56a0 2024-04-28T13:07:27.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.408+0000 7f62f2ffd640 1 --2- 172.21.15.114:0/1296994426 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f62f40baf40 0x7f62f40d5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:27.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.408+0000 7f62f27fc640 1 -- 172.21.15.114:0/1296994426 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2751089992 0 0) 0x7f62dc003520 con 0x7f62f40d56a0 2024-04-28T13:07:27.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.408+0000 7f62f27fc640 1 -- 172.21.15.114:0/1296994426 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f62f40baf40 msgr2=0x7f62f40d5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:27.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.408+0000 7f62f27fc640 1 --2- 172.21.15.114:0/1296994426 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f62f40baf40 0x7f62f40d5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:27.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.408+0000 7f62f27fc640 1 -- 172.21.15.114:0/1296994426 >> v1:172.21.15.134:6789/0 conn(0x7f62f415f430 legacy=0x7f62f40d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:27.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.408+0000 7f62f27fc640 1 -- 172.21.15.114:0/1296994426 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f40d2760 con 0x7f62f40d56a0 2024-04-28T13:07:27.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.408+0000 7f62f27fc640 1 -- 172.21.15.114:0/1296994426 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f62ec0019f0 con 0x7f62f40d56a0 2024-04-28T13:07:27.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.408+0000 7f62f27fc640 1 -- 172.21.15.114:0/1296994426 >> v1:172.21.15.114:6789/0 conn(0x7f62f40d56a0 legacy=0x7f62f40d3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:27.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.408+0000 7f62f27fc640 1 --2- 172.21.15.114:0/1296994426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62dc0039e0 0x7f62dc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:27.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.408+0000 7f62f27fc640 1 --2- 172.21.15.114:0/1296994426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62dc004800 0x7f62dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:27.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.408+0000 7f62f27fc640 1 --2- 172.21.15.114:0/1296994426 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f62f40baf40 0x7f62dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:27.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.409+0000 7f62f27fc640 1 -- 172.21.15.114:0/1296994426 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f62dc00ba70 con 0x7f62dc0039e0 2024-04-28T13:07:27.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.409+0000 7f62f27fc640 1 -- 172.21.15.114:0/1296994426 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f62dc00bbf0 con 0x7f62dc004800 2024-04-28T13:07:27.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.409+0000 7f62f27fc640 1 -- 172.21.15.114:0/1296994426 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f62dc00bdf0 con 0x7f62f40baf40 2024-04-28T13:07:27.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.409+0000 7f62f37fe640 1 --2- 172.21.15.114:0/1296994426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62dc0039e0 0x7f62dc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:27.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.409+0000 7f62f2ffd640 1 --2- 172.21.15.114:0/1296994426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62dc004800 0x7f62dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:27.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.409+0000 7f62f3fff640 1 --2- 172.21.15.114:0/1296994426 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f62f40baf40 0x7f62dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:27.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.409+0000 7f62f37fe640 1 -- 172.21.15.114:0/1296994426 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f62f40baf40 msgr2=0x7f62dc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:27.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.409+0000 7f62f37fe640 1 --2- 172.21.15.114:0/1296994426 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f62f40baf40 0x7f62dc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:27.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.409+0000 7f62f37fe640 1 -- 172.21.15.114:0/1296994426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62dc004800 msgr2=0x7f62dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:27.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.409+0000 7f62f37fe640 1 --2- 172.21.15.114:0/1296994426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62dc004800 0x7f62dc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:27.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.409+0000 7f62f37fe640 1 -- 172.21.15.114:0/1296994426 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62dc003520 con 0x7f62dc0039e0 2024-04-28T13:07:27.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.409+0000 7f62f37fe640 1 --2- 172.21.15.114:0/1296994426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62dc0039e0 0x7f62dc003e00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f62e4001720 tx=0x7f62dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2bae40e8cbcc056 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:27.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.410+0000 7f62f27fc640 1 -- 172.21.15.114:0/1296994426 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e4001370 con 0x7f62dc0039e0 2024-04-28T13:07:27.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.410+0000 7f62f27fc640 1 -- 172.21.15.114:0/1296994426 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e40052d0 con 0x7f62dc0039e0 2024-04-28T13:07:27.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.410+0000 7f62f27fc640 1 -- 172.21.15.114:0/1296994426 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e402ab90 con 0x7f62dc0039e0 2024-04-28T13:07:27.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.410+0000 7f62f9baf640 1 -- 172.21.15.114:0/1296994426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62dc0039e0 msgr2=0x7f62dc003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:27.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.410+0000 7f62f9baf640 1 --2- 172.21.15.114:0/1296994426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62dc0039e0 0x7f62dc003e00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f62e4001720 tx=0x7f62dc005830 comp rx=0 tx=0).stop 2024-04-28T13:07:27.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.410+0000 7f62f3fff640 1 -- 172.21.15.114:0/1296994426 reap_dead start 2024-04-28T13:07:27.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.410+0000 7f62f9baf640 1 -- 172.21.15.114:0/1296994426 shutdown_connections 2024-04-28T13:07:27.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.410+0000 7f62f9baf640 1 -- 172.21.15.114:0/1296994426 >> 172.21.15.114:0/1296994426 conn(0x7f62f40633a0 msgr2=0x7f62f406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:27.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.410+0000 7f62f9baf640 1 -- 172.21.15.114:0/1296994426 shutdown_connections 2024-04-28T13:07:27.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.410+0000 7f62f9baf640 1 -- 172.21.15.114:0/1296994426 wait complete. 2024-04-28T13:07:27.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.411+0000 7f62f9baf640 1 Processor -- start 2024-04-28T13:07:27.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.411+0000 7f62f9baf640 1 -- start start 2024-04-28T13:07:27.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.412+0000 7f62f9baf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62dc0039e0 0x7f62f41f81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:27.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.412+0000 7f62f9baf640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f62f40ca200 0x7f62f40ca680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:27.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.412+0000 7f62f9baf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62f4156820 0x7f62f4156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:27.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.412+0000 7f62f9baf640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f62f40d2190 con 0x7f62dc0039e0 2024-04-28T13:07:27.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.412+0000 7f62f9baf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f62f40d36d0 con 0x7f62f4156820 2024-04-28T13:07:27.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.412+0000 7f62f9baf640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f62f40d5160 con 0x7f62f40ca200 2024-04-28T13:07:27.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.412+0000 7f62f37fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62dc0039e0 0x7f62f41f81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:27.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.412+0000 7f62f37fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62dc0039e0 0x7f62f41f81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38224/0 (socket says 172.21.15.114:38224) 2024-04-28T13:07:27.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.412+0000 7f62f37fe640 1 -- 172.21.15.114:0/3455860068 learned_addr learned my addr 172.21.15.114:0/3455860068 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:27.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.412+0000 7f62f37fe640 1 -- 172.21.15.114:0/3455860068 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f62f40ca200 msgr2=0x7f62f40ca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:27.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.412+0000 7f62f2ffd640 1 --2- 172.21.15.114:0/3455860068 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f62f40ca200 0x7f62f40ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:27.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.412+0000 7f62f3fff640 1 --2- 172.21.15.114:0/3455860068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62f4156820 0x7f62f4156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:27.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.412+0000 7f62f37fe640 1 --2- 172.21.15.114:0/3455860068 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f62f40ca200 0x7f62f40ca680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:27.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.412+0000 7f62f37fe640 1 -- 172.21.15.114:0/3455860068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62f4156820 msgr2=0x7f62f4156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:27.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.412+0000 7f62f37fe640 1 --2- 172.21.15.114:0/3455860068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62f4156820 0x7f62f4156ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:27.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.412+0000 7f62f37fe640 1 -- 172.21.15.114:0/3455860068 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f4143d70 con 0x7f62dc0039e0 2024-04-28T13:07:27.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.413+0000 7f62f37fe640 1 --2- 172.21.15.114:0/3455860068 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62dc0039e0 0x7f62f41f81b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f62e402a540 tx=0x7f62e4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:27.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.413+0000 7f62dbfff640 1 -- 172.21.15.114:0/3455860068 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e4037040 con 0x7f62dc0039e0 2024-04-28T13:07:27.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.413+0000 7f62dbfff640 1 -- 172.21.15.114:0/3455860068 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e4005480 con 0x7f62dc0039e0 2024-04-28T13:07:27.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.413+0000 7f62f9baf640 1 -- 172.21.15.114:0/3455860068 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62f4144010 con 0x7f62dc0039e0 2024-04-28T13:07:27.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.413+0000 7f62dbfff640 1 -- 172.21.15.114:0/3455860068 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e4007a30 con 0x7f62dc0039e0 2024-04-28T13:07:27.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.413+0000 7f62f9baf640 1 -- 172.21.15.114:0/3455860068 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62f41445d0 con 0x7f62dc0039e0 2024-04-28T13:07:27.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.414+0000 7f62f9baf640 1 -- 172.21.15.114:0/3455860068 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62f4075c40 con 0x7f62dc0039e0 2024-04-28T13:07:27.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.414+0000 7f62dbfff640 1 -- 172.21.15.114:0/3455860068 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f62e4044020 con 0x7f62dc0039e0 2024-04-28T13:07:27.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.415+0000 7f62dbfff640 1 --2- 172.21.15.114:0/3455860068 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f62e006c920 0x7f62e006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:27.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.415+0000 7f62dbfff640 1 -- 172.21.15.114:0/3455860068 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f62e40ab6d0 con 0x7f62dc0039e0 2024-04-28T13:07:27.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.415+0000 7f62f2ffd640 1 --2- 172.21.15.114:0/3455860068 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f62e006c920 0x7f62e006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:27.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.415+0000 7f62f2ffd640 1 --2- 172.21.15.114:0/3455860068 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f62e006c920 0x7f62e006ede0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f62f40cb9e0 tx=0x7f62e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:27.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.419+0000 7f62dbfff640 1 -- 172.21.15.114:0/3455860068 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f62e4079b90 con 0x7f62dc0039e0 2024-04-28T13:07:27.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:27.634+0000 7f62f9baf640 1 -- 172.21.15.114:0/3455860068 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f62f41f86f0 con 0x7f62dc0039e0 2024-04-28T13:07:28.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.299+0000 7f62dbfff640 1 -- 172.21.15.114:0/3455860068 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7f62e4079490 con 0x7f62dc0039e0 2024-04-28T13:07:28.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.301+0000 7f62f9baf640 1 -- 172.21.15.114:0/3455860068 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f62e006c920 msgr2=0x7f62e006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:28.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.301+0000 7f62f9baf640 1 --2- 172.21.15.114:0/3455860068 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f62e006c920 0x7f62e006ede0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f62f40cb9e0 tx=0x7f62e8008040 comp rx=0 tx=0).stop 2024-04-28T13:07:28.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.302+0000 7f62f9baf640 1 -- 172.21.15.114:0/3455860068 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62dc0039e0 msgr2=0x7f62f41f81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:28.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.302+0000 7f62f9baf640 1 --2- 172.21.15.114:0/3455860068 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62dc0039e0 0x7f62f41f81b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f62e402a540 tx=0x7f62e4001120 comp rx=0 tx=0).stop 2024-04-28T13:07:28.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.302+0000 7f62f9baf640 1 -- 172.21.15.114:0/3455860068 shutdown_connections 2024-04-28T13:07:28.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.302+0000 7f62f9baf640 1 --2- 172.21.15.114:0/3455860068 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f62e006c920 0x7f62e006ede0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:28.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.302+0000 7f62f9baf640 1 --2- 172.21.15.114:0/3455860068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62f4156820 0x7f62f4156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:28.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.302+0000 7f62f9baf640 1 --2- 172.21.15.114:0/3455860068 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f62f40ca200 0x7f62f40ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:28.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.302+0000 7f62f9baf640 1 --2- 172.21.15.114:0/3455860068 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62dc0039e0 0x7f62f41f81b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:28.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.302+0000 7f62f9baf640 1 -- 172.21.15.114:0/3455860068 >> 172.21.15.114:0/3455860068 conn(0x7f62f40633a0 msgr2=0x7f62f40ba2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:28.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.302+0000 7f62f9baf640 1 -- 172.21.15.114:0/3455860068 shutdown_connections 2024-04-28T13:07:28.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.302+0000 7f62f9baf640 1 -- 172.21.15.114:0/3455860068 wait complete. 2024-04-28T13:07:28.314 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-28T13:07:28.314 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-28T13:07:28.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.409+0000 7f6ff6351640 1 Processor -- start 2024-04-28T13:07:28.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.409+0000 7f6ff6351640 1 -- start start 2024-04-28T13:07:28.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.410+0000 7f6ff6351640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6ff00cda00 0x7f6ff00d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:28.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.410+0000 7f6ff6351640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6ff01601d0 0x7f6ff0155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:28.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.410+0000 7f6ff6351640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ff00d2be0 con 0x7f6ff00d07b0 2024-04-28T13:07:28.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.410+0000 7f6ff6351640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f6ff0160980 con 0x7f6ff01601d0 2024-04-28T13:07:28.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.410+0000 7f6ff6351640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f6ff01606a0 con 0x7f6ff00cda00 2024-04-28T13:07:28.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.410+0000 7f6ff48ee640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6ff01601d0 0x7f6ff0155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:28.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.410+0000 7f6fef7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6ff00d07b0 0x7f6ff015fac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47042/0 (socket says 172.21.15.114:47042) 2024-04-28T13:07:28.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.410+0000 7f6fef7fe640 1 -- 172.21.15.114:0/1339912261 learned_addr learned my addr 172.21.15.114:0/1339912261 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:28.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.411+0000 7f6feffff640 1 --2- 172.21.15.114:0/1339912261 >> v2:172.21.15.134:3300/0 conn(0x7f6ff00cda00 0x7f6ff00d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:28.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.411+0000 7f6ff48ee640 1 -- 172.21.15.114:0/1339912261 >> v2:172.21.15.134:3300/0 conn(0x7f6ff00cda00 msgr2=0x7f6ff00d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:28.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.411+0000 7f6ff48ee640 1 --2- 172.21.15.114:0/1339912261 >> v2:172.21.15.134:3300/0 conn(0x7f6ff00cda00 0x7f6ff00d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:28.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.411+0000 7f6ff48ee640 1 -- 172.21.15.114:0/1339912261 >> v1:172.21.15.114:6789/0 conn(0x7f6ff00d07b0 legacy=0x7f6ff015fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:28.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.411+0000 7f6ff48ee640 1 -- 172.21.15.114:0/1339912261 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff00cf7b0 con 0x7f6ff01601d0 2024-04-28T13:07:28.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.411+0000 7f6feffff640 1 --2- 172.21.15.114:0/1339912261 >> v2:172.21.15.134:3300/0 conn(0x7f6ff00cda00 0x7f6ff00d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:07:28.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.411+0000 7f6feeffd640 1 -- 172.21.15.114:0/1339912261 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 564626458 0 0) 0x7f6ff00d2be0 con 0x7f6ff00d07b0 2024-04-28T13:07:28.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.411+0000 7f6ff48ee640 1 --2- 172.21.15.114:0/1339912261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ff01601d0 0x7f6ff0155fc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0063d50 tx=0x7f6fe802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11d59e2c77b0d24f server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:28.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.411+0000 7f6feeffd640 1 -- 172.21.15.114:0/1339912261 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8007740 con 0x7f6ff01601d0 2024-04-28T13:07:28.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.411+0000 7f6feeffd640 1 -- 172.21.15.114:0/1339912261 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fe80078e0 con 0x7f6ff01601d0 2024-04-28T13:07:28.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.411+0000 7f6feeffd640 1 -- 172.21.15.114:0/1339912261 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8007cb0 con 0x7f6ff01601d0 2024-04-28T13:07:28.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.412+0000 7f6ff6351640 1 -- 172.21.15.114:0/1339912261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ff01601d0 msgr2=0x7f6ff0155fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:28.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.412+0000 7f6ff6351640 1 --2- 172.21.15.114:0/1339912261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ff01601d0 0x7f6ff0155fc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0063d50 tx=0x7f6fe802a680 comp rx=0 tx=0).stop 2024-04-28T13:07:28.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.412+0000 7f6ff6351640 1 -- 172.21.15.114:0/1339912261 shutdown_connections 2024-04-28T13:07:28.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.412+0000 7f6ff6351640 1 --2- 172.21.15.114:0/1339912261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ff01601d0 0x7f6ff0155fc0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:28.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.412+0000 7f6ff6351640 1 --2- 172.21.15.114:0/1339912261 >> v2:172.21.15.134:3300/0 conn(0x7f6ff00cda00 0x7f6ff00d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:28.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.412+0000 7f6ff6351640 1 -- 172.21.15.114:0/1339912261 >> 172.21.15.114:0/1339912261 conn(0x7f6ff00706f0 msgr2=0x7f6ff0070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:28.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.412+0000 7f6ff6351640 1 -- 172.21.15.114:0/1339912261 shutdown_connections 2024-04-28T13:07:28.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.412+0000 7f6ff6351640 1 -- 172.21.15.114:0/1339912261 wait complete. 2024-04-28T13:07:28.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.413+0000 7f6ff6351640 1 Processor -- start 2024-04-28T13:07:28.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.413+0000 7f6ff6351640 1 -- start start 2024-04-28T13:07:28.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.414+0000 7f6ff6351640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ff00cda00 0x7f6ff00c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:28.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.414+0000 7f6ff6351640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ff00d07b0 0x7f6ff01f5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:28.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.414+0000 7f6ff6351640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ff01601d0 0x7f6ff01f64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:28.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.414+0000 7f6ff6351640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff00cdde0 con 0x7f6ff00cda00 2024-04-28T13:07:28.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.414+0000 7f6ff6351640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff00cfd70 con 0x7f6ff01601d0 2024-04-28T13:07:28.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.414+0000 7f6ff6351640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f6ff00cdf60 con 0x7f6ff00d07b0 2024-04-28T13:07:28.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.414+0000 7f6feffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ff00cda00 0x7f6ff00c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:28.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.414+0000 7f6feffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ff00cda00 0x7f6ff00c7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38242/0 (socket says 172.21.15.114:38242) 2024-04-28T13:07:28.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.414+0000 7f6feffff640 1 -- 172.21.15.114:0/2474649611 learned_addr learned my addr 172.21.15.114:0/2474649611 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:28.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.414+0000 7f6ff48ee640 1 --2- 172.21.15.114:0/2474649611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ff01601d0 0x7f6ff01f64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:28.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.414+0000 7f6fef7fe640 1 --2- 172.21.15.114:0/2474649611 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ff00d07b0 0x7f6ff01f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:28.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.414+0000 7f6feffff640 1 -- 172.21.15.114:0/2474649611 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ff00d07b0 msgr2=0x7f6ff01f5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:28.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.414+0000 7f6feffff640 1 --2- 172.21.15.114:0/2474649611 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ff00d07b0 0x7f6ff01f5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:28.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.414+0000 7f6feffff640 1 -- 172.21.15.114:0/2474649611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ff01601d0 msgr2=0x7f6ff01f64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:28.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.414+0000 7f6feffff640 1 --2- 172.21.15.114:0/2474649611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ff01601d0 0x7f6ff01f64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:28.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.414+0000 7f6feffff640 1 -- 172.21.15.114:0/2474649611 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff00c6e10 con 0x7f6ff00cda00 2024-04-28T13:07:28.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.414+0000 7f6ff48ee640 1 --2- 172.21.15.114:0/2474649611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ff01601d0 0x7f6ff01f64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:07:28.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.414+0000 7f6fef7fe640 1 --2- 172.21.15.114:0/2474649611 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ff00d07b0 0x7f6ff01f5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:07:28.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.415+0000 7f6feffff640 1 --2- 172.21.15.114:0/2474649611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ff00cda00 0x7f6ff00c7eb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6fe000c7f0 tx=0x7f6fe000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:28.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.415+0000 7f6fecff9640 1 -- 172.21.15.114:0/2474649611 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0015070 con 0x7f6ff00cda00 2024-04-28T13:07:28.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.415+0000 7f6fecff9640 1 -- 172.21.15.114:0/2474649611 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fe0007a30 con 0x7f6ff00cda00 2024-04-28T13:07:28.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.415+0000 7f6ff6351640 1 -- 172.21.15.114:0/2474649611 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ff00c70f0 con 0x7f6ff00cda00 2024-04-28T13:07:28.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.415+0000 7f6fecff9640 1 -- 172.21.15.114:0/2474649611 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0007e00 con 0x7f6ff00cda00 2024-04-28T13:07:28.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.415+0000 7f6ff6351640 1 -- 172.21.15.114:0/2474649611 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ff00c76b0 con 0x7f6ff00cda00 2024-04-28T13:07:28.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.416+0000 7f6ff6351640 1 -- 172.21.15.114:0/2474649611 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ff006a3d0 con 0x7f6ff00cda00 2024-04-28T13:07:28.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.416+0000 7f6fecff9640 1 -- 172.21.15.114:0/2474649611 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6fe0018070 con 0x7f6ff00cda00 2024-04-28T13:07:28.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.417+0000 7f6fecff9640 1 --2- 172.21.15.114:0/2474649611 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6fdc06c8f0 0x7f6fdc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:28.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.417+0000 7f6fef7fe640 1 --2- 172.21.15.114:0/2474649611 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6fdc06c8f0 0x7f6fdc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:28.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.417+0000 7f6fecff9640 1 -- 172.21.15.114:0/2474649611 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6fe008bad0 con 0x7f6ff00cda00 2024-04-28T13:07:28.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.417+0000 7f6fef7fe640 1 --2- 172.21.15.114:0/2474649611 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6fdc06c8f0 0x7f6fdc06edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4007fd0 tx=0x7f6fe4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:28.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.421+0000 7f6fecff9640 1 -- 172.21.15.114:0/2474649611 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6fe0059f90 con 0x7f6ff00cda00 2024-04-28T13:07:28.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.635+0000 7f6ff6351640 1 -- 172.21.15.114:0/2474649611 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ff00cc6f0 con 0x7f6ff00cda00 2024-04-28T13:07:28.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.635+0000 7f6fecff9640 1 -- 172.21.15.114:0/2474649611 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5181 (secure 0 0 0) 0x7f6fe0059890 con 0x7f6ff00cda00 2024-04-28T13:07:28.636 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:28.637 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2660339514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2660339514},{"type":"v1","addr":"172.21.15.114:6837","nonce":2660339514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3536977085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3536977085},{"type":"v1","addr":"172.21.15.134:6833","nonce":3536977085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/869609014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":869609014},{"type":"v1","addr":"172.21.15.134:6835","nonce":869609014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-28T13:07:25.635297+0000","modified":"2024-04-28T13:07:27.635944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/888574435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":888574435},{"type":"v1","addr":"172.21.15.114:6836","nonce":888574435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-04-28T13:07:28.637 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 6 2024-04-28T13:07:28.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.637+0000 7f6ff6351640 1 -- 172.21.15.114:0/2474649611 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6fdc06c8f0 msgr2=0x7f6fdc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:28.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.637+0000 7f6ff6351640 1 --2- 172.21.15.114:0/2474649611 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6fdc06c8f0 0x7f6fdc06edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4007fd0 tx=0x7f6fe4009040 comp rx=0 tx=0).stop 2024-04-28T13:07:28.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.637+0000 7f6ff6351640 1 -- 172.21.15.114:0/2474649611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ff00cda00 msgr2=0x7f6ff00c7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:28.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.637+0000 7f6ff6351640 1 --2- 172.21.15.114:0/2474649611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ff00cda00 0x7f6ff00c7eb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6fe000c7f0 tx=0x7f6fe000cbf0 comp rx=0 tx=0).stop 2024-04-28T13:07:28.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.637+0000 7f6ff6351640 1 -- 172.21.15.114:0/2474649611 shutdown_connections 2024-04-28T13:07:28.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.637+0000 7f6ff6351640 1 --2- 172.21.15.114:0/2474649611 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6fdc06c8f0 0x7f6fdc06edb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:28.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.637+0000 7f6ff6351640 1 --2- 172.21.15.114:0/2474649611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ff01601d0 0x7f6ff01f64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:28.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.637+0000 7f6ff6351640 1 --2- 172.21.15.114:0/2474649611 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ff00d07b0 0x7f6ff01f5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:28.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.637+0000 7f6ff6351640 1 --2- 172.21.15.114:0/2474649611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ff00cda00 0x7f6ff00c7eb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:28.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.637+0000 7f6ff6351640 1 -- 172.21.15.114:0/2474649611 >> 172.21.15.114:0/2474649611 conn(0x7f6ff00706f0 msgr2=0x7f6ff00cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:28.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.638+0000 7f6ff6351640 1 -- 172.21.15.114:0/2474649611 shutdown_connections 2024-04-28T13:07:28.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.638+0000 7f6ff6351640 1 -- 172.21.15.114:0/2474649611 wait complete. 2024-04-28T13:07:28.649 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:07:28.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.745+0000 7f599749c640 1 Processor -- start 2024-04-28T13:07:28.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.745+0000 7f599749c640 1 -- start start 2024-04-28T13:07:28.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.746+0000 7f599749c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5990146b90 0x7f59900725f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:28.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.746+0000 7f599749c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59900c9eb0 con 0x7f59900706d0 2024-04-28T13:07:28.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.746+0000 7f599749c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5990146f70 con 0x7f59900d2870 2024-04-28T13:07:28.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.746+0000 7f599749c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f59900cdd90 con 0x7f5990146b90 2024-04-28T13:07:28.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.746+0000 7f5995a39640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f59900706d0 0x7f59900d15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47044/0 (socket says 172.21.15.114:47044) 2024-04-28T13:07:28.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.746+0000 7f5995a39640 1 -- 172.21.15.114:0/3892890663 learned_addr learned my addr 172.21.15.114:0/3892890663 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:28.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.746+0000 7f5995238640 1 --2- 172.21.15.114:0/3892890663 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5990146b90 0x7f59900725f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:28.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.747+0000 7f5987fff640 1 -- 172.21.15.114:0/3892890663 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3920620316 0 0) 0x7f59900c9eb0 con 0x7f59900706d0 2024-04-28T13:07:28.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.747+0000 7f5987fff640 1 -- 172.21.15.114:0/3892890663 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f597c003520 con 0x7f59900706d0 2024-04-28T13:07:28.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.747+0000 7f5987fff640 1 -- 172.21.15.114:0/3892890663 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1103847776 0 0) 0x7f5990146f70 con 0x7f59900d2870 2024-04-28T13:07:28.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.747+0000 7f5987fff640 1 -- 172.21.15.114:0/3892890663 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59900c9eb0 con 0x7f59900d2870 2024-04-28T13:07:28.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.747+0000 7f5995238640 1 -- 172.21.15.114:0/3892890663 >> v1:172.21.15.134:6789/0 conn(0x7f59900d2870 legacy=0x7f59900cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:28.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.747+0000 7f5995238640 1 -- 172.21.15.114:0/3892890663 >> v1:172.21.15.114:6789/0 conn(0x7f59900706d0 legacy=0x7f59900d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:28.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.747+0000 7f5995238640 1 -- 172.21.15.114:0/3892890663 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59900c8120 con 0x7f5990146b90 2024-04-28T13:07:28.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.748+0000 7f5995238640 1 --2- 172.21.15.114:0/3892890663 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5990146b90 0x7f59900725f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f598c009dc0 tx=0x7f598c02a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6944c5b29f0d3152 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:28.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.748+0000 7f5987fff640 1 -- 172.21.15.114:0/3892890663 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598c02ae60 con 0x7f5990146b90 2024-04-28T13:07:28.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.748+0000 7f5987fff640 1 -- 172.21.15.114:0/3892890663 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f598c007740 con 0x7f5990146b90 2024-04-28T13:07:28.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.748+0000 7f5987fff640 1 -- 172.21.15.114:0/3892890663 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598c007af0 con 0x7f5990146b90 2024-04-28T13:07:28.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.748+0000 7f599749c640 1 -- 172.21.15.114:0/3892890663 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5990146b90 msgr2=0x7f59900725f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:28.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.748+0000 7f599749c640 1 --2- 172.21.15.114:0/3892890663 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5990146b90 0x7f59900725f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f598c009dc0 tx=0x7f598c02a640 comp rx=0 tx=0).stop 2024-04-28T13:07:28.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.748+0000 7f599749c640 1 -- 172.21.15.114:0/3892890663 shutdown_connections 2024-04-28T13:07:28.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.748+0000 7f599749c640 1 --2- 172.21.15.114:0/3892890663 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5990146b90 0x7f59900725f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:28.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.748+0000 7f599749c640 1 -- 172.21.15.114:0/3892890663 >> 172.21.15.114:0/3892890663 conn(0x7f59900d3030 msgr2=0x7f59900d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:28.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.748+0000 7f599749c640 1 -- 172.21.15.114:0/3892890663 shutdown_connections 2024-04-28T13:07:28.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.748+0000 7f599749c640 1 -- 172.21.15.114:0/3892890663 wait complete. 2024-04-28T13:07:28.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.749+0000 7f599749c640 1 Processor -- start 2024-04-28T13:07:28.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.749+0000 7f599749c640 1 -- start start 2024-04-28T13:07:28.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.750+0000 7f599749c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59900706d0 0x7f59901f33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:28.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.750+0000 7f599749c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59900d2870 0x7f5990140770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:28.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.750+0000 7f599749c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5990146b90 0x7f599013ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:28.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.750+0000 7f599749c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f59900c86e0 con 0x7f5990146b90 2024-04-28T13:07:28.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.750+0000 7f599749c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f59900c7ed0 con 0x7f59900706d0 2024-04-28T13:07:28.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.750+0000 7f599749c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f59900d10b0 con 0x7f59900d2870 2024-04-28T13:07:28.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.750+0000 7f5995a39640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5990146b90 0x7f599013ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:28.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.750+0000 7f5995a39640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5990146b90 0x7f599013ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38246/0 (socket says 172.21.15.114:38246) 2024-04-28T13:07:28.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.750+0000 7f5995a39640 1 -- 172.21.15.114:0/900516234 learned_addr learned my addr 172.21.15.114:0/900516234 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:28.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.750+0000 7f5994a37640 1 --2- 172.21.15.114:0/900516234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59900d2870 0x7f5990140770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:28.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.750+0000 7f5995238640 1 --2- 172.21.15.114:0/900516234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59900706d0 0x7f59901f33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:28.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.751+0000 7f5995a39640 1 -- 172.21.15.114:0/900516234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59900d2870 msgr2=0x7f5990140770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:28.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.751+0000 7f5995a39640 1 --2- 172.21.15.114:0/900516234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59900d2870 0x7f5990140770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:28.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.751+0000 7f5995a39640 1 -- 172.21.15.114:0/900516234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59900706d0 msgr2=0x7f59901f33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:28.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.751+0000 7f5995a39640 1 --2- 172.21.15.114:0/900516234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59900706d0 0x7f59901f33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:28.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.751+0000 7f5995a39640 1 -- 172.21.15.114:0/900516234 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f599013f6b0 con 0x7f5990146b90 2024-04-28T13:07:28.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.751+0000 7f5995a39640 1 --2- 172.21.15.114:0/900516234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5990146b90 0x7f599013ef10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f598800c430 tx=0x7f598800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:28.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.751+0000 7f5985ffb640 1 -- 172.21.15.114:0/900516234 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5988017070 con 0x7f5990146b90 2024-04-28T13:07:28.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.751+0000 7f5985ffb640 1 -- 172.21.15.114:0/900516234 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5988005d00 con 0x7f5990146b90 2024-04-28T13:07:28.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.751+0000 7f599749c640 1 -- 172.21.15.114:0/900516234 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59900ca1a0 con 0x7f5990146b90 2024-04-28T13:07:28.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.751+0000 7f5985ffb640 1 -- 172.21.15.114:0/900516234 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5988007310 con 0x7f5990146b90 2024-04-28T13:07:28.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.751+0000 7f599749c640 1 -- 172.21.15.114:0/900516234 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59900ca760 con 0x7f5990146b90 2024-04-28T13:07:28.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.752+0000 7f599749c640 1 -- 172.21.15.114:0/900516234 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f599006a3d0 con 0x7f5990146b90 2024-04-28T13:07:28.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.752+0000 7f5985ffb640 1 -- 172.21.15.114:0/900516234 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f598801a070 con 0x7f5990146b90 2024-04-28T13:07:28.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.753+0000 7f5985ffb640 1 --2- 172.21.15.114:0/900516234 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f597406c920 0x7f597406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:28.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.753+0000 7f5985ffb640 1 -- 172.21.15.114:0/900516234 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f598808af10 con 0x7f5990146b90 2024-04-28T13:07:28.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.753+0000 7f5995238640 1 --2- 172.21.15.114:0/900516234 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f597406c920 0x7f597406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:28.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.753+0000 7f5995238640 1 --2- 172.21.15.114:0/900516234 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f597406c920 0x7f597406ede0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f598c034000 tx=0x7f598c02f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:28.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.757+0000 7f5985ffb640 1 -- 172.21.15.114:0/900516234 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5988058cf0 con 0x7f5990146b90 2024-04-28T13:07:28.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.933+0000 7f599749c640 1 -- 172.21.15.114:0/900516234 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59900d3d20 con 0x7f5990146b90 2024-04-28T13:07:28.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.934+0000 7f5985ffb640 1 -- 172.21.15.114:0/900516234 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7f598805cff0 con 0x7f5990146b90 2024-04-28T13:07:28.935 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:28.935 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:07:27.292537+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-28T13:07:23.706359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-28T13:07:24.596188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:07:28.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.936+0000 7f599749c640 1 -- 172.21.15.114:0/900516234 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f597406c920 msgr2=0x7f597406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:28.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.936+0000 7f599749c640 1 --2- 172.21.15.114:0/900516234 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f597406c920 0x7f597406ede0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f598c034000 tx=0x7f598c02f000 comp rx=0 tx=0).stop 2024-04-28T13:07:28.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.936+0000 7f599749c640 1 -- 172.21.15.114:0/900516234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5990146b90 msgr2=0x7f599013ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:28.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.936+0000 7f599749c640 1 --2- 172.21.15.114:0/900516234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5990146b90 0x7f599013ef10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f598800c430 tx=0x7f598800c8f0 comp rx=0 tx=0).stop 2024-04-28T13:07:28.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.936+0000 7f599749c640 1 -- 172.21.15.114:0/900516234 shutdown_connections 2024-04-28T13:07:28.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.936+0000 7f599749c640 1 --2- 172.21.15.114:0/900516234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5990146b90 0x7f599013ef10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:28.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.936+0000 7f599749c640 1 --2- 172.21.15.114:0/900516234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59900d2870 0x7f5990140770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:28.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.936+0000 7f599749c640 1 --2- 172.21.15.114:0/900516234 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f597406c920 0x7f597406ede0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:28.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.936+0000 7f599749c640 1 --2- 172.21.15.114:0/900516234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59900706d0 0x7f59901f33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:28.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.936+0000 7f599749c640 1 -- 172.21.15.114:0/900516234 >> 172.21.15.114:0/900516234 conn(0x7f59900d3030 msgr2=0x7f59900cdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:28.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.936+0000 7f599749c640 1 -- 172.21.15.114:0/900516234 shutdown_connections 2024-04-28T13:07:28.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:28.936+0000 7f599749c640 1 -- 172.21.15.114:0/900516234 wait complete. 2024-04-28T13:07:28.947 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-28T13:07:28.948 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-28T13:07:29.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.043+0000 7f094996a640 1 Processor -- start 2024-04-28T13:07:29.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.043+0000 7f094996a640 1 -- start start 2024-04-28T13:07:29.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.044+0000 7f094996a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09440b4380 0x7f09440baaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:29.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.044+0000 7f094996a640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09440d3650 con 0x7f09440d0670 2024-04-28T13:07:29.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.044+0000 7f094996a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f094415f7f0 con 0x7f094415f410 2024-04-28T13:07:29.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.044+0000 7f094996a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f09440d3f10 con 0x7f09440b4380 2024-04-28T13:07:29.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.044+0000 7f093bfff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f09440d0670 0x7f09440d43a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47048/0 (socket says 172.21.15.114:47048) 2024-04-28T13:07:29.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.044+0000 7f093bfff640 1 -- 172.21.15.114:0/3007743615 learned_addr learned my addr 172.21.15.114:0/3007743615 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:29.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.044+0000 7f09437fe640 1 --2- 172.21.15.114:0/3007743615 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09440b4380 0x7f09440baaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:29.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.045+0000 7f09427fc640 1 -- 172.21.15.114:0/3007743615 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 321956313 0 0) 0x7f09440d3650 con 0x7f09440d0670 2024-04-28T13:07:29.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.045+0000 7f09427fc640 1 -- 172.21.15.114:0/3007743615 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0930003520 con 0x7f09440d0670 2024-04-28T13:07:29.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.045+0000 7f09427fc640 1 -- 172.21.15.114:0/3007743615 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1133323404 0 0) 0x7f0930003520 con 0x7f09440d0670 2024-04-28T13:07:29.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.045+0000 7f09427fc640 1 -- 172.21.15.114:0/3007743615 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09440b4380 msgr2=0x7f09440baaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:29.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.045+0000 7f09427fc640 1 --2- 172.21.15.114:0/3007743615 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09440b4380 0x7f09440baaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:29.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.045+0000 7f09427fc640 1 -- 172.21.15.114:0/3007743615 >> v1:172.21.15.134:6789/0 conn(0x7f094415f410 legacy=0x7f09440cff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:29.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.045+0000 7f09427fc640 1 -- 172.21.15.114:0/3007743615 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09440d2570 con 0x7f09440d0670 2024-04-28T13:07:29.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.045+0000 7f09427fc640 1 -- 172.21.15.114:0/3007743615 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f092c001670 con 0x7f09440d0670 2024-04-28T13:07:29.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.045+0000 7f09427fc640 1 -- 172.21.15.114:0/3007743615 >> v1:172.21.15.114:6789/0 conn(0x7f09440d0670 legacy=0x7f09440d43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:29.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.045+0000 7f09427fc640 1 --2- 172.21.15.114:0/3007743615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09300039e0 0x7f0930003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:29.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.045+0000 7f09427fc640 1 --2- 172.21.15.114:0/3007743615 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09440b4380 0x7f0930004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:29.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.045+0000 7f09427fc640 1 --2- 172.21.15.114:0/3007743615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0930004d40 0x7f09300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:29.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.045+0000 7f09427fc640 1 -- 172.21.15.114:0/3007743615 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f09440d3f10 con 0x7f0930004d40 2024-04-28T13:07:29.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.045+0000 7f09427fc640 1 -- 172.21.15.114:0/3007743615 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f093000ba70 con 0x7f09300039e0 2024-04-28T13:07:29.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.045+0000 7f09427fc640 1 -- 172.21.15.114:0/3007743615 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f093000bbf0 con 0x7f09440b4380 2024-04-28T13:07:29.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.045+0000 7f09437fe640 1 --2- 172.21.15.114:0/3007743615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0930004d40 0x7f09300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:29.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.045+0000 7f0942ffd640 1 --2- 172.21.15.114:0/3007743615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09300039e0 0x7f0930003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:29.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.045+0000 7f093bfff640 1 --2- 172.21.15.114:0/3007743615 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09440b4380 0x7f0930004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:29.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.045+0000 7f09437fe640 1 -- 172.21.15.114:0/3007743615 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09440b4380 msgr2=0x7f0930004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:29.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.045+0000 7f09437fe640 1 --2- 172.21.15.114:0/3007743615 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09440b4380 0x7f0930004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:29.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.045+0000 7f09437fe640 1 -- 172.21.15.114:0/3007743615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09300039e0 msgr2=0x7f0930003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:29.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.045+0000 7f09437fe640 1 --2- 172.21.15.114:0/3007743615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09300039e0 0x7f0930003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:29.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.045+0000 7f09437fe640 1 -- 172.21.15.114:0/3007743615 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0930003520 con 0x7f0930004d40 2024-04-28T13:07:29.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.046+0000 7f09437fe640 1 --2- 172.21.15.114:0/3007743615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0930004d40 0x7f09300051c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f093c009fc0 tx=0x7f0930005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=908d2892849311aa server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:29.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.046+0000 7f09427fc640 1 -- 172.21.15.114:0/3007743615 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093c009c10 con 0x7f0930004d40 2024-04-28T13:07:29.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.046+0000 7f09427fc640 1 -- 172.21.15.114:0/3007743615 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f093c036070 con 0x7f0930004d40 2024-04-28T13:07:29.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.046+0000 7f09427fc640 1 -- 172.21.15.114:0/3007743615 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093c031880 con 0x7f0930004d40 2024-04-28T13:07:29.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.047+0000 7f094996a640 1 -- 172.21.15.114:0/3007743615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0930004d40 msgr2=0x7f09300051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:29.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.047+0000 7f094996a640 1 --2- 172.21.15.114:0/3007743615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0930004d40 0x7f09300051c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f093c009fc0 tx=0x7f0930005830 comp rx=0 tx=0).stop 2024-04-28T13:07:29.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.047+0000 7f09437fe640 1 -- 172.21.15.114:0/3007743615 reap_dead start 2024-04-28T13:07:29.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.047+0000 7f094996a640 1 -- 172.21.15.114:0/3007743615 shutdown_connections 2024-04-28T13:07:29.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.047+0000 7f094996a640 1 -- 172.21.15.114:0/3007743615 >> 172.21.15.114:0/3007743615 conn(0x7f09440633a0 msgr2=0x7f09440d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:29.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.047+0000 7f094996a640 1 -- 172.21.15.114:0/3007743615 shutdown_connections 2024-04-28T13:07:29.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.047+0000 7f094996a640 1 -- 172.21.15.114:0/3007743615 wait complete. 2024-04-28T13:07:29.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.048+0000 7f094996a640 1 Processor -- start 2024-04-28T13:07:29.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.048+0000 7f094996a640 1 -- start start 2024-04-28T13:07:29.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.049+0000 7f094996a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0930004d40 0x7f0944157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:29.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.049+0000 7f094996a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0944147e30 0x7f094415f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:29.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.049+0000 7f094996a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0944147220 0x7f09441476a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:29.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.049+0000 7f094996a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f09440bb180 con 0x7f0944147220 2024-04-28T13:07:29.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.049+0000 7f094996a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f09440d3ba0 con 0x7f0944147e30 2024-04-28T13:07:29.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.049+0000 7f094996a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f09440baaf0 con 0x7f0930004d40 2024-04-28T13:07:29.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.049+0000 7f09437fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0944147220 0x7f09441476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:29.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.049+0000 7f09437fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0944147220 0x7f09441476a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38258/0 (socket says 172.21.15.114:38258) 2024-04-28T13:07:29.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.049+0000 7f09437fe640 1 -- 172.21.15.114:0/2630377794 learned_addr learned my addr 172.21.15.114:0/2630377794 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:29.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.049+0000 7f0942ffd640 1 --2- 172.21.15.114:0/2630377794 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0930004d40 0x7f0944157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:29.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.049+0000 7f093bfff640 1 --2- 172.21.15.114:0/2630377794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0944147e30 0x7f094415f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:29.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.049+0000 7f09437fe640 1 -- 172.21.15.114:0/2630377794 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0930004d40 msgr2=0x7f0944157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:29.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.049+0000 7f09437fe640 1 --2- 172.21.15.114:0/2630377794 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0930004d40 0x7f0944157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:29.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.049+0000 7f09437fe640 1 -- 172.21.15.114:0/2630377794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0944147e30 msgr2=0x7f094415f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:29.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.049+0000 7f09437fe640 1 --2- 172.21.15.114:0/2630377794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0944147e30 0x7f094415f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:29.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.049+0000 7f09437fe640 1 -- 172.21.15.114:0/2630377794 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0944162990 con 0x7f0944147220 2024-04-28T13:07:29.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.049+0000 7f093bfff640 1 --2- 172.21.15.114:0/2630377794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0944147e30 0x7f094415f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:07:29.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.049+0000 7f0942ffd640 1 --2- 172.21.15.114:0/2630377794 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0930004d40 0x7f0944157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:07:29.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.049+0000 7f09437fe640 1 --2- 172.21.15.114:0/2630377794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0944147220 0x7f09441476a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f093c033040 tx=0x7f093c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:29.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.049+0000 7f0940ff9640 1 -- 172.21.15.114:0/2630377794 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093c009c10 con 0x7f0944147220 2024-04-28T13:07:29.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.049+0000 7f0940ff9640 1 -- 172.21.15.114:0/2630377794 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f093c031df0 con 0x7f0944147220 2024-04-28T13:07:29.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.049+0000 7f094996a640 1 -- 172.21.15.114:0/2630377794 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0944158330 con 0x7f0944147220 2024-04-28T13:07:29.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.049+0000 7f0940ff9640 1 -- 172.21.15.114:0/2630377794 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093c003bd0 con 0x7f0944147220 2024-04-28T13:07:29.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.049+0000 7f094996a640 1 -- 172.21.15.114:0/2630377794 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09441623d0 con 0x7f0944147220 2024-04-28T13:07:29.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.050+0000 7f094996a640 1 -- 172.21.15.114:0/2630377794 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f094406a3d0 con 0x7f0944147220 2024-04-28T13:07:29.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.051+0000 7f0940ff9640 1 -- 172.21.15.114:0/2630377794 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f093c005d10 con 0x7f0944147220 2024-04-28T13:07:29.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.051+0000 7f0940ff9640 1 --2- 172.21.15.114:0/2630377794 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f092406c8f0 0x7f092406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:29.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.051+0000 7f0940ff9640 1 -- 172.21.15.114:0/2630377794 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f093c0acf60 con 0x7f0944147220 2024-04-28T13:07:29.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.051+0000 7f0942ffd640 1 --2- 172.21.15.114:0/2630377794 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f092406c8f0 0x7f092406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:29.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.051+0000 7f0942ffd640 1 --2- 172.21.15.114:0/2630377794 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f092406c8f0 0x7f092406edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0934003700 tx=0x7f0934009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:29.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.055+0000 7f0940ff9640 1 -- 172.21.15.114:0/2630377794 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f093c04a060 con 0x7f0944147220 2024-04-28T13:07:29.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.227+0000 7f094996a640 1 -- 172.21.15.114:0/2630377794 --> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f09440baec0 con 0x7f092406c8f0 2024-04-28T13:07:29.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.232+0000 7f0940ff9640 1 -- 172.21.15.114:0/2630377794 <== mgr.4104 v2:172.21.15.114:6832/2240257326 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237079 (secure 0 0 0) 0x7f09440baec0 con 0x7f092406c8f0 2024-04-28T13:07:29.236 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:29.237 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-04-28T13:07:29.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.235+0000 7f094996a640 1 -- 172.21.15.114:0/2630377794 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f092406c8f0 msgr2=0x7f092406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:29.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.235+0000 7f094996a640 1 --2- 172.21.15.114:0/2630377794 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f092406c8f0 0x7f092406edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0934003700 tx=0x7f0934009040 comp rx=0 tx=0).stop 2024-04-28T13:07:29.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.235+0000 7f094996a640 1 -- 172.21.15.114:0/2630377794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0944147220 msgr2=0x7f09441476a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:29.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.235+0000 7f094996a640 1 --2- 172.21.15.114:0/2630377794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0944147220 0x7f09441476a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f093c033040 tx=0x7f093c009750 comp rx=0 tx=0).stop 2024-04-28T13:07:29.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.235+0000 7f094996a640 1 -- 172.21.15.114:0/2630377794 shutdown_connections 2024-04-28T13:07:29.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.235+0000 7f094996a640 1 --2- 172.21.15.114:0/2630377794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0944147220 0x7f09441476a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:29.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.235+0000 7f094996a640 1 --2- 172.21.15.114:0/2630377794 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f092406c8f0 0x7f092406edb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:29.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.235+0000 7f094996a640 1 --2- 172.21.15.114:0/2630377794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0944147e30 0x7f094415f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:29.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.235+0000 7f094996a640 1 --2- 172.21.15.114:0/2630377794 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0930004d40 0x7f0944157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:29.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.235+0000 7f094996a640 1 -- 172.21.15.114:0/2630377794 >> 172.21.15.114:0/2630377794 conn(0x7f09440633a0 msgr2=0x7f09440b66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:29.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.235+0000 7f094996a640 1 -- 172.21.15.114:0/2630377794 shutdown_connections 2024-04-28T13:07:29.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.235+0000 7f094996a640 1 -- 172.21.15.114:0/2630377794 wait complete. 2024-04-28T13:07:29.247 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-28T13:07:28.707684+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219012,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755708,"statfs":{"total":773094113280,"available":772869844992,"internally_reserved":0,"allocated":2531328,"data_stored":1584240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.425736"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-28T13:07:17.424196+0000","last_change":"2024-04-28T13:07:16.698740+0000","last_active":"2024-04-28T13:07:17.424196+0000","last_peered":"2024-04-28T13:07:17.424196+0000","last_clean":"2024-04-28T13:07:17.424196+0000","last_became_active":"2024-04-28T13:07:16.696364+0000","last_became_peered":"2024-04-28T13:07:16.696364+0000","last_unstale":"2024-04-28T13:07:17.424196+0000","last_undegraded":"2024-04-28T13:07:17.424196+0000","last_fullsized":"2024-04-28T13:07:17.424196+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:14.770499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:14.770499+0000","last_clean_scrub_stamp":"2024-04-28T13:07:14.770499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:39:38.986133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-28T13:07:29.251 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-28T13:07:29.266 INFO:tasks.ceph.mds.a.smithi114.stderr:2024-04-28T13:07:29.265+0000 7f066aeb3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-28T13:07:29.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.361+0000 7f494d452640 1 Processor -- start 2024-04-28T13:07:29.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.361+0000 7f494d452640 1 -- start start 2024-04-28T13:07:29.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.362+0000 7f494d452640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4948069ca0 0x7f49480c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:29.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.362+0000 7f494d452640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f49480d1f00 0x7f49480ca020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:29.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.362+0000 7f494d452640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49480c8320 con 0x7f494815d610 2024-04-28T13:07:29.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.362+0000 7f494d452640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f49480c9650 con 0x7f49480d1f00 2024-04-28T13:07:29.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.362+0000 7f494d452640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f49480c85e0 con 0x7f4948069ca0 2024-04-28T13:07:29.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.362+0000 7f49477fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f49480d1f00 0x7f49480ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:29.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.362+0000 7f49477fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f49480d1f00 0x7f49480ca020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38264/0 (socket says 172.21.15.114:38264) 2024-04-28T13:07:29.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.362+0000 7f49477fe640 1 -- 172.21.15.114:0/575765859 learned_addr learned my addr 172.21.15.114:0/575765859 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:29.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.362+0000 7f49467fc640 1 --2- 172.21.15.114:0/575765859 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4948069ca0 0x7f49480c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:29.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.362+0000 7f49477fe640 1 -- 172.21.15.114:0/575765859 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4948069ca0 msgr2=0x7f49480c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:29.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.362+0000 7f49477fe640 1 --2- 172.21.15.114:0/575765859 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4948069ca0 0x7f49480c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:29.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.362+0000 7f49477fe640 1 -- 172.21.15.114:0/575765859 >> v1:172.21.15.134:6789/0 conn(0x7f494815d610 legacy=0x7f49480cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:29.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.362+0000 7f49477fe640 1 -- 172.21.15.114:0/575765859 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49480cba40 con 0x7f49480d1f00 2024-04-28T13:07:29.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.363+0000 7f49477fe640 1 --2- 172.21.15.114:0/575765859 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49480d1f00 0x7f49480ca020 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4938009870 tx=0x7f493802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc927a0776dfaa4 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:29.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.363+0000 7f4945ffb640 1 -- 172.21.15.114:0/575765859 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4938037070 con 0x7f49480d1f00 2024-04-28T13:07:29.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.363+0000 7f4945ffb640 1 -- 172.21.15.114:0/575765859 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4938032440 con 0x7f49480d1f00 2024-04-28T13:07:29.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.363+0000 7f4945ffb640 1 -- 172.21.15.114:0/575765859 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4938032810 con 0x7f49480d1f00 2024-04-28T13:07:29.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.364+0000 7f494d452640 1 -- 172.21.15.114:0/575765859 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49480d1f00 msgr2=0x7f49480ca020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:29.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.364+0000 7f494d452640 1 --2- 172.21.15.114:0/575765859 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49480d1f00 0x7f49480ca020 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4938009870 tx=0x7f493802a1c0 comp rx=0 tx=0).stop 2024-04-28T13:07:29.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.364+0000 7f494d452640 1 -- 172.21.15.114:0/575765859 shutdown_connections 2024-04-28T13:07:29.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.364+0000 7f494d452640 1 --2- 172.21.15.114:0/575765859 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4948069ca0 0x7f49480c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:29.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.364+0000 7f494d452640 1 --2- 172.21.15.114:0/575765859 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49480d1f00 0x7f49480ca020 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:29.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.364+0000 7f494d452640 1 -- 172.21.15.114:0/575765859 >> 172.21.15.114:0/575765859 conn(0x7f49480d1250 msgr2=0x7f49480d1660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:29.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.364+0000 7f494d452640 1 -- 172.21.15.114:0/575765859 shutdown_connections 2024-04-28T13:07:29.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.364+0000 7f494d452640 1 -- 172.21.15.114:0/575765859 wait complete. 2024-04-28T13:07:29.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.365+0000 7f494d452640 1 Processor -- start 2024-04-28T13:07:29.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.365+0000 7f494d452640 1 -- start start 2024-04-28T13:07:29.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.366+0000 7f494d452640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4948069ca0 0x7f49481f4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:29.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.366+0000 7f494d452640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49480d1f00 0x7f494809d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:29.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.366+0000 7f494d452640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f494815d610 0x7f494809d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:29.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.366+0000 7f494d452640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f494806d1c0 con 0x7f4948069ca0 2024-04-28T13:07:29.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.366+0000 7f494d452640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f494806d040 con 0x7f49480d1f00 2024-04-28T13:07:29.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.366+0000 7f494d452640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f49480cd750 con 0x7f494815d610 2024-04-28T13:07:29.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.366+0000 7f4946ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4948069ca0 0x7f49481f4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:29.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.366+0000 7f4946ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4948069ca0 0x7f49481f4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38266/0 (socket says 172.21.15.114:38266) 2024-04-28T13:07:29.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.366+0000 7f4946ffd640 1 -- 172.21.15.114:0/3383845568 learned_addr learned my addr 172.21.15.114:0/3383845568 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:29.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.366+0000 7f4946ffd640 1 -- 172.21.15.114:0/3383845568 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f494815d610 msgr2=0x7f494809d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:29.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.366+0000 7f4946ffd640 1 --2- 172.21.15.114:0/3383845568 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f494815d610 0x7f494809d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:29.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.366+0000 7f4946ffd640 1 -- 172.21.15.114:0/3383845568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49480d1f00 msgr2=0x7f494809d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:29.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.366+0000 7f49467fc640 1 --2- 172.21.15.114:0/3383845568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49480d1f00 0x7f494809d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:29.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.366+0000 7f4946ffd640 1 --2- 172.21.15.114:0/3383845568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49480d1f00 0x7f494809d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:29.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.366+0000 7f4946ffd640 1 -- 172.21.15.114:0/3383845568 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49481f4fd0 con 0x7f4948069ca0 2024-04-28T13:07:29.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.366+0000 7f49467fc640 1 --2- 172.21.15.114:0/3383845568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49480d1f00 0x7f494809d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:07:29.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.366+0000 7f4946ffd640 1 --2- 172.21.15.114:0/3383845568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4948069ca0 0x7f49481f4a90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f494000c760 tx=0x7f494000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:29.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.366+0000 7f493f7fe640 1 -- 172.21.15.114:0/3383845568 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4940016020 con 0x7f4948069ca0 2024-04-28T13:07:29.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.366+0000 7f493f7fe640 1 -- 172.21.15.114:0/3383845568 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4940006d50 con 0x7f4948069ca0 2024-04-28T13:07:29.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.366+0000 7f494d452640 1 -- 172.21.15.114:0/3383845568 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f494809e050 con 0x7f4948069ca0 2024-04-28T13:07:29.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.366+0000 7f493f7fe640 1 -- 172.21.15.114:0/3383845568 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4940003bb0 con 0x7f4948069ca0 2024-04-28T13:07:29.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.366+0000 7f494d452640 1 -- 172.21.15.114:0/3383845568 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f494809e610 con 0x7f4948069ca0 2024-04-28T13:07:29.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.367+0000 7f494d452640 1 -- 172.21.15.114:0/3383845568 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f494806a3d0 con 0x7f4948069ca0 2024-04-28T13:07:29.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.368+0000 7f493f7fe640 1 -- 172.21.15.114:0/3383845568 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f494000a850 con 0x7f4948069ca0 2024-04-28T13:07:29.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.368+0000 7f493f7fe640 1 --2- 172.21.15.114:0/3383845568 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f492806c8f0 0x7f492806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:29.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.368+0000 7f493f7fe640 1 -- 172.21.15.114:0/3383845568 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f494008b780 con 0x7f4948069ca0 2024-04-28T13:07:29.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.368+0000 7f49467fc640 1 --2- 172.21.15.114:0/3383845568 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f492806c8f0 0x7f492806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:29.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.369+0000 7f49467fc640 1 --2- 172.21.15.114:0/3383845568 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f492806c8f0 0x7f492806edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f49481f8620 tx=0x7f4930008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:29.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.373+0000 7f493f7fe640 1 -- 172.21.15.114:0/3383845568 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4940020020 con 0x7f4948069ca0 2024-04-28T13:07:29.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.544+0000 7f494d452640 1 -- 172.21.15.114:0/3383845568 --> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f494815cd40 con 0x7f492806c8f0 2024-04-28T13:07:29.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.549+0000 7f493f7fe640 1 -- 172.21.15.114:0/3383845568 <== mgr.4104 v2:172.21.15.114:6832/2240257326 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237079 (secure 0 0 0) 0x7f494815cd40 con 0x7f492806c8f0 2024-04-28T13:07:29.552 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:29.553 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-04-28T13:07:29.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.552+0000 7f494d452640 1 -- 172.21.15.114:0/3383845568 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f492806c8f0 msgr2=0x7f492806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:29.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.552+0000 7f494d452640 1 --2- 172.21.15.114:0/3383845568 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f492806c8f0 0x7f492806edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f49481f8620 tx=0x7f4930008040 comp rx=0 tx=0).stop 2024-04-28T13:07:29.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.552+0000 7f494d452640 1 -- 172.21.15.114:0/3383845568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4948069ca0 msgr2=0x7f49481f4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:29.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.552+0000 7f494d452640 1 --2- 172.21.15.114:0/3383845568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4948069ca0 0x7f49481f4a90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f494000c760 tx=0x7f494000cc20 comp rx=0 tx=0).stop 2024-04-28T13:07:29.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.552+0000 7f494d452640 1 -- 172.21.15.114:0/3383845568 shutdown_connections 2024-04-28T13:07:29.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.552+0000 7f494d452640 1 --2- 172.21.15.114:0/3383845568 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f494815d610 0x7f494809d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:29.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.552+0000 7f494d452640 1 --2- 172.21.15.114:0/3383845568 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f492806c8f0 0x7f492806edb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:29.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.552+0000 7f494d452640 1 --2- 172.21.15.114:0/3383845568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49480d1f00 0x7f494809d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:29.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.552+0000 7f494d452640 1 --2- 172.21.15.114:0/3383845568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4948069ca0 0x7f49481f4a90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:29.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.552+0000 7f494d452640 1 -- 172.21.15.114:0/3383845568 >> 172.21.15.114:0/3383845568 conn(0x7f49480d1250 msgr2=0x7f494806e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:29.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.552+0000 7f494d452640 1 -- 172.21.15.114:0/3383845568 shutdown_connections 2024-04-28T13:07:29.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.552+0000 7f494d452640 1 -- 172.21.15.114:0/3383845568 wait complete. 2024-04-28T13:07:29.563 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-28T13:07:28.707684+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219012,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755708,"statfs":{"total":773094113280,"available":772869844992,"internally_reserved":0,"allocated":2531328,"data_stored":1584240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.425736"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-28T13:07:17.424196+0000","last_change":"2024-04-28T13:07:16.698740+0000","last_active":"2024-04-28T13:07:17.424196+0000","last_peered":"2024-04-28T13:07:17.424196+0000","last_clean":"2024-04-28T13:07:17.424196+0000","last_became_active":"2024-04-28T13:07:16.696364+0000","last_became_peered":"2024-04-28T13:07:16.696364+0000","last_unstale":"2024-04-28T13:07:17.424196+0000","last_undegraded":"2024-04-28T13:07:17.424196+0000","last_fullsized":"2024-04-28T13:07:17.424196+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:14.770499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:14.770499+0000","last_clean_scrub_stamp":"2024-04-28T13:07:14.770499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:39:38.986133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-28T13:07:29.567 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-28T13:07:29.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.700+0000 7fa55e0fc640 1 Processor -- start 2024-04-28T13:07:29.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.700+0000 7fa55e0fc640 1 -- start start 2024-04-28T13:07:29.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.700+0000 7fa55e0fc640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5580b9790 0x7fa5580d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:29.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.701+0000 7fa55e0fc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5580b82a0 con 0x7fa5580b73a0 2024-04-28T13:07:29.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.701+0000 7fa55e0fc640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5580d4a00 con 0x7fa55815f3f0 2024-04-28T13:07:29.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.701+0000 7fa55e0fc640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fa55815f7d0 con 0x7fa5580b9790 2024-04-28T13:07:29.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.701+0000 7fa556ffd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa5580b73a0 0x7fa5580b3c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47056/0 (socket says 172.21.15.114:47056) 2024-04-28T13:07:29.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.701+0000 7fa556ffd640 1 -- 172.21.15.114:0/905427134 learned_addr learned my addr 172.21.15.114:0/905427134 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:29.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.701+0000 7fa5567fc640 1 -- 172.21.15.114:0/905427134 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3025704598 0 0) 0x7fa5580b82a0 con 0x7fa5580b73a0 2024-04-28T13:07:29.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.701+0000 7fa557fff640 1 --2- 172.21.15.114:0/905427134 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5580b9790 0x7fa5580d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:29.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.701+0000 7fa5567fc640 1 -- 172.21.15.114:0/905427134 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa540003520 con 0x7fa5580b73a0 2024-04-28T13:07:29.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.701+0000 7fa5567fc640 1 -- 172.21.15.114:0/905427134 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3602503408 0 0) 0x7fa540003520 con 0x7fa5580b73a0 2024-04-28T13:07:29.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.701+0000 7fa5567fc640 1 -- 172.21.15.114:0/905427134 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5580b9790 msgr2=0x7fa5580d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:29.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.701+0000 7fa5567fc640 1 --2- 172.21.15.114:0/905427134 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5580b9790 0x7fa5580d32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:29.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.701+0000 7fa5567fc640 1 -- 172.21.15.114:0/905427134 >> v1:172.21.15.134:6789/0 conn(0x7fa55815f3f0 legacy=0x7fa5580b6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:29.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.701+0000 7fa5567fc640 1 -- 172.21.15.114:0/905427134 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5580d3880 con 0x7fa5580b73a0 2024-04-28T13:07:29.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.701+0000 7fa5567fc640 1 -- 172.21.15.114:0/905427134 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7fa54c001670 con 0x7fa5580b73a0 2024-04-28T13:07:29.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.701+0000 7fa5567fc640 1 -- 172.21.15.114:0/905427134 >> v1:172.21.15.114:6789/0 conn(0x7fa5580b73a0 legacy=0x7fa5580b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:29.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.701+0000 7fa5567fc640 1 --2- 172.21.15.114:0/905427134 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5580b9790 0x7fa5400039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:29.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.701+0000 7fa5567fc640 1 --2- 172.21.15.114:0/905427134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa540003f60 0x7fa540004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:29.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.701+0000 7fa5567fc640 1 --2- 172.21.15.114:0/905427134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa540004d40 0x7fa5400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:29.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.701+0000 7fa5567fc640 1 -- 172.21.15.114:0/905427134 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa55815f7d0 con 0x7fa540004d40 2024-04-28T13:07:29.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.701+0000 7fa5567fc640 1 -- 172.21.15.114:0/905427134 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa54000baa0 con 0x7fa540003f60 2024-04-28T13:07:29.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.701+0000 7fa5567fc640 1 -- 172.21.15.114:0/905427134 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fa54000bca0 con 0x7fa5580b9790 2024-04-28T13:07:29.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.701+0000 7fa557fff640 1 --2- 172.21.15.114:0/905427134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa540004d40 0x7fa5400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:29.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.701+0000 7fa5577fe640 1 --2- 172.21.15.114:0/905427134 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5580b9790 0x7fa5400039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:29.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.701+0000 7fa556ffd640 1 --2- 172.21.15.114:0/905427134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa540003f60 0x7fa540004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:29.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.702+0000 7fa557fff640 1 -- 172.21.15.114:0/905427134 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5580b9790 msgr2=0x7fa5400039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:29.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.702+0000 7fa557fff640 1 --2- 172.21.15.114:0/905427134 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5580b9790 0x7fa5400039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:29.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.702+0000 7fa557fff640 1 -- 172.21.15.114:0/905427134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa540003f60 msgr2=0x7fa540004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:29.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.702+0000 7fa557fff640 1 --2- 172.21.15.114:0/905427134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa540003f60 0x7fa540004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:29.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.702+0000 7fa557fff640 1 -- 172.21.15.114:0/905427134 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa540003520 con 0x7fa540004d40 2024-04-28T13:07:29.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.702+0000 7fa556ffd640 1 --2- 172.21.15.114:0/905427134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa540003f60 0x7fa540004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:29.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.702+0000 7fa557fff640 1 --2- 172.21.15.114:0/905427134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa540004d40 0x7fa5400051c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa550009fc0 tx=0x7fa540005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e1c165173bf4bd server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:29.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.702+0000 7fa5567fc640 1 -- 172.21.15.114:0/905427134 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa550009c10 con 0x7fa540004d40 2024-04-28T13:07:29.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.702+0000 7fa5567fc640 1 -- 172.21.15.114:0/905427134 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa550036070 con 0x7fa540004d40 2024-04-28T13:07:29.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.702+0000 7fa5567fc640 1 -- 172.21.15.114:0/905427134 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa550031880 con 0x7fa540004d40 2024-04-28T13:07:29.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.703+0000 7fa55e0fc640 1 -- 172.21.15.114:0/905427134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa540004d40 msgr2=0x7fa5400051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:29.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.703+0000 7fa55e0fc640 1 --2- 172.21.15.114:0/905427134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa540004d40 0x7fa5400051c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa550009fc0 tx=0x7fa540005830 comp rx=0 tx=0).stop 2024-04-28T13:07:29.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.703+0000 7fa557fff640 1 -- 172.21.15.114:0/905427134 reap_dead start 2024-04-28T13:07:29.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.703+0000 7fa55e0fc640 1 -- 172.21.15.114:0/905427134 shutdown_connections 2024-04-28T13:07:29.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.703+0000 7fa55e0fc640 1 -- 172.21.15.114:0/905427134 >> 172.21.15.114:0/905427134 conn(0x7fa5580633a0 msgr2=0x7fa5580d1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:29.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.703+0000 7fa55e0fc640 1 -- 172.21.15.114:0/905427134 shutdown_connections 2024-04-28T13:07:29.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.703+0000 7fa55e0fc640 1 -- 172.21.15.114:0/905427134 wait complete. 2024-04-28T13:07:29.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.704+0000 7fa55e0fc640 1 Processor -- start 2024-04-28T13:07:29.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.704+0000 7fa55e0fc640 1 -- start start 2024-04-28T13:07:29.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.705+0000 7fa55e0fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5580cafb0 0x7fa5580cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:29.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.705+0000 7fa55e0fc640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5580ce2f0 0x7fa558158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:29.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.705+0000 7fa55e0fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa558158dd0 0x7fa55815a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:29.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.705+0000 7fa55e0fc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa5580d4120 con 0x7fa558158dd0 2024-04-28T13:07:29.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.705+0000 7fa55e0fc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa5580d3e40 con 0x7fa5580cafb0 2024-04-28T13:07:29.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.705+0000 7fa55e0fc640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fa5580d32a0 con 0x7fa5580ce2f0 2024-04-28T13:07:29.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.705+0000 7fa557fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa558158dd0 0x7fa55815a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:29.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.705+0000 7fa557fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa558158dd0 0x7fa55815a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38286/0 (socket says 172.21.15.114:38286) 2024-04-28T13:07:29.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.705+0000 7fa557fff640 1 -- 172.21.15.114:0/45007544 learned_addr learned my addr 172.21.15.114:0/45007544 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:29.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.705+0000 7fa5577fe640 1 --2- 172.21.15.114:0/45007544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5580cafb0 0x7fa5580cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:29.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.705+0000 7fa556ffd640 1 --2- 172.21.15.114:0/45007544 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5580ce2f0 0x7fa558158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:29.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.705+0000 7fa557fff640 1 -- 172.21.15.114:0/45007544 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5580ce2f0 msgr2=0x7fa558158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:29.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.705+0000 7fa557fff640 1 --2- 172.21.15.114:0/45007544 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5580ce2f0 0x7fa558158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:29.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.705+0000 7fa557fff640 1 -- 172.21.15.114:0/45007544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5580cafb0 msgr2=0x7fa5580cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:29.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.705+0000 7fa557fff640 1 --2- 172.21.15.114:0/45007544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5580cafb0 0x7fa5580cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:29.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.705+0000 7fa557fff640 1 -- 172.21.15.114:0/45007544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5580ce870 con 0x7fa558158dd0 2024-04-28T13:07:29.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.705+0000 7fa5577fe640 1 --2- 172.21.15.114:0/45007544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5580cafb0 0x7fa5580cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:29.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.705+0000 7fa556ffd640 1 --2- 172.21.15.114:0/45007544 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5580ce2f0 0x7fa558158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:29.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.705+0000 7fa557fff640 1 --2- 172.21.15.114:0/45007544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa558158dd0 0x7fa55815a9d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa55000e230 tx=0x7fa550009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:29.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.706+0000 7fa53ffff640 1 -- 172.21.15.114:0/45007544 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa550009c10 con 0x7fa558158dd0 2024-04-28T13:07:29.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.706+0000 7fa53ffff640 1 -- 172.21.15.114:0/45007544 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa550031dd0 con 0x7fa558158dd0 2024-04-28T13:07:29.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.706+0000 7fa55e0fc640 1 -- 172.21.15.114:0/45007544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5580ceb50 con 0x7fa558158dd0 2024-04-28T13:07:29.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.706+0000 7fa53ffff640 1 -- 172.21.15.114:0/45007544 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa550003bd0 con 0x7fa558158dd0 2024-04-28T13:07:29.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.706+0000 7fa55e0fc640 1 -- 172.21.15.114:0/45007544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa558156440 con 0x7fa558158dd0 2024-04-28T13:07:29.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.707+0000 7fa55e0fc640 1 -- 172.21.15.114:0/45007544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa558156640 con 0x7fa558158dd0 2024-04-28T13:07:29.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.707+0000 7fa53ffff640 1 -- 172.21.15.114:0/45007544 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa550005d10 con 0x7fa558158dd0 2024-04-28T13:07:29.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.707+0000 7fa53ffff640 1 --2- 172.21.15.114:0/45007544 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa54406c920 0x7fa54406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:29.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.707+0000 7fa53ffff640 1 -- 172.21.15.114:0/45007544 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa5500acd70 con 0x7fa558158dd0 2024-04-28T13:07:29.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.707+0000 7fa5577fe640 1 --2- 172.21.15.114:0/45007544 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa54406c920 0x7fa54406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:29.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.708+0000 7fa5577fe640 1 --2- 172.21.15.114:0/45007544 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa54406c920 0x7fa54406ede0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa5480036b0 tx=0x7fa548009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:29.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.712+0000 7fa53ffff640 1 -- 172.21.15.114:0/45007544 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa558156640 con 0x7fa558158dd0 2024-04-28T13:07:29.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.885+0000 7fa55e0fc640 1 -- 172.21.15.114:0/45007544 --> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa55806a3d0 con 0x7fa54406c920 2024-04-28T13:07:29.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.891+0000 7fa53ffff640 1 -- 172.21.15.114:0/45007544 <== mgr.4104 v2:172.21.15.114:6832/2240257326 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237079 (secure 0 0 0) 0x7fa55806a3d0 con 0x7fa54406c920 2024-04-28T13:07:29.894 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:29.895 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-04-28T13:07:29.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.894+0000 7fa55e0fc640 1 -- 172.21.15.114:0/45007544 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa54406c920 msgr2=0x7fa54406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:29.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.894+0000 7fa55e0fc640 1 --2- 172.21.15.114:0/45007544 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa54406c920 0x7fa54406ede0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa5480036b0 tx=0x7fa548009040 comp rx=0 tx=0).stop 2024-04-28T13:07:29.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.894+0000 7fa55e0fc640 1 -- 172.21.15.114:0/45007544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa558158dd0 msgr2=0x7fa55815a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:29.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.894+0000 7fa55e0fc640 1 --2- 172.21.15.114:0/45007544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa558158dd0 0x7fa55815a9d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa55000e230 tx=0x7fa550009750 comp rx=0 tx=0).stop 2024-04-28T13:07:29.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.894+0000 7fa55e0fc640 1 -- 172.21.15.114:0/45007544 shutdown_connections 2024-04-28T13:07:29.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.894+0000 7fa55e0fc640 1 --2- 172.21.15.114:0/45007544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa558158dd0 0x7fa55815a9d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:29.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.894+0000 7fa55e0fc640 1 --2- 172.21.15.114:0/45007544 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5580ce2f0 0x7fa558158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:29.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.894+0000 7fa55e0fc640 1 --2- 172.21.15.114:0/45007544 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa54406c920 0x7fa54406ede0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:29.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.894+0000 7fa55e0fc640 1 --2- 172.21.15.114:0/45007544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5580cafb0 0x7fa5580cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:29.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.894+0000 7fa55e0fc640 1 -- 172.21.15.114:0/45007544 >> 172.21.15.114:0/45007544 conn(0x7fa5580633a0 msgr2=0x7fa5580cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:29.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.894+0000 7fa55e0fc640 1 -- 172.21.15.114:0/45007544 shutdown_connections 2024-04-28T13:07:29.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:29.894+0000 7fa55e0fc640 1 -- 172.21.15.114:0/45007544 wait complete. 2024-04-28T13:07:29.905 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-28T13:07:28.707684+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219012,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755708,"statfs":{"total":773094113280,"available":772869844992,"internally_reserved":0,"allocated":2531328,"data_stored":1584240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.425736"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-28T13:07:17.424196+0000","last_change":"2024-04-28T13:07:16.698740+0000","last_active":"2024-04-28T13:07:17.424196+0000","last_peered":"2024-04-28T13:07:17.424196+0000","last_clean":"2024-04-28T13:07:17.424196+0000","last_became_active":"2024-04-28T13:07:16.696364+0000","last_became_peered":"2024-04-28T13:07:16.696364+0000","last_unstale":"2024-04-28T13:07:17.424196+0000","last_undegraded":"2024-04-28T13:07:17.424196+0000","last_fullsized":"2024-04-28T13:07:17.424196+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:14.770499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:14.770499+0000","last_clean_scrub_stamp":"2024-04-28T13:07:14.770499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:39:38.986133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-28T13:07:29.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2024-04-28T13:07:29.909 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3e is not active+clean 2024-04-28T13:07:29.909 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2024-04-28T13:07:29.909 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3c is not active+clean 2024-04-28T13:07:29.909 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2024-04-28T13:07:29.909 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2024-04-28T13:07:29.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2024-04-28T13:07:29.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.38 is not active+clean 2024-04-28T13:07:29.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.37 is not active+clean 2024-04-28T13:07:29.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2024-04-28T13:07:29.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.35 is not active+clean 2024-04-28T13:07:29.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.34 is not active+clean 2024-04-28T13:07:29.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.33 is not active+clean 2024-04-28T13:07:29.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.32 is not active+clean 2024-04-28T13:07:29.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.31 is not active+clean 2024-04-28T13:07:29.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.30 is not active+clean 2024-04-28T13:07:29.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2f is not active+clean 2024-04-28T13:07:29.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2e is not active+clean 2024-04-28T13:07:29.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2d is not active+clean 2024-04-28T13:07:29.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2c is not active+clean 2024-04-28T13:07:29.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2024-04-28T13:07:29.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2a is not active+clean 2024-04-28T13:07:29.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.29 is not active+clean 2024-04-28T13:07:29.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.28 is not active+clean 2024-04-28T13:07:29.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.27 is not active+clean 2024-04-28T13:07:29.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.26 is not active+clean 2024-04-28T13:07:29.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.25 is not active+clean 2024-04-28T13:07:29.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.24 is not active+clean 2024-04-28T13:07:29.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2024-04-28T13:07:29.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.22 is not active+clean 2024-04-28T13:07:29.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.21 is not active+clean 2024-04-28T13:07:29.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.20 is not active+clean 2024-04-28T13:07:29.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-04-28T13:07:29.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1b is not active+clean 2024-04-28T13:07:29.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-04-28T13:07:29.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1a is not active+clean 2024-04-28T13:07:29.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.19 is not active+clean 2024-04-28T13:07:29.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-04-28T13:07:29.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.18 is not active+clean 2024-04-28T13:07:29.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-04-28T13:07:29.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.17 is not active+clean 2024-04-28T13:07:29.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2024-04-28T13:07:29.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.16 is not active+clean 2024-04-28T13:07:29.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-04-28T13:07:29.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.15 is not active+clean 2024-04-28T13:07:29.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-04-28T13:07:29.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.14 is not active+clean 2024-04-28T13:07:29.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2024-04-28T13:07:29.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.13 is not active+clean 2024-04-28T13:07:29.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-04-28T13:07:29.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.12 is not active+clean 2024-04-28T13:07:29.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2024-04-28T13:07:29.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.11 is not active+clean 2024-04-28T13:07:29.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2024-04-28T13:07:29.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.10 is not active+clean 2024-04-28T13:07:29.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-04-28T13:07:29.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.f is not active+clean 2024-04-28T13:07:29.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2024-04-28T13:07:29.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.e is not active+clean 2024-04-28T13:07:29.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2024-04-28T13:07:29.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.d is not active+clean 2024-04-28T13:07:29.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2024-04-28T13:07:29.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.c is not active+clean 2024-04-28T13:07:29.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2024-04-28T13:07:29.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.3 is not active+clean 2024-04-28T13:07:29.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-04-28T13:07:29.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.0 is not active+clean 2024-04-28T13:07:29.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-04-28T13:07:29.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1 is not active+clean 2024-04-28T13:07:29.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-04-28T13:07:29.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.2 is not active+clean 2024-04-28T13:07:29.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-04-28T13:07:29.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.4 is not active+clean 2024-04-28T13:07:29.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.922 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2024-04-28T13:07:29.922 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.922 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.5 is not active+clean 2024-04-28T13:07:29.922 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.922 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2024-04-28T13:07:29.922 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.922 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.6 is not active+clean 2024-04-28T13:07:29.922 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.922 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-04-28T13:07:29.922 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.923 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.7 is not active+clean 2024-04-28T13:07:29.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.923 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-04-28T13:07:29.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.923 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.8 is not active+clean 2024-04-28T13:07:29.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.923 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-04-28T13:07:29.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.923 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.9 is not active+clean 2024-04-28T13:07:29.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.923 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-04-28T13:07:29.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.924 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.a is not active+clean 2024-04-28T13:07:29.924 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.924 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-04-28T13:07:29.924 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.924 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.b is not active+clean 2024-04-28T13:07:29.924 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.924 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2024-04-28T13:07:29.924 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.924 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2024-04-28T13:07:29.924 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.924 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1c is not active+clean 2024-04-28T13:07:29.924 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.925 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2024-04-28T13:07:29.925 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.925 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1d is not active+clean 2024-04-28T13:07:29.925 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.925 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-04-28T13:07:29.925 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.925 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1e is not active+clean 2024-04-28T13:07:29.925 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.925 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-04-28T13:07:29.925 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:25.279682+0000', 'last_change': '2024-04-28T13:07:25.279682+0000', 'last_active': '2024-04-28T13:07:25.279682+0000', 'last_peered': '2024-04-28T13:07:25.279682+0000', 'last_clean': '2024-04-28T13:07:25.279682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:25.279682+0000', 'last_undegraded': '2024-04-28T13:07:25.279682+0000', 'last_fullsized': '2024-04-28T13:07:25.279682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:25.279682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.925 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1f is not active+clean 2024-04-28T13:07:29.926 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:07:24.270280+0000', 'last_change': '2024-04-28T13:07:24.270280+0000', 'last_active': '2024-04-28T13:07:24.270280+0000', 'last_peered': '2024-04-28T13:07:24.270280+0000', 'last_clean': '2024-04-28T13:07:24.270280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:07:24.270280+0000', 'last_undegraded': '2024-04-28T13:07:24.270280+0000', 'last_fullsized': '2024-04-28T13:07:24.270280+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'last_clean_scrub_stamp': '2024-04-28T13:07:24.270280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:07:29.926 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-28T13:07:30.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.041+0000 7f04d5cb0640 1 Processor -- start 2024-04-28T13:07:30.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.041+0000 7f04d5cb0640 1 -- start start 2024-04-28T13:07:30.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.042+0000 7f04d5cb0640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04d00b9390 0x7f04d00b6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:30.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.042+0000 7f04d5cb0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f04d00b72b0 0x7f04d00d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:30.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.042+0000 7f04d5cb0640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04d00bb280 con 0x7f04d015f3c0 2024-04-28T13:07:30.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.042+0000 7f04d5cb0640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f04d00b7720 con 0x7f04d00b72b0 2024-04-28T13:07:30.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.042+0000 7f04d5cb0640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f04d00b9850 con 0x7f04d00b9390 2024-04-28T13:07:30.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.042+0000 7f04cffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f04d00b72b0 0x7f04d00d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:30.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.042+0000 7f04cffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f04d00b72b0 0x7f04d00d3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38294/0 (socket says 172.21.15.114:38294) 2024-04-28T13:07:30.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.042+0000 7f04cffff640 1 -- 172.21.15.114:0/2541481740 learned_addr learned my addr 172.21.15.114:0/2541481740 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:30.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.042+0000 7f04c7fff640 1 --2- 172.21.15.114:0/2541481740 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04d00b9390 0x7f04d00b6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:30.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.042+0000 7f04cffff640 1 -- 172.21.15.114:0/2541481740 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04d00b9390 msgr2=0x7f04d00b6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:30.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.042+0000 7f04cffff640 1 --2- 172.21.15.114:0/2541481740 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04d00b9390 0x7f04d00b6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:30.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.042+0000 7f04cffff640 1 -- 172.21.15.114:0/2541481740 >> v1:172.21.15.134:6789/0 conn(0x7f04d015f3c0 legacy=0x7f04d00bab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:30.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.042+0000 7f04cffff640 1 -- 172.21.15.114:0/2541481740 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d00b9b30 con 0x7f04d00b72b0 2024-04-28T13:07:30.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.043+0000 7f04cffff640 1 --2- 172.21.15.114:0/2541481740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04d00b72b0 0x7f04d00d3630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f04c8009e50 tx=0x7f04c802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=910bf9270df75a99 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:30.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.043+0000 7f04ceffd640 1 -- 172.21.15.114:0/2541481740 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c8036070 con 0x7f04d00b72b0 2024-04-28T13:07:30.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.043+0000 7f04ceffd640 1 -- 172.21.15.114:0/2541481740 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c8031600 con 0x7f04d00b72b0 2024-04-28T13:07:30.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.043+0000 7f04ceffd640 1 -- 172.21.15.114:0/2541481740 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c80319d0 con 0x7f04d00b72b0 2024-04-28T13:07:30.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.043+0000 7f04d5cb0640 1 -- 172.21.15.114:0/2541481740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04d00b72b0 msgr2=0x7f04d00d3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:30.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.043+0000 7f04d5cb0640 1 --2- 172.21.15.114:0/2541481740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04d00b72b0 0x7f04d00d3630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f04c8009e50 tx=0x7f04c802a6c0 comp rx=0 tx=0).stop 2024-04-28T13:07:30.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.043+0000 7f04d5cb0640 1 -- 172.21.15.114:0/2541481740 shutdown_connections 2024-04-28T13:07:30.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.043+0000 7f04d5cb0640 1 --2- 172.21.15.114:0/2541481740 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04d00b9390 0x7f04d00b6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:30.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.043+0000 7f04d5cb0640 1 --2- 172.21.15.114:0/2541481740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04d00b72b0 0x7f04d00d3630 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:30.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.043+0000 7f04d5cb0640 1 -- 172.21.15.114:0/2541481740 >> 172.21.15.114:0/2541481740 conn(0x7f04d0063190 msgr2=0x7f04d00635a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:30.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.043+0000 7f04d5cb0640 1 -- 172.21.15.114:0/2541481740 shutdown_connections 2024-04-28T13:07:30.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.043+0000 7f04d5cb0640 1 -- 172.21.15.114:0/2541481740 wait complete. 2024-04-28T13:07:30.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.044+0000 7f04d5cb0640 1 Processor -- start 2024-04-28T13:07:30.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.045+0000 7f04d5cb0640 1 -- start start 2024-04-28T13:07:30.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.045+0000 7f04d5cb0640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04d00b72b0 0x7f04d015c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:30.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.045+0000 7f04d5cb0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04d00b9390 0x7f04d0143690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:30.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.045+0000 7f04d5cb0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04d015f3c0 0x7f04d01f3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:30.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.045+0000 7f04d5cb0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f04d00ba3d0 con 0x7f04d00b9390 2024-04-28T13:07:30.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.045+0000 7f04d5cb0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f04d00ba0f0 con 0x7f04d015f3c0 2024-04-28T13:07:30.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.045+0000 7f04d5cb0640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f04d015f7a0 con 0x7f04d00b72b0 2024-04-28T13:07:30.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.045+0000 7f04c7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04d00b9390 0x7f04d0143690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:30.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.045+0000 7f04c7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04d00b9390 0x7f04d0143690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38298/0 (socket says 172.21.15.114:38298) 2024-04-28T13:07:30.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.045+0000 7f04c7fff640 1 -- 172.21.15.114:0/1013315363 learned_addr learned my addr 172.21.15.114:0/1013315363 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:30.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.045+0000 7f04cf7fe640 1 --2- 172.21.15.114:0/1013315363 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04d00b72b0 0x7f04d015c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:30.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.045+0000 7f04cffff640 1 --2- 172.21.15.114:0/1013315363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04d015f3c0 0x7f04d01f3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:30.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.046+0000 7f04c7fff640 1 -- 172.21.15.114:0/1013315363 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04d00b72b0 msgr2=0x7f04d015c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:30.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.046+0000 7f04c7fff640 1 --2- 172.21.15.114:0/1013315363 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04d00b72b0 0x7f04d015c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:30.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.046+0000 7f04c7fff640 1 -- 172.21.15.114:0/1013315363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04d015f3c0 msgr2=0x7f04d01f3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:30.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.046+0000 7f04c7fff640 1 --2- 172.21.15.114:0/1013315363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04d015f3c0 0x7f04d01f3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:30.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.046+0000 7f04c7fff640 1 -- 172.21.15.114:0/1013315363 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d0144150 con 0x7f04d00b9390 2024-04-28T13:07:30.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.046+0000 7f04c7fff640 1 --2- 172.21.15.114:0/1013315363 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04d00b9390 0x7f04d0143690 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f04b800c7f0 tx=0x7f04b800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:30.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.046+0000 7f04ccff9640 1 -- 172.21.15.114:0/1013315363 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b8015070 con 0x7f04d00b9390 2024-04-28T13:07:30.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.046+0000 7f04ccff9640 1 -- 172.21.15.114:0/1013315363 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04b8004240 con 0x7f04d00b9390 2024-04-28T13:07:30.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.046+0000 7f04d5cb0640 1 -- 172.21.15.114:0/1013315363 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04d0144430 con 0x7f04d00b9390 2024-04-28T13:07:30.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.046+0000 7f04ccff9640 1 -- 172.21.15.114:0/1013315363 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b8007620 con 0x7f04d00b9390 2024-04-28T13:07:30.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.046+0000 7f04d5cb0640 1 -- 172.21.15.114:0/1013315363 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04d0141af0 con 0x7f04d00b9390 2024-04-28T13:07:30.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.047+0000 7f04d5cb0640 1 -- 172.21.15.114:0/1013315363 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04d006a3d0 con 0x7f04d00b9390 2024-04-28T13:07:30.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.047+0000 7f04ccff9640 1 -- 172.21.15.114:0/1013315363 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f04b80079d0 con 0x7f04d00b9390 2024-04-28T13:07:30.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.048+0000 7f04ccff9640 1 --2- 172.21.15.114:0/1013315363 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f04b006c8f0 0x7f04b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:30.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.048+0000 7f04ccff9640 1 -- 172.21.15.114:0/1013315363 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f04b808bf60 con 0x7f04d00b9390 2024-04-28T13:07:30.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.048+0000 7f04cf7fe640 1 --2- 172.21.15.114:0/1013315363 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f04b006c8f0 0x7f04b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:30.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.048+0000 7f04cf7fe640 1 --2- 172.21.15.114:0/1013315363 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f04b006c8f0 0x7f04b006edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f04c0006fd0 tx=0x7f04c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:30.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.052+0000 7f04ccff9640 1 -- 172.21.15.114:0/1013315363 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f04b805a390 con 0x7f04d00b9390 2024-04-28T13:07:30.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.293+0000 7f04d5cb0640 1 -- 172.21.15.114:0/1013315363 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f04d006c350 con 0x7f04d00b9390 2024-04-28T13:07:30.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.294+0000 7f04ccff9640 1 -- 172.21.15.114:0/1013315363 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1021 (secure 0 0 0) 0x7f04b8059c90 con 0x7f04d00b9390 2024-04-28T13:07:30.295 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:30.295 INFO:teuthology.orchestra.run.smithi114.stdout:{"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1714309632,"num_in_osds":8,"osd_in_since":1714309623,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":224268288,"bytes_avail":772869844992,"bytes_total":773094113280,"unknown_pgs_ratio":0.98969072103500366},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4284}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-04-28T13:07:00.626564+0000","services":{}},"progress_events":{}} 2024-04-28T13:07:30.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.295+0000 7f04d5cb0640 1 -- 172.21.15.114:0/1013315363 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f04b006c8f0 msgr2=0x7f04b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:30.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.295+0000 7f04d5cb0640 1 --2- 172.21.15.114:0/1013315363 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f04b006c8f0 0x7f04b006edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f04c0006fd0 tx=0x7f04c0008040 comp rx=0 tx=0).stop 2024-04-28T13:07:30.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.295+0000 7f04d5cb0640 1 -- 172.21.15.114:0/1013315363 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04d00b9390 msgr2=0x7f04d0143690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:30.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.295+0000 7f04d5cb0640 1 --2- 172.21.15.114:0/1013315363 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04d00b9390 0x7f04d0143690 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f04b800c7f0 tx=0x7f04b800ccb0 comp rx=0 tx=0).stop 2024-04-28T13:07:30.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.295+0000 7f04d5cb0640 1 -- 172.21.15.114:0/1013315363 shutdown_connections 2024-04-28T13:07:30.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.295+0000 7f04d5cb0640 1 --2- 172.21.15.114:0/1013315363 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f04b006c8f0 0x7f04b006edb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:30.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.295+0000 7f04d5cb0640 1 --2- 172.21.15.114:0/1013315363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04d015f3c0 0x7f04d01f3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:30.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.295+0000 7f04d5cb0640 1 --2- 172.21.15.114:0/1013315363 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04d00b9390 0x7f04d0143690 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:30.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.295+0000 7f04d5cb0640 1 --2- 172.21.15.114:0/1013315363 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04d00b72b0 0x7f04d015c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:30.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.296+0000 7f04d5cb0640 1 -- 172.21.15.114:0/1013315363 >> 172.21.15.114:0/1013315363 conn(0x7f04d0063190 msgr2=0x7f04d015abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:30.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.296+0000 7f04d5cb0640 1 -- 172.21.15.114:0/1013315363 shutdown_connections 2024-04-28T13:07:30.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.296+0000 7f04d5cb0640 1 -- 172.21.15.114:0/1013315363 wait complete. 2024-04-28T13:07:30.307 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-28T13:07:30.307 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-28T13:07:30.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.402+0000 7f21a5474640 1 Processor -- start 2024-04-28T13:07:30.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.402+0000 7f21a5474640 1 -- start start 2024-04-28T13:07:30.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.403+0000 7f21a5474640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f21a015f410 0x7f21a00baaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:30.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.403+0000 7f21a5474640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21a00d3650 con 0x7f21a00b4380 2024-04-28T13:07:30.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.403+0000 7f21a5474640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21a015f7f0 con 0x7f21a00d0670 2024-04-28T13:07:30.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.403+0000 7f21a5474640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f21a00d3f10 con 0x7f21a015f410 2024-04-28T13:07:30.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.403+0000 7f219effd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f21a015f410 0x7f21a00baaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:30.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.403+0000 7f219e7fc640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f21a00b4380 0x7f21a00cff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47072/0 (socket says 172.21.15.114:47072) 2024-04-28T13:07:30.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.403+0000 7f219e7fc640 1 -- 172.21.15.114:0/2310384959 learned_addr learned my addr 172.21.15.114:0/2310384959 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:30.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.403+0000 7f219effd640 1 -- 172.21.15.114:0/2310384959 >> v1:172.21.15.134:6789/0 conn(0x7f21a00d0670 legacy=0x7f21a00d43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:30.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.403+0000 7f219effd640 1 -- 172.21.15.114:0/2310384959 >> v1:172.21.15.114:6789/0 conn(0x7f21a00b4380 legacy=0x7f21a00cff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:30.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.403+0000 7f219dffb640 1 -- 172.21.15.114:0/2310384959 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 64068175 0 0) 0x7f21a00d3650 con 0x7f21a00b4380 2024-04-28T13:07:30.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.403+0000 7f219effd640 1 -- 172.21.15.114:0/2310384959 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a00d2570 con 0x7f21a015f410 2024-04-28T13:07:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.404+0000 7f219effd640 1 --2- 172.21.15.114:0/2310384959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21a015f410 0x7f21a00baaf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f21a015f9c0 tx=0x7f219002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ebe9541e97a5974 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.404+0000 7f219dffb640 1 -- 172.21.15.114:0/2310384959 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2190037070 con 0x7f21a015f410 2024-04-28T13:07:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.404+0000 7f219dffb640 1 -- 172.21.15.114:0/2310384959 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2190032440 con 0x7f21a015f410 2024-04-28T13:07:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.404+0000 7f219dffb640 1 -- 172.21.15.114:0/2310384959 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2190032810 con 0x7f21a015f410 2024-04-28T13:07:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.404+0000 7f21a5474640 1 -- 172.21.15.114:0/2310384959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21a015f410 msgr2=0x7f21a00baaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.404+0000 7f21a5474640 1 --2- 172.21.15.114:0/2310384959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21a015f410 0x7f21a00baaf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f21a015f9c0 tx=0x7f219002a270 comp rx=0 tx=0).stop 2024-04-28T13:07:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.405+0000 7f21a5474640 1 -- 172.21.15.114:0/2310384959 shutdown_connections 2024-04-28T13:07:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.405+0000 7f21a5474640 1 --2- 172.21.15.114:0/2310384959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21a015f410 0x7f21a00baaf0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.405+0000 7f21a5474640 1 -- 172.21.15.114:0/2310384959 >> 172.21.15.114:0/2310384959 conn(0x7f21a00633a0 msgr2=0x7f21a00d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.405+0000 7f21a5474640 1 -- 172.21.15.114:0/2310384959 shutdown_connections 2024-04-28T13:07:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.405+0000 7f21a5474640 1 -- 172.21.15.114:0/2310384959 wait complete. 2024-04-28T13:07:30.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.406+0000 7f21a5474640 1 Processor -- start 2024-04-28T13:07:30.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.406+0000 7f21a5474640 1 -- start start 2024-04-28T13:07:30.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.407+0000 7f21a5474640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21a00b4380 0x7f21a0152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:30.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.407+0000 7f21a5474640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21a00d0670 0x7f21a00abc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:30.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.407+0000 7f21a5474640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21a015f410 0x7f21a00ac160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:30.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.407+0000 7f21a5474640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f21a00bb180 con 0x7f21a00b4380 2024-04-28T13:07:30.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.407+0000 7f21a5474640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f21a00d3ba0 con 0x7f21a00d0670 2024-04-28T13:07:30.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.407+0000 7f21a5474640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f21a00b8300 con 0x7f21a015f410 2024-04-28T13:07:30.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.407+0000 7f219effd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21a00b4380 0x7f21a0152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:30.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.407+0000 7f219effd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21a00b4380 0x7f21a0152770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38324/0 (socket says 172.21.15.114:38324) 2024-04-28T13:07:30.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.407+0000 7f219effd640 1 -- 172.21.15.114:0/1779282520 learned_addr learned my addr 172.21.15.114:0/1779282520 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:30.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.407+0000 7f219f7fe640 1 --2- 172.21.15.114:0/1779282520 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21a015f410 0x7f21a00ac160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:30.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.407+0000 7f219effd640 1 -- 172.21.15.114:0/1779282520 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21a015f410 msgr2=0x7f21a00ac160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:30.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.407+0000 7f219effd640 1 --2- 172.21.15.114:0/1779282520 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21a015f410 0x7f21a00ac160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:30.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.407+0000 7f219e7fc640 1 --2- 172.21.15.114:0/1779282520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21a00d0670 0x7f21a00abc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:30.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.407+0000 7f219effd640 1 -- 172.21.15.114:0/1779282520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21a00d0670 msgr2=0x7f21a00abc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:30.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.407+0000 7f219effd640 1 --2- 172.21.15.114:0/1779282520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21a00d0670 0x7f21a00abc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:30.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.407+0000 7f219effd640 1 -- 172.21.15.114:0/1779282520 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a00cb710 con 0x7f21a00b4380 2024-04-28T13:07:30.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.407+0000 7f219f7fe640 1 --2- 172.21.15.114:0/1779282520 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21a015f410 0x7f21a00ac160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:07:30.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.407+0000 7f219e7fc640 1 --2- 172.21.15.114:0/1779282520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21a00d0670 0x7f21a00abc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:07:30.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.407+0000 7f219effd640 1 --2- 172.21.15.114:0/1779282520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21a00b4380 0x7f21a0152770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2190035040 tx=0x7f21900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:30.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.407+0000 7f21877fe640 1 -- 172.21.15.114:0/1779282520 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2190037040 con 0x7f21a00b4380 2024-04-28T13:07:30.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.407+0000 7f21877fe640 1 -- 172.21.15.114:0/1779282520 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2190004230 con 0x7f21a00b4380 2024-04-28T13:07:30.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.407+0000 7f21877fe640 1 -- 172.21.15.114:0/1779282520 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2190032e20 con 0x7f21a00b4380 2024-04-28T13:07:30.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.407+0000 7f21a5474640 1 -- 172.21.15.114:0/1779282520 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21a00cb9f0 con 0x7f21a00b4380 2024-04-28T13:07:30.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.407+0000 7f21a5474640 1 -- 172.21.15.114:0/1779282520 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21a0161ba0 con 0x7f21a00b4380 2024-04-28T13:07:30.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.408+0000 7f21a5474640 1 -- 172.21.15.114:0/1779282520 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21a006a3d0 con 0x7f21a00b4380 2024-04-28T13:07:30.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.409+0000 7f21877fe640 1 -- 172.21.15.114:0/1779282520 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2190030770 con 0x7f21a00b4380 2024-04-28T13:07:30.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.409+0000 7f21877fe640 1 --2- 172.21.15.114:0/1779282520 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f218c06c8f0 0x7f218c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:30.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.410+0000 7f21877fe640 1 -- 172.21.15.114:0/1779282520 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f21900ad690 con 0x7f21a00b4380 2024-04-28T13:07:30.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.410+0000 7f219e7fc640 1 --2- 172.21.15.114:0/1779282520 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f218c06c8f0 0x7f218c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:30.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.410+0000 7f219e7fc640 1 --2- 172.21.15.114:0/1779282520 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f218c06c8f0 0x7f218c06edb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f21a015e7b0 tx=0x7f2194009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:30.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.413+0000 7f21877fe640 1 -- 172.21.15.114:0/1779282520 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f219007bcc0 con 0x7f21a00b4380 2024-04-28T13:07:30.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.583+0000 7f21a5474640 1 -- 172.21.15.114:0/1779282520 --> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f21a0161e30 con 0x7f218c06c8f0 2024-04-28T13:07:30.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.588+0000 7f21877fe640 1 -- 172.21.15.114:0/1779282520 <== mgr.4104 v2:172.21.15.114:6832/2240257326 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237079 (secure 0 0 0) 0x7f21a0161e30 con 0x7f218c06c8f0 2024-04-28T13:07:30.591 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:30.592 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-04-28T13:07:30.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.591+0000 7f21a5474640 1 -- 172.21.15.114:0/1779282520 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f218c06c8f0 msgr2=0x7f218c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:30.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.591+0000 7f21a5474640 1 --2- 172.21.15.114:0/1779282520 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f218c06c8f0 0x7f218c06edb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f21a015e7b0 tx=0x7f2194009040 comp rx=0 tx=0).stop 2024-04-28T13:07:30.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.591+0000 7f21a5474640 1 -- 172.21.15.114:0/1779282520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21a00b4380 msgr2=0x7f21a0152770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:30.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.591+0000 7f21a5474640 1 --2- 172.21.15.114:0/1779282520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21a00b4380 0x7f21a0152770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2190035040 tx=0x7f21900046c0 comp rx=0 tx=0).stop 2024-04-28T13:07:30.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.591+0000 7f21a5474640 1 -- 172.21.15.114:0/1779282520 shutdown_connections 2024-04-28T13:07:30.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.591+0000 7f21a5474640 1 --2- 172.21.15.114:0/1779282520 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21a015f410 0x7f21a00ac160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:30.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.591+0000 7f21a5474640 1 --2- 172.21.15.114:0/1779282520 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f218c06c8f0 0x7f218c06edb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:30.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.591+0000 7f21a5474640 1 --2- 172.21.15.114:0/1779282520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21a00d0670 0x7f21a00abc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:30.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.591+0000 7f21a5474640 1 --2- 172.21.15.114:0/1779282520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21a00b4380 0x7f21a0152770 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:30.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.591+0000 7f21a5474640 1 -- 172.21.15.114:0/1779282520 >> 172.21.15.114:0/1779282520 conn(0x7f21a00633a0 msgr2=0x7f21a00d43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:30.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.591+0000 7f21a5474640 1 -- 172.21.15.114:0/1779282520 shutdown_connections 2024-04-28T13:07:30.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:30.591+0000 7f21a5474640 1 -- 172.21.15.114:0/1779282520 wait complete. 2024-04-28T13:07:30.603 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-28T13:07:28.707684+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219012,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755708,"statfs":{"total":773094113280,"available":772869844992,"internally_reserved":0,"allocated":2531328,"data_stored":1584240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.425736"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-28T13:07:17.424196+0000","last_change":"2024-04-28T13:07:16.698740+0000","last_active":"2024-04-28T13:07:17.424196+0000","last_peered":"2024-04-28T13:07:17.424196+0000","last_clean":"2024-04-28T13:07:17.424196+0000","last_became_active":"2024-04-28T13:07:16.696364+0000","last_became_peered":"2024-04-28T13:07:16.696364+0000","last_unstale":"2024-04-28T13:07:17.424196+0000","last_undegraded":"2024-04-28T13:07:17.424196+0000","last_fullsized":"2024-04-28T13:07:17.424196+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:14.770499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:14.770499+0000","last_clean_scrub_stamp":"2024-04-28T13:07:14.770499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:39:38.986133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:25.279682+0000","last_change":"2024-04-28T13:07:25.279682+0000","last_active":"2024-04-28T13:07:25.279682+0000","last_peered":"2024-04-28T13:07:25.279682+0000","last_clean":"2024-04-28T13:07:25.279682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:25.279682+0000","last_undegraded":"2024-04-28T13:07:25.279682+0000","last_fullsized":"2024-04-28T13:07:25.279682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:07:24.270280+0000","last_change":"2024-04-28T13:07:24.270280+0000","last_active":"2024-04-28T13:07:24.270280+0000","last_peered":"2024-04-28T13:07:24.270280+0000","last_clean":"2024-04-28T13:07:24.270280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:07:24.270280+0000","last_undegraded":"2024-04-28T13:07:24.270280+0000","last_fullsized":"2024-04-28T13:07:24.270280+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-28T13:07:33.606 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-28T13:07:33.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.714+0000 7f79c7ec5640 1 Processor -- start 2024-04-28T13:07:33.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.715+0000 7f79c7ec5640 1 -- start start 2024-04-28T13:07:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.715+0000 7f79c7ec5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f79c00cdfa0 0x7f79c00ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.715+0000 7f79c7ec5640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79c0146fe0 con 0x7f79c0146c00 2024-04-28T13:07:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.715+0000 7f79c7ec5640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79c0073440 con 0x7f79c015eb10 2024-04-28T13:07:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.715+0000 7f79c7ec5640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f79c00cf390 con 0x7f79c00cdfa0 2024-04-28T13:07:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.716+0000 7f79c6462640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f79c00cdfa0 0x7f79c00ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.716+0000 7f79c5c61640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f79c0146c00 0x7f79c015e390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46804/0 (socket says 172.21.15.114:46804) 2024-04-28T13:07:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.716+0000 7f79c5c61640 1 -- 172.21.15.114:0/4259586808 learned_addr learned my addr 172.21.15.114:0/4259586808 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.716+0000 7f79c6462640 1 -- 172.21.15.114:0/4259586808 >> v1:172.21.15.134:6789/0 conn(0x7f79c015eb10 legacy=0x7f79c00cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.716+0000 7f79c6462640 1 -- 172.21.15.114:0/4259586808 >> v1:172.21.15.114:6789/0 conn(0x7f79c0146c00 legacy=0x7f79c015e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.716+0000 7f79c4c5f640 1 -- 172.21.15.114:0/4259586808 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3766038562 0 0) 0x7f79bc001110 con 0x7f79c0146c00 2024-04-28T13:07:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.716+0000 7f79c6462640 1 -- 172.21.15.114:0/4259586808 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c00cf670 con 0x7f79c00cdfa0 2024-04-28T13:07:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.717+0000 7f79c6462640 1 --2- 172.21.15.114:0/4259586808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79c00cdfa0 0x7f79c00ced60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f79b8009d90 tx=0x7f79b802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c37772dea054b7b server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:33.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.717+0000 7f79c4c5f640 1 -- 172.21.15.114:0/4259586808 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b8007740 con 0x7f79c00cdfa0 2024-04-28T13:07:33.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.717+0000 7f79c4c5f640 1 -- 172.21.15.114:0/4259586808 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79b80078e0 con 0x7f79c00cdfa0 2024-04-28T13:07:33.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.717+0000 7f79c4c5f640 1 -- 172.21.15.114:0/4259586808 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b8007cb0 con 0x7f79c00cdfa0 2024-04-28T13:07:33.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.717+0000 7f79c7ec5640 1 -- 172.21.15.114:0/4259586808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79c00cdfa0 msgr2=0x7f79c00ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:33.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.717+0000 7f79c7ec5640 1 --2- 172.21.15.114:0/4259586808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79c00cdfa0 0x7f79c00ced60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f79b8009d90 tx=0x7f79b802a6a0 comp rx=0 tx=0).stop 2024-04-28T13:07:33.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.717+0000 7f79c7ec5640 1 -- 172.21.15.114:0/4259586808 shutdown_connections 2024-04-28T13:07:33.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.717+0000 7f79c7ec5640 1 --2- 172.21.15.114:0/4259586808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79c00cdfa0 0x7f79c00ced60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:33.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.717+0000 7f79c7ec5640 1 -- 172.21.15.114:0/4259586808 >> 172.21.15.114:0/4259586808 conn(0x7f79c006c980 msgr2=0x7f79c00b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:33.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.717+0000 7f79c7ec5640 1 -- 172.21.15.114:0/4259586808 shutdown_connections 2024-04-28T13:07:33.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.717+0000 7f79c7ec5640 1 -- 172.21.15.114:0/4259586808 wait complete. 2024-04-28T13:07:33.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.719+0000 7f79c7ec5640 1 Processor -- start 2024-04-28T13:07:33.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.719+0000 7f79c7ec5640 1 -- start start 2024-04-28T13:07:33.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.719+0000 7f79c7ec5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79c00cdfa0 0x7f79c0144370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:33.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.719+0000 7f79c7ec5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79c0146c00 0x7f79c013e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:33.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.719+0000 7f79c7ec5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79c015eb10 0x7f79c00c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:33.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.719+0000 7f79c7ec5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f79c0073920 con 0x7f79c0146c00 2024-04-28T13:07:33.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.719+0000 7f79c7ec5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f79c00cfc30 con 0x7f79c015eb10 2024-04-28T13:07:33.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.719+0000 7f79c7ec5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f79c0073aa0 con 0x7f79c00cdfa0 2024-04-28T13:07:33.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.719+0000 7f79c5460640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79c0146c00 0x7f79c013e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:33.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.719+0000 7f79c5460640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79c0146c00 0x7f79c013e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47950/0 (socket says 172.21.15.114:47950) 2024-04-28T13:07:33.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.719+0000 7f79c5460640 1 -- 172.21.15.114:0/3122724377 learned_addr learned my addr 172.21.15.114:0/3122724377 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:33.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.720+0000 7f79c5c61640 1 --2- 172.21.15.114:0/3122724377 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79c00cdfa0 0x7f79c0144370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:33.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.720+0000 7f79c6462640 1 --2- 172.21.15.114:0/3122724377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79c015eb10 0x7f79c00c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:33.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.720+0000 7f79c5460640 1 -- 172.21.15.114:0/3122724377 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79c00cdfa0 msgr2=0x7f79c0144370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:33.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.720+0000 7f79c5460640 1 --2- 172.21.15.114:0/3122724377 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79c00cdfa0 0x7f79c0144370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:33.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.720+0000 7f79c5460640 1 -- 172.21.15.114:0/3122724377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79c015eb10 msgr2=0x7f79c00c5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:33.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.720+0000 7f79c5460640 1 --2- 172.21.15.114:0/3122724377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79c015eb10 0x7f79c00c5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:33.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.720+0000 7f79c5460640 1 -- 172.21.15.114:0/3122724377 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c013f2b0 con 0x7f79c0146c00 2024-04-28T13:07:33.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.720+0000 7f79c5c61640 1 --2- 172.21.15.114:0/3122724377 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79c00cdfa0 0x7f79c0144370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:07:33.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.720+0000 7f79c6462640 1 --2- 172.21.15.114:0/3122724377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79c015eb10 0x7f79c00c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:07:33.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.720+0000 7f79c5460640 1 --2- 172.21.15.114:0/3122724377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79c0146c00 0x7f79c013e990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f79b000b3f0 tx=0x7f79b000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:33.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.720+0000 7f79b67fc640 1 -- 172.21.15.114:0/3122724377 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b0015020 con 0x7f79c0146c00 2024-04-28T13:07:33.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.720+0000 7f79b67fc640 1 -- 172.21.15.114:0/3122724377 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79b0011830 con 0x7f79c0146c00 2024-04-28T13:07:33.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.720+0000 7f79c7ec5640 1 -- 172.21.15.114:0/3122724377 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79c0143890 con 0x7f79c0146c00 2024-04-28T13:07:33.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.720+0000 7f79b67fc640 1 -- 172.21.15.114:0/3122724377 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b0011c20 con 0x7f79c0146c00 2024-04-28T13:07:33.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.720+0000 7f79c7ec5640 1 -- 172.21.15.114:0/3122724377 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79c0145bc0 con 0x7f79c0146c00 2024-04-28T13:07:33.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.721+0000 7f79c7ec5640 1 -- 172.21.15.114:0/3122724377 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79c006a3d0 con 0x7f79c0146c00 2024-04-28T13:07:33.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.721+0000 7f79b67fc640 1 -- 172.21.15.114:0/3122724377 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f79b0018020 con 0x7f79c0146c00 2024-04-28T13:07:33.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.722+0000 7f79b67fc640 1 --2- 172.21.15.114:0/3122724377 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f79a406c8f0 0x7f79a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:33.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.722+0000 7f79c5c61640 1 --2- 172.21.15.114:0/3122724377 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f79a406c8f0 0x7f79a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:33.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.722+0000 7f79b67fc640 1 -- 172.21.15.114:0/3122724377 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f79b008b830 con 0x7f79c0146c00 2024-04-28T13:07:33.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.722+0000 7f79c5c61640 1 --2- 172.21.15.114:0/3122724377 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f79a406c8f0 0x7f79a406edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f79bc0013b0 tx=0x7f79bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:33.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.726+0000 7f79b67fc640 1 -- 172.21.15.114:0/3122724377 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f79b001f030 con 0x7f79c0146c00 2024-04-28T13:07:33.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.898+0000 7f79c7ec5640 1 -- 172.21.15.114:0/3122724377 --> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f79c013f060 con 0x7f79a406c8f0 2024-04-28T13:07:33.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.904+0000 7f79b67fc640 1 -- 172.21.15.114:0/3122724377 <== mgr.4104 v2:172.21.15.114:6832/2240257326 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251946 (secure 0 0 0) 0x7f79c013f060 con 0x7f79a406c8f0 2024-04-28T13:07:33.908 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:33.909 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-04-28T13:07:33.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.907+0000 7f79c7ec5640 1 -- 172.21.15.114:0/3122724377 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f79a406c8f0 msgr2=0x7f79a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:33.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.907+0000 7f79c7ec5640 1 --2- 172.21.15.114:0/3122724377 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f79a406c8f0 0x7f79a406edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f79bc0013b0 tx=0x7f79bc009040 comp rx=0 tx=0).stop 2024-04-28T13:07:33.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.907+0000 7f79c7ec5640 1 -- 172.21.15.114:0/3122724377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79c0146c00 msgr2=0x7f79c013e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:33.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.907+0000 7f79c7ec5640 1 --2- 172.21.15.114:0/3122724377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79c0146c00 0x7f79c013e990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f79b000b3f0 tx=0x7f79b000b8b0 comp rx=0 tx=0).stop 2024-04-28T13:07:33.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.907+0000 7f79c7ec5640 1 -- 172.21.15.114:0/3122724377 shutdown_connections 2024-04-28T13:07:33.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.907+0000 7f79c7ec5640 1 --2- 172.21.15.114:0/3122724377 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f79a406c8f0 0x7f79a406edb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:33.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.907+0000 7f79c7ec5640 1 --2- 172.21.15.114:0/3122724377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79c015eb10 0x7f79c00c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:33.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.907+0000 7f79c7ec5640 1 --2- 172.21.15.114:0/3122724377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79c0146c00 0x7f79c013e990 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:33.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.907+0000 7f79c7ec5640 1 --2- 172.21.15.114:0/3122724377 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79c00cdfa0 0x7f79c0144370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:33.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.907+0000 7f79c7ec5640 1 -- 172.21.15.114:0/3122724377 >> 172.21.15.114:0/3122724377 conn(0x7f79c006c980 msgr2=0x7f79c00b5250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:33.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.907+0000 7f79c7ec5640 1 -- 172.21.15.114:0/3122724377 shutdown_connections 2024-04-28T13:07:33.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:33.907+0000 7f79c7ec5640 1 -- 172.21.15.114:0/3122724377 wait complete. 2024-04-28T13:07:33.919 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-28T13:07:32.708503+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":164,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219052,"kb_used_data":2872,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755668,"statfs":{"total":773094113280,"available":772869804032,"internally_reserved":0,"allocated":2940928,"data_stored":1765196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.423768"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021526+0000","last_change":"2024-04-28T13:07:26.313967+0000","last_active":"2024-04-28T13:07:28.021526+0000","last_peered":"2024-04-28T13:07:28.021526+0000","last_clean":"2024-04-28T13:07:28.021526+0000","last_became_active":"2024-04-28T13:07:26.309492+0000","last_became_peered":"2024-04-28T13:07:26.309492+0000","last_unstale":"2024-04-28T13:07:28.021526+0000","last_undegraded":"2024-04-28T13:07:28.021526+0000","last_fullsized":"2024-04-28T13:07:28.021526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:39:10.176279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298698+0000","last_change":"2024-04-28T13:07:26.309087+0000","last_active":"2024-04-28T13:07:27.298698+0000","last_peered":"2024-04-28T13:07:27.298698+0000","last_clean":"2024-04-28T13:07:27.298698+0000","last_became_active":"2024-04-28T13:07:26.308799+0000","last_became_peered":"2024-04-28T13:07:26.308799+0000","last_unstale":"2024-04-28T13:07:27.298698+0000","last_undegraded":"2024-04-28T13:07:27.298698+0000","last_fullsized":"2024-04-28T13:07:27.298698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:15:46.081328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519230+0000","last_change":"2024-04-28T13:07:26.310735+0000","last_active":"2024-04-28T13:07:27.519230+0000","last_peered":"2024-04-28T13:07:27.519230+0000","last_clean":"2024-04-28T13:07:27.519230+0000","last_became_active":"2024-04-28T13:07:26.310442+0000","last_became_peered":"2024-04-28T13:07:26.310442+0000","last_unstale":"2024-04-28T13:07:27.519230+0000","last_undegraded":"2024-04-28T13:07:27.519230+0000","last_fullsized":"2024-04-28T13:07:27.519230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:59:35.713480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299050+0000","last_change":"2024-04-28T13:07:26.316425+0000","last_active":"2024-04-28T13:07:27.299050+0000","last_peered":"2024-04-28T13:07:27.299050+0000","last_clean":"2024-04-28T13:07:27.299050+0000","last_became_active":"2024-04-28T13:07:26.316055+0000","last_became_peered":"2024-04-28T13:07:26.316055+0000","last_unstale":"2024-04-28T13:07:27.299050+0000","last_undegraded":"2024-04-28T13:07:27.299050+0000","last_fullsized":"2024-04-28T13:07:27.299050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:17:42.011752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020050+0000","last_change":"2024-04-28T13:07:26.315472+0000","last_active":"2024-04-28T13:07:28.020050+0000","last_peered":"2024-04-28T13:07:28.020050+0000","last_clean":"2024-04-28T13:07:28.020050+0000","last_became_active":"2024-04-28T13:07:26.315216+0000","last_became_peered":"2024-04-28T13:07:26.315216+0000","last_unstale":"2024-04-28T13:07:28.020050+0000","last_undegraded":"2024-04-28T13:07:28.020050+0000","last_fullsized":"2024-04-28T13:07:28.020050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T13:30:05.831084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298986+0000","last_change":"2024-04-28T13:07:26.313012+0000","last_active":"2024-04-28T13:07:27.298986+0000","last_peered":"2024-04-28T13:07:27.298986+0000","last_clean":"2024-04-28T13:07:27.298986+0000","last_became_active":"2024-04-28T13:07:26.312724+0000","last_became_peered":"2024-04-28T13:07:26.312724+0000","last_unstale":"2024-04-28T13:07:27.298986+0000","last_undegraded":"2024-04-28T13:07:27.298986+0000","last_fullsized":"2024-04-28T13:07:27.298986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:34:15.706993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019989+0000","last_change":"2024-04-28T13:07:26.314352+0000","last_active":"2024-04-28T13:07:28.019989+0000","last_peered":"2024-04-28T13:07:28.019989+0000","last_clean":"2024-04-28T13:07:28.019989+0000","last_became_active":"2024-04-28T13:07:26.314068+0000","last_became_peered":"2024-04-28T13:07:26.314068+0000","last_unstale":"2024-04-28T13:07:28.019989+0000","last_undegraded":"2024-04-28T13:07:28.019989+0000","last_fullsized":"2024-04-28T13:07:28.019989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:34:15.706993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019405+0000","last_change":"2024-04-28T13:07:26.308898+0000","last_active":"2024-04-28T13:07:28.019405+0000","last_peered":"2024-04-28T13:07:28.019405+0000","last_clean":"2024-04-28T13:07:28.019405+0000","last_became_active":"2024-04-28T13:07:26.308567+0000","last_became_peered":"2024-04-28T13:07:26.308567+0000","last_unstale":"2024-04-28T13:07:28.019405+0000","last_undegraded":"2024-04-28T13:07:28.019405+0000","last_fullsized":"2024-04-28T13:07:28.019405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:37:35.063109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021532+0000","last_change":"2024-04-28T13:07:26.313669+0000","last_active":"2024-04-28T13:07:28.021532+0000","last_peered":"2024-04-28T13:07:28.021532+0000","last_clean":"2024-04-28T13:07:28.021532+0000","last_became_active":"2024-04-28T13:07:26.307908+0000","last_became_peered":"2024-04-28T13:07:26.307908+0000","last_unstale":"2024-04-28T13:07:28.021532+0000","last_undegraded":"2024-04-28T13:07:28.021532+0000","last_fullsized":"2024-04-28T13:07:28.021532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:04:24.766267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021321+0000","last_change":"2024-04-28T13:07:26.307257+0000","last_active":"2024-04-28T13:07:28.021321+0000","last_peered":"2024-04-28T13:07:28.021321+0000","last_clean":"2024-04-28T13:07:28.021321+0000","last_became_active":"2024-04-28T13:07:26.306866+0000","last_became_peered":"2024-04-28T13:07:26.306866+0000","last_unstale":"2024-04-28T13:07:28.021321+0000","last_undegraded":"2024-04-28T13:07:28.021321+0000","last_fullsized":"2024-04-28T13:07:28.021321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T16:06:41.543332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020923+0000","last_change":"2024-04-28T13:07:26.309606+0000","last_active":"2024-04-28T13:07:28.020923+0000","last_peered":"2024-04-28T13:07:28.020923+0000","last_clean":"2024-04-28T13:07:28.020923+0000","last_became_active":"2024-04-28T13:07:26.309338+0000","last_became_peered":"2024-04-28T13:07:26.309338+0000","last_unstale":"2024-04-28T13:07:28.020923+0000","last_undegraded":"2024-04-28T13:07:28.020923+0000","last_fullsized":"2024-04-28T13:07:28.020923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:28:05.357255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020781+0000","last_change":"2024-04-28T13:07:26.308307+0000","last_active":"2024-04-28T13:07:28.020781+0000","last_peered":"2024-04-28T13:07:28.020781+0000","last_clean":"2024-04-28T13:07:28.020781+0000","last_became_active":"2024-04-28T13:07:26.307664+0000","last_became_peered":"2024-04-28T13:07:26.307664+0000","last_unstale":"2024-04-28T13:07:28.020781+0000","last_undegraded":"2024-04-28T13:07:28.020781+0000","last_fullsized":"2024-04-28T13:07:28.020781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:18:37.751080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019688+0000","last_change":"2024-04-28T13:07:26.311807+0000","last_active":"2024-04-28T13:07:28.019688+0000","last_peered":"2024-04-28T13:07:28.019688+0000","last_clean":"2024-04-28T13:07:28.019688+0000","last_became_active":"2024-04-28T13:07:26.310515+0000","last_became_peered":"2024-04-28T13:07:26.310515+0000","last_unstale":"2024-04-28T13:07:28.019688+0000","last_undegraded":"2024-04-28T13:07:28.019688+0000","last_fullsized":"2024-04-28T13:07:28.019688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:28:05.357255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519030+0000","last_change":"2024-04-28T13:07:26.315421+0000","last_active":"2024-04-28T13:07:27.519030+0000","last_peered":"2024-04-28T13:07:27.519030+0000","last_clean":"2024-04-28T13:07:27.519030+0000","last_became_active":"2024-04-28T13:07:26.315112+0000","last_became_peered":"2024-04-28T13:07:26.315112+0000","last_unstale":"2024-04-28T13:07:27.519030+0000","last_undegraded":"2024-04-28T13:07:27.519030+0000","last_fullsized":"2024-04-28T13:07:27.519030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:27:11.373413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298416+0000","last_change":"2024-04-28T13:07:26.297276+0000","last_active":"2024-04-28T13:07:27.298416+0000","last_peered":"2024-04-28T13:07:27.298416+0000","last_clean":"2024-04-28T13:07:27.298416+0000","last_became_active":"2024-04-28T13:07:26.297008+0000","last_became_peered":"2024-04-28T13:07:26.297008+0000","last_unstale":"2024-04-28T13:07:27.298416+0000","last_undegraded":"2024-04-28T13:07:27.298416+0000","last_fullsized":"2024-04-28T13:07:27.298416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:59:35.713480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298922+0000","last_change":"2024-04-28T13:07:26.312387+0000","last_active":"2024-04-28T13:07:27.298922+0000","last_peered":"2024-04-28T13:07:27.298922+0000","last_clean":"2024-04-28T13:07:27.298922+0000","last_became_active":"2024-04-28T13:07:26.312111+0000","last_became_peered":"2024-04-28T13:07:26.312111+0000","last_unstale":"2024-04-28T13:07:27.298922+0000","last_undegraded":"2024-04-28T13:07:27.298922+0000","last_fullsized":"2024-04-28T13:07:27.298922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:17:21.385726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299713+0000","last_change":"2024-04-28T13:07:26.306073+0000","last_active":"2024-04-28T13:07:27.299713+0000","last_peered":"2024-04-28T13:07:27.299713+0000","last_clean":"2024-04-28T13:07:27.299713+0000","last_became_active":"2024-04-28T13:07:26.305799+0000","last_became_peered":"2024-04-28T13:07:26.305799+0000","last_unstale":"2024-04-28T13:07:27.299713+0000","last_undegraded":"2024-04-28T13:07:27.299713+0000","last_fullsized":"2024-04-28T13:07:27.299713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:04:24.766267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019321+0000","last_change":"2024-04-28T13:07:26.308368+0000","last_active":"2024-04-28T13:07:28.019321+0000","last_peered":"2024-04-28T13:07:28.019321+0000","last_clean":"2024-04-28T13:07:28.019321+0000","last_became_active":"2024-04-28T13:07:26.308098+0000","last_became_peered":"2024-04-28T13:07:26.308098+0000","last_unstale":"2024-04-28T13:07:28.019321+0000","last_undegraded":"2024-04-28T13:07:28.019321+0000","last_fullsized":"2024-04-28T13:07:28.019321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:48:49.408457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021412+0000","last_change":"2024-04-28T13:07:26.307438+0000","last_active":"2024-04-28T13:07:28.021412+0000","last_peered":"2024-04-28T13:07:28.021412+0000","last_clean":"2024-04-28T13:07:28.021412+0000","last_became_active":"2024-04-28T13:07:26.306984+0000","last_became_peered":"2024-04-28T13:07:26.306984+0000","last_unstale":"2024-04-28T13:07:28.021412+0000","last_undegraded":"2024-04-28T13:07:28.021412+0000","last_fullsized":"2024-04-28T13:07:28.021412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T16:22:52.630763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020405+0000","last_change":"2024-04-28T13:07:26.309790+0000","last_active":"2024-04-28T13:07:28.020405+0000","last_peered":"2024-04-28T13:07:28.020405+0000","last_clean":"2024-04-28T13:07:28.020405+0000","last_became_active":"2024-04-28T13:07:26.309521+0000","last_became_peered":"2024-04-28T13:07:26.309521+0000","last_unstale":"2024-04-28T13:07:28.020405+0000","last_undegraded":"2024-04-28T13:07:28.020405+0000","last_fullsized":"2024-04-28T13:07:28.020405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:59:35.713480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519103+0000","last_change":"2024-04-28T13:07:26.318544+0000","last_active":"2024-04-28T13:07:27.519103+0000","last_peered":"2024-04-28T13:07:27.519103+0000","last_clean":"2024-04-28T13:07:27.519103+0000","last_became_active":"2024-04-28T13:07:26.318279+0000","last_became_peered":"2024-04-28T13:07:26.318279+0000","last_unstale":"2024-04-28T13:07:27.519103+0000","last_undegraded":"2024-04-28T13:07:27.519103+0000","last_fullsized":"2024-04-28T13:07:27.519103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:37:35.063109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299378+0000","last_change":"2024-04-28T13:07:26.309606+0000","last_active":"2024-04-28T13:07:27.299378+0000","last_peered":"2024-04-28T13:07:27.299378+0000","last_clean":"2024-04-28T13:07:27.299378+0000","last_became_active":"2024-04-28T13:07:26.309338+0000","last_became_peered":"2024-04-28T13:07:26.309338+0000","last_unstale":"2024-04-28T13:07:27.299378+0000","last_undegraded":"2024-04-28T13:07:27.299378+0000","last_fullsized":"2024-04-28T13:07:27.299378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:10:44.035551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019649+0000","last_change":"2024-04-28T13:07:26.307514+0000","last_active":"2024-04-28T13:07:28.019649+0000","last_peered":"2024-04-28T13:07:28.019649+0000","last_clean":"2024-04-28T13:07:28.019649+0000","last_became_active":"2024-04-28T13:07:26.307215+0000","last_became_peered":"2024-04-28T13:07:26.307215+0000","last_unstale":"2024-04-28T13:07:28.019649+0000","last_undegraded":"2024-04-28T13:07:28.019649+0000","last_fullsized":"2024-04-28T13:07:28.019649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:59:35.713480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298920+0000","last_change":"2024-04-28T13:07:26.303832+0000","last_active":"2024-04-28T13:07:27.298920+0000","last_peered":"2024-04-28T13:07:27.298920+0000","last_clean":"2024-04-28T13:07:27.298920+0000","last_became_active":"2024-04-28T13:07:26.303498+0000","last_became_peered":"2024-04-28T13:07:26.303498+0000","last_unstale":"2024-04-28T13:07:27.298920+0000","last_undegraded":"2024-04-28T13:07:27.298920+0000","last_fullsized":"2024-04-28T13:07:27.298920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:15:46.081328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019826+0000","last_change":"2024-04-28T13:07:26.306835+0000","last_active":"2024-04-28T13:07:28.019826+0000","last_peered":"2024-04-28T13:07:28.019826+0000","last_clean":"2024-04-28T13:07:28.019826+0000","last_became_active":"2024-04-28T13:07:26.306535+0000","last_became_peered":"2024-04-28T13:07:26.306535+0000","last_unstale":"2024-04-28T13:07:28.019826+0000","last_undegraded":"2024-04-28T13:07:28.019826+0000","last_fullsized":"2024-04-28T13:07:28.019826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:17:21.385726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021476+0000","last_change":"2024-04-28T13:07:26.316514+0000","last_active":"2024-04-28T13:07:28.021476+0000","last_peered":"2024-04-28T13:07:28.021476+0000","last_clean":"2024-04-28T13:07:28.021476+0000","last_became_active":"2024-04-28T13:07:26.316249+0000","last_became_peered":"2024-04-28T13:07:26.316249+0000","last_unstale":"2024-04-28T13:07:28.021476+0000","last_undegraded":"2024-04-28T13:07:28.021476+0000","last_fullsized":"2024-04-28T13:07:28.021476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:15:46.081328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298512+0000","last_change":"2024-04-28T13:07:26.297829+0000","last_active":"2024-04-28T13:07:27.298512+0000","last_peered":"2024-04-28T13:07:27.298512+0000","last_clean":"2024-04-28T13:07:27.298512+0000","last_became_active":"2024-04-28T13:07:26.297468+0000","last_became_peered":"2024-04-28T13:07:26.297468+0000","last_unstale":"2024-04-28T13:07:27.298512+0000","last_undegraded":"2024-04-28T13:07:27.298512+0000","last_fullsized":"2024-04-28T13:07:27.298512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T16:06:41.543332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019812+0000","last_change":"2024-04-28T13:07:26.313763+0000","last_active":"2024-04-28T13:07:28.019812+0000","last_peered":"2024-04-28T13:07:28.019812+0000","last_clean":"2024-04-28T13:07:28.019812+0000","last_became_active":"2024-04-28T13:07:26.313337+0000","last_became_peered":"2024-04-28T13:07:26.313337+0000","last_unstale":"2024-04-28T13:07:28.019812+0000","last_undegraded":"2024-04-28T13:07:28.019812+0000","last_fullsized":"2024-04-28T13:07:28.019812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:15:46.081328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519145+0000","last_change":"2024-04-28T13:07:26.317540+0000","last_active":"2024-04-28T13:07:27.519145+0000","last_peered":"2024-04-28T13:07:27.519145+0000","last_clean":"2024-04-28T13:07:27.519145+0000","last_became_active":"2024-04-28T13:07:26.316912+0000","last_became_peered":"2024-04-28T13:07:26.316912+0000","last_unstale":"2024-04-28T13:07:27.519145+0000","last_undegraded":"2024-04-28T13:07:27.519145+0000","last_fullsized":"2024-04-28T13:07:27.519145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:48:54.699408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299350+0000","last_change":"2024-04-28T13:07:26.311313+0000","last_active":"2024-04-28T13:07:27.299350+0000","last_peered":"2024-04-28T13:07:27.299350+0000","last_clean":"2024-04-28T13:07:27.299350+0000","last_became_active":"2024-04-28T13:07:26.310960+0000","last_became_peered":"2024-04-28T13:07:26.310960+0000","last_unstale":"2024-04-28T13:07:27.299350+0000","last_undegraded":"2024-04-28T13:07:27.299350+0000","last_fullsized":"2024-04-28T13:07:27.299350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:00:58.728022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019235+0000","last_change":"2024-04-28T13:07:26.306545+0000","last_active":"2024-04-28T13:07:28.019235+0000","last_peered":"2024-04-28T13:07:28.019235+0000","last_clean":"2024-04-28T13:07:28.019235+0000","last_became_active":"2024-04-28T13:07:26.306242+0000","last_became_peered":"2024-04-28T13:07:26.306242+0000","last_unstale":"2024-04-28T13:07:28.019235+0000","last_undegraded":"2024-04-28T13:07:28.019235+0000","last_fullsized":"2024-04-28T13:07:28.019235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T20:04:56.915910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019926+0000","last_change":"2024-04-28T13:07:26.314926+0000","last_active":"2024-04-28T13:07:28.019926+0000","last_peered":"2024-04-28T13:07:28.019926+0000","last_clean":"2024-04-28T13:07:28.019926+0000","last_became_active":"2024-04-28T13:07:26.314391+0000","last_became_peered":"2024-04-28T13:07:26.314391+0000","last_unstale":"2024-04-28T13:07:28.019926+0000","last_undegraded":"2024-04-28T13:07:28.019926+0000","last_fullsized":"2024-04-28T13:07:28.019926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:27:11.373413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020208+0000","last_change":"2024-04-28T13:07:26.303423+0000","last_active":"2024-04-28T13:07:28.020208+0000","last_peered":"2024-04-28T13:07:28.020208+0000","last_clean":"2024-04-28T13:07:28.020208+0000","last_became_active":"2024-04-28T13:07:26.302361+0000","last_became_peered":"2024-04-28T13:07:26.302361+0000","last_unstale":"2024-04-28T13:07:28.020208+0000","last_undegraded":"2024-04-28T13:07:28.020208+0000","last_fullsized":"2024-04-28T13:07:28.020208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:45:56.180751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019816+0000","last_change":"2024-04-28T13:07:25.306186+0000","last_active":"2024-04-28T13:07:28.019816+0000","last_peered":"2024-04-28T13:07:28.019816+0000","last_clean":"2024-04-28T13:07:28.019816+0000","last_became_active":"2024-04-28T13:07:25.305761+0000","last_became_peered":"2024-04-28T13:07:25.305761+0000","last_unstale":"2024-04-28T13:07:28.019816+0000","last_undegraded":"2024-04-28T13:07:28.019816+0000","last_fullsized":"2024-04-28T13:07:28.019816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:01:05.000996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519234+0000","last_change":"2024-04-28T13:07:26.317195+0000","last_active":"2024-04-28T13:07:27.519234+0000","last_peered":"2024-04-28T13:07:27.519234+0000","last_clean":"2024-04-28T13:07:27.519234+0000","last_became_active":"2024-04-28T13:07:26.316432+0000","last_became_peered":"2024-04-28T13:07:26.316432+0000","last_unstale":"2024-04-28T13:07:27.519234+0000","last_undegraded":"2024-04-28T13:07:27.519234+0000","last_fullsized":"2024-04-28T13:07:27.519234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T16:06:41.543332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020047+0000","last_change":"2024-04-28T13:07:25.303307+0000","last_active":"2024-04-28T13:07:28.020047+0000","last_peered":"2024-04-28T13:07:28.020047+0000","last_clean":"2024-04-28T13:07:28.020047+0000","last_became_active":"2024-04-28T13:07:25.302669+0000","last_became_peered":"2024-04-28T13:07:25.302669+0000","last_unstale":"2024-04-28T13:07:28.020047+0000","last_undegraded":"2024-04-28T13:07:28.020047+0000","last_fullsized":"2024-04-28T13:07:28.020047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:34:02.814463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019548+0000","last_change":"2024-04-28T13:07:25.305429+0000","last_active":"2024-04-28T13:07:28.019548+0000","last_peered":"2024-04-28T13:07:28.019548+0000","last_clean":"2024-04-28T13:07:28.019548+0000","last_became_active":"2024-04-28T13:07:25.305121+0000","last_became_peered":"2024-04-28T13:07:25.305121+0000","last_unstale":"2024-04-28T13:07:28.019548+0000","last_undegraded":"2024-04-28T13:07:28.019548+0000","last_fullsized":"2024-04-28T13:07:28.019548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:49:52.826796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019378+0000","last_change":"2024-04-28T13:07:26.312253+0000","last_active":"2024-04-28T13:07:28.019378+0000","last_peered":"2024-04-28T13:07:28.019378+0000","last_clean":"2024-04-28T13:07:28.019378+0000","last_became_active":"2024-04-28T13:07:26.310573+0000","last_became_peered":"2024-04-28T13:07:26.310573+0000","last_unstale":"2024-04-28T13:07:28.019378+0000","last_undegraded":"2024-04-28T13:07:28.019378+0000","last_fullsized":"2024-04-28T13:07:28.019378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:27:11.373413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299130+0000","last_change":"2024-04-28T13:07:25.301794+0000","last_active":"2024-04-28T13:07:27.299130+0000","last_peered":"2024-04-28T13:07:27.299130+0000","last_clean":"2024-04-28T13:07:27.299130+0000","last_became_active":"2024-04-28T13:07:25.301463+0000","last_became_peered":"2024-04-28T13:07:25.301463+0000","last_unstale":"2024-04-28T13:07:27.299130+0000","last_undegraded":"2024-04-28T13:07:27.299130+0000","last_fullsized":"2024-04-28T13:07:27.299130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:15:37.155770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298405+0000","last_change":"2024-04-28T13:07:26.296566+0000","last_active":"2024-04-28T13:07:27.298405+0000","last_peered":"2024-04-28T13:07:27.298405+0000","last_clean":"2024-04-28T13:07:27.298405+0000","last_became_active":"2024-04-28T13:07:26.296273+0000","last_became_peered":"2024-04-28T13:07:26.296273+0000","last_unstale":"2024-04-28T13:07:27.298405+0000","last_undegraded":"2024-04-28T13:07:27.298405+0000","last_fullsized":"2024-04-28T13:07:27.298405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:48:54.699408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021606+0000","last_change":"2024-04-28T13:07:25.308017+0000","last_active":"2024-04-28T13:07:28.021606+0000","last_peered":"2024-04-28T13:07:28.021606+0000","last_clean":"2024-04-28T13:07:28.021606+0000","last_became_active":"2024-04-28T13:07:25.307704+0000","last_became_peered":"2024-04-28T13:07:25.307704+0000","last_unstale":"2024-04-28T13:07:28.021606+0000","last_undegraded":"2024-04-28T13:07:28.021606+0000","last_fullsized":"2024-04-28T13:07:28.021606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:57:54.511728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299240+0000","last_change":"2024-04-28T13:07:26.305171+0000","last_active":"2024-04-28T13:07:27.299240+0000","last_peered":"2024-04-28T13:07:27.299240+0000","last_clean":"2024-04-28T13:07:27.299240+0000","last_became_active":"2024-04-28T13:07:26.304900+0000","last_became_peered":"2024-04-28T13:07:26.304900+0000","last_unstale":"2024-04-28T13:07:27.299240+0000","last_undegraded":"2024-04-28T13:07:27.299240+0000","last_fullsized":"2024-04-28T13:07:27.299240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:06:39.922627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299510+0000","last_change":"2024-04-28T13:07:25.307177+0000","last_active":"2024-04-28T13:07:27.299510+0000","last_peered":"2024-04-28T13:07:27.299510+0000","last_clean":"2024-04-28T13:07:27.299510+0000","last_became_active":"2024-04-28T13:07:25.306922+0000","last_became_peered":"2024-04-28T13:07:25.306922+0000","last_unstale":"2024-04-28T13:07:27.299510+0000","last_undegraded":"2024-04-28T13:07:27.299510+0000","last_fullsized":"2024-04-28T13:07:27.299510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:34:02.814463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519315+0000","last_change":"2024-04-28T13:07:26.308975+0000","last_active":"2024-04-28T13:07:27.519315+0000","last_peered":"2024-04-28T13:07:27.519315+0000","last_clean":"2024-04-28T13:07:27.519315+0000","last_became_active":"2024-04-28T13:07:26.308715+0000","last_became_peered":"2024-04-28T13:07:26.308715+0000","last_unstale":"2024-04-28T13:07:27.519315+0000","last_undegraded":"2024-04-28T13:07:27.519315+0000","last_fullsized":"2024-04-28T13:07:27.519315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:17:21.385726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298608+0000","last_change":"2024-04-28T13:07:25.307356+0000","last_active":"2024-04-28T13:07:27.298608+0000","last_peered":"2024-04-28T13:07:27.298608+0000","last_clean":"2024-04-28T13:07:27.298608+0000","last_became_active":"2024-04-28T13:07:25.307108+0000","last_became_peered":"2024-04-28T13:07:25.307108+0000","last_unstale":"2024-04-28T13:07:27.298608+0000","last_undegraded":"2024-04-28T13:07:27.298608+0000","last_fullsized":"2024-04-28T13:07:27.298608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:57:54.511728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020935+0000","last_change":"2024-04-28T13:07:26.306801+0000","last_active":"2024-04-28T13:07:28.020935+0000","last_peered":"2024-04-28T13:07:28.020935+0000","last_clean":"2024-04-28T13:07:28.020935+0000","last_became_active":"2024-04-28T13:07:26.306051+0000","last_became_peered":"2024-04-28T13:07:26.306051+0000","last_unstale":"2024-04-28T13:07:28.020935+0000","last_undegraded":"2024-04-28T13:07:28.020935+0000","last_fullsized":"2024-04-28T13:07:28.020935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T20:04:56.915910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020644+0000","last_change":"2024-04-28T13:07:25.304551+0000","last_active":"2024-04-28T13:07:28.020644+0000","last_peered":"2024-04-28T13:07:28.020644+0000","last_clean":"2024-04-28T13:07:28.020644+0000","last_became_active":"2024-04-28T13:07:25.304117+0000","last_became_peered":"2024-04-28T13:07:25.304117+0000","last_unstale":"2024-04-28T13:07:28.020644+0000","last_undegraded":"2024-04-28T13:07:28.020644+0000","last_fullsized":"2024-04-28T13:07:28.020644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:45:55.171349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021023+0000","last_change":"2024-04-28T13:07:26.301509+0000","last_active":"2024-04-28T13:07:28.021023+0000","last_peered":"2024-04-28T13:07:28.021023+0000","last_clean":"2024-04-28T13:07:28.021023+0000","last_became_active":"2024-04-28T13:07:26.301221+0000","last_became_peered":"2024-04-28T13:07:26.301221+0000","last_unstale":"2024-04-28T13:07:28.021023+0000","last_undegraded":"2024-04-28T13:07:28.021023+0000","last_fullsized":"2024-04-28T13:07:28.021023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:00:58.728022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519255+0000","last_change":"2024-04-28T13:07:25.297320+0000","last_active":"2024-04-28T13:07:27.519255+0000","last_peered":"2024-04-28T13:07:27.519255+0000","last_clean":"2024-04-28T13:07:27.519255+0000","last_became_active":"2024-04-28T13:07:25.297037+0000","last_became_peered":"2024-04-28T13:07:25.297037+0000","last_unstale":"2024-04-28T13:07:27.519255+0000","last_undegraded":"2024-04-28T13:07:27.519255+0000","last_fullsized":"2024-04-28T13:07:27.519255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:01:05.000996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519019+0000","last_change":"2024-04-28T13:07:26.317885+0000","last_active":"2024-04-28T13:07:27.519019+0000","last_peered":"2024-04-28T13:07:27.519019+0000","last_clean":"2024-04-28T13:07:27.519019+0000","last_became_active":"2024-04-28T13:07:26.317583+0000","last_became_peered":"2024-04-28T13:07:26.317583+0000","last_unstale":"2024-04-28T13:07:27.519019+0000","last_undegraded":"2024-04-28T13:07:27.519019+0000","last_fullsized":"2024-04-28T13:07:27.519019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:03:37.479826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299720+0000","last_change":"2024-04-28T13:07:25.305697+0000","last_active":"2024-04-28T13:07:27.299720+0000","last_peered":"2024-04-28T13:07:27.299720+0000","last_clean":"2024-04-28T13:07:27.299720+0000","last_became_active":"2024-04-28T13:07:25.304315+0000","last_became_peered":"2024-04-28T13:07:25.304315+0000","last_unstale":"2024-04-28T13:07:27.299720+0000","last_undegraded":"2024-04-28T13:07:27.299720+0000","last_fullsized":"2024-04-28T13:07:27.299720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:57:54.511728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020601+0000","last_change":"2024-04-28T13:07:26.314531+0000","last_active":"2024-04-28T13:07:28.020601+0000","last_peered":"2024-04-28T13:07:28.020601+0000","last_clean":"2024-04-28T13:07:28.020601+0000","last_became_active":"2024-04-28T13:07:26.314257+0000","last_became_peered":"2024-04-28T13:07:26.314257+0000","last_unstale":"2024-04-28T13:07:28.020601+0000","last_undegraded":"2024-04-28T13:07:28.020601+0000","last_fullsized":"2024-04-28T13:07:28.020601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:06:39.922627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020115+0000","last_change":"2024-04-28T13:07:25.295863+0000","last_active":"2024-04-28T13:07:28.020115+0000","last_peered":"2024-04-28T13:07:28.020115+0000","last_clean":"2024-04-28T13:07:28.020115+0000","last_became_active":"2024-04-28T13:07:25.295475+0000","last_became_peered":"2024-04-28T13:07:25.295475+0000","last_unstale":"2024-04-28T13:07:28.020115+0000","last_undegraded":"2024-04-28T13:07:28.020115+0000","last_fullsized":"2024-04-28T13:07:28.020115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:15:37.155770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020204+0000","last_change":"2024-04-28T13:07:26.314673+0000","last_active":"2024-04-28T13:07:28.020204+0000","last_peered":"2024-04-28T13:07:28.020204+0000","last_clean":"2024-04-28T13:07:28.020204+0000","last_became_active":"2024-04-28T13:07:26.314038+0000","last_became_peered":"2024-04-28T13:07:26.314038+0000","last_unstale":"2024-04-28T13:07:28.020204+0000","last_undegraded":"2024-04-28T13:07:28.020204+0000","last_fullsized":"2024-04-28T13:07:28.020204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:48:54.699408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019157+0000","last_change":"2024-04-28T13:07:25.295521+0000","last_active":"2024-04-28T13:07:28.019157+0000","last_peered":"2024-04-28T13:07:28.019157+0000","last_clean":"2024-04-28T13:07:28.019157+0000","last_became_active":"2024-04-28T13:07:25.295243+0000","last_became_peered":"2024-04-28T13:07:25.295243+0000","last_unstale":"2024-04-28T13:07:28.019157+0000","last_undegraded":"2024-04-28T13:07:28.019157+0000","last_fullsized":"2024-04-28T13:07:28.019157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:49:52.826796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020137+0000","last_change":"2024-04-28T13:07:26.314594+0000","last_active":"2024-04-28T13:07:28.020137+0000","last_peered":"2024-04-28T13:07:28.020137+0000","last_clean":"2024-04-28T13:07:28.020137+0000","last_became_active":"2024-04-28T13:07:26.310077+0000","last_became_peered":"2024-04-28T13:07:26.310077+0000","last_unstale":"2024-04-28T13:07:28.020137+0000","last_undegraded":"2024-04-28T13:07:28.020137+0000","last_fullsized":"2024-04-28T13:07:28.020137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:17:42.011752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021124+0000","last_change":"2024-04-28T13:07:25.298854+0000","last_active":"2024-04-28T13:07:28.021124+0000","last_peered":"2024-04-28T13:07:28.021124+0000","last_clean":"2024-04-28T13:07:28.021124+0000","last_became_active":"2024-04-28T13:07:25.298100+0000","last_became_peered":"2024-04-28T13:07:25.298100+0000","last_unstale":"2024-04-28T13:07:28.021124+0000","last_undegraded":"2024-04-28T13:07:28.021124+0000","last_fullsized":"2024-04-28T13:07:28.021124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:50:40.986549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020963+0000","last_change":"2024-04-28T13:07:26.312944+0000","last_active":"2024-04-28T13:07:28.020963+0000","last_peered":"2024-04-28T13:07:28.020963+0000","last_clean":"2024-04-28T13:07:28.020963+0000","last_became_active":"2024-04-28T13:07:26.309861+0000","last_became_peered":"2024-04-28T13:07:26.309861+0000","last_unstale":"2024-04-28T13:07:28.020963+0000","last_undegraded":"2024-04-28T13:07:28.020963+0000","last_fullsized":"2024-04-28T13:07:28.020963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:06:35.011350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019402+0000","last_change":"2024-04-28T13:07:25.300448+0000","last_active":"2024-04-28T13:07:28.019402+0000","last_peered":"2024-04-28T13:07:28.019402+0000","last_clean":"2024-04-28T13:07:28.019402+0000","last_became_active":"2024-04-28T13:07:25.300181+0000","last_became_peered":"2024-04-28T13:07:25.300181+0000","last_unstale":"2024-04-28T13:07:28.019402+0000","last_undegraded":"2024-04-28T13:07:28.019402+0000","last_fullsized":"2024-04-28T13:07:28.019402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:34:02.814463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021674+0000","last_change":"2024-04-28T13:07:26.315390+0000","last_active":"2024-04-28T13:07:28.021674+0000","last_peered":"2024-04-28T13:07:28.021674+0000","last_clean":"2024-04-28T13:07:28.021674+0000","last_became_active":"2024-04-28T13:07:26.315077+0000","last_became_peered":"2024-04-28T13:07:26.315077+0000","last_unstale":"2024-04-28T13:07:28.021674+0000","last_undegraded":"2024-04-28T13:07:28.021674+0000","last_fullsized":"2024-04-28T13:07:28.021674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:05:21.187278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298630+0000","last_change":"2024-04-28T13:07:25.296275+0000","last_active":"2024-04-28T13:07:27.298630+0000","last_peered":"2024-04-28T13:07:27.298630+0000","last_clean":"2024-04-28T13:07:27.298630+0000","last_became_active":"2024-04-28T13:07:25.295930+0000","last_became_peered":"2024-04-28T13:07:25.295930+0000","last_unstale":"2024-04-28T13:07:27.298630+0000","last_undegraded":"2024-04-28T13:07:27.298630+0000","last_fullsized":"2024-04-28T13:07:27.298630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T20:04:55.906508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299309+0000","last_change":"2024-04-28T13:07:26.310964+0000","last_active":"2024-04-28T13:07:27.299309+0000","last_peered":"2024-04-28T13:07:27.299309+0000","last_clean":"2024-04-28T13:07:27.299309+0000","last_became_active":"2024-04-28T13:07:26.310666+0000","last_became_peered":"2024-04-28T13:07:26.310666+0000","last_unstale":"2024-04-28T13:07:27.299309+0000","last_undegraded":"2024-04-28T13:07:27.299309+0000","last_fullsized":"2024-04-28T13:07:27.299309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:06:35.011350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019509+0000","last_change":"2024-04-28T13:07:25.308033+0000","last_active":"2024-04-28T13:07:28.019509+0000","last_peered":"2024-04-28T13:07:28.019509+0000","last_clean":"2024-04-28T13:07:28.019509+0000","last_became_active":"2024-04-28T13:07:25.307709+0000","last_became_peered":"2024-04-28T13:07:25.307709+0000","last_unstale":"2024-04-28T13:07:28.019509+0000","last_undegraded":"2024-04-28T13:07:28.019509+0000","last_fullsized":"2024-04-28T13:07:28.019509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:45:55.171349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021170+0000","last_change":"2024-04-28T13:07:26.317026+0000","last_active":"2024-04-28T13:07:28.021170+0000","last_peered":"2024-04-28T13:07:28.021170+0000","last_clean":"2024-04-28T13:07:28.021170+0000","last_became_active":"2024-04-28T13:07:26.316637+0000","last_became_peered":"2024-04-28T13:07:26.316637+0000","last_unstale":"2024-04-28T13:07:28.021170+0000","last_undegraded":"2024-04-28T13:07:28.021170+0000","last_fullsized":"2024-04-28T13:07:28.021170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:10:44.035551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020210+0000","last_change":"2024-04-28T13:07:16.698740+0000","last_active":"2024-04-28T13:07:28.020210+0000","last_peered":"2024-04-28T13:07:28.020210+0000","last_clean":"2024-04-28T13:07:28.020210+0000","last_became_active":"2024-04-28T13:07:16.696364+0000","last_became_peered":"2024-04-28T13:07:16.696364+0000","last_unstale":"2024-04-28T13:07:28.020210+0000","last_undegraded":"2024-04-28T13:07:28.020210+0000","last_fullsized":"2024-04-28T13:07:28.020210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:14.770499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:14.770499+0000","last_clean_scrub_stamp":"2024-04-28T13:07:14.770499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:39:38.986133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299409+0000","last_change":"2024-04-28T13:07:25.301675+0000","last_active":"2024-04-28T13:07:27.299409+0000","last_peered":"2024-04-28T13:07:27.299409+0000","last_clean":"2024-04-28T13:07:27.299409+0000","last_became_active":"2024-04-28T13:07:25.301373+0000","last_became_peered":"2024-04-28T13:07:25.301373+0000","last_unstale":"2024-04-28T13:07:27.299409+0000","last_undegraded":"2024-04-28T13:07:27.299409+0000","last_fullsized":"2024-04-28T13:07:27.299409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:45:55.171349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019902+0000","last_change":"2024-04-28T13:07:26.309600+0000","last_active":"2024-04-28T13:07:28.019902+0000","last_peered":"2024-04-28T13:07:28.019902+0000","last_clean":"2024-04-28T13:07:28.019902+0000","last_became_active":"2024-04-28T13:07:26.309317+0000","last_became_peered":"2024-04-28T13:07:26.309317+0000","last_unstale":"2024-04-28T13:07:28.019902+0000","last_undegraded":"2024-04-28T13:07:28.019902+0000","last_fullsized":"2024-04-28T13:07:28.019902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T13:30:05.831084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020381+0000","last_change":"2024-04-28T13:07:25.305597+0000","last_active":"2024-04-28T13:07:28.020381+0000","last_peered":"2024-04-28T13:07:28.020381+0000","last_clean":"2024-04-28T13:07:28.020381+0000","last_became_active":"2024-04-28T13:07:25.305095+0000","last_became_peered":"2024-04-28T13:07:25.305095+0000","last_unstale":"2024-04-28T13:07:28.020381+0000","last_undegraded":"2024-04-28T13:07:28.020381+0000","last_fullsized":"2024-04-28T13:07:28.020381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:37:32.063208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.518924+0000","last_change":"2024-04-28T13:07:26.312371+0000","last_active":"2024-04-28T13:07:27.518924+0000","last_peered":"2024-04-28T13:07:27.518924+0000","last_clean":"2024-04-28T13:07:27.518924+0000","last_became_active":"2024-04-28T13:07:26.312094+0000","last_became_peered":"2024-04-28T13:07:26.312094+0000","last_unstale":"2024-04-28T13:07:27.518924+0000","last_undegraded":"2024-04-28T13:07:27.518924+0000","last_fullsized":"2024-04-28T13:07:27.518924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T20:29:58.561638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019272+0000","last_change":"2024-04-28T13:07:25.299270+0000","last_active":"2024-04-28T13:07:28.019272+0000","last_peered":"2024-04-28T13:07:28.019272+0000","last_clean":"2024-04-28T13:07:28.019272+0000","last_became_active":"2024-04-28T13:07:25.299003+0000","last_became_peered":"2024-04-28T13:07:25.299003+0000","last_unstale":"2024-04-28T13:07:28.019272+0000","last_undegraded":"2024-04-28T13:07:28.019272+0000","last_fullsized":"2024-04-28T13:07:28.019272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:15:37.155770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298443+0000","last_change":"2024-04-28T13:07:26.304077+0000","last_active":"2024-04-28T13:07:27.298443+0000","last_peered":"2024-04-28T13:07:27.298443+0000","last_clean":"2024-04-28T13:07:27.298443+0000","last_became_active":"2024-04-28T13:07:26.302114+0000","last_became_peered":"2024-04-28T13:07:26.302114+0000","last_unstale":"2024-04-28T13:07:27.298443+0000","last_undegraded":"2024-04-28T13:07:27.298443+0000","last_fullsized":"2024-04-28T13:07:27.298443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:28:05.357255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299704+0000","last_change":"2024-04-28T13:07:25.306063+0000","last_active":"2024-04-28T13:07:27.299704+0000","last_peered":"2024-04-28T13:07:27.299704+0000","last_clean":"2024-04-28T13:07:27.299704+0000","last_became_active":"2024-04-28T13:07:25.305789+0000","last_became_peered":"2024-04-28T13:07:25.305789+0000","last_unstale":"2024-04-28T13:07:27.299704+0000","last_undegraded":"2024-04-28T13:07:27.299704+0000","last_fullsized":"2024-04-28T13:07:27.299704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:18:36.741678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020557+0000","last_change":"2024-04-28T13:07:26.314298+0000","last_active":"2024-04-28T13:07:28.020557+0000","last_peered":"2024-04-28T13:07:28.020557+0000","last_clean":"2024-04-28T13:07:28.020557+0000","last_became_active":"2024-04-28T13:07:26.313337+0000","last_became_peered":"2024-04-28T13:07:26.313337+0000","last_unstale":"2024-04-28T13:07:28.020557+0000","last_undegraded":"2024-04-28T13:07:28.020557+0000","last_fullsized":"2024-04-28T13:07:28.020557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:57:55.521129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298469+0000","last_change":"2024-04-28T13:07:25.300122+0000","last_active":"2024-04-28T13:07:27.298469+0000","last_peered":"2024-04-28T13:07:27.298469+0000","last_clean":"2024-04-28T13:07:27.298469+0000","last_became_active":"2024-04-28T13:07:25.299837+0000","last_became_peered":"2024-04-28T13:07:25.299837+0000","last_unstale":"2024-04-28T13:07:27.298469+0000","last_undegraded":"2024-04-28T13:07:27.298469+0000","last_fullsized":"2024-04-28T13:07:27.298469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:34:02.814463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299554+0000","last_change":"2024-04-28T13:07:26.312457+0000","last_active":"2024-04-28T13:07:27.299554+0000","last_peered":"2024-04-28T13:07:27.299554+0000","last_clean":"2024-04-28T13:07:27.299554+0000","last_became_active":"2024-04-28T13:07:26.310729+0000","last_became_peered":"2024-04-28T13:07:26.310729+0000","last_unstale":"2024-04-28T13:07:27.299554+0000","last_undegraded":"2024-04-28T13:07:27.299554+0000","last_fullsized":"2024-04-28T13:07:27.299554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:39:10.176279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021328+0000","last_change":"2024-04-28T13:07:25.305837+0000","last_active":"2024-04-28T13:07:28.021328+0000","last_peered":"2024-04-28T13:07:28.021328+0000","last_clean":"2024-04-28T13:07:28.021328+0000","last_became_active":"2024-04-28T13:07:25.305581+0000","last_became_peered":"2024-04-28T13:07:25.305581+0000","last_unstale":"2024-04-28T13:07:28.021328+0000","last_undegraded":"2024-04-28T13:07:28.021328+0000","last_fullsized":"2024-04-28T13:07:28.021328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T20:04:55.906508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298902+0000","last_change":"2024-04-28T13:07:26.306415+0000","last_active":"2024-04-28T13:07:27.298902+0000","last_peered":"2024-04-28T13:07:27.298902+0000","last_clean":"2024-04-28T13:07:27.298902+0000","last_became_active":"2024-04-28T13:07:26.306144+0000","last_became_peered":"2024-04-28T13:07:26.306144+0000","last_unstale":"2024-04-28T13:07:27.298902+0000","last_undegraded":"2024-04-28T13:07:27.298902+0000","last_fullsized":"2024-04-28T13:07:27.298902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:17:21.385726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.292069+0000","last_change":"2024-04-28T13:07:25.303907+0000","last_active":"2024-04-28T13:07:28.292069+0000","last_peered":"2024-04-28T13:07:28.292069+0000","last_clean":"2024-04-28T13:07:28.292069+0000","last_became_active":"2024-04-28T13:07:25.303642+0000","last_became_peered":"2024-04-28T13:07:25.303642+0000","last_unstale":"2024-04-28T13:07:28.292069+0000","last_undegraded":"2024-04-28T13:07:28.292069+0000","last_fullsized":"2024-04-28T13:07:28.292069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:18:36.741678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019882+0000","last_change":"2024-04-28T13:07:26.302909+0000","last_active":"2024-04-28T13:07:28.019882+0000","last_peered":"2024-04-28T13:07:28.019882+0000","last_clean":"2024-04-28T13:07:28.019882+0000","last_became_active":"2024-04-28T13:07:26.302616+0000","last_became_peered":"2024-04-28T13:07:26.302616+0000","last_unstale":"2024-04-28T13:07:28.019882+0000","last_undegraded":"2024-04-28T13:07:28.019882+0000","last_fullsized":"2024-04-28T13:07:28.019882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:34:15.706993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021645+0000","last_change":"2024-04-28T13:07:25.303003+0000","last_active":"2024-04-28T13:07:28.021645+0000","last_peered":"2024-04-28T13:07:28.021645+0000","last_clean":"2024-04-28T13:07:28.021645+0000","last_became_active":"2024-04-28T13:07:25.302712+0000","last_became_peered":"2024-04-28T13:07:25.302712+0000","last_unstale":"2024-04-28T13:07:28.021645+0000","last_undegraded":"2024-04-28T13:07:28.021645+0000","last_fullsized":"2024-04-28T13:07:28.021645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:18:36.741678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519293+0000","last_change":"2024-04-28T13:07:26.315645+0000","last_active":"2024-04-28T13:07:27.519293+0000","last_peered":"2024-04-28T13:07:27.519293+0000","last_clean":"2024-04-28T13:07:27.519293+0000","last_became_active":"2024-04-28T13:07:26.315143+0000","last_became_peered":"2024-04-28T13:07:26.315143+0000","last_unstale":"2024-04-28T13:07:27.519293+0000","last_undegraded":"2024-04-28T13:07:27.519293+0000","last_fullsized":"2024-04-28T13:07:27.519293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:15:46.081328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019894+0000","last_change":"2024-04-28T13:07:25.305301+0000","last_active":"2024-04-28T13:07:28.019894+0000","last_peered":"2024-04-28T13:07:28.019894+0000","last_clean":"2024-04-28T13:07:28.019894+0000","last_became_active":"2024-04-28T13:07:25.304822+0000","last_became_peered":"2024-04-28T13:07:25.304822+0000","last_unstale":"2024-04-28T13:07:28.019894+0000","last_undegraded":"2024-04-28T13:07:28.019894+0000","last_fullsized":"2024-04-28T13:07:28.019894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:34:02.814463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020519+0000","last_change":"2024-04-28T13:07:26.303907+0000","last_active":"2024-04-28T13:07:28.020519+0000","last_peered":"2024-04-28T13:07:28.020519+0000","last_clean":"2024-04-28T13:07:28.020519+0000","last_became_active":"2024-04-28T13:07:26.302029+0000","last_became_peered":"2024-04-28T13:07:26.302029+0000","last_unstale":"2024-04-28T13:07:28.020519+0000","last_undegraded":"2024-04-28T13:07:28.020519+0000","last_fullsized":"2024-04-28T13:07:28.020519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:34:03.823865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298502+0000","last_change":"2024-04-28T13:07:25.302824+0000","last_active":"2024-04-28T13:07:27.298502+0000","last_peered":"2024-04-28T13:07:27.298502+0000","last_clean":"2024-04-28T13:07:27.298502+0000","last_became_active":"2024-04-28T13:07:25.302542+0000","last_became_peered":"2024-04-28T13:07:25.302542+0000","last_unstale":"2024-04-28T13:07:27.298502+0000","last_undegraded":"2024-04-28T13:07:27.298502+0000","last_fullsized":"2024-04-28T13:07:27.298502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:48:48.399055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019557+0000","last_change":"2024-04-28T13:07:26.302092+0000","last_active":"2024-04-28T13:07:28.019557+0000","last_peered":"2024-04-28T13:07:28.019557+0000","last_clean":"2024-04-28T13:07:28.019557+0000","last_became_active":"2024-04-28T13:07:26.301796+0000","last_became_peered":"2024-04-28T13:07:26.301796+0000","last_unstale":"2024-04-28T13:07:28.019557+0000","last_undegraded":"2024-04-28T13:07:28.019557+0000","last_fullsized":"2024-04-28T13:07:28.019557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:48:54.699408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298737+0000","last_change":"2024-04-28T13:07:25.297284+0000","last_active":"2024-04-28T13:07:27.298737+0000","last_peered":"2024-04-28T13:07:27.298737+0000","last_clean":"2024-04-28T13:07:27.298737+0000","last_became_active":"2024-04-28T13:07:25.296587+0000","last_became_peered":"2024-04-28T13:07:25.296587+0000","last_unstale":"2024-04-28T13:07:27.298737+0000","last_undegraded":"2024-04-28T13:07:27.298737+0000","last_fullsized":"2024-04-28T13:07:27.298737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:45:55.171349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019805+0000","last_change":"2024-04-28T13:07:26.312775+0000","last_active":"2024-04-28T13:07:28.019805+0000","last_peered":"2024-04-28T13:07:28.019805+0000","last_clean":"2024-04-28T13:07:28.019805+0000","last_became_active":"2024-04-28T13:07:26.312360+0000","last_became_peered":"2024-04-28T13:07:26.312360+0000","last_unstale":"2024-04-28T13:07:28.019805+0000","last_undegraded":"2024-04-28T13:07:28.019805+0000","last_fullsized":"2024-04-28T13:07:28.019805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T16:06:41.543332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020772+0000","last_change":"2024-04-28T13:07:25.305849+0000","last_active":"2024-04-28T13:07:28.020772+0000","last_peered":"2024-04-28T13:07:28.020772+0000","last_clean":"2024-04-28T13:07:28.020772+0000","last_became_active":"2024-04-28T13:07:25.305412+0000","last_became_peered":"2024-04-28T13:07:25.305412+0000","last_unstale":"2024-04-28T13:07:28.020772+0000","last_undegraded":"2024-04-28T13:07:28.020772+0000","last_fullsized":"2024-04-28T13:07:28.020772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:48:48.399055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019933+0000","last_change":"2024-04-28T13:07:26.310511+0000","last_active":"2024-04-28T13:07:28.019933+0000","last_peered":"2024-04-28T13:07:28.019933+0000","last_clean":"2024-04-28T13:07:28.019933+0000","last_became_active":"2024-04-28T13:07:26.310172+0000","last_became_peered":"2024-04-28T13:07:26.310172+0000","last_unstale":"2024-04-28T13:07:28.019933+0000","last_undegraded":"2024-04-28T13:07:28.019933+0000","last_fullsized":"2024-04-28T13:07:28.019933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:37:35.063109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299465+0000","last_change":"2024-04-28T13:07:26.310919+0000","last_active":"2024-04-28T13:07:27.299465+0000","last_peered":"2024-04-28T13:07:27.299465+0000","last_clean":"2024-04-28T13:07:27.299465+0000","last_became_active":"2024-04-28T13:07:26.310613+0000","last_became_peered":"2024-04-28T13:07:26.310613+0000","last_unstale":"2024-04-28T13:07:27.299465+0000","last_undegraded":"2024-04-28T13:07:27.299465+0000","last_fullsized":"2024-04-28T13:07:27.299465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T16:22:52.630763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020907+0000","last_change":"2024-04-28T13:07:25.307476+0000","last_active":"2024-04-28T13:07:28.020907+0000","last_peered":"2024-04-28T13:07:28.020907+0000","last_clean":"2024-04-28T13:07:28.020907+0000","last_became_active":"2024-04-28T13:07:25.307191+0000","last_became_peered":"2024-04-28T13:07:25.307191+0000","last_unstale":"2024-04-28T13:07:28.020907+0000","last_undegraded":"2024-04-28T13:07:28.020907+0000","last_fullsized":"2024-04-28T13:07:28.020907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:57:54.511728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299045+0000","last_change":"2024-04-28T13:07:26.310400+0000","last_active":"2024-04-28T13:07:27.299045+0000","last_peered":"2024-04-28T13:07:27.299045+0000","last_clean":"2024-04-28T13:07:27.299045+0000","last_became_active":"2024-04-28T13:07:26.310134+0000","last_became_peered":"2024-04-28T13:07:26.310134+0000","last_unstale":"2024-04-28T13:07:27.299045+0000","last_undegraded":"2024-04-28T13:07:27.299045+0000","last_fullsized":"2024-04-28T13:07:27.299045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T13:30:05.831084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021269+0000","last_change":"2024-04-28T13:07:25.307311+0000","last_active":"2024-04-28T13:07:28.021269+0000","last_peered":"2024-04-28T13:07:28.021269+0000","last_clean":"2024-04-28T13:07:28.021269+0000","last_became_active":"2024-04-28T13:07:25.307038+0000","last_became_peered":"2024-04-28T13:07:25.307038+0000","last_unstale":"2024-04-28T13:07:28.021269+0000","last_undegraded":"2024-04-28T13:07:28.021269+0000","last_fullsized":"2024-04-28T13:07:28.021269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:18:36.741678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519232+0000","last_change":"2024-04-28T13:07:26.311594+0000","last_active":"2024-04-28T13:07:27.519232+0000","last_peered":"2024-04-28T13:07:27.519232+0000","last_clean":"2024-04-28T13:07:27.519232+0000","last_became_active":"2024-04-28T13:07:26.311214+0000","last_became_peered":"2024-04-28T13:07:26.311214+0000","last_unstale":"2024-04-28T13:07:27.519232+0000","last_undegraded":"2024-04-28T13:07:27.519232+0000","last_fullsized":"2024-04-28T13:07:27.519232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:28:05.357255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019855+0000","last_change":"2024-04-28T13:07:25.301929+0000","last_active":"2024-04-28T13:07:28.019855+0000","last_peered":"2024-04-28T13:07:28.019855+0000","last_clean":"2024-04-28T13:07:28.019855+0000","last_became_active":"2024-04-28T13:07:25.301636+0000","last_became_peered":"2024-04-28T13:07:25.301636+0000","last_unstale":"2024-04-28T13:07:28.019855+0000","last_undegraded":"2024-04-28T13:07:28.019855+0000","last_fullsized":"2024-04-28T13:07:28.019855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:45:35.718557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019918+0000","last_change":"2024-04-28T13:07:26.311537+0000","last_active":"2024-04-28T13:07:28.019918+0000","last_peered":"2024-04-28T13:07:28.019918+0000","last_clean":"2024-04-28T13:07:28.019918+0000","last_became_active":"2024-04-28T13:07:26.310710+0000","last_became_peered":"2024-04-28T13:07:26.310710+0000","last_unstale":"2024-04-28T13:07:28.019918+0000","last_undegraded":"2024-04-28T13:07:28.019918+0000","last_fullsized":"2024-04-28T13:07:28.019918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:17:42.011752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519326+0000","last_change":"2024-04-28T13:07:25.302646+0000","last_active":"2024-04-28T13:07:27.519326+0000","last_peered":"2024-04-28T13:07:27.519326+0000","last_clean":"2024-04-28T13:07:27.519326+0000","last_became_active":"2024-04-28T13:07:25.302386+0000","last_became_peered":"2024-04-28T13:07:25.302386+0000","last_unstale":"2024-04-28T13:07:27.519326+0000","last_undegraded":"2024-04-28T13:07:27.519326+0000","last_fullsized":"2024-04-28T13:07:27.519326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:45:35.718557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":660255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":69431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":69305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-28T13:07:33.923 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-28T13:07:33.923 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-28T13:07:33.923 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-28T13:07:33.923 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-28T13:07:33.924 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-28T13:07:34.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.055+0000 7fe6539e7640 1 Processor -- start 2024-04-28T13:07:34.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.055+0000 7fe6539e7640 1 -- start start 2024-04-28T13:07:34.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.056+0000 7fe6539e7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe64c0ce5d0 0x7fe64c160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:34.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.056+0000 7fe6539e7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe64c06f230 0x7fe64c06f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:34.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.056+0000 7fe6539e7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe64c0b1980 con 0x7fe64c15c590 2024-04-28T13:07:34.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.056+0000 7fe6539e7640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fe64c160a80 con 0x7fe64c06f230 2024-04-28T13:07:34.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.056+0000 7fe6539e7640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fe64c0b5760 con 0x7fe64c0ce5d0 2024-04-28T13:07:34.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.056+0000 7fe651f84640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe64c06f230 0x7fe64c06f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:34.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.056+0000 7fe651f84640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe64c06f230 0x7fe64c06f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47962/0 (socket says 172.21.15.114:47962) 2024-04-28T13:07:34.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.056+0000 7fe651f84640 1 -- 172.21.15.114:0/3199609745 learned_addr learned my addr 172.21.15.114:0/3199609745 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:34.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.057+0000 7fe651783640 1 --2- 172.21.15.114:0/3199609745 >> v2:172.21.15.134:3300/0 conn(0x7fe64c0ce5d0 0x7fe64c160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:34.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.057+0000 7fe651f84640 1 -- 172.21.15.114:0/3199609745 >> v2:172.21.15.134:3300/0 conn(0x7fe64c0ce5d0 msgr2=0x7fe64c160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:34.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.057+0000 7fe651f84640 1 --2- 172.21.15.114:0/3199609745 >> v2:172.21.15.134:3300/0 conn(0x7fe64c0ce5d0 0x7fe64c160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:34.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.057+0000 7fe651f84640 1 -- 172.21.15.114:0/3199609745 >> v1:172.21.15.134:6789/0 conn(0x7fe64c15c590 legacy=0x7fe64c0b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:34.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.057+0000 7fe651f84640 1 -- 172.21.15.114:0/3199609745 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe64c141730 con 0x7fe64c06f230 2024-04-28T13:07:34.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.057+0000 7fe651f84640 1 --2- 172.21.15.114:0/3199609745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe64c06f230 0x7fe64c06f6c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe64c074470 tx=0x7fe64402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93f1000a96b1c5d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:34.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.057+0000 7fe643fff640 1 -- 172.21.15.114:0/3199609745 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe644037070 con 0x7fe64c06f230 2024-04-28T13:07:34.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.057+0000 7fe643fff640 1 -- 172.21.15.114:0/3199609745 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe644032440 con 0x7fe64c06f230 2024-04-28T13:07:34.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.057+0000 7fe643fff640 1 -- 172.21.15.114:0/3199609745 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe644032810 con 0x7fe64c06f230 2024-04-28T13:07:34.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.058+0000 7fe6539e7640 1 -- 172.21.15.114:0/3199609745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe64c06f230 msgr2=0x7fe64c06f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:34.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.058+0000 7fe6539e7640 1 --2- 172.21.15.114:0/3199609745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe64c06f230 0x7fe64c06f6c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe64c074470 tx=0x7fe64402a270 comp rx=0 tx=0).stop 2024-04-28T13:07:34.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.058+0000 7fe6539e7640 1 -- 172.21.15.114:0/3199609745 shutdown_connections 2024-04-28T13:07:34.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.058+0000 7fe6539e7640 1 --2- 172.21.15.114:0/3199609745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe64c06f230 0x7fe64c06f6c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:34.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.058+0000 7fe6539e7640 1 --2- 172.21.15.114:0/3199609745 >> v2:172.21.15.134:3300/0 conn(0x7fe64c0ce5d0 0x7fe64c160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:34.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.058+0000 7fe6539e7640 1 -- 172.21.15.114:0/3199609745 >> 172.21.15.114:0/3199609745 conn(0x7fe64c0d1fe0 msgr2=0x7fe64c0d23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:34.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.058+0000 7fe6539e7640 1 -- 172.21.15.114:0/3199609745 shutdown_connections 2024-04-28T13:07:34.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.058+0000 7fe6539e7640 1 -- 172.21.15.114:0/3199609745 wait complete. 2024-04-28T13:07:34.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.059+0000 7fe6539e7640 1 Processor -- start 2024-04-28T13:07:34.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.059+0000 7fe6539e7640 1 -- start start 2024-04-28T13:07:34.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.060+0000 7fe6539e7640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe64c06f230 0x7fe64c1f3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:34.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.060+0000 7fe6539e7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe64c0ce5d0 0x7fe64c13c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:34.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.060+0000 7fe6539e7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe64c15c590 0x7fe64c071410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:34.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.060+0000 7fe6539e7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe64c15d0a0 con 0x7fe64c15c590 2024-04-28T13:07:34.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.060+0000 7fe6539e7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe64c15cdc0 con 0x7fe64c0ce5d0 2024-04-28T13:07:34.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.060+0000 7fe6539e7640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fe64c15d380 con 0x7fe64c06f230 2024-04-28T13:07:34.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.060+0000 7fe651f84640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe64c15c590 0x7fe64c071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:34.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.060+0000 7fe651f84640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe64c15c590 0x7fe64c071410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47966/0 (socket says 172.21.15.114:47966) 2024-04-28T13:07:34.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.060+0000 7fe651f84640 1 -- 172.21.15.114:0/4890121 learned_addr learned my addr 172.21.15.114:0/4890121 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:34.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.060+0000 7fe651783640 1 --2- 172.21.15.114:0/4890121 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe64c06f230 0x7fe64c1f3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:34.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.060+0000 7fe650f82640 1 --2- 172.21.15.114:0/4890121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe64c0ce5d0 0x7fe64c13c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:34.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.060+0000 7fe651f84640 1 -- 172.21.15.114:0/4890121 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe64c06f230 msgr2=0x7fe64c1f3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:34.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.060+0000 7fe651f84640 1 --2- 172.21.15.114:0/4890121 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe64c06f230 0x7fe64c1f3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:34.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.060+0000 7fe651f84640 1 -- 172.21.15.114:0/4890121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe64c0ce5d0 msgr2=0x7fe64c13c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:34.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.060+0000 7fe651f84640 1 --2- 172.21.15.114:0/4890121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe64c0ce5d0 0x7fe64c13c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:34.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.060+0000 7fe651f84640 1 -- 172.21.15.114:0/4890121 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe64c1f3c40 con 0x7fe64c15c590 2024-04-28T13:07:34.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.060+0000 7fe651783640 1 --2- 172.21.15.114:0/4890121 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe64c06f230 0x7fe64c1f3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:34.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.060+0000 7fe650f82640 1 --2- 172.21.15.114:0/4890121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe64c0ce5d0 0x7fe64c13c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:34.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.060+0000 7fe651f84640 1 --2- 172.21.15.114:0/4890121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe64c15c590 0x7fe64c071410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe64402a2b0 tx=0x7fe6440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:34.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.061+0000 7fe641ffb640 1 -- 172.21.15.114:0/4890121 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe644037040 con 0x7fe64c15c590 2024-04-28T13:07:34.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.061+0000 7fe641ffb640 1 -- 172.21.15.114:0/4890121 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe644042070 con 0x7fe64c15c590 2024-04-28T13:07:34.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.061+0000 7fe6539e7640 1 -- 172.21.15.114:0/4890121 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe64c1539c0 con 0x7fe64c15c590 2024-04-28T13:07:34.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.061+0000 7fe641ffb640 1 -- 172.21.15.114:0/4890121 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe644030920 con 0x7fe64c15c590 2024-04-28T13:07:34.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.061+0000 7fe6539e7640 1 -- 172.21.15.114:0/4890121 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe64c070c10 con 0x7fe64c15c590 2024-04-28T13:07:34.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.062+0000 7fe6539e7640 1 -- 172.21.15.114:0/4890121 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe64c06a3d0 con 0x7fe64c15c590 2024-04-28T13:07:34.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.062+0000 7fe641ffb640 1 -- 172.21.15.114:0/4890121 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe644030ac0 con 0x7fe64c15c590 2024-04-28T13:07:34.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.063+0000 7fe641ffb640 1 --2- 172.21.15.114:0/4890121 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fe63006c8f0 0x7fe63006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:34.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.063+0000 7fe651783640 1 --2- 172.21.15.114:0/4890121 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fe63006c8f0 0x7fe63006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:34.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.063+0000 7fe641ffb640 1 -- 172.21.15.114:0/4890121 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe6440ac410 con 0x7fe64c15c590 2024-04-28T13:07:34.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.063+0000 7fe651783640 1 --2- 172.21.15.114:0/4890121 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fe63006c8f0 0x7fe63006edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe648009b20 tx=0x7fe6480039d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:34.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.067+0000 7fe641ffb640 1 -- 172.21.15.114:0/4890121 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe64407a280 con 0x7fe64c15c590 2024-04-28T13:07:34.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.288+0000 7fe6539e7640 1 -- 172.21.15.114:0/4890121 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fe64c06c790 con 0x7fe64c15c590 2024-04-28T13:07:34.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.291+0000 7fe641ffb640 1 -- 172.21.15.114:0/4890121 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174144 (secure 0 0 0) 0x7fe64407e580 con 0x7fe64c15c590 2024-04-28T13:07:34.294 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:34.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.293+0000 7fe6539e7640 1 -- 172.21.15.114:0/4890121 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fe63006c8f0 msgr2=0x7fe63006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:34.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.293+0000 7fe6539e7640 1 --2- 172.21.15.114:0/4890121 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fe63006c8f0 0x7fe63006edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe648009b20 tx=0x7fe6480039d0 comp rx=0 tx=0).stop 2024-04-28T13:07:34.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.293+0000 7fe6539e7640 1 -- 172.21.15.114:0/4890121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe64c15c590 msgr2=0x7fe64c071410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:34.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.293+0000 7fe6539e7640 1 --2- 172.21.15.114:0/4890121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe64c15c590 0x7fe64c071410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe64402a2b0 tx=0x7fe6440046c0 comp rx=0 tx=0).stop 2024-04-28T13:07:34.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.294+0000 7fe6539e7640 1 -- 172.21.15.114:0/4890121 shutdown_connections 2024-04-28T13:07:34.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.294+0000 7fe6539e7640 1 --2- 172.21.15.114:0/4890121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe64c15c590 0x7fe64c071410 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:34.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.294+0000 7fe6539e7640 1 --2- 172.21.15.114:0/4890121 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fe63006c8f0 0x7fe63006edb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:34.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.294+0000 7fe6539e7640 1 --2- 172.21.15.114:0/4890121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe64c0ce5d0 0x7fe64c13c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:34.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.294+0000 7fe6539e7640 1 --2- 172.21.15.114:0/4890121 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe64c06f230 0x7fe64c1f3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:34.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.294+0000 7fe6539e7640 1 -- 172.21.15.114:0/4890121 >> 172.21.15.114:0/4890121 conn(0x7fe64c0d1fe0 msgr2=0x7fe64c0b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:34.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.294+0000 7fe6539e7640 1 -- 172.21.15.114:0/4890121 shutdown_connections 2024-04-28T13:07:34.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.294+0000 7fe6539e7640 1 -- 172.21.15.114:0/4890121 wait complete. 2024-04-28T13:07:34.305 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2240257326},{"type":"v1","addr":"172.21.15.114:6833","nonce":2240257326}]},"active_addr":"172.21.15.114:6833/2240257326","active_change":"2024-04-28T13:07:04.698809+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4101,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":2150865086}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":2579288568}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":3007374084}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":2902103884}]}]} 2024-04-28T13:07:34.308 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-28T13:07:34.308 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-28T13:07:34.308 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:07:34.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.404+0000 7f367fbf7640 1 Processor -- start 2024-04-28T13:07:34.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.404+0000 7f367fbf7640 1 -- start start 2024-04-28T13:07:34.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.405+0000 7f367fbf7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f367815f8a0 0x7f3678071160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:34.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.405+0000 7f367fbf7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3678163c20 con 0x7f367815fc80 2024-04-28T13:07:34.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.405+0000 7f367fbf7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36780c88e0 con 0x7f3678161bf0 2024-04-28T13:07:34.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.405+0000 7f367fbf7640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f36780c8f10 con 0x7f367815f8a0 2024-04-28T13:07:34.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.405+0000 7f367d993640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f367815f8a0 0x7f3678071160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:34.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.405+0000 7f367d192640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f367815fc80 0x7f3678162e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46808/0 (socket says 172.21.15.114:46808) 2024-04-28T13:07:34.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.405+0000 7f367d993640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f367815f8a0 0x7f3678071160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47980/0 (socket says 172.21.15.114:47980) 2024-04-28T13:07:34.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.405+0000 7f367d192640 1 -- 172.21.15.114:0/87917022 learned_addr learned my addr 172.21.15.114:0/87917022 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:34.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.405+0000 7f367d993640 1 -- 172.21.15.114:0/87917022 >> v1:172.21.15.134:6789/0 conn(0x7f3678161bf0 legacy=0x7f3678163510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:34.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.405+0000 7f367d993640 1 -- 172.21.15.114:0/87917022 >> v1:172.21.15.114:6789/0 conn(0x7f367815fc80 legacy=0x7f3678162e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:34.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.405+0000 7f367d993640 1 -- 172.21.15.114:0/87917022 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f367806d7a0 con 0x7f367815f8a0 2024-04-28T13:07:34.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.406+0000 7f367d993640 1 --2- 172.21.15.114:0/87917022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f367815f8a0 0x7f3678071160 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f36740097a0 tx=0x7f367402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7082fc598d007a06 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:34.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.406+0000 7f367c991640 1 -- 172.21.15.114:0/87917022 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3674037070 con 0x7f367815f8a0 2024-04-28T13:07:34.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.406+0000 7f367c991640 1 -- 172.21.15.114:0/87917022 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3674032440 con 0x7f367815f8a0 2024-04-28T13:07:34.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.406+0000 7f367c991640 1 -- 172.21.15.114:0/87917022 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3674032810 con 0x7f367815f8a0 2024-04-28T13:07:34.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.406+0000 7f367fbf7640 1 -- 172.21.15.114:0/87917022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f367815f8a0 msgr2=0x7f3678071160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:34.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.406+0000 7f367fbf7640 1 --2- 172.21.15.114:0/87917022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f367815f8a0 0x7f3678071160 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f36740097a0 tx=0x7f367402a1e0 comp rx=0 tx=0).stop 2024-04-28T13:07:34.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.406+0000 7f367fbf7640 1 -- 172.21.15.114:0/87917022 shutdown_connections 2024-04-28T13:07:34.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.406+0000 7f367fbf7640 1 --2- 172.21.15.114:0/87917022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f367815f8a0 0x7f3678071160 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:34.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.406+0000 7f367fbf7640 1 -- 172.21.15.114:0/87917022 >> 172.21.15.114:0/87917022 conn(0x7f3678062d70 msgr2=0x7f3678063150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:34.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.406+0000 7f367fbf7640 1 -- 172.21.15.114:0/87917022 shutdown_connections 2024-04-28T13:07:34.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.406+0000 7f367fbf7640 1 -- 172.21.15.114:0/87917022 wait complete. 2024-04-28T13:07:34.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.407+0000 7f367fbf7640 1 Processor -- start 2024-04-28T13:07:34.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.408+0000 7f367fbf7640 1 -- start start 2024-04-28T13:07:34.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.408+0000 7f367fbf7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f367815f8a0 0x7f36780ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:34.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.408+0000 7f367fbf7640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f367815fc80 0x7f36780cec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:34.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.408+0000 7f367fbf7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3678161bf0 0x7f36780ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:34.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.408+0000 7f367fbf7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f36780d3930 con 0x7f367815f8a0 2024-04-28T13:07:34.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.408+0000 7f367fbf7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f36780c8ba0 con 0x7f3678161bf0 2024-04-28T13:07:34.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.408+0000 7f367fbf7640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f36781600c0 con 0x7f367815fc80 2024-04-28T13:07:34.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.408+0000 7f367d993640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f367815f8a0 0x7f36780ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:34.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.408+0000 7f367d993640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f367815f8a0 0x7f36780ccf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47982/0 (socket says 172.21.15.114:47982) 2024-04-28T13:07:34.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.408+0000 7f367d993640 1 -- 172.21.15.114:0/431871622 learned_addr learned my addr 172.21.15.114:0/431871622 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:34.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.408+0000 7f367d192640 1 --2- 172.21.15.114:0/431871622 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f367815fc80 0x7f36780cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:34.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.408+0000 7f367e194640 1 --2- 172.21.15.114:0/431871622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3678161bf0 0x7f36780ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:34.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.409+0000 7f367d993640 1 -- 172.21.15.114:0/431871622 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f367815fc80 msgr2=0x7f36780cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:34.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.409+0000 7f367d993640 1 --2- 172.21.15.114:0/431871622 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f367815fc80 0x7f36780cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:34.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.409+0000 7f367d993640 1 -- 172.21.15.114:0/431871622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3678161bf0 msgr2=0x7f36780ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:34.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.409+0000 7f367d993640 1 --2- 172.21.15.114:0/431871622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3678161bf0 0x7f36780ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:34.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.409+0000 7f367d993640 1 -- 172.21.15.114:0/431871622 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36780cf370 con 0x7f367815f8a0 2024-04-28T13:07:34.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.409+0000 7f367e194640 1 --2- 172.21.15.114:0/431871622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3678161bf0 0x7f36780ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:34.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.409+0000 7f367d993640 1 --2- 172.21.15.114:0/431871622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f367815f8a0 0x7f36780ccf30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f36740098c0 tx=0x7f36740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:34.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.409+0000 7f366e7fc640 1 -- 172.21.15.114:0/431871622 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3674037040 con 0x7f367815f8a0 2024-04-28T13:07:34.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.409+0000 7f366e7fc640 1 -- 172.21.15.114:0/431871622 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3674042070 con 0x7f367815f8a0 2024-04-28T13:07:34.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.409+0000 7f367fbf7640 1 -- 172.21.15.114:0/431871622 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36780cf650 con 0x7f367815f8a0 2024-04-28T13:07:34.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.409+0000 7f366e7fc640 1 -- 172.21.15.114:0/431871622 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3674030a70 con 0x7f367815f8a0 2024-04-28T13:07:34.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.409+0000 7f367fbf7640 1 -- 172.21.15.114:0/431871622 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36780cfc10 con 0x7f367815f8a0 2024-04-28T13:07:34.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.410+0000 7f367fbf7640 1 -- 172.21.15.114:0/431871622 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f367806a3d0 con 0x7f367815f8a0 2024-04-28T13:07:34.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.410+0000 7f366e7fc640 1 -- 172.21.15.114:0/431871622 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3674030c10 con 0x7f367815f8a0 2024-04-28T13:07:34.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.411+0000 7f366e7fc640 1 --2- 172.21.15.114:0/431871622 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f365c06c8f0 0x7f365c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:34.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.411+0000 7f367d192640 1 --2- 172.21.15.114:0/431871622 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f365c06c8f0 0x7f365c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:34.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.411+0000 7f366e7fc640 1 -- 172.21.15.114:0/431871622 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f36740ac490 con 0x7f367815f8a0 2024-04-28T13:07:34.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.411+0000 7f367d192640 1 --2- 172.21.15.114:0/431871622 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f365c06c8f0 0x7f365c06edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f36780cbdd0 tx=0x7f3668007e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:34.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.415+0000 7f366e7fc640 1 -- 172.21.15.114:0/431871622 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f367407a8c0 con 0x7f367815f8a0 2024-04-28T13:07:34.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.590+0000 7f367fbf7640 1 -- 172.21.15.114:0/431871622 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3678070f40 con 0x7f367815f8a0 2024-04-28T13:07:34.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.591+0000 7f366e7fc640 1 -- 172.21.15.114:0/431871622 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7f367407a1c0 con 0x7f367815f8a0 2024-04-28T13:07:34.592 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:34.592 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:07:27.292537+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-28T13:07:23.706359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-28T13:07:24.596188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:07:34.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.594+0000 7f367fbf7640 1 -- 172.21.15.114:0/431871622 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f365c06c8f0 msgr2=0x7f365c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:34.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.594+0000 7f367fbf7640 1 --2- 172.21.15.114:0/431871622 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f365c06c8f0 0x7f365c06edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f36780cbdd0 tx=0x7f3668007e80 comp rx=0 tx=0).stop 2024-04-28T13:07:34.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.594+0000 7f367fbf7640 1 -- 172.21.15.114:0/431871622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f367815f8a0 msgr2=0x7f36780ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:34.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.594+0000 7f367fbf7640 1 --2- 172.21.15.114:0/431871622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f367815f8a0 0x7f36780ccf30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f36740098c0 tx=0x7f36740046c0 comp rx=0 tx=0).stop 2024-04-28T13:07:34.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.594+0000 7f367fbf7640 1 -- 172.21.15.114:0/431871622 shutdown_connections 2024-04-28T13:07:34.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.594+0000 7f367fbf7640 1 --2- 172.21.15.114:0/431871622 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f365c06c8f0 0x7f365c06edb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:34.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.594+0000 7f367fbf7640 1 --2- 172.21.15.114:0/431871622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3678161bf0 0x7f36780ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:34.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.594+0000 7f367fbf7640 1 --2- 172.21.15.114:0/431871622 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f367815fc80 0x7f36780cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:34.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.594+0000 7f367fbf7640 1 --2- 172.21.15.114:0/431871622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f367815f8a0 0x7f36780ccf30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:34.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.594+0000 7f367fbf7640 1 -- 172.21.15.114:0/431871622 >> 172.21.15.114:0/431871622 conn(0x7f3678062d70 msgr2=0x7f36780b4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:34.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.594+0000 7f367fbf7640 1 -- 172.21.15.114:0/431871622 shutdown_connections 2024-04-28T13:07:34.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.594+0000 7f367fbf7640 1 -- 172.21.15.114:0/431871622 wait complete. 2024-04-28T13:07:34.606 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-28T13:07:34.606 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:07:34.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.702+0000 7f2b1e893640 1 Processor -- start 2024-04-28T13:07:34.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.702+0000 7f2b1e893640 1 -- start start 2024-04-28T13:07:34.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.702+0000 7f2b1e893640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b180b73d0 0x7f2b180d27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:34.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.702+0000 7f2b1e893640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b18072830 con 0x7f2b18070710 2024-04-28T13:07:34.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.702+0000 7f2b1e893640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b180d1d10 con 0x7f2b180722a0 2024-04-28T13:07:34.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.702+0000 7f2b1e893640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2b18072b10 con 0x7f2b180b73d0 2024-04-28T13:07:34.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.702+0000 7f2b177fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2b18070710 0x7f2b18071b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46822/0 (socket says 172.21.15.114:46822) 2024-04-28T13:07:34.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.703+0000 7f2b177fe640 1 -- 172.21.15.114:0/3613316636 learned_addr learned my addr 172.21.15.114:0/3613316636 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:34.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.703+0000 7f2b17fff640 1 --2- 172.21.15.114:0/3613316636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b180b73d0 0x7f2b180d27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:34.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.703+0000 7f2b16ffd640 1 -- 172.21.15.114:0/3613316636 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2838107218 0 0) 0x7f2b18072830 con 0x7f2b18070710 2024-04-28T13:07:34.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.703+0000 7f2b16ffd640 1 -- 172.21.15.114:0/3613316636 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b00003520 con 0x7f2b18070710 2024-04-28T13:07:34.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.703+0000 7f2b16ffd640 1 -- 172.21.15.114:0/3613316636 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2057688533 0 0) 0x7f2b180d1d10 con 0x7f2b180722a0 2024-04-28T13:07:34.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.703+0000 7f2b17fff640 1 -- 172.21.15.114:0/3613316636 >> v1:172.21.15.134:6789/0 conn(0x7f2b180722a0 legacy=0x7f2b180b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:34.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.703+0000 7f2b17fff640 1 -- 172.21.15.114:0/3613316636 >> v1:172.21.15.114:6789/0 conn(0x7f2b18070710 legacy=0x7f2b18071b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:34.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.703+0000 7f2b17fff640 1 -- 172.21.15.114:0/3613316636 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b180d1ff0 con 0x7f2b180b73d0 2024-04-28T13:07:34.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.704+0000 7f2b17fff640 1 --2- 172.21.15.114:0/3613316636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b180b73d0 0x7f2b180d27f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2b080097d0 tx=0x7f2b0802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c10d198501dbc5f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:34.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.704+0000 7f2b16ffd640 1 -- 172.21.15.114:0/3613316636 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b08037070 con 0x7f2b180b73d0 2024-04-28T13:07:34.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.704+0000 7f2b16ffd640 1 -- 172.21.15.114:0/3613316636 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b0802ac10 con 0x7f2b180b73d0 2024-04-28T13:07:34.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.704+0000 7f2b16ffd640 1 -- 172.21.15.114:0/3613316636 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c0015f0 con 0x7f2b180b73d0 2024-04-28T13:07:34.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.704+0000 7f2b1e893640 1 -- 172.21.15.114:0/3613316636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b180b73d0 msgr2=0x7f2b180d27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:34.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.704+0000 7f2b1e893640 1 --2- 172.21.15.114:0/3613316636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b180b73d0 0x7f2b180d27f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2b080097d0 tx=0x7f2b0802a180 comp rx=0 tx=0).stop 2024-04-28T13:07:34.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.704+0000 7f2b1e893640 1 -- 172.21.15.114:0/3613316636 shutdown_connections 2024-04-28T13:07:34.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.704+0000 7f2b1e893640 1 --2- 172.21.15.114:0/3613316636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b180b73d0 0x7f2b180d27f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:34.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.704+0000 7f2b1e893640 1 -- 172.21.15.114:0/3613316636 >> 172.21.15.114:0/3613316636 conn(0x7f2b180b4c60 msgr2=0x7f2b180b5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:34.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.704+0000 7f2b1e893640 1 -- 172.21.15.114:0/3613316636 shutdown_connections 2024-04-28T13:07:34.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.704+0000 7f2b1e893640 1 -- 172.21.15.114:0/3613316636 wait complete. 2024-04-28T13:07:34.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.706+0000 7f2b1e893640 1 Processor -- start 2024-04-28T13:07:34.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.706+0000 7f2b1e893640 1 -- start start 2024-04-28T13:07:34.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.706+0000 7f2b1e893640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b18070710 0x7f2b1814a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:34.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.706+0000 7f2b1e893640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b180722a0 0x7f2b180ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:34.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.706+0000 7f2b1e893640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b180b73d0 0x7f2b18147230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:34.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.706+0000 7f2b1e893640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2b180d2eb0 con 0x7f2b18070710 2024-04-28T13:07:34.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.706+0000 7f2b1e893640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2b180d2d30 con 0x7f2b180b73d0 2024-04-28T13:07:34.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.706+0000 7f2b1e893640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2b180b77b0 con 0x7f2b180722a0 2024-04-28T13:07:34.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.706+0000 7f2b17fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b18070710 0x7f2b1814a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:34.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.706+0000 7f2b17fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b18070710 0x7f2b1814a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47988/0 (socket says 172.21.15.114:47988) 2024-04-28T13:07:34.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.707+0000 7f2b17fff640 1 -- 172.21.15.114:0/459259996 learned_addr learned my addr 172.21.15.114:0/459259996 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:34.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.707+0000 7f2b177fe640 1 --2- 172.21.15.114:0/459259996 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b180722a0 0x7f2b180ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:34.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.707+0000 7f2b1ce30640 1 --2- 172.21.15.114:0/459259996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b180b73d0 0x7f2b18147230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:34.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.707+0000 7f2b17fff640 1 -- 172.21.15.114:0/459259996 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b180722a0 msgr2=0x7f2b180ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:34.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.707+0000 7f2b17fff640 1 --2- 172.21.15.114:0/459259996 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b180722a0 0x7f2b180ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:34.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.707+0000 7f2b17fff640 1 -- 172.21.15.114:0/459259996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b180b73d0 msgr2=0x7f2b18147230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:34.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.707+0000 7f2b17fff640 1 --2- 172.21.15.114:0/459259996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b180b73d0 0x7f2b18147230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:34.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.707+0000 7f2b17fff640 1 -- 172.21.15.114:0/459259996 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b180b04a0 con 0x7f2b18070710 2024-04-28T13:07:34.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.707+0000 7f2b1ce30640 1 --2- 172.21.15.114:0/459259996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b180b73d0 0x7f2b18147230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:07:34.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.707+0000 7f2b17fff640 1 --2- 172.21.15.114:0/459259996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b18070710 0x7f2b1814a770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2b08035040 tx=0x7f2b080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:34.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.707+0000 7f2b14ff9640 1 -- 172.21.15.114:0/459259996 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b08042070 con 0x7f2b18070710 2024-04-28T13:07:34.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.707+0000 7f2b14ff9640 1 -- 172.21.15.114:0/459259996 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b0803d440 con 0x7f2b18070710 2024-04-28T13:07:34.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.707+0000 7f2b14ff9640 1 -- 172.21.15.114:0/459259996 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b08037040 con 0x7f2b18070710 2024-04-28T13:07:34.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.707+0000 7f2b1e893640 1 -- 172.21.15.114:0/459259996 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b180aed90 con 0x7f2b18070710 2024-04-28T13:07:34.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.707+0000 7f2b1e893640 1 -- 172.21.15.114:0/459259996 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b180b0a20 con 0x7f2b18070710 2024-04-28T13:07:34.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.708+0000 7f2b1e893640 1 -- 172.21.15.114:0/459259996 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b1806a3d0 con 0x7f2b18070710 2024-04-28T13:07:34.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.709+0000 7f2b14ff9640 1 -- 172.21.15.114:0/459259996 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2b08045070 con 0x7f2b18070710 2024-04-28T13:07:34.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.709+0000 7f2b14ff9640 1 --2- 172.21.15.114:0/459259996 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2b0406c8f0 0x7f2b0406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:34.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.709+0000 7f2b177fe640 1 --2- 172.21.15.114:0/459259996 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2b0406c8f0 0x7f2b0406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:34.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.709+0000 7f2b14ff9640 1 -- 172.21.15.114:0/459259996 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2b080ac000 con 0x7f2b18070710 2024-04-28T13:07:34.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.709+0000 7f2b177fe640 1 --2- 172.21.15.114:0/459259996 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2b0406c8f0 0x7f2b0406edb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c001760 tx=0x7f2b0c001650 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:34.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.714+0000 7f2b14ff9640 1 -- 172.21.15.114:0/459259996 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2b0807a4c0 con 0x7f2b18070710 2024-04-28T13:07:34.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.888+0000 7f2b1e893640 1 -- 172.21.15.114:0/459259996 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2b18071460 con 0x7f2b18070710 2024-04-28T13:07:34.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.889+0000 7f2b14ff9640 1 -- 172.21.15.114:0/459259996 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7f2b08079dc0 con 0x7f2b18070710 2024-04-28T13:07:34.890 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:34.890 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:07:27.292537+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-28T13:07:23.706359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-28T13:07:24.596188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:07:34.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.891+0000 7f2b1e893640 1 -- 172.21.15.114:0/459259996 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2b0406c8f0 msgr2=0x7f2b0406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:34.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.891+0000 7f2b1e893640 1 --2- 172.21.15.114:0/459259996 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2b0406c8f0 0x7f2b0406edb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c001760 tx=0x7f2b0c001650 comp rx=0 tx=0).stop 2024-04-28T13:07:34.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.891+0000 7f2b1e893640 1 -- 172.21.15.114:0/459259996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b18070710 msgr2=0x7f2b1814a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:34.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.891+0000 7f2b1e893640 1 --2- 172.21.15.114:0/459259996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b18070710 0x7f2b1814a770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2b08035040 tx=0x7f2b080046c0 comp rx=0 tx=0).stop 2024-04-28T13:07:34.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.891+0000 7f2b1e893640 1 -- 172.21.15.114:0/459259996 shutdown_connections 2024-04-28T13:07:34.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.891+0000 7f2b1e893640 1 --2- 172.21.15.114:0/459259996 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2b0406c8f0 0x7f2b0406edb0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:34.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.891+0000 7f2b1e893640 1 --2- 172.21.15.114:0/459259996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b180b73d0 0x7f2b18147230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:34.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.891+0000 7f2b1e893640 1 --2- 172.21.15.114:0/459259996 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b180722a0 0x7f2b180ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:34.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.891+0000 7f2b1e893640 1 --2- 172.21.15.114:0/459259996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b18070710 0x7f2b1814a770 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:34.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.891+0000 7f2b1e893640 1 -- 172.21.15.114:0/459259996 >> 172.21.15.114:0/459259996 conn(0x7f2b180b4c60 msgr2=0x7f2b18157390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:34.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.891+0000 7f2b1e893640 1 -- 172.21.15.114:0/459259996 shutdown_connections 2024-04-28T13:07:34.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:34.891+0000 7f2b1e893640 1 -- 172.21.15.114:0/459259996 wait complete. 2024-04-28T13:07:34.904 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-28T13:07:34.904 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-28T13:07:34.904 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-28T13:07:34.905 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-28T13:07:34.905 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-28T13:07:34.906 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-28T13:07:34.906 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-28T13:07:34.906 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-28T13:07:35.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.071+0000 7fbe94722640 1 Processor -- start 2024-04-28T13:07:35.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.071+0000 7fbe94722640 1 -- start start 2024-04-28T13:07:35.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.072+0000 7f923b221640 1 Processor -- start 2024-04-28T13:07:35.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.072+0000 7f923b221640 1 -- start start 2024-04-28T13:07:35.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.072+0000 7f1fc1342640 1 Processor -- start 2024-04-28T13:07:35.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.072+0000 7f1fc1342640 1 -- start start 2024-04-28T13:07:35.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.073+0000 7fbe94722640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe8c0701f0 0x7fbe8c15f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.073+0000 7fbe94722640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbe8c15fb10 0x7fbe8c0d0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.073+0000 7fbe94722640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe8c1632f0 con 0x7fbe8c0d1130 2024-04-28T13:07:35.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.073+0000 7fbe94722640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fbe8c15c8e0 con 0x7fbe8c15fb10 2024-04-28T13:07:35.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.073+0000 7fbe94722640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fbe8c0d1580 con 0x7fbe8c0701f0 2024-04-28T13:07:35.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.073+0000 7f0c06f52640 1 Processor -- start 2024-04-28T13:07:35.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.073+0000 7fcd77512640 1 Processor -- start 2024-04-28T13:07:35.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.073+0000 7f923b221640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f922c04f290 0x7f922c007190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.073+0000 7f0c06f52640 1 -- start start 2024-04-28T13:07:35.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.073+0000 7f5ab2878640 1 Processor -- start 2024-04-28T13:07:35.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.073+0000 7f923b221640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f922c033990 0x7f922c037c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7fbe924be640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe8c0701f0 0x7fbe8c15f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7f923b221640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f922c054830 con 0x7f922c0543c0 2024-04-28T13:07:35.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7fbe924be640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe8c0701f0 0x7fbe8c15f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:58348/0 (socket says 172.21.15.114:58348) 2024-04-28T13:07:35.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7fbe924be640 1 -- 172.21.15.114:0/854582385 learned_addr learned my addr 172.21.15.114:0/854582385 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:35.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7f923b221640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f922c038890 con 0x7f922c04f290 2024-04-28T13:07:35.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7f923b221640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f922c0069d0 con 0x7f922c033990 2024-04-28T13:07:35.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7f923a21f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f922c04f290 0x7f922c007190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7f923a21f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f922c04f290 0x7f922c007190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:49856/0 (socket says 172.21.15.114:49856) 2024-04-28T13:07:35.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7f923a21f640 1 -- 172.21.15.114:0/1635500096 learned_addr learned my addr 172.21.15.114:0/1635500096 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:35.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7f1fc1342640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1fbc0693f0 0x7f1fbc0742d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7f1fc1342640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fbc0b5330 con 0x7f1fbc0b57e0 2024-04-28T13:07:35.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7f1fc1342640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fbc0b0550 con 0x7f1fbc0cea30 2024-04-28T13:07:35.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7f1fc1342640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f1fbc0b0830 con 0x7f1fbc0693f0 2024-04-28T13:07:35.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7f6e2549c640 1 Processor -- start 2024-04-28T13:07:35.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7f1fbbfff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f1fbc0cea30 0x7f1fbc15b5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:43322/0 (socket says 172.21.15.114:43322) 2024-04-28T13:07:35.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7f1fbbfff640 1 -- 172.21.15.114:0/2505170315 learned_addr learned my addr 172.21.15.114:0/2505170315 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:35.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7f9239a1e640 1 --2- 172.21.15.114:0/1635500096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f922c033990 0x7f922c037c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7fbe91cbd640 1 --2- 172.21.15.114:0/854582385 >> v2:172.21.15.134:3300/0 conn(0x7fbe8c15fb10 0x7fbe8c0d0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7fbe924be640 1 -- 172.21.15.114:0/854582385 >> v2:172.21.15.134:3300/0 conn(0x7fbe8c15fb10 msgr2=0x7fbe8c0d0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:35.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7fbe924be640 1 --2- 172.21.15.114:0/854582385 >> v2:172.21.15.134:3300/0 conn(0x7fbe8c15fb10 0x7fbe8c0d0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7fbe924be640 1 -- 172.21.15.114:0/854582385 >> v1:172.21.15.134:6789/0 conn(0x7fbe8c0d1130 legacy=0x7fbe8c072220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:35.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7fbe924be640 1 -- 172.21.15.114:0/854582385 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe8c15be00 con 0x7fbe8c0701f0 2024-04-28T13:07:35.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.073+0000 7fcd77512640 1 -- start start 2024-04-28T13:07:35.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7fcd77512640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcd7014d160 0x7fcd700b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7fcd77512640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcd700b43a0 0x7fcd700d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.075+0000 7fcd77512640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd700ceb60 con 0x7fcd700d12c0 2024-04-28T13:07:35.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.075+0000 7fcd77512640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fcd700cee40 con 0x7fcd700b43a0 2024-04-28T13:07:35.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.075+0000 7fcd77512640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fcd700cf120 con 0x7fcd7014d160 2024-04-28T13:07:35.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.075+0000 7f0c06f52640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bf80eac70 0x7f0bf8052680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7f923921d640 1 -- 172.21.15.114:0/1635500096 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2476323010 0 0) 0x7f922c054830 con 0x7f922c0543c0 2024-04-28T13:07:35.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7f923921d640 1 -- 172.21.15.114:0/1635500096 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9220003520 con 0x7f922c0543c0 2024-04-28T13:07:35.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7f923a21f640 1 -- 172.21.15.114:0/1635500096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f922c033990 msgr2=0x7f922c037c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:35.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7f923a21f640 1 --2- 172.21.15.114:0/1635500096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f922c033990 0x7f922c037c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7f923a21f640 1 -- 172.21.15.114:0/1635500096 >> v1:172.21.15.134:6789/0 conn(0x7f922c0543c0 legacy=0x7f922c038180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7f923a21f640 1 -- 172.21.15.114:0/1635500096 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922c053e00 con 0x7f922c04f290 2024-04-28T13:07:35.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.075+0000 7fcd752ae640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcd7014d160 0x7fcd700b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.075+0000 7fcd752ae640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcd7014d160 0x7fcd700b3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:49868/0 (socket says 172.21.15.114:49868) 2024-04-28T13:07:35.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.075+0000 7fcd752ae640 1 -- 172.21.15.114:0/3808902486 learned_addr learned my addr 172.21.15.114:0/3808902486 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:35.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.075+0000 7f0c06f52640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bf803a2f0 con 0x7f0bf8048ad0 2024-04-28T13:07:35.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.075+0000 7f0c05f50640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bf80eac70 0x7f0bf8052680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7f5ab2878640 1 -- start start 2024-04-28T13:07:35.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.075+0000 7f5ab2878640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5aac163800 0x7f5aac0cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.075+0000 7f0c05f50640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bf80eac70 0x7f0bf8052680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:58370/0 (socket says 172.21.15.114:58370) 2024-04-28T13:07:35.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.075+0000 7f1fbb7fe640 1 --2- 172.21.15.114:0/2505170315 >> v2:172.21.15.114:3300/0 conn(0x7f1fbc0693f0 0x7f1fbc0742d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.075+0000 7f0c05f50640 1 -- 172.21.15.114:0/3651076243 learned_addr learned my addr 172.21.15.114:0/3651076243 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:35.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.075+0000 7f5ab2878640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5aac0cd000 0x7f5aac0cd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.075+0000 7f5ab2878640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5aac0c4010 0x7f5aac0c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.075+0000 7f5ab2878640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f5aac06f0a0 con 0x7f5aac0cd000 2024-04-28T13:07:35.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.075+0000 7f5ab2878640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f5aac06e490 con 0x7f5aac163800 2024-04-28T13:07:35.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.075+0000 7f5ab2878640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f5aac06e770 con 0x7f5aac0c4010 2024-04-28T13:07:35.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.075+0000 7f0c06f52640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bf803a5d0 con 0x7f0bf803b0b0 2024-04-28T13:07:35.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.075+0000 7f0c06f52640 1 -- 172.21.15.114:0/3651076243 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f0bf8052bc0 con 0x7f0bf80eac70 2024-04-28T13:07:35.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.075+0000 7fcd74aad640 1 --2- 172.21.15.114:0/3808902486 >> v2:172.21.15.114:3300/0 conn(0x7fcd700b43a0 0x7fcd700d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.075+0000 7fcd67fff640 1 -- 172.21.15.114:0/3808902486 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3095902062 0 0) 0x7fcd700ceb60 con 0x7fcd700d12c0 2024-04-28T13:07:35.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7f6e2549c640 1 -- start start 2024-04-28T13:07:35.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.075+0000 7fcd67fff640 1 -- 172.21.15.114:0/3808902486 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd5c003520 con 0x7fcd700d12c0 2024-04-28T13:07:35.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f5ab1876640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5aac163800 0x7f5aac0cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f5ab2077640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5aac0c4010 0x7f5aac0c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f5ab2077640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5aac0c4010 0x7f5aac0c44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:58378/0 (socket says 172.21.15.114:58378) 2024-04-28T13:07:35.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f5ab2077640 1 -- 172.21.15.114:0/1633972115 learned_addr learned my addr 172.21.15.114:0/1633972115 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:35.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f5ab1075640 1 --2- 172.21.15.114:0/1633972115 >> v2:172.21.15.114:3300/0 conn(0x7f5aac0cd000 0x7f5aac0cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7f4317fff640 1 Processor -- start 2024-04-28T13:07:35.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.074+0000 7f4317fff640 1 -- start start 2024-04-28T13:07:35.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f6e2549c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6e18048100 0x7f6e18006f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f6e2549c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6e18054560 0x7f6e1804f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f6e2549c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e18005ec0 con 0x7f6e18007460 2024-04-28T13:07:35.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f6e2549c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f6e180e7b90 con 0x7f6e18054560 2024-04-28T13:07:35.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f6e2549c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f6e18006a90 con 0x7f6e18048100 2024-04-28T13:07:35.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f1fbaffd640 1 -- 172.21.15.114:0/2505170315 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 448047900 0 0) 0x7f1fbc0b0550 con 0x7f1fbc0cea30 2024-04-28T13:07:35.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f1fbaffd640 1 -- 172.21.15.114:0/2505170315 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fa4003520 con 0x7f1fbc0cea30 2024-04-28T13:07:35.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7fbe924be640 1 --2- 172.21.15.114:0/854582385 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe8c0701f0 0x7fbe8c15f5d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbe88009870 tx=0x7fbe8802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55b7cd9dd55aa832 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f1fbaffd640 1 -- 172.21.15.114:0/2505170315 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1995146103 0 0) 0x7f1fbc0b5330 con 0x7f1fbc0b57e0 2024-04-28T13:07:35.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f1fbaffd640 1 -- 172.21.15.114:0/2505170315 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fbc0b0550 con 0x7f1fbc0b57e0 2024-04-28T13:07:35.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f923a21f640 1 --2- 172.21.15.114:0/1635500096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f922c04f290 0x7f922c007190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9230009870 tx=0x7f923002a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=637fe4e3b51a4291 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f4317fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f43100df800 0x7f4310055d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f4317fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f43100366a0 0x7f431004fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f4317fff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f431003a0a0 0x7f431003a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f4317fff640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f431003a9f0 con 0x7f43100366a0 2024-04-28T13:07:35.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f4317fff640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f4310006c30 con 0x7f43100df800 2024-04-28T13:07:35.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f4317fff640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f4310006f10 con 0x7f431003a0a0 2024-04-28T13:07:35.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f6e1e7fc640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f6e18007460 0x7f6e18053e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:43350/0 (socket says 172.21.15.114:43350) 2024-04-28T13:07:35.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f6e1e7fc640 1 -- 172.21.15.114:0/3115414389 learned_addr learned my addr 172.21.15.114:0/3115414389 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:35.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f6e1effd640 1 --2- 172.21.15.114:0/3115414389 >> v2:172.21.15.134:3300/0 conn(0x7f6e18048100 0x7f6e18006f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f923921d640 1 -- 172.21.15.114:0/1635500096 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9230037070 con 0x7f922c04f290 2024-04-28T13:07:35.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f923921d640 1 -- 172.21.15.114:0/1635500096 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9230032440 con 0x7f922c04f290 2024-04-28T13:07:35.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f923921d640 1 -- 172.21.15.114:0/1635500096 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9230037070 con 0x7f922c04f290 2024-04-28T13:07:35.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7fcd67fff640 1 -- 172.21.15.114:0/3808902486 <== mon.1 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1217158761 0 0) 0x7fcd5c003520 con 0x7fcd700d12c0 2024-04-28T13:07:35.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7fcd67fff640 1 -- 172.21.15.114:0/3808902486 >> v2:172.21.15.134:3300/0 conn(0x7fcd7014d160 msgr2=0x7fcd700b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:35.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7fcd67fff640 1 --2- 172.21.15.114:0/3808902486 >> v2:172.21.15.134:3300/0 conn(0x7fcd7014d160 0x7fcd700b3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7fcd67fff640 1 -- 172.21.15.114:0/3808902486 >> v2:172.21.15.114:3300/0 conn(0x7fcd700b43a0 msgr2=0x7fcd700d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:35.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7fcd67fff640 1 --2- 172.21.15.114:0/3808902486 >> v2:172.21.15.114:3300/0 conn(0x7fcd700b43a0 0x7fcd700d0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7fcd67fff640 1 -- 172.21.15.114:0/3808902486 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd70168080 con 0x7fcd700d12c0 2024-04-28T13:07:35.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7fcd67fff640 1 -- 172.21.15.114:0/3808902486 <== mon.1 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7fcd60001670 con 0x7fcd700d12c0 2024-04-28T13:07:35.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7fcd67fff640 1 -- 172.21.15.114:0/3808902486 >> v1:172.21.15.134:6789/0 conn(0x7fcd700d12c0 legacy=0x7fcd700cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7fcd67fff640 1 --2- 172.21.15.114:0/3808902486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd5c0039b0 0x7fcd5c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7fcd67fff640 1 --2- 172.21.15.114:0/3808902486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd5c004800 0x7fcd5c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f43177fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f431003a0a0 0x7f431003a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f43177fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f431003a0a0 0x7f431003a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:58384/0 (socket says 172.21.15.114:58384) 2024-04-28T13:07:35.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f43177fe640 1 -- 172.21.15.114:0/339927276 learned_addr learned my addr 172.21.15.114:0/339927276 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:35.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f43167fc640 1 --2- 172.21.15.114:0/339927276 >> v2:172.21.15.114:3300/0 conn(0x7f43100366a0 0x7f431004fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7fcd67fff640 1 --2- 172.21.15.114:0/3808902486 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcd5c0051c0 0x7fcd5c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7fcd67fff640 1 -- 172.21.15.114:0/3808902486 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcd700cee40 con 0x7fcd5c004800 2024-04-28T13:07:35.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7fcd67fff640 1 -- 172.21.15.114:0/3808902486 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcd700cf120 con 0x7fcd5c0039b0 2024-04-28T13:07:35.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7fcd67fff640 1 -- 172.21.15.114:0/3808902486 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fcd5c00c090 con 0x7fcd5c0051c0 2024-04-28T13:07:35.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7fcd752ae640 1 --2- 172.21.15.114:0/3808902486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd5c0039b0 0x7fcd5c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7fcd74aad640 1 --2- 172.21.15.114:0/3808902486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd5c004800 0x7fcd5c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f1fbaffd640 1 -- 172.21.15.114:0/2505170315 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3318451885 0 0) 0x7f1fbc0b0550 con 0x7f1fbc0b57e0 2024-04-28T13:07:35.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f1fbaffd640 1 -- 172.21.15.114:0/2505170315 >> v2:172.21.15.114:3300/0 conn(0x7f1fbc0693f0 msgr2=0x7f1fbc0742d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:35.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f1fbaffd640 1 --2- 172.21.15.114:0/2505170315 >> v2:172.21.15.114:3300/0 conn(0x7f1fbc0693f0 0x7f1fbc0742d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f1fbaffd640 1 -- 172.21.15.114:0/2505170315 >> v1:172.21.15.134:6789/0 conn(0x7f1fbc0cea30 legacy=0x7f1fbc15b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f1fbaffd640 1 -- 172.21.15.114:0/2505170315 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fbc0b5000 con 0x7f1fbc0b57e0 2024-04-28T13:07:35.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f1fbaffd640 1 -- 172.21.15.114:0/2505170315 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f1fb0001670 con 0x7f1fbc0b57e0 2024-04-28T13:07:35.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f1fbaffd640 1 -- 172.21.15.114:0/2505170315 >> v1:172.21.15.114:6789/0 conn(0x7f1fbc0b57e0 legacy=0x7f1fbc0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f1fbaffd640 1 --2- 172.21.15.114:0/2505170315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fa4004ba0 0x7f1fa4004fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f1fbaffd640 1 --2- 172.21.15.114:0/2505170315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fa40037a0 0x7f1fa4003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f1fbaffd640 1 --2- 172.21.15.114:0/2505170315 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1fa4004160 0x7f1fa40141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f1fbaffd640 1 -- 172.21.15.114:0/2505170315 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc0b0830 con 0x7f1fa40037a0 2024-04-28T13:07:35.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f1fbaffd640 1 -- 172.21.15.114:0/2505170315 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa4014900 con 0x7f1fa4004ba0 2024-04-28T13:07:35.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f1fbaffd640 1 -- 172.21.15.114:0/2505170315 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1fa4014b00 con 0x7f1fa4004160 2024-04-28T13:07:35.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7fbe914bc640 1 -- 172.21.15.114:0/854582385 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88037070 con 0x7fbe8c0701f0 2024-04-28T13:07:35.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.077+0000 7fbe914bc640 1 -- 172.21.15.114:0/854582385 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe88032440 con 0x7fbe8c0701f0 2024-04-28T13:07:35.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.077+0000 7fbe914bc640 1 -- 172.21.15.114:0/854582385 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88032810 con 0x7fbe8c0701f0 2024-04-28T13:07:35.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f43177fe640 1 -- 172.21.15.114:0/339927276 >> v2:172.21.15.134:3300/0 conn(0x7f43100df800 msgr2=0x7f4310055d10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-28T13:07:35.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f43177fe640 1 --2- 172.21.15.114:0/339927276 >> v2:172.21.15.134:3300/0 conn(0x7f43100df800 0x7f4310055d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f43177fe640 1 -- 172.21.15.114:0/339927276 >> v2:172.21.15.114:3300/0 conn(0x7f43100366a0 msgr2=0x7f431004fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:35.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f43177fe640 1 --2- 172.21.15.114:0/339927276 >> v2:172.21.15.114:3300/0 conn(0x7f43100366a0 0x7f431004fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f43177fe640 1 -- 172.21.15.114:0/339927276 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43100071f0 con 0x7f431003a0a0 2024-04-28T13:07:35.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.077+0000 7f1fc0b41640 1 --2- 172.21.15.114:0/2505170315 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1fa4004160 0x7f1fa40141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.077+0000 7fcd752ae640 1 -- 172.21.15.114:0/3808902486 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcd5c0051c0 msgr2=0x7fcd5c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:35.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.077+0000 7fcd752ae640 1 --2- 172.21.15.114:0/3808902486 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcd5c0051c0 0x7fcd5c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.077+0000 7fcd752ae640 1 -- 172.21.15.114:0/3808902486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd5c004800 msgr2=0x7fcd5c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:35.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.077+0000 7f923b221640 1 -- 172.21.15.114:0/1635500096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f922c04f290 msgr2=0x7f922c007190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.077+0000 7f923b221640 1 --2- 172.21.15.114:0/1635500096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f922c04f290 0x7f922c007190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9230009870 tx=0x7f923002a250 comp rx=0 tx=0).stop 2024-04-28T13:07:35.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.077+0000 7f6e1effd640 1 -- 172.21.15.114:0/3115414389 >> v2:172.21.15.114:3300/0 conn(0x7f6e18054560 msgr2=0x7f6e1804f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:35.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.077+0000 7f6e1effd640 1 --2- 172.21.15.114:0/3115414389 >> v2:172.21.15.114:3300/0 conn(0x7f6e18054560 0x7f6e1804f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.077+0000 7f6e1effd640 1 -- 172.21.15.114:0/3115414389 >> v1:172.21.15.134:6789/0 conn(0x7f6e18007460 legacy=0x7f6e18053e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.077+0000 7f6e1effd640 1 -- 172.21.15.114:0/3115414389 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e18053280 con 0x7f6e18048100 2024-04-28T13:07:35.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.077+0000 7fcd752ae640 1 --2- 172.21.15.114:0/3808902486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd5c004800 0x7fcd5c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.077+0000 7fcd752ae640 1 -- 172.21.15.114:0/3808902486 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd70168080 con 0x7fcd5c0039b0 2024-04-28T13:07:35.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.077+0000 7fcd75aaf640 1 -- 172.21.15.114:0/3808902486 reap_dead start 2024-04-28T13:07:35.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f0c05f50640 1 -- 172.21.15.114:0/3651076243 >> v1:172.21.15.134:6789/0 conn(0x7f0bf803b0b0 legacy=0x7f0bf80483c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f0c05f50640 1 -- 172.21.15.114:0/3651076243 >> v1:172.21.15.114:6789/0 conn(0x7f0bf8048ad0 legacy=0x7f0bf80537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f0c05f50640 1 -- 172.21.15.114:0/3651076243 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf803a8b0 con 0x7f0bf80eac70 2024-04-28T13:07:35.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.077+0000 7f0c05f50640 1 --2- 172.21.15.114:0/3651076243 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bf80eac70 0x7f0bf8052680 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc009820 tx=0x7f0bfc02a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=603f9f36e0de9439 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f5ab1876640 1 -- 172.21.15.114:0/1633972115 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5aac0c4010 msgr2=0x7f5aac0c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:35.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f5ab1876640 1 --2- 172.21.15.114:0/1633972115 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5aac0c4010 0x7f5aac0c44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f5ab1876640 1 -- 172.21.15.114:0/1633972115 >> v2:172.21.15.114:3300/0 conn(0x7f5aac0cd000 msgr2=0x7f5aac0cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:35.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f5ab1876640 1 --2- 172.21.15.114:0/1633972115 >> v2:172.21.15.114:3300/0 conn(0x7f5aac0cd000 0x7f5aac0cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.076+0000 7f5ab1876640 1 -- 172.21.15.114:0/1633972115 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aac06ea50 con 0x7f5aac163800 2024-04-28T13:07:35.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.077+0000 7f923b221640 1 -- 172.21.15.114:0/1635500096 shutdown_connections 2024-04-28T13:07:35.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.077+0000 7f923b221640 1 --2- 172.21.15.114:0/1635500096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f922c033990 0x7f922c037c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.077+0000 7f923b221640 1 --2- 172.21.15.114:0/1635500096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f922c04f290 0x7f922c007190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.077+0000 7f923b221640 1 -- 172.21.15.114:0/1635500096 >> 172.21.15.114:0/1635500096 conn(0x7f922c009fb0 msgr2=0x7f922c00a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.077+0000 7f1fbb7fe640 1 --2- 172.21.15.114:0/2505170315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fa40037a0 0x7f1fa4003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.077+0000 7f1fbb7fe640 1 -- 172.21.15.114:0/2505170315 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1fa4004160 msgr2=0x7f1fa40141d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:35.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.077+0000 7f1fbb7fe640 1 --2- 172.21.15.114:0/2505170315 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1fa4004160 0x7f1fa40141d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.077+0000 7f1fbb7fe640 1 -- 172.21.15.114:0/2505170315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fa4004ba0 msgr2=0x7f1fa4004fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:35.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.077+0000 7f1fbbfff640 1 --2- 172.21.15.114:0/2505170315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fa4004ba0 0x7f1fa4004fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.077+0000 7f1fbb7fe640 1 --2- 172.21.15.114:0/2505170315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fa4004ba0 0x7f1fa4004fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.078+0000 7f1fbb7fe640 1 -- 172.21.15.114:0/2505170315 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fbc0b5000 con 0x7f1fa40037a0 2024-04-28T13:07:35.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.078+0000 7f0c04f4e640 1 -- 172.21.15.114:0/3651076243 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc037070 con 0x7f0bf80eac70 2024-04-28T13:07:35.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.078+0000 7f1fc0b41640 1 --2- 172.21.15.114:0/2505170315 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1fa4004160 0x7f1fa40141d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:35.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.078+0000 7f1fc0b41640 1 -- 172.21.15.114:0/2505170315 reap_dead start 2024-04-28T13:07:35.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.078+0000 7f0c04f4e640 1 -- 172.21.15.114:0/3651076243 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bfc02ad70 con 0x7f0bf80eac70 2024-04-28T13:07:35.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.078+0000 7f0c04f4e640 1 -- 172.21.15.114:0/3651076243 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc032660 con 0x7f0bf80eac70 2024-04-28T13:07:35.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.078+0000 7f923b221640 1 -- 172.21.15.114:0/1635500096 shutdown_connections 2024-04-28T13:07:35.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.078+0000 7f923b221640 1 -- 172.21.15.114:0/1635500096 wait complete. 2024-04-28T13:07:35.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.078+0000 7f43177fe640 1 --2- 172.21.15.114:0/339927276 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f431003a0a0 0x7f431003a4b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f431000dc60 tx=0x7f430c02c720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4397688a044421d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.078+0000 7f5ab1876640 1 --2- 172.21.15.114:0/1633972115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5aac163800 0x7f5aac0cebf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5aac0b0b30 tx=0x7f5a9c02a120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae24ba672205e72 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.078+0000 7f6e1effd640 1 --2- 172.21.15.114:0/3115414389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e18048100 0x7f6e18006f20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6e18006c10 tx=0x7f6e1002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e1cb5b7854b26bc server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.078+0000 7fcd752ae640 1 --2- 172.21.15.114:0/3808902486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd5c0039b0 0x7fcd5c003dd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c0098d0 tx=0x7fcd5c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77f50d8092c06bef server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.078+0000 7f4315ffb640 1 -- 172.21.15.114:0/339927276 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f430c03a070 con 0x7f431003a0a0 2024-04-28T13:07:35.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.078+0000 7fcd67fff640 1 -- 172.21.15.114:0/3808902486 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c037070 con 0x7fcd5c0039b0 2024-04-28T13:07:35.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.078+0000 7f5ab0874640 1 -- 172.21.15.114:0/1633972115 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c037070 con 0x7f5aac163800 2024-04-28T13:07:35.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.078+0000 7f6e1dffb640 1 -- 172.21.15.114:0/3115414389 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e10037070 con 0x7f6e18048100 2024-04-28T13:07:35.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.078+0000 7fcd67fff640 1 -- 172.21.15.114:0/3808902486 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd6c02ad20 con 0x7fcd5c0039b0 2024-04-28T13:07:35.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.078+0000 7f5ab0874640 1 -- 172.21.15.114:0/1633972115 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a9c032440 con 0x7f5aac163800 2024-04-28T13:07:35.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.078+0000 7fcd67fff640 1 -- 172.21.15.114:0/3808902486 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c00f040 con 0x7fcd5c0039b0 2024-04-28T13:07:35.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.078+0000 7f6e1dffb640 1 -- 172.21.15.114:0/3115414389 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e1002ada0 con 0x7f6e18048100 2024-04-28T13:07:35.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.078+0000 7f6e1dffb640 1 -- 172.21.15.114:0/3115414389 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e10032660 con 0x7f6e18048100 2024-04-28T13:07:35.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.078+0000 7fbe94722640 1 -- 172.21.15.114:0/854582385 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe8c0701f0 msgr2=0x7fbe8c15f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.078+0000 7fbe94722640 1 --2- 172.21.15.114:0/854582385 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe8c0701f0 0x7fbe8c15f5d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbe88009870 tx=0x7fbe8802a210 comp rx=0 tx=0).stop 2024-04-28T13:07:35.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.079+0000 7f1fbb7fe640 1 --2- 172.21.15.114:0/2505170315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fa40037a0 0x7f1fa4003c20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4009f70 tx=0x7f1fa4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13288dffca63614e server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.079+0000 7fbe94722640 1 -- 172.21.15.114:0/854582385 shutdown_connections 2024-04-28T13:07:35.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.079+0000 7fbe94722640 1 --2- 172.21.15.114:0/854582385 >> v2:172.21.15.134:3300/0 conn(0x7fbe8c15fb10 0x7fbe8c0d0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.079+0000 7fbe94722640 1 --2- 172.21.15.114:0/854582385 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe8c0701f0 0x7fbe8c15f5d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.079+0000 7fbe94722640 1 -- 172.21.15.114:0/854582385 >> 172.21.15.114:0/854582385 conn(0x7fbe8c0cd8b0 msgr2=0x7fbe8c0cdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.079+0000 7f1fbaffd640 1 -- 172.21.15.114:0/2505170315 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb4037070 con 0x7f1fa40037a0 2024-04-28T13:07:35.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.079+0000 7f1fbaffd640 1 -- 172.21.15.114:0/2505170315 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb4032620 con 0x7f1fa40037a0 2024-04-28T13:07:35.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.079+0000 7f1fbaffd640 1 -- 172.21.15.114:0/2505170315 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb4009bf0 con 0x7f1fa40037a0 2024-04-28T13:07:35.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.079+0000 7fcd77512640 1 -- 172.21.15.114:0/3808902486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd5c0039b0 msgr2=0x7fcd5c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.079+0000 7fcd77512640 1 --2- 172.21.15.114:0/3808902486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd5c0039b0 0x7fcd5c003dd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c0098d0 tx=0x7fcd5c005830 comp rx=0 tx=0).stop 2024-04-28T13:07:35.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.079+0000 7fbe94722640 1 -- 172.21.15.114:0/854582385 shutdown_connections 2024-04-28T13:07:35.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.079+0000 7fbe94722640 1 -- 172.21.15.114:0/854582385 wait complete. 2024-04-28T13:07:35.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.079+0000 7f5ab2878640 1 -- 172.21.15.114:0/1633972115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5aac163800 msgr2=0x7f5aac0cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.079+0000 7f5ab2878640 1 --2- 172.21.15.114:0/1633972115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5aac163800 0x7f5aac0cebf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5aac0b0b30 tx=0x7f5a9c02a120 comp rx=0 tx=0).stop 2024-04-28T13:07:35.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.079+0000 7f6e2549c640 1 -- 172.21.15.114:0/3115414389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e18048100 msgr2=0x7f6e18006f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.079+0000 7f6e2549c640 1 --2- 172.21.15.114:0/3115414389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e18048100 0x7f6e18006f20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6e18006c10 tx=0x7f6e1002a110 comp rx=0 tx=0).stop 2024-04-28T13:07:35.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.079+0000 7f6e2549c640 1 -- 172.21.15.114:0/3115414389 shutdown_connections 2024-04-28T13:07:35.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.079+0000 7f6e2549c640 1 --2- 172.21.15.114:0/3115414389 >> v2:172.21.15.114:3300/0 conn(0x7f6e18054560 0x7f6e1804f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.079+0000 7f6e2549c640 1 --2- 172.21.15.114:0/3115414389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e18048100 0x7f6e18006f20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.079+0000 7f6e2549c640 1 -- 172.21.15.114:0/3115414389 >> 172.21.15.114:0/3115414389 conn(0x7f6e18009fe0 msgr2=0x7f6e1800a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.078+0000 7f4315ffb640 1 -- 172.21.15.114:0/339927276 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f430c032480 con 0x7f431003a0a0 2024-04-28T13:07:35.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.078+0000 7f4315ffb640 1 -- 172.21.15.114:0/339927276 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f430c032850 con 0x7f431003a0a0 2024-04-28T13:07:35.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.079+0000 7f6e2549c640 1 -- 172.21.15.114:0/3115414389 shutdown_connections 2024-04-28T13:07:35.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.079+0000 7f6e2549c640 1 -- 172.21.15.114:0/3115414389 wait complete. 2024-04-28T13:07:35.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.079+0000 7f0c06f52640 1 -- 172.21.15.114:0/3651076243 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bf80eac70 msgr2=0x7f0bf8052680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.079+0000 7f5ab2878640 1 -- 172.21.15.114:0/1633972115 shutdown_connections 2024-04-28T13:07:35.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.079+0000 7f5ab2878640 1 --2- 172.21.15.114:0/1633972115 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5aac0c4010 0x7f5aac0c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.079+0000 7f5ab2878640 1 --2- 172.21.15.114:0/1633972115 >> v2:172.21.15.114:3300/0 conn(0x7f5aac0cd000 0x7f5aac0cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.079+0000 7f5ab2878640 1 --2- 172.21.15.114:0/1633972115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5aac163800 0x7f5aac0cebf0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.079+0000 7f5ab2878640 1 -- 172.21.15.114:0/1633972115 >> 172.21.15.114:0/1633972115 conn(0x7f5aac0d1020 msgr2=0x7f5aac0d1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.079+0000 7f0c06f52640 1 --2- 172.21.15.114:0/3651076243 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bf80eac70 0x7f0bf8052680 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc009820 tx=0x7f0bfc02a060 comp rx=0 tx=0).stop 2024-04-28T13:07:35.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.080+0000 7fcd77512640 1 -- 172.21.15.114:0/3808902486 shutdown_connections 2024-04-28T13:07:35.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.080+0000 7f923b221640 1 Processor -- start 2024-04-28T13:07:35.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.080+0000 7fcd77512640 1 --2- 172.21.15.114:0/3808902486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd5c0039b0 0x7fcd5c003dd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.080+0000 7f4317fff640 1 -- 172.21.15.114:0/339927276 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f431003a0a0 msgr2=0x7f431003a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.080+0000 7f923b221640 1 -- start start 2024-04-28T13:07:35.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.080+0000 7f4317fff640 1 --2- 172.21.15.114:0/339927276 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f431003a0a0 0x7f431003a4b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f431000dc60 tx=0x7f430c02c720 comp rx=0 tx=0).stop 2024-04-28T13:07:35.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.080+0000 7fcd77512640 1 -- 172.21.15.114:0/3808902486 >> 172.21.15.114:0/3808902486 conn(0x7fcd700cd8b0 msgr2=0x7fcd700cdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.080+0000 7f4317fff640 1 -- 172.21.15.114:0/339927276 shutdown_connections 2024-04-28T13:07:35.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.080+0000 7f4317fff640 1 --2- 172.21.15.114:0/339927276 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f431003a0a0 0x7f431003a4b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.080+0000 7f4317fff640 1 --2- 172.21.15.114:0/339927276 >> v2:172.21.15.114:3300/0 conn(0x7f43100366a0 0x7f431004fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.080+0000 7f4317fff640 1 --2- 172.21.15.114:0/339927276 >> v2:172.21.15.134:3300/0 conn(0x7f43100df800 0x7f4310055d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.080+0000 7f1fc1342640 1 -- 172.21.15.114:0/2505170315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fa40037a0 msgr2=0x7f1fa4003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.080+0000 7f4317fff640 1 -- 172.21.15.114:0/339927276 >> 172.21.15.114:0/339927276 conn(0x7f431001e6c0 msgr2=0x7f43100553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.080+0000 7f1fc1342640 1 --2- 172.21.15.114:0/2505170315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fa40037a0 0x7f1fa4003c20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4009f70 tx=0x7f1fa4005830 comp rx=0 tx=0).stop 2024-04-28T13:07:35.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.080+0000 7f5ab2878640 1 -- 172.21.15.114:0/1633972115 shutdown_connections 2024-04-28T13:07:35.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.080+0000 7f5ab2878640 1 -- 172.21.15.114:0/1633972115 wait complete. 2024-04-28T13:07:35.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.080+0000 7f0c06f52640 1 -- 172.21.15.114:0/3651076243 shutdown_connections 2024-04-28T13:07:35.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.080+0000 7f0c06f52640 1 --2- 172.21.15.114:0/3651076243 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bf80eac70 0x7f0bf8052680 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.080+0000 7f0c06f52640 1 -- 172.21.15.114:0/3651076243 >> 172.21.15.114:0/3651076243 conn(0x7f0bf801e6c0 msgr2=0x7f0bf80553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.080+0000 7f4317fff640 1 -- 172.21.15.114:0/339927276 shutdown_connections 2024-04-28T13:07:35.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.080+0000 7f4317fff640 1 -- 172.21.15.114:0/339927276 wait complete. 2024-04-28T13:07:35.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.080+0000 7f0c06f52640 1 -- 172.21.15.114:0/3651076243 shutdown_connections 2024-04-28T13:07:35.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.080+0000 7fbe94722640 1 Processor -- start 2024-04-28T13:07:35.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.080+0000 7f1fc1342640 1 -- 172.21.15.114:0/2505170315 shutdown_connections 2024-04-28T13:07:35.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.080+0000 7f1fc1342640 1 --2- 172.21.15.114:0/2505170315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fa40037a0 0x7f1fa4003c20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.080+0000 7f1fc1342640 1 -- 172.21.15.114:0/2505170315 >> 172.21.15.114:0/2505170315 conn(0x7f1fbc0737b0 msgr2=0x7f1fbc073bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.081+0000 7f0c06f52640 1 -- 172.21.15.114:0/3651076243 wait complete. 2024-04-28T13:07:35.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.081+0000 7fbe94722640 1 -- start start 2024-04-28T13:07:35.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.081+0000 7f923b221640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f922c033990 0x7f922c0f1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.081+0000 7f923b221640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f922c04f290 0x7f922c053160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.081+0000 7f1fc1342640 1 -- 172.21.15.114:0/2505170315 shutdown_connections 2024-04-28T13:07:35.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.081+0000 7f923a21f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f922c033990 0x7f922c0f1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.081+0000 7fcd77512640 1 -- 172.21.15.114:0/3808902486 shutdown_connections 2024-04-28T13:07:35.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.081+0000 7fcd77512640 1 -- 172.21.15.114:0/3808902486 wait complete. 2024-04-28T13:07:35.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.081+0000 7f923a21f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f922c033990 0x7f922c0f1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:49904/0 (socket says 172.21.15.114:49904) 2024-04-28T13:07:35.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.081+0000 7f923a21f640 1 -- 172.21.15.114:0/3075270797 learned_addr learned my addr 172.21.15.114:0/3075270797 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:35.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.082+0000 7f923b221640 1 --2- 172.21.15.114:0/3075270797 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f922c0543c0 0x7f922c0f2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.082+0000 7fbe94722640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe8c0701f0 0x7fbe8c133080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.082+0000 7f923b221640 1 -- 172.21.15.114:0/3075270797 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f922c0076d0 con 0x7f922c04f290 2024-04-28T13:07:35.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.082+0000 7f923b221640 1 -- 172.21.15.114:0/3075270797 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f922c006c70 con 0x7f922c033990 2024-04-28T13:07:35.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.082+0000 7f923b221640 1 -- 172.21.15.114:0/3075270797 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f922c04f670 con 0x7f922c0543c0 2024-04-28T13:07:35.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.082+0000 7f4317fff640 1 Processor -- start 2024-04-28T13:07:35.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.082+0000 7f5ab2878640 1 Processor -- start 2024-04-28T13:07:35.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.082+0000 7f0c06f52640 1 Processor -- start 2024-04-28T13:07:35.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.082+0000 7f9239a1e640 1 --2- 172.21.15.114:0/3075270797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f922c04f290 0x7f922c053160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.082+0000 7f923a21f640 1 -- 172.21.15.114:0/3075270797 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f922c0543c0 msgr2=0x7f922c0f2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.082+0000 7f923a21f640 1 --2- 172.21.15.114:0/3075270797 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f922c0543c0 0x7f922c0f2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.082+0000 7f923a21f640 1 -- 172.21.15.114:0/3075270797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f922c04f290 msgr2=0x7f922c053160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.082+0000 7f923a21f640 1 --2- 172.21.15.114:0/3075270797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f922c04f290 0x7f922c053160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.082+0000 7f923a21f640 1 -- 172.21.15.114:0/3075270797 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922c035d00 con 0x7f922c033990 2024-04-28T13:07:35.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.082+0000 7f9239a1e640 1 --2- 172.21.15.114:0/3075270797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f922c04f290 0x7f922c053160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:07:35.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.081+0000 7f1fc1342640 1 -- 172.21.15.114:0/2505170315 wait complete. 2024-04-28T13:07:35.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.082+0000 7f5ab2878640 1 -- start start 2024-04-28T13:07:35.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.082+0000 7f4317fff640 1 -- start start 2024-04-28T13:07:35.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.081+0000 7f6e2549c640 1 Processor -- start 2024-04-28T13:07:35.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.081+0000 7f6e2549c640 1 -- start start 2024-04-28T13:07:35.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.082+0000 7f6e2549c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e18007460 0x7f6e180e2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.082+0000 7f6e2549c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e18048100 0x7f6e180394a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7f6e2549c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e18054560 0x7f6e180399e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7f6e2549c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6e18006720 con 0x7f6e18048100 2024-04-28T13:07:35.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7f6e2549c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6e18006440 con 0x7f6e18007460 2024-04-28T13:07:35.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7f6e2549c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f6e1804fe70 con 0x7f6e18054560 2024-04-28T13:07:35.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7f6e1effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e18007460 0x7f6e180e2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7f6e1effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e18007460 0x7f6e180e2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:49906/0 (socket says 172.21.15.114:49906) 2024-04-28T13:07:35.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7f6e1effd640 1 -- 172.21.15.114:0/1846254048 learned_addr learned my addr 172.21.15.114:0/1846254048 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:35.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.082+0000 7f0c06f52640 1 -- start start 2024-04-28T13:07:35.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7f6e1e7fc640 1 --2- 172.21.15.114:0/1846254048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e18048100 0x7f6e180394a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7f6e1f7fe640 1 --2- 172.21.15.114:0/1846254048 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e18054560 0x7f6e180399e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7f6e1effd640 1 -- 172.21.15.114:0/1846254048 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e18054560 msgr2=0x7f6e180399e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7f6e1effd640 1 --2- 172.21.15.114:0/1846254048 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e18054560 0x7f6e180399e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7f6e1effd640 1 -- 172.21.15.114:0/1846254048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e18048100 msgr2=0x7f6e180394a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7f0c06f52640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bf803b0b0 0x7f0bf804cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7f6e1effd640 1 --2- 172.21.15.114:0/1846254048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e18048100 0x7f6e180394a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7f1fc1342640 1 Processor -- start 2024-04-28T13:07:35.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7f4317fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43100366a0 0x7f43100d5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7f923a21f640 1 --2- 172.21.15.114:0/3075270797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f922c033990 0x7f922c0f1a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9230000c00 tx=0x7f92300046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7f4317fff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f431003a0a0 0x7f431000b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7f5ab2878640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aac0c4010 0x7f5aac0ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7fbe94722640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe8c0d1130 0x7fbe8c1335c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7fbe924be640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe8c0701f0 0x7fbe8c133080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7f6e1effd640 1 -- 172.21.15.114:0/1846254048 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e18038a00 con 0x7f6e18007460 2024-04-28T13:07:35.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7fbe94722640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe8c15fb10 0x7fbe8c0b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7fbe94722640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8c072930 con 0x7fbe8c0701f0 2024-04-28T13:07:35.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7fbe94722640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8c072ea0 con 0x7fbe8c0d1130 2024-04-28T13:07:35.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7fbe94722640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fbe8c072ab0 con 0x7fbe8c15fb10 2024-04-28T13:07:35.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7fbe91cbd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe8c0d1130 0x7fbe8c1335c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7fbe92cbf640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe8c15fb10 0x7fbe8c0b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7fbe91cbd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe8c0d1130 0x7fbe8c1335c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:49922/0 (socket says 172.21.15.114:49922) 2024-04-28T13:07:35.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7fbe91cbd640 1 -- 172.21.15.114:0/1726730860 learned_addr learned my addr 172.21.15.114:0/1726730860 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:35.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f4317fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43100df800 0x7f431000b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f5ab1876640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aac0c4010 0x7f5aac0ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f5ab1876640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aac0c4010 0x7f5aac0ca260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48092/0 (socket says 172.21.15.114:48092) 2024-04-28T13:07:35.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f5ab2878640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5aac0cd000 0x7f5aac1601f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7f6e1e7fc640 1 --2- 172.21.15.114:0/1846254048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e18048100 0x7f6e180394a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:35.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f1fc1342640 1 -- start start 2024-04-28T13:07:35.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f4316ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43100366a0 0x7f43100d5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f43167fc640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f431003a0a0 0x7f431000b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f4316ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43100366a0 0x7f43100d5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48094/0 (socket says 172.21.15.114:48094) 2024-04-28T13:07:35.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f43167fc640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f431003a0a0 0x7f431000b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:58420/0 (socket says 172.21.15.114:58420) 2024-04-28T13:07:35.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f4316ffd640 1 -- 172.21.15.114:0/2419856260 learned_addr learned my addr 172.21.15.114:0/2419856260 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:35.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7f0c06f52640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0bf8048ad0 0x7f0bf80de2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f922affd640 1 -- 172.21.15.114:0/3075270797 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9230042020 con 0x7f922c033990 2024-04-28T13:07:35.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f6e1effd640 1 --2- 172.21.15.114:0/1846254048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e18007460 0x7f6e180e2c20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6e10000c00 tx=0x7f6e100046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f43177fe640 1 --2- 172.21.15.114:0/2419856260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43100df800 0x7f431000b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f5ab2878640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5aac163800 0x7f5aac160730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f4317fff640 1 -- 172.21.15.114:0/2419856260 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f43100dfbe0 con 0x7f43100366a0 2024-04-28T13:07:35.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f4317fff640 1 -- 172.21.15.114:0/2419856260 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4310036b10 con 0x7f43100df800 2024-04-28T13:07:35.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f5ab2878640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5aac0cf2b0 con 0x7f5aac0c4010 2024-04-28T13:07:35.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f5ab2878640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5aac0cf130 con 0x7f5aac0cd000 2024-04-28T13:07:35.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f5ab2878640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f5aac06f530 con 0x7f5aac163800 2024-04-28T13:07:35.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f4317fff640 1 -- 172.21.15.114:0/2419856260 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f431004ff80 con 0x7f431003a0a0 2024-04-28T13:07:35.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f922affd640 1 -- 172.21.15.114:0/3075270797 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9230030980 con 0x7f922c033990 2024-04-28T13:07:35.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f5ab1876640 1 -- 172.21.15.114:0/1410187160 learned_addr learned my addr 172.21.15.114:0/1410187160 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:35.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f923b221640 1 -- 172.21.15.114:0/3075270797 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f922c035470 con 0x7f922c033990 2024-04-28T13:07:35.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f923b221640 1 -- 172.21.15.114:0/3075270797 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f922c036560 con 0x7f922c033990 2024-04-28T13:07:35.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f922affd640 1 -- 172.21.15.114:0/3075270797 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9230037070 con 0x7f922c033990 2024-04-28T13:07:35.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7f0c06f52640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bf80eac70 0x7f0bf80de820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7f0c05f50640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bf803b0b0 0x7f0bf804cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f0c05f50640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bf803b0b0 0x7f0bf804cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:58416/0 (socket says 172.21.15.114:58416) 2024-04-28T13:07:35.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f0c0574f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0bf8048ad0 0x7f0bf80de2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f0c0574f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0bf8048ad0 0x7f0bf80de2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48076/0 (socket says 172.21.15.114:48076) 2024-04-28T13:07:35.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f0c05f50640 1 -- 172.21.15.114:0/1420365388 learned_addr learned my addr 172.21.15.114:0/1420365388 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:35.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f5ab1075640 1 --2- 172.21.15.114:0/1410187160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5aac0cd000 0x7f5aac1601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7fcd77512640 1 Processor -- start 2024-04-28T13:07:35.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.083+0000 7fcd77512640 1 -- start start 2024-04-28T13:07:35.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7fcd77512640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd5c0039b0 0x7fcd70201e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7fcd77512640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcd70205e70 0x7fcd70164dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7fcd77512640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd70162a00 0x7fcd70162eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7fcd77512640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcd700d1110 con 0x7fcd70162a00 2024-04-28T13:07:35.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7fcd77512640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcd700d0f90 con 0x7fcd5c0039b0 2024-04-28T13:07:35.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7fcd77512640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fcd700b3e60 con 0x7fcd70205e70 2024-04-28T13:07:35.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7fcd74aad640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcd70205e70 0x7fcd70164dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7fcd74aad640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcd70205e70 0x7fcd70164dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:58428/0 (socket says 172.21.15.114:58428) 2024-04-28T13:07:35.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7fcd74aad640 1 -- 172.21.15.114:0/1786350974 learned_addr learned my addr 172.21.15.114:0/1786350974 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:35.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7fcd752ae640 1 --2- 172.21.15.114:0/1786350974 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd5c0039b0 0x7fcd70201e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f6e077fe640 1 -- 172.21.15.114:0/1846254048 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e10041070 con 0x7f6e18007460 2024-04-28T13:07:35.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7fbe92cbf640 1 -- 172.21.15.114:0/1726730860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe8c0d1130 msgr2=0x7fbe8c1335c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7fbe92cbf640 1 --2- 172.21.15.114:0/1726730860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe8c0d1130 0x7fbe8c1335c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f0c06f52640 1 -- 172.21.15.114:0/1420365388 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf803a0a0 con 0x7f0bf8048ad0 2024-04-28T13:07:35.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f0c06f52640 1 -- 172.21.15.114:0/1420365388 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf80eb2e0 con 0x7f0bf80eac70 2024-04-28T13:07:35.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f0c06f52640 1 -- 172.21.15.114:0/1420365388 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f0bf803ac20 con 0x7f0bf803b0b0 2024-04-28T13:07:35.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f0c06751640 1 --2- 172.21.15.114:0/1420365388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bf80eac70 0x7f0bf80de820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7fbe92cbf640 1 -- 172.21.15.114:0/1726730860 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe8c0701f0 msgr2=0x7fbe8c133080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7fbe92cbf640 1 --2- 172.21.15.114:0/1726730860 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe8c0701f0 0x7fbe8c133080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7fbe92cbf640 1 -- 172.21.15.114:0/1726730860 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe8c0b2a50 con 0x7fbe8c15fb10 2024-04-28T13:07:35.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f5ab1876640 1 -- 172.21.15.114:0/1410187160 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5aac163800 msgr2=0x7f5aac160730 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-28T13:07:35.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f5ab1876640 1 --2- 172.21.15.114:0/1410187160 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5aac163800 0x7f5aac160730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f5ab1876640 1 -- 172.21.15.114:0/1410187160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5aac0cd000 msgr2=0x7f5aac1601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f5ab1876640 1 --2- 172.21.15.114:0/1410187160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5aac0cd000 0x7f5aac1601f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f5ab1876640 1 -- 172.21.15.114:0/1410187160 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aac09c990 con 0x7f5aac0c4010 2024-04-28T13:07:35.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f6e2549c640 1 -- 172.21.15.114:0/1846254048 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e180ebb30 con 0x7f6e18007460 2024-04-28T13:07:35.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.084+0000 7f6e2549c640 1 -- 172.21.15.114:0/1846254048 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e180e3160 con 0x7f6e18007460 2024-04-28T13:07:35.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7f5ab1876640 1 --2- 172.21.15.114:0/1410187160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aac0c4010 0x7f5aac0ca260 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c000c00 tx=0x7f5a9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7f6e077fe640 1 -- 172.21.15.114:0/1846254048 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e1003c680 con 0x7f6e18007460 2024-04-28T13:07:35.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7f6e077fe640 1 -- 172.21.15.114:0/1846254048 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e10037040 con 0x7f6e18007460 2024-04-28T13:07:35.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7fbe92cbf640 1 --2- 172.21.15.114:0/1726730860 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe8c15fb10 0x7fbe8c0b0d40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbe8400c780 tx=0x7fbe8400cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7f1fc1342640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fa40037a0 0x7f1fbc150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7f1fc1342640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1fbc1f4760 0x7f1fbc1f1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7f1fc1342640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fbc1f2190 0x7f1fbc1563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7f0c0574f640 1 -- 172.21.15.114:0/1420365388 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bf803b0b0 msgr2=0x7f0bf804cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7f0c0574f640 1 --2- 172.21.15.114:0/1420365388 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bf803b0b0 0x7f0bf804cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7f0c0574f640 1 -- 172.21.15.114:0/1420365388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bf80eac70 msgr2=0x7f0bf80de820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7f0c0574f640 1 --2- 172.21.15.114:0/1420365388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bf80eac70 0x7f0bf80de820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7f0c0574f640 1 -- 172.21.15.114:0/1420365388 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf804d430 con 0x7f0bf8048ad0 2024-04-28T13:07:35.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7f5aa27fc640 1 -- 172.21.15.114:0/1410187160 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c040020 con 0x7f5aac0c4010 2024-04-28T13:07:35.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7f1fbb7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1fbc1f4760 0x7f1fbc1f1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7f1fbb7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1fbc1f4760 0x7f1fbc1f1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:58440/0 (socket says 172.21.15.114:58440) 2024-04-28T13:07:35.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7f5aa27fc640 1 -- 172.21.15.114:0/1410187160 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a9c038040 con 0x7f5aac0c4010 2024-04-28T13:07:35.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7f5aa27fc640 1 -- 172.21.15.114:0/1410187160 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c037070 con 0x7f5aac0c4010 2024-04-28T13:07:35.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7f5ab2878640 1 -- 172.21.15.114:0/1410187160 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5aac09cc70 con 0x7f5aac0c4010 2024-04-28T13:07:35.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7f1fbbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fa40037a0 0x7f1fbc150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7f1fbb7fe640 1 -- 172.21.15.114:0/3666504792 learned_addr learned my addr 172.21.15.114:0/3666504792 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:35.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7f1fc1342640 1 -- 172.21.15.114:0/3666504792 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc074660 con 0x7f1fa40037a0 2024-04-28T13:07:35.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7f1fc1342640 1 -- 172.21.15.114:0/3666504792 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc0744e0 con 0x7f1fbc1f2190 2024-04-28T13:07:35.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7f1fc1342640 1 -- 172.21.15.114:0/3666504792 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1fbc15b5f0 con 0x7f1fbc1f4760 2024-04-28T13:07:35.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7fbe82ffd640 1 -- 172.21.15.114:0/1726730860 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe84016020 con 0x7fbe8c15fb10 2024-04-28T13:07:35.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7f5ab2878640 1 -- 172.21.15.114:0/1410187160 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5aac09d230 con 0x7f5aac0c4010 2024-04-28T13:07:35.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7fbe94722640 1 -- 172.21.15.114:0/1726730860 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe8c0b5170 con 0x7fbe8c15fb10 2024-04-28T13:07:35.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.086+0000 7fbe94722640 1 -- 172.21.15.114:0/1726730860 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe8c0b2fd0 con 0x7fbe8c15fb10 2024-04-28T13:07:35.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.086+0000 7fbe82ffd640 1 -- 172.21.15.114:0/1726730860 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe8400aa50 con 0x7fbe8c15fb10 2024-04-28T13:07:35.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7fcd74aad640 1 -- 172.21.15.114:0/1786350974 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd5c0039b0 msgr2=0x7fcd70201e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7fcd74aad640 1 --2- 172.21.15.114:0/1786350974 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd5c0039b0 0x7fcd70201e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7fcd74aad640 1 -- 172.21.15.114:0/1786350974 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd70162a00 msgr2=0x7fcd70162eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7fcd74aad640 1 --2- 172.21.15.114:0/1786350974 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd70162a00 0x7fcd70162eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7fcd74aad640 1 -- 172.21.15.114:0/1786350974 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd702024b0 con 0x7fcd70205e70 2024-04-28T13:07:35.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7fcd752ae640 1 --2- 172.21.15.114:0/1786350974 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd5c0039b0 0x7fcd70201e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:07:35.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7fcd74aad640 1 --2- 172.21.15.114:0/1786350974 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcd70205e70 0x7fcd70164dc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcd68009ee0 tx=0x7fcd680115a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.086+0000 7fbe82ffd640 1 -- 172.21.15.114:0/1726730860 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe84016020 con 0x7fbe8c15fb10 2024-04-28T13:07:35.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.086+0000 7fbe924be640 1 --2- 172.21.15.114:0/1726730860 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe8c0701f0 0x7fbe8c133080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:35.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.086+0000 7f6e2549c640 1 -- 172.21.15.114:0/1846254048 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6e00001030 con 0x7f6e18007460 2024-04-28T13:07:35.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.085+0000 7f923b221640 1 -- 172.21.15.114:0/3075270797 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f922c005390 con 0x7f922c033990 2024-04-28T13:07:35.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.086+0000 7f5ab2878640 1 -- 172.21.15.114:0/1410187160 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5aac06a3d0 con 0x7f5aac0c4010 2024-04-28T13:07:35.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.086+0000 7f6e077fe640 1 -- 172.21.15.114:0/1846254048 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6e10044070 con 0x7f6e18007460 2024-04-28T13:07:35.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.087+0000 7f6e077fe640 1 --2- 172.21.15.114:0/1846254048 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6e0c06c940 0x7f6e0c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.087+0000 7fbe94722640 1 -- 172.21.15.114:0/1726730860 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbe8c133b00 con 0x7fbe8c15fb10 2024-04-28T13:07:35.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.086+0000 7f43177fe640 1 -- 172.21.15.114:0/2419856260 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f431003a0a0 msgr2=0x7f431000b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.086+0000 7f43177fe640 1 --2- 172.21.15.114:0/2419856260 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f431003a0a0 0x7f431000b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.087+0000 7f43177fe640 1 -- 172.21.15.114:0/2419856260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43100366a0 msgr2=0x7f43100d5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.087+0000 7f43177fe640 1 --2- 172.21.15.114:0/2419856260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43100366a0 0x7f43100d5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.087+0000 7f43177fe640 1 -- 172.21.15.114:0/2419856260 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4310053ed0 con 0x7f43100df800 2024-04-28T13:07:35.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.087+0000 7f43177fe640 1 --2- 172.21.15.114:0/2419856260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43100df800 0x7f431000b770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f430c034000 tx=0x7f430c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.087+0000 7f6e077fe640 1 -- 172.21.15.114:0/1846254048 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6e100ac480 con 0x7f6e18007460 2024-04-28T13:07:35.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.087+0000 7f1fc0b41640 1 --2- 172.21.15.114:0/3666504792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fbc1f2190 0x7f1fbc1563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.087+0000 7f1fbbfff640 1 -- 172.21.15.114:0/3666504792 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1fbc1f4760 msgr2=0x7f1fbc1f1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.087+0000 7f1fbbfff640 1 --2- 172.21.15.114:0/3666504792 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1fbc1f4760 0x7f1fbc1f1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.087+0000 7f1fbbfff640 1 -- 172.21.15.114:0/3666504792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fbc1f2190 msgr2=0x7f1fbc1563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.087+0000 7f1fbbfff640 1 --2- 172.21.15.114:0/3666504792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fbc1f2190 0x7f1fbc1563b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.087+0000 7f1fbbfff640 1 -- 172.21.15.114:0/3666504792 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fbc155310 con 0x7f1fa40037a0 2024-04-28T13:07:35.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.087+0000 7f1fc0b41640 1 --2- 172.21.15.114:0/3666504792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fbc1f2190 0x7f1fbc1563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:07:35.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.087+0000 7f0c0574f640 1 --2- 172.21.15.114:0/1420365388 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0bf8048ad0 0x7f0bf80de2e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000c7a0 tx=0x7f0bf000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.087+0000 7f922affd640 1 -- 172.21.15.114:0/3075270797 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9230045020 con 0x7f922c033990 2024-04-28T13:07:35.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.087+0000 7f6e077fe640 1 --2- 172.21.15.114:0/1846254048 >> [v2:172.21.15.134:6816/1909762070,v1:172.21.15.134:6817/1909762070] conn(0x7f6e0c074b60 0x7f6e0c076f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.087+0000 7f6e077fe640 1 -- 172.21.15.114:0/1846254048 --> [v2:172.21.15.134:6816/1909762070,v1:172.21.15.134:6817/1909762070] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6e0c077630 con 0x7f6e0c074b60 2024-04-28T13:07:35.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.087+0000 7f6e077fe640 1 -- 172.21.15.114:0/1846254048 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6e100ac830 con 0x7f6e18007460 2024-04-28T13:07:35.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.087+0000 7f6e1f7fe640 1 --2- 172.21.15.114:0/1846254048 >> [v2:172.21.15.134:6816/1909762070,v1:172.21.15.134:6817/1909762070] conn(0x7f6e0c074b60 0x7f6e0c076f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.087+0000 7f42ff7fe640 1 -- 172.21.15.114:0/2419856260 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f430c045070 con 0x7f43100df800 2024-04-28T13:07:35.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.087+0000 7f42ff7fe640 1 -- 172.21.15.114:0/2419856260 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f430c03f860 con 0x7f43100df800 2024-04-28T13:07:35.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.087+0000 7f42ff7fe640 1 -- 172.21.15.114:0/2419856260 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f430c03a040 con 0x7f43100df800 2024-04-28T13:07:35.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.088+0000 7f0bf67fc640 1 -- 172.21.15.114:0/1420365388 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0005270 con 0x7f0bf8048ad0 2024-04-28T13:07:35.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.088+0000 7f0bf67fc640 1 -- 172.21.15.114:0/1420365388 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf0005410 con 0x7f0bf8048ad0 2024-04-28T13:07:35.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.086+0000 7fcd65ffb640 1 -- 172.21.15.114:0/1786350974 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6801a020 con 0x7fcd70205e70 2024-04-28T13:07:35.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.086+0000 7fcd65ffb640 1 -- 172.21.15.114:0/1786350974 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd68016470 con 0x7fcd70205e70 2024-04-28T13:07:35.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.087+0000 7fcd65ffb640 1 -- 172.21.15.114:0/1786350974 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd68016840 con 0x7fcd70205e70 2024-04-28T13:07:35.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.087+0000 7fcd77512640 1 -- 172.21.15.114:0/1786350974 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd70202790 con 0x7fcd70205e70 2024-04-28T13:07:35.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.088+0000 7fcd77512640 1 -- 172.21.15.114:0/1786350974 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd70202d50 con 0x7fcd70205e70 2024-04-28T13:07:35.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.088+0000 7f6e1e7fc640 1 --2- 172.21.15.114:0/1846254048 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6e0c06c940 0x7f6e0c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.088+0000 7f922affd640 1 --2- 172.21.15.114:0/3075270797 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f921806c9c0 0x7f921806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.088+0000 7f0c06f52640 1 -- 172.21.15.114:0/1420365388 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bf804d710 con 0x7f0bf8048ad0 2024-04-28T13:07:35.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.088+0000 7f0c06f52640 1 -- 172.21.15.114:0/1420365388 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bf804dcd0 con 0x7f0bf8048ad0 2024-04-28T13:07:35.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.088+0000 7f922affd640 1 -- 172.21.15.114:0/3075270797 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f92300ac190 con 0x7f922c033990 2024-04-28T13:07:35.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.088+0000 7f1fbbfff640 1 --2- 172.21.15.114:0/3666504792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fa40037a0 0x7f1fbc150760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00d7a0 tx=0x7f1fac00dba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.088+0000 7f0bf67fc640 1 -- 172.21.15.114:0/1420365388 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0005270 con 0x7f0bf8048ad0 2024-04-28T13:07:35.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.088+0000 7f922affd640 1 --2- 172.21.15.114:0/3075270797 >> [v2:172.21.15.114:6816/2936162808,v1:172.21.15.114:6817/2936162808] conn(0x7f9218074be0 0x7f9218077000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.089+0000 7f922affd640 1 -- 172.21.15.114:0/3075270797 --> [v2:172.21.15.114:6816/2936162808,v1:172.21.15.114:6817/2936162808] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f92180776b0 con 0x7f9218074be0 2024-04-28T13:07:35.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.088+0000 7f6e1f7fe640 1 --2- 172.21.15.114:0/1846254048 >> [v2:172.21.15.134:6816/1909762070,v1:172.21.15.134:6817/1909762070] conn(0x7f6e0c074b60 0x7f6e0c076f80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.089+0000 7f922affd640 1 -- 172.21.15.114:0/3075270797 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f92300ac580 con 0x7f922c033990 2024-04-28T13:07:35.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.089+0000 7f1fb8ff9640 1 -- 172.21.15.114:0/3666504792 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac005ad0 con 0x7f1fa40037a0 2024-04-28T13:07:35.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.088+0000 7f4317fff640 1 -- 172.21.15.114:0/2419856260 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f431004aec0 con 0x7f43100df800 2024-04-28T13:07:35.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.088+0000 7f4317fff640 1 -- 172.21.15.114:0/2419856260 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f431004b480 con 0x7f43100df800 2024-04-28T13:07:35.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.089+0000 7f923aa20640 1 --2- 172.21.15.114:0/3075270797 >> [v2:172.21.15.114:6816/2936162808,v1:172.21.15.114:6817/2936162808] conn(0x7f9218074be0 0x7f9218077000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.089+0000 7f6e1e7fc640 1 --2- 172.21.15.114:0/1846254048 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6e0c06c940 0x7f6e0c06ee00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6e2002e060 tx=0x7f6e20074d10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.089+0000 7fcd77512640 1 -- 172.21.15.114:0/1786350974 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcd7006a3d0 con 0x7fcd70205e70 2024-04-28T13:07:35.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.089+0000 7f1fb8ff9640 1 -- 172.21.15.114:0/3666504792 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fac017070 con 0x7f1fa40037a0 2024-04-28T13:07:35.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.089+0000 7f1fb8ff9640 1 -- 172.21.15.114:0/3666504792 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac007070 con 0x7f1fa40037a0 2024-04-28T13:07:35.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.089+0000 7f1fc1342640 1 -- 172.21.15.114:0/3666504792 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fbc1555f0 con 0x7f1fa40037a0 2024-04-28T13:07:35.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.089+0000 7f1fc1342640 1 -- 172.21.15.114:0/3666504792 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fbc155bb0 con 0x7f1fa40037a0 2024-04-28T13:07:35.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.090+0000 7fbe82ffd640 1 -- 172.21.15.114:0/1726730860 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbe84019020 con 0x7fbe8c15fb10 2024-04-28T13:07:35.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.089+0000 7f923aa20640 1 --2- 172.21.15.114:0/3075270797 >> [v2:172.21.15.114:6816/2936162808,v1:172.21.15.114:6817/2936162808] conn(0x7f9218074be0 0x7f9218077000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.090+0000 7f9239a1e640 1 --2- 172.21.15.114:0/3075270797 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f921806c9c0 0x7f921806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.089+0000 7f5aa27fc640 1 -- 172.21.15.114:0/1410187160 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5a9c043020 con 0x7f5aac0c4010 2024-04-28T13:07:35.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.090+0000 7f5aa27fc640 1 --2- 172.21.15.114:0/1410187160 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5a9006c9c0 0x7f5a9006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.090+0000 7f1fc1342640 1 -- 172.21.15.114:0/3666504792 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1fbc076830 con 0x7f1fa40037a0 2024-04-28T13:07:35.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.090+0000 7fcd65ffb640 1 -- 172.21.15.114:0/1786350974 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcd68005d10 con 0x7fcd70205e70 2024-04-28T13:07:35.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.090+0000 7f5ab1075640 1 --2- 172.21.15.114:0/1410187160 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5a9006c9c0 0x7f5a9006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.090+0000 7fbe82ffd640 1 --2- 172.21.15.114:0/1726730860 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbe7006caf0 0x7fbe7006efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.091+0000 7fbe82ffd640 1 -- 172.21.15.114:0/1726730860 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbe8408b8c0 con 0x7fbe8c15fb10 2024-04-28T13:07:35.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.091+0000 7fbe82ffd640 1 --2- 172.21.15.114:0/1726730860 >> [v2:172.21.15.114:6803/1115116056,v1:172.21.15.114:6805/1115116056] conn(0x7fbe70074d10 0x7fbe70077130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.091+0000 7fbe82ffd640 1 -- 172.21.15.114:0/1726730860 --> [v2:172.21.15.114:6803/1115116056,v1:172.21.15.114:6805/1115116056] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbe700777e0 con 0x7fbe70074d10 2024-04-28T13:07:35.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.091+0000 7f0c06f52640 1 -- 172.21.15.114:0/1420365388 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0bf804e0b0 con 0x7f0bf8048ad0 2024-04-28T13:07:35.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.091+0000 7f6e077fe640 1 -- 172.21.15.114:0/1846254048 <== osd.6 v2:172.21.15.134:6816/1909762070 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6e0c077630 con 0x7f6e0c074b60 2024-04-28T13:07:35.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.091+0000 7fbe82ffd640 1 -- 172.21.15.114:0/1726730860 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbe8408bcb0 con 0x7fbe8c15fb10 2024-04-28T13:07:35.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.091+0000 7f922affd640 1 -- 172.21.15.114:0/3075270797 <== osd.1 v2:172.21.15.114:6816/2936162808 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f92180776b0 con 0x7f9218074be0 2024-04-28T13:07:35.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.091+0000 7fbe924be640 1 --2- 172.21.15.114:0/1726730860 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbe7006caf0 0x7fbe7006efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.091+0000 7fcd65ffb640 1 --2- 172.21.15.114:0/1786350974 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fcd5406c9f0 0x7fcd5406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.091+0000 7fcd752ae640 1 --2- 172.21.15.114:0/1786350974 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fcd5406c9f0 0x7fcd5406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.091+0000 7fcd65ffb640 1 -- 172.21.15.114:0/1786350974 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcd6808c750 con 0x7fcd70205e70 2024-04-28T13:07:35.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.091+0000 7fcd65ffb640 1 --2- 172.21.15.114:0/1786350974 >> [v2:172.21.15.134:6824/2503413832,v1:172.21.15.134:6825/2503413832] conn(0x7fcd54074c10 0x7fcd54077030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.091+0000 7fcd65ffb640 1 -- 172.21.15.114:0/1786350974 --> [v2:172.21.15.134:6824/2503413832,v1:172.21.15.134:6825/2503413832] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcd6801ce70 con 0x7fcd54074c10 2024-04-28T13:07:35.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.091+0000 7fcd65ffb640 1 -- 172.21.15.114:0/1786350974 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fcd68093050 con 0x7fcd70205e70 2024-04-28T13:07:35.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.091+0000 7f42fd7fa640 1 -- 172.21.15.114:0/2419856260 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f43100057e0 con 0x7f43100df800 2024-04-28T13:07:35.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.091+0000 7f42ff7fe640 1 -- 172.21.15.114:0/2419856260 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f430c03fc10 con 0x7f43100df800 2024-04-28T13:07:35.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.091+0000 7fbe91cbd640 1 --2- 172.21.15.114:0/1726730860 >> [v2:172.21.15.114:6803/1115116056,v1:172.21.15.114:6805/1115116056] conn(0x7fbe70074d10 0x7fbe70077130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.091+0000 7f5aa27fc640 1 -- 172.21.15.114:0/1410187160 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5a9c0ac040 con 0x7f5aac0c4010 2024-04-28T13:07:35.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.091+0000 7f5aa27fc640 1 --2- 172.21.15.114:0/1410187160 >> [v2:172.21.15.134:6800/3315097167,v1:172.21.15.134:6801/3315097167] conn(0x7f5a90074b60 0x7f5a90076f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.091+0000 7f5aa27fc640 1 -- 172.21.15.114:0/1410187160 --> [v2:172.21.15.134:6800/3315097167,v1:172.21.15.134:6801/3315097167] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5a9c007e40 con 0x7f5a90074b60 2024-04-28T13:07:35.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.091+0000 7f5aa27fc640 1 -- 172.21.15.114:0/1410187160 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5a9c075eb0 con 0x7f5aac0c4010 2024-04-28T13:07:35.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.091+0000 7f5ab1075640 1 --2- 172.21.15.114:0/1410187160 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5a9006c9c0 0x7f5a9006ee80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5aac09df90 tx=0x7f5aa8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.091+0000 7f42ff7fe640 1 --2- 172.21.15.114:0/2419856260 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f430406c9c0 0x7f430406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.091+0000 7f42ff7fe640 1 -- 172.21.15.114:0/2419856260 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f430c0af9c0 con 0x7f43100df800 2024-04-28T13:07:35.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.091+0000 7f42ff7fe640 1 --2- 172.21.15.114:0/2419856260 >> [v2:172.21.15.134:6802/881087352,v1:172.21.15.134:6804/881087352] conn(0x7f4304074b60 0x7f4304076f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.092+0000 7fbe91cbd640 1 --2- 172.21.15.114:0/1726730860 >> [v2:172.21.15.114:6803/1115116056,v1:172.21.15.114:6805/1115116056] conn(0x7fbe70074d10 0x7fbe70077130 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.092+0000 7f9239a1e640 1 --2- 172.21.15.114:0/3075270797 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f921806c9c0 0x7f921806ee80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9224006fd0 tx=0x7f9224008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.092+0000 7fcd75aaf640 1 --2- 172.21.15.114:0/1786350974 >> [v2:172.21.15.134:6824/2503413832,v1:172.21.15.134:6825/2503413832] conn(0x7fcd54074c10 0x7fcd54077030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.092+0000 7f42ff7fe640 1 -- 172.21.15.114:0/2419856260 --> [v2:172.21.15.134:6802/881087352,v1:172.21.15.134:6804/881087352] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4304077630 con 0x7f4304074b60 2024-04-28T13:07:35.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.092+0000 7f42ff7fe640 1 -- 172.21.15.114:0/2419856260 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f430c079a20 con 0x7f43100df800 2024-04-28T13:07:35.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.092+0000 7f5ab2077640 1 --2- 172.21.15.114:0/1410187160 >> [v2:172.21.15.134:6800/3315097167,v1:172.21.15.134:6801/3315097167] conn(0x7f5a90074b60 0x7f5a90076f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.092+0000 7fbe924be640 1 --2- 172.21.15.114:0/1726730860 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbe7006caf0 0x7fbe7006efb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbe88034000 tx=0x7fbe8802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.092+0000 7f43167fc640 1 --2- 172.21.15.114:0/2419856260 >> [v2:172.21.15.134:6802/881087352,v1:172.21.15.134:6804/881087352] conn(0x7f4304074b60 0x7f4304076f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.092+0000 7f43167fc640 1 --2- 172.21.15.114:0/2419856260 >> [v2:172.21.15.134:6802/881087352,v1:172.21.15.134:6804/881087352] conn(0x7f4304074b60 0x7f4304076f80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.092+0000 7f4316ffd640 1 --2- 172.21.15.114:0/2419856260 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f430406c9c0 0x7f430406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.092+0000 7fcd752ae640 1 --2- 172.21.15.114:0/1786350974 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fcd5406c9f0 0x7fcd5406eeb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c034000 tx=0x7fcd6c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.093+0000 7fcd75aaf640 1 --2- 172.21.15.114:0/1786350974 >> [v2:172.21.15.134:6824/2503413832,v1:172.21.15.134:6825/2503413832] conn(0x7fcd54074c10 0x7fcd54077030 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.093+0000 7fbe82ffd640 1 -- 172.21.15.114:0/1726730860 <== osd.0 v2:172.21.15.114:6803/1115116056 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbe700777e0 con 0x7fbe70074d10 2024-04-28T13:07:35.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.093+0000 7f4316ffd640 1 --2- 172.21.15.114:0/2419856260 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f430406c9c0 0x7f430406ee80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4308009a30 tx=0x7f4308009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.093+0000 7f1fb8ff9640 1 -- 172.21.15.114:0/3666504792 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1fac007210 con 0x7f1fa40037a0 2024-04-28T13:07:35.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.093+0000 7f42ff7fe640 1 -- 172.21.15.114:0/2419856260 <== osd.7 v2:172.21.15.134:6802/881087352 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4304077630 con 0x7f4304074b60 2024-04-28T13:07:35.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.093+0000 7f5ab2077640 1 --2- 172.21.15.114:0/1410187160 >> [v2:172.21.15.134:6800/3315097167,v1:172.21.15.134:6801/3315097167] conn(0x7f5a90074b60 0x7f5a90076f80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.093+0000 7f0bf67fc640 1 -- 172.21.15.114:0/1420365388 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0bf000a640 con 0x7f0bf8048ad0 2024-04-28T13:07:35.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.093+0000 7f1fb8ff9640 1 --2- 172.21.15.114:0/3666504792 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1fa806c940 0x7f1fa806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.094+0000 7f1fb8ff9640 1 -- 172.21.15.114:0/3666504792 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1fac08c280 con 0x7f1fa40037a0 2024-04-28T13:07:35.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.094+0000 7f0bf67fc640 1 --2- 172.21.15.114:0/1420365388 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f0be406caf0 0x7f0be406efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.094+0000 7f1fb8ff9640 1 --2- 172.21.15.114:0/3666504792 >> [v2:172.21.15.114:6824/1255181515,v1:172.21.15.114:6825/1255181515] conn(0x7f1fa8074b60 0x7f1fa8076f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.094+0000 7f1fb8ff9640 1 -- 172.21.15.114:0/3666504792 --> [v2:172.21.15.114:6824/1255181515,v1:172.21.15.114:6825/1255181515] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1fac005640 con 0x7f1fa8074b60 2024-04-28T13:07:35.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.094+0000 7f1fb8ff9640 1 -- 172.21.15.114:0/3666504792 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1fac08c630 con 0x7f1fa40037a0 2024-04-28T13:07:35.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.094+0000 7f1fc0b41640 1 --2- 172.21.15.114:0/3666504792 >> [v2:172.21.15.114:6824/1255181515,v1:172.21.15.114:6825/1255181515] conn(0x7f1fa8074b60 0x7f1fa8076f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.094+0000 7f1fbb7fe640 1 --2- 172.21.15.114:0/3666504792 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1fa806c940 0x7f1fa806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.095+0000 7f1fc0b41640 1 --2- 172.21.15.114:0/3666504792 >> [v2:172.21.15.114:6824/1255181515,v1:172.21.15.114:6825/1255181515] conn(0x7f1fa8074b60 0x7f1fa8076f80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.095+0000 7f1fbb7fe640 1 --2- 172.21.15.114:0/3666504792 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1fa806c940 0x7f1fa806ee00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4009f70 tx=0x7f1fb402f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.094+0000 7f0bf67fc640 1 -- 172.21.15.114:0/1420365388 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0bf008be40 con 0x7f0bf8048ad0 2024-04-28T13:07:35.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.094+0000 7f0bf67fc640 1 --2- 172.21.15.114:0/1420365388 >> [v2:172.21.15.114:6800/2142391188,v1:172.21.15.114:6801/2142391188] conn(0x7f0be4074c90 0x7f0be40770b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.094+0000 7f0bf67fc640 1 -- 172.21.15.114:0/1420365388 --> [v2:172.21.15.114:6800/2142391188,v1:172.21.15.114:6801/2142391188] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0bf001ce50 con 0x7f0be4074c90 2024-04-28T13:07:35.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.094+0000 7f0bf67fc640 1 -- 172.21.15.114:0/1420365388 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f0bf008c2d0 con 0x7f0bf8048ad0 2024-04-28T13:07:35.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.094+0000 7f0c05f50640 1 --2- 172.21.15.114:0/1420365388 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f0be406caf0 0x7f0be406efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.094+0000 7f0c06751640 1 --2- 172.21.15.114:0/1420365388 >> [v2:172.21.15.114:6800/2142391188,v1:172.21.15.114:6801/2142391188] conn(0x7f0be4074c90 0x7f0be40770b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.095+0000 7f0c05f50640 1 --2- 172.21.15.114:0/1420365388 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f0be406caf0 0x7f0be406efb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc009630 tx=0x7f0bfc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.095+0000 7f0c06751640 1 --2- 172.21.15.114:0/1420365388 >> [v2:172.21.15.114:6800/2142391188,v1:172.21.15.114:6801/2142391188] conn(0x7f0be4074c90 0x7f0be40770b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.096+0000 7f1fb8ff9640 1 -- 172.21.15.114:0/3666504792 <== osd.2 v2:172.21.15.114:6824/1255181515 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1fac005640 con 0x7f1fa8074b60 2024-04-28T13:07:35.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.096+0000 7f5aa27fc640 1 -- 172.21.15.114:0/1410187160 <== osd.4 v2:172.21.15.134:6800/3315097167 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5a9c007e40 con 0x7f5a90074b60 2024-04-28T13:07:35.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.096+0000 7f0bf67fc640 1 -- 172.21.15.114:0/1420365388 <== osd.3 v2:172.21.15.114:6800/2142391188 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0bf001ce50 con 0x7f0be4074c90 2024-04-28T13:07:35.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.094+0000 7fcd65ffb640 1 -- 172.21.15.114:0/1786350974 <== osd.5 v2:172.21.15.134:6824/2503413832 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcd6801ce70 con 0x7fcd54074c10 2024-04-28T13:07:35.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.121+0000 7f923b221640 1 -- 172.21.15.114:0/3075270797 --> [v2:172.21.15.114:6816/2936162808,v1:172.21.15.114:6817/2936162808] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f922c034120 con 0x7f9218074be0 2024-04-28T13:07:35.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.121+0000 7f6e2549c640 1 -- 172.21.15.114:0/1846254048 --> [v2:172.21.15.134:6816/1909762070,v1:172.21.15.134:6817/1909762070] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6e00002dd0 con 0x7f6e0c074b60 2024-04-28T13:07:35.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.121+0000 7f922affd640 1 -- 172.21.15.114:0/3075270797 <== osd.1 v2:172.21.15.114:6816/2936162808 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f922c034120 con 0x7f9218074be0 2024-04-28T13:07:35.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.122+0000 7f6e077fe640 1 -- 172.21.15.114:0/1846254048 <== osd.6 v2:172.21.15.134:6816/1909762070 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6e00002dd0 con 0x7f6e0c074b60 2024-04-28T13:07:35.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.122+0000 7f9228ff9640 1 -- 172.21.15.114:0/3075270797 >> [v2:172.21.15.114:6816/2936162808,v1:172.21.15.114:6817/2936162808] conn(0x7f9218074be0 msgr2=0x7f9218077000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.122+0000 7f9228ff9640 1 --2- 172.21.15.114:0/3075270797 >> [v2:172.21.15.114:6816/2936162808,v1:172.21.15.114:6817/2936162808] conn(0x7f9218074be0 0x7f9218077000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.122+0000 7f6e057fa640 1 -- 172.21.15.114:0/1846254048 >> [v2:172.21.15.134:6816/1909762070,v1:172.21.15.134:6817/1909762070] conn(0x7f6e0c074b60 msgr2=0x7f6e0c076f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.122+0000 7f6e057fa640 1 --2- 172.21.15.114:0/1846254048 >> [v2:172.21.15.134:6816/1909762070,v1:172.21.15.134:6817/1909762070] conn(0x7f6e0c074b60 0x7f6e0c076f80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.122+0000 7f9228ff9640 1 -- 172.21.15.114:0/3075270797 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f921806c9c0 msgr2=0x7f921806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.122+0000 7f9228ff9640 1 --2- 172.21.15.114:0/3075270797 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f921806c9c0 0x7f921806ee80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9224006fd0 tx=0x7f9224008040 comp rx=0 tx=0).stop 2024-04-28T13:07:35.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.122+0000 7f9228ff9640 1 -- 172.21.15.114:0/3075270797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f922c033990 msgr2=0x7f922c0f1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.122+0000 7f9228ff9640 1 --2- 172.21.15.114:0/3075270797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f922c033990 0x7f922c0f1a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9230000c00 tx=0x7f92300046c0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.122+0000 7f923aa20640 1 -- 172.21.15.114:0/3075270797 reap_dead start 2024-04-28T13:07:35.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.122+0000 7f9228ff9640 1 -- 172.21.15.114:0/3075270797 shutdown_connections 2024-04-28T13:07:35.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.122+0000 7f9228ff9640 1 -- 172.21.15.114:0/3075270797 >> 172.21.15.114:0/3075270797 conn(0x7f922c009fb0 msgr2=0x7f922c04cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.123+0000 7f6e057fa640 1 -- 172.21.15.114:0/1846254048 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6e0c06c940 msgr2=0x7f6e0c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.123+0000 7f9228ff9640 1 -- 172.21.15.114:0/3075270797 shutdown_connections 2024-04-28T13:07:35.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.123+0000 7f9228ff9640 1 -- 172.21.15.114:0/3075270797 wait complete. 2024-04-28T13:07:35.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.123+0000 7f6e057fa640 1 --2- 172.21.15.114:0/1846254048 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6e0c06c940 0x7f6e0c06ee00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6e2002e060 tx=0x7f6e20074d10 comp rx=0 tx=0).stop 2024-04-28T13:07:35.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.123+0000 7f6e057fa640 1 -- 172.21.15.114:0/1846254048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e18007460 msgr2=0x7f6e180e2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.123+0000 7f6e057fa640 1 --2- 172.21.15.114:0/1846254048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e18007460 0x7f6e180e2c20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6e10000c00 tx=0x7f6e100046c0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.123+0000 7f6e1f7fe640 1 -- 172.21.15.114:0/1846254048 reap_dead start 2024-04-28T13:07:35.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.123+0000 7f6e057fa640 1 -- 172.21.15.114:0/1846254048 shutdown_connections 2024-04-28T13:07:35.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.123+0000 7f6e057fa640 1 -- 172.21.15.114:0/1846254048 >> 172.21.15.114:0/1846254048 conn(0x7f6e18009fe0 msgr2=0x7f6e1804aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.124+0000 7f6e057fa640 1 -- 172.21.15.114:0/1846254048 shutdown_connections 2024-04-28T13:07:35.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.124+0000 7f6e057fa640 1 -- 172.21.15.114:0/1846254048 wait complete. 2024-04-28T13:07:35.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.125+0000 7f42fd7fa640 1 -- 172.21.15.114:0/2419856260 --> [v2:172.21.15.134:6802/881087352,v1:172.21.15.134:6804/881087352] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f43100de920 con 0x7f4304074b60 2024-04-28T13:07:35.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.126+0000 7f42ff7fe640 1 -- 172.21.15.114:0/2419856260 <== osd.7 v2:172.21.15.134:6802/881087352 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f43100de920 con 0x7f4304074b60 2024-04-28T13:07:35.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.126+0000 7f4317fff640 1 -- 172.21.15.114:0/2419856260 >> [v2:172.21.15.134:6802/881087352,v1:172.21.15.134:6804/881087352] conn(0x7f4304074b60 msgr2=0x7f4304076f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.126+0000 7f4317fff640 1 --2- 172.21.15.114:0/2419856260 >> [v2:172.21.15.134:6802/881087352,v1:172.21.15.134:6804/881087352] conn(0x7f4304074b60 0x7f4304076f80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.127+0000 7fbe94722640 1 -- 172.21.15.114:0/1726730860 --> [v2:172.21.15.114:6803/1115116056,v1:172.21.15.114:6805/1115116056] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbe8c06a3d0 con 0x7fbe70074d10 2024-04-28T13:07:35.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.127+0000 7f4317fff640 1 -- 172.21.15.114:0/2419856260 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f430406c9c0 msgr2=0x7f430406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.127+0000 7f5ab2878640 1 -- 172.21.15.114:0/1410187160 --> [v2:172.21.15.134:6800/3315097167,v1:172.21.15.134:6801/3315097167] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5aac0c5390 con 0x7f5a90074b60 2024-04-28T13:07:35.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.127+0000 7f4317fff640 1 --2- 172.21.15.114:0/2419856260 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f430406c9c0 0x7f430406ee80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4308009a30 tx=0x7f4308009190 comp rx=0 tx=0).stop 2024-04-28T13:07:35.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.127+0000 7f4317fff640 1 -- 172.21.15.114:0/2419856260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43100df800 msgr2=0x7f431000b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.127+0000 7f4317fff640 1 --2- 172.21.15.114:0/2419856260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43100df800 0x7f431000b770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f430c034000 tx=0x7f430c0046c0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.127+0000 7f43177fe640 1 -- 172.21.15.114:0/2419856260 reap_dead start 2024-04-28T13:07:35.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.127+0000 7fcd77512640 1 -- 172.21.15.114:0/1786350974 --> [v2:172.21.15.134:6824/2503413832,v1:172.21.15.134:6825/2503413832] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcd7006ff70 con 0x7fcd54074c10 2024-04-28T13:07:35.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.127+0000 7f4317fff640 1 -- 172.21.15.114:0/2419856260 shutdown_connections 2024-04-28T13:07:35.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.127+0000 7f4317fff640 1 -- 172.21.15.114:0/2419856260 >> 172.21.15.114:0/2419856260 conn(0x7f431001e6c0 msgr2=0x7f43100d7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.127+0000 7f5aa27fc640 1 -- 172.21.15.114:0/1410187160 <== osd.4 v2:172.21.15.134:6800/3315097167 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5aa4003990 con 0x7f5a90074b60 2024-04-28T13:07:35.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.127+0000 7f4317fff640 1 -- 172.21.15.114:0/2419856260 shutdown_connections 2024-04-28T13:07:35.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.127+0000 7f4317fff640 1 -- 172.21.15.114:0/2419856260 wait complete. 2024-04-28T13:07:35.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.127+0000 7fcd65ffb640 1 -- 172.21.15.114:0/1786350974 <== osd.5 v2:172.21.15.134:6824/2503413832 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcd7006ff70 con 0x7fcd54074c10 2024-04-28T13:07:35.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.128+0000 7f0c06f52640 1 -- 172.21.15.114:0/1420365388 --> [v2:172.21.15.114:6800/2142391188,v1:172.21.15.114:6801/2142391188] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0bf804e750 con 0x7f0be4074c90 2024-04-28T13:07:35.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.128+0000 7fbe82ffd640 1 -- 172.21.15.114:0/1726730860 <== osd.0 v2:172.21.15.114:6803/1115116056 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbe8c06a3d0 con 0x7fbe70074d10 2024-04-28T13:07:35.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.128+0000 7fcd537fe640 1 -- 172.21.15.114:0/1786350974 >> [v2:172.21.15.134:6824/2503413832,v1:172.21.15.134:6825/2503413832] conn(0x7fcd54074c10 msgr2=0x7fcd54077030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.128+0000 7fcd537fe640 1 --2- 172.21.15.114:0/1786350974 >> [v2:172.21.15.134:6824/2503413832,v1:172.21.15.134:6825/2503413832] conn(0x7fcd54074c10 0x7fcd54077030 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.128+0000 7f0bf67fc640 1 -- 172.21.15.114:0/1420365388 <== osd.3 v2:172.21.15.114:6800/2142391188 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0bf804e750 con 0x7f0be4074c90 2024-04-28T13:07:35.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.128+0000 7f5a8ffff640 1 -- 172.21.15.114:0/1410187160 >> [v2:172.21.15.134:6800/3315097167,v1:172.21.15.134:6801/3315097167] conn(0x7f5a90074b60 msgr2=0x7f5a90076f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.128+0000 7f5a8ffff640 1 --2- 172.21.15.114:0/1410187160 >> [v2:172.21.15.134:6800/3315097167,v1:172.21.15.134:6801/3315097167] conn(0x7f5a90074b60 0x7f5a90076f80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.128+0000 7fcd537fe640 1 -- 172.21.15.114:0/1786350974 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fcd5406c9f0 msgr2=0x7fcd5406eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.128+0000 7fcd537fe640 1 --2- 172.21.15.114:0/1786350974 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fcd5406c9f0 0x7fcd5406eeb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c034000 tx=0x7fcd6c02e000 comp rx=0 tx=0).stop 2024-04-28T13:07:35.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.128+0000 7f5a8ffff640 1 -- 172.21.15.114:0/1410187160 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5a9006c9c0 msgr2=0x7f5a9006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.128+0000 7f5a8ffff640 1 --2- 172.21.15.114:0/1410187160 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5a9006c9c0 0x7f5a9006ee80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5aac09df90 tx=0x7f5aa8009190 comp rx=0 tx=0).stop 2024-04-28T13:07:35.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.128+0000 7fcd537fe640 1 -- 172.21.15.114:0/1786350974 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcd70205e70 msgr2=0x7fcd70164dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.128+0000 7fcd537fe640 1 --2- 172.21.15.114:0/1786350974 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcd70205e70 0x7fcd70164dc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcd68009ee0 tx=0x7fcd680115a0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.128+0000 7fcd75aaf640 1 -- 172.21.15.114:0/1786350974 reap_dead start 2024-04-28T13:07:35.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.129+0000 7fcd537fe640 1 -- 172.21.15.114:0/1786350974 shutdown_connections 2024-04-28T13:07:35.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.129+0000 7fcd537fe640 1 -- 172.21.15.114:0/1786350974 >> 172.21.15.114:0/1786350974 conn(0x7fcd700cd8b0 msgr2=0x7fcd7014a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.129+0000 7fbe80ff9640 1 -- 172.21.15.114:0/1726730860 >> [v2:172.21.15.114:6803/1115116056,v1:172.21.15.114:6805/1115116056] conn(0x7fbe70074d10 msgr2=0x7fbe70077130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.129+0000 7fbe80ff9640 1 --2- 172.21.15.114:0/1726730860 >> [v2:172.21.15.114:6803/1115116056,v1:172.21.15.114:6805/1115116056] conn(0x7fbe70074d10 0x7fbe70077130 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.129+0000 7f5a8ffff640 1 -- 172.21.15.114:0/1410187160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aac0c4010 msgr2=0x7f5aac0ca260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.129+0000 7f5a8ffff640 1 --2- 172.21.15.114:0/1410187160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aac0c4010 0x7f5aac0ca260 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c000c00 tx=0x7f5a9c0046c0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.129+0000 7f5ab2077640 1 -- 172.21.15.114:0/1410187160 reap_dead start 2024-04-28T13:07:35.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.129+0000 7fbe80ff9640 1 -- 172.21.15.114:0/1726730860 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbe7006caf0 msgr2=0x7fbe7006efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.129+0000 7fbe80ff9640 1 --2- 172.21.15.114:0/1726730860 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbe7006caf0 0x7fbe7006efb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbe88034000 tx=0x7fbe8802e000 comp rx=0 tx=0).stop 2024-04-28T13:07:35.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.129+0000 7fbe80ff9640 1 -- 172.21.15.114:0/1726730860 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe8c15fb10 msgr2=0x7fbe8c0b0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.129+0000 7fbe80ff9640 1 --2- 172.21.15.114:0/1726730860 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe8c15fb10 0x7fbe8c0b0d40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbe8400c780 tx=0x7fbe8400cc40 comp rx=0 tx=0).stop 2024-04-28T13:07:35.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.129+0000 7fbe92cbf640 1 -- 172.21.15.114:0/1726730860 reap_dead start 2024-04-28T13:07:35.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.129+0000 7fbe80ff9640 1 -- 172.21.15.114:0/1726730860 shutdown_connections 2024-04-28T13:07:35.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.129+0000 7fbe80ff9640 1 -- 172.21.15.114:0/1726730860 >> 172.21.15.114:0/1726730860 conn(0x7fbe8c0cd8b0 msgr2=0x7fbe8c15cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.129+0000 7f0c06f52640 1 -- 172.21.15.114:0/1420365388 >> [v2:172.21.15.114:6800/2142391188,v1:172.21.15.114:6801/2142391188] conn(0x7f0be4074c90 msgr2=0x7f0be40770b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.129+0000 7f0c06f52640 1 --2- 172.21.15.114:0/1420365388 >> [v2:172.21.15.114:6800/2142391188,v1:172.21.15.114:6801/2142391188] conn(0x7f0be4074c90 0x7f0be40770b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.129+0000 7f5a8ffff640 1 -- 172.21.15.114:0/1410187160 shutdown_connections 2024-04-28T13:07:35.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.129+0000 7f5a8ffff640 1 -- 172.21.15.114:0/1410187160 >> 172.21.15.114:0/1410187160 conn(0x7f5aac0d1020 msgr2=0x7f5aac0ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.129+0000 7f5a8ffff640 1 -- 172.21.15.114:0/1410187160 shutdown_connections 2024-04-28T13:07:35.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.129+0000 7f5a8ffff640 1 -- 172.21.15.114:0/1410187160 wait complete. 2024-04-28T13:07:35.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.129+0000 7fcd537fe640 1 -- 172.21.15.114:0/1786350974 shutdown_connections 2024-04-28T13:07:35.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.129+0000 7fcd537fe640 1 -- 172.21.15.114:0/1786350974 wait complete. 2024-04-28T13:07:35.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.129+0000 7f0c06f52640 1 -- 172.21.15.114:0/1420365388 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f0be406caf0 msgr2=0x7f0be406efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.129+0000 7f0c06f52640 1 --2- 172.21.15.114:0/1420365388 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f0be406caf0 0x7f0be406efb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc009630 tx=0x7f0bfc02e000 comp rx=0 tx=0).stop 2024-04-28T13:07:35.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.129+0000 7f0c06f52640 1 -- 172.21.15.114:0/1420365388 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0bf8048ad0 msgr2=0x7f0bf80de2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.129+0000 7f0c06f52640 1 --2- 172.21.15.114:0/1420365388 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0bf8048ad0 0x7f0bf80de2e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000c7a0 tx=0x7f0bf000cc60 comp rx=0 tx=0).stop 2024-04-28T13:07:35.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.129+0000 7f0c06751640 1 -- 172.21.15.114:0/1420365388 reap_dead start 2024-04-28T13:07:35.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.129+0000 7f0c06f52640 1 -- 172.21.15.114:0/1420365388 shutdown_connections 2024-04-28T13:07:35.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.129+0000 7f0c06f52640 1 -- 172.21.15.114:0/1420365388 >> 172.21.15.114:0/1420365388 conn(0x7f0bf801e6c0 msgr2=0x7f0bf80e9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.130+0000 7fbe80ff9640 1 -- 172.21.15.114:0/1726730860 shutdown_connections 2024-04-28T13:07:35.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.130+0000 7fbe80ff9640 1 -- 172.21.15.114:0/1726730860 wait complete. 2024-04-28T13:07:35.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.130+0000 7f0c06f52640 1 -- 172.21.15.114:0/1420365388 shutdown_connections 2024-04-28T13:07:35.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.130+0000 7f0c06f52640 1 -- 172.21.15.114:0/1420365388 wait complete. 2024-04-28T13:07:35.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.131+0000 7f1fc1342640 1 -- 172.21.15.114:0/3666504792 --> [v2:172.21.15.114:6824/1255181515,v1:172.21.15.114:6825/1255181515] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1fbc06e8a0 con 0x7f1fa8074b60 2024-04-28T13:07:35.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.131+0000 7f1fb8ff9640 1 -- 172.21.15.114:0/3666504792 <== osd.2 v2:172.21.15.114:6824/1255181515 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1fbc06e8a0 con 0x7f1fa8074b60 2024-04-28T13:07:35.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.133+0000 7f1fa27fc640 1 -- 172.21.15.114:0/3666504792 >> [v2:172.21.15.114:6824/1255181515,v1:172.21.15.114:6825/1255181515] conn(0x7f1fa8074b60 msgr2=0x7f1fa8076f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.133+0000 7f1fa27fc640 1 --2- 172.21.15.114:0/3666504792 >> [v2:172.21.15.114:6824/1255181515,v1:172.21.15.114:6825/1255181515] conn(0x7f1fa8074b60 0x7f1fa8076f80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.134+0000 7f1fa27fc640 1 -- 172.21.15.114:0/3666504792 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1fa806c940 msgr2=0x7f1fa806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.134+0000 7f1fa27fc640 1 --2- 172.21.15.114:0/3666504792 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1fa806c940 0x7f1fa806ee00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4009f70 tx=0x7f1fb402f000 comp rx=0 tx=0).stop 2024-04-28T13:07:35.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.134+0000 7f1fa27fc640 1 -- 172.21.15.114:0/3666504792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fa40037a0 msgr2=0x7f1fbc150760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.134+0000 7f1fa27fc640 1 --2- 172.21.15.114:0/3666504792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fa40037a0 0x7f1fbc150760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00d7a0 tx=0x7f1fac00dba0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.134+0000 7f1fc0b41640 1 -- 172.21.15.114:0/3666504792 reap_dead start 2024-04-28T13:07:35.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.134+0000 7f1fa27fc640 1 -- 172.21.15.114:0/3666504792 shutdown_connections 2024-04-28T13:07:35.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.134+0000 7f1fa27fc640 1 -- 172.21.15.114:0/3666504792 >> 172.21.15.114:0/3666504792 conn(0x7f1fbc0737b0 msgr2=0x7f1fbc151260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.135+0000 7f1fa27fc640 1 -- 172.21.15.114:0/3666504792 shutdown_connections 2024-04-28T13:07:35.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.135+0000 7f1fa27fc640 1 -- 172.21.15.114:0/3666504792 wait complete. 2024-04-28T13:07:35.193 INFO:teuthology.orchestra.run.smithi114.stdout:55834574857 2024-04-28T13:07:35.193 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-28T13:07:35.194 INFO:teuthology.orchestra.run.smithi114.stdout:55834574856 2024-04-28T13:07:35.195 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-28T13:07:35.195 INFO:teuthology.orchestra.run.smithi114.stdout:55834574856 2024-04-28T13:07:35.196 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-28T13:07:35.196 INFO:teuthology.orchestra.run.smithi114.stdout:55834574856 2024-04-28T13:07:35.197 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-28T13:07:35.197 INFO:teuthology.orchestra.run.smithi114.stdout:55834574855 2024-04-28T13:07:35.198 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-28T13:07:35.198 INFO:teuthology.orchestra.run.smithi114.stdout:55834574856 2024-04-28T13:07:35.199 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-28T13:07:35.199 INFO:teuthology.orchestra.run.smithi114.stdout:55834574856 2024-04-28T13:07:35.200 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-28T13:07:35.200 INFO:teuthology.orchestra.run.smithi114.stdout:55834574857 2024-04-28T13:07:35.201 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-28T13:07:35.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.400+0000 7ff5a8d9d640 1 Processor -- start 2024-04-28T13:07:35.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.400+0000 7fb1cb42c640 1 Processor -- start 2024-04-28T13:07:35.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.401+0000 7fb1cb42c640 1 -- start start 2024-04-28T13:07:35.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.401+0000 7f42c586f640 1 Processor -- start 2024-04-28T13:07:35.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.401+0000 7f42c586f640 1 -- start start 2024-04-28T13:07:35.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.400+0000 7ff5a8d9d640 1 -- start start 2024-04-28T13:07:35.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.402+0000 7ff5a8d9d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5a40d28e0 0x7ff5a40d2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.402+0000 7ff5a259c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff5a41463d0 0x7ff5a41616f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46844/0 (socket says 172.21.15.114:46844) 2024-04-28T13:07:35.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.402+0000 7ff5a8d9d640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5a4071270 con 0x7ff5a41463d0 2024-04-28T13:07:35.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.402+0000 7fb1cb42c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb1bc009190 0x7fb1bc052f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.402+0000 7ff5a8d9d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5a40d2d40 con 0x7ff5a40d3500 2024-04-28T13:07:35.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.402+0000 7fb1cb42c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb1bc049070 0x7fb1bc0eb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.402+0000 7fb1cb42c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1bc009570 con 0x7fb1bc048c40 2024-04-28T13:07:35.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.402+0000 7fb1cb42c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fb1bc035970 con 0x7fb1bc009190 2024-04-28T13:07:35.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.402+0000 7fb1cb42c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb1bc035c30 con 0x7fb1bc049070 2024-04-28T13:07:35.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.402+0000 7ff5a8d9d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff5a40d3960 con 0x7ff5a40d28e0 2024-04-28T13:07:35.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.402+0000 7ff59bfff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5a40d28e0 0x7ff5a40d2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.402+0000 7ff5a2d9d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ff5a40d3500 0x7ff5a40c7ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:43352/0 (socket says 172.21.15.114:43352) 2024-04-28T13:07:35.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.402+0000 7ff5a2d9d640 1 -- 172.21.15.114:0/2909486732 learned_addr learned my addr 172.21.15.114:0/2909486732 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:35.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.402+0000 7fb1c91c8640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb1bc009190 0x7fb1bc052f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.402+0000 7fb1c99c9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb1bc049070 0x7fb1bc0eb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.402+0000 7f7183340640 1 Processor -- start 2024-04-28T13:07:35.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.402+0000 7fb1c89c7640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb1bc048c40 0x7fb1bc0eb2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46856/0 (socket says 172.21.15.114:46856) 2024-04-28T13:07:35.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.402+0000 7f42c586f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f42c006f7f0 0x7f42c00730b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.402+0000 7f42c586f640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c00b0f40 con 0x7f42c00b6060 2024-04-28T13:07:35.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.402+0000 7f42c586f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c00b4fc0 con 0x7f42c015bfb0 2024-04-28T13:07:35.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.402+0000 7f42c586f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f42c00b5bd0 con 0x7f42c006f7f0 2024-04-28T13:07:35.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.402+0000 7fb1c89c7640 1 -- 172.21.15.114:0/4051054639 learned_addr learned my addr 172.21.15.114:0/4051054639 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:35.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.403+0000 7fb1c91c8640 1 -- 172.21.15.114:0/4051054639 >> v2:172.21.15.134:3300/0 conn(0x7fb1bc049070 msgr2=0x7fb1bc0eb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:35.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.403+0000 7fb1c91c8640 1 --2- 172.21.15.114:0/4051054639 >> v2:172.21.15.134:3300/0 conn(0x7fb1bc049070 0x7fb1bc0eb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.403+0000 7fb1c91c8640 1 -- 172.21.15.114:0/4051054639 >> v1:172.21.15.114:6789/0 conn(0x7fb1bc048c40 legacy=0x7fb1bc0eb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.403+0000 7fb1c91c8640 1 -- 172.21.15.114:0/4051054639 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1bc035f10 con 0x7fb1bc009190 2024-04-28T13:07:35.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.403+0000 7f42bffff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f42c00b6060 0x7f42c006f0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46868/0 (socket says 172.21.15.114:46868) 2024-04-28T13:07:35.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.403+0000 7f42bffff640 1 -- 172.21.15.114:0/3914583639 learned_addr learned my addr 172.21.15.114:0/3914583639 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:35.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.403+0000 7f42c506e640 1 --2- 172.21.15.114:0/3914583639 >> v2:172.21.15.134:3300/0 conn(0x7f42c006f7f0 0x7f42c00730b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.403+0000 7f42bf7fe640 1 -- 172.21.15.114:0/3914583639 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3190037427 0 0) 0x7f42c00b0f40 con 0x7f42c00b6060 2024-04-28T13:07:35.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.403+0000 7f42bf7fe640 1 -- 172.21.15.114:0/3914583639 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42a8003520 con 0x7f42c00b6060 2024-04-28T13:07:35.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.403+0000 7f42bf7fe640 1 -- 172.21.15.114:0/3914583639 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3796474172 0 0) 0x7f42c00b4fc0 con 0x7f42c015bfb0 2024-04-28T13:07:35.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.403+0000 7f42bf7fe640 1 -- 172.21.15.114:0/3914583639 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42c00b0f40 con 0x7f42c015bfb0 2024-04-28T13:07:35.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.403+0000 7ff5a1d9b640 1 -- 172.21.15.114:0/2909486732 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 732875706 0 0) 0x7ff5a40d2d40 con 0x7ff5a40d3500 2024-04-28T13:07:35.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.403+0000 7ff5a1d9b640 1 -- 172.21.15.114:0/2909486732 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff590003520 con 0x7ff5a40d3500 2024-04-28T13:07:35.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.403+0000 7f42c506e640 1 -- 172.21.15.114:0/3914583639 >> v1:172.21.15.134:6789/0 conn(0x7f42c015bfb0 legacy=0x7f42c00b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.403+0000 7f42c506e640 1 -- 172.21.15.114:0/3914583639 >> v1:172.21.15.114:6789/0 conn(0x7f42c00b6060 legacy=0x7f42c006f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.403+0000 7f42c506e640 1 -- 172.21.15.114:0/3914583639 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c00b52a0 con 0x7f42c006f7f0 2024-04-28T13:07:35.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.403+0000 7ff59bfff640 1 -- 172.21.15.114:0/2909486732 >> v1:172.21.15.134:6789/0 conn(0x7ff5a40d3500 legacy=0x7ff5a40c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.403+0000 7ff59bfff640 1 -- 172.21.15.114:0/2909486732 >> v1:172.21.15.114:6789/0 conn(0x7ff5a41463d0 legacy=0x7ff5a41616f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.403+0000 7f7183340640 1 -- start start 2024-04-28T13:07:35.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.403+0000 7ff5a1d9b640 1 -- 172.21.15.114:0/2909486732 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2928478915 0 0) 0x7ff5a4071270 con 0x7ff5a41463d0 2024-04-28T13:07:35.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.403+0000 7ff59bfff640 1 -- 172.21.15.114:0/2909486732 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a40714e0 con 0x7ff5a40d28e0 2024-04-28T13:07:35.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.404+0000 7fb1c91c8640 1 --2- 172.21.15.114:0/4051054639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1bc009190 0x7fb1bc052f00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4050be0 tx=0x7fb1c40a6a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b0bb373ee753b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.404+0000 7f7183340640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f717c15f1a0 0x7f717c0d4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.404+0000 7f7183340640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f717c0bae80 0x7f717c0d5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.404+0000 7f7183340640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f717c0d3af0 con 0x7f717c15f580 2024-04-28T13:07:35.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.404+0000 7f89a893e640 1 Processor -- start 2024-04-28T13:07:35.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.404+0000 7f7183340640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f717c0d3dd0 con 0x7f717c15f1a0 2024-04-28T13:07:35.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.404+0000 7f7183340640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f717c0d40b0 con 0x7f717c0bae80 2024-04-28T13:07:35.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.404+0000 7f80227a7640 1 Processor -- start 2024-04-28T13:07:35.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.404+0000 7f71808db640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f717c15f580 0x7f717c0d32c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46874/0 (socket says 172.21.15.114:46874) 2024-04-28T13:07:35.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.404+0000 7f71808db640 1 -- 172.21.15.114:0/1806359905 learned_addr learned my addr 172.21.15.114:0/1806359905 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:35.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.404+0000 7f71810dc640 1 --2- 172.21.15.114:0/1806359905 >> v2:172.21.15.114:3300/0 conn(0x7f717c15f1a0 0x7f717c0d4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.404+0000 7f80227a7640 1 -- start start 2024-04-28T13:07:35.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.404+0000 7f89a893e640 1 -- start start 2024-04-28T13:07:35.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.404+0000 7fb1bbfff640 1 -- 172.21.15.114:0/4051054639 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c40aa8d0 con 0x7fb1bc009190 2024-04-28T13:07:35.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.404+0000 7fb1bbfff640 1 -- 172.21.15.114:0/4051054639 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1c40aaa70 con 0x7fb1bc009190 2024-04-28T13:07:35.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.404+0000 7fb1bbfff640 1 -- 172.21.15.114:0/4051054639 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c40aae60 con 0x7fb1bc009190 2024-04-28T13:07:35.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.405+0000 7f42c506e640 1 --2- 172.21.15.114:0/3914583639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42c006f7f0 0x7f42c00730b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f42b00097a0 tx=0x7f42b002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9086134462dc842 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.405+0000 7f71818dd640 1 --2- 172.21.15.114:0/1806359905 >> v2:172.21.15.134:3300/0 conn(0x7f717c0bae80 0x7f717c0d5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.405+0000 7f7173fff640 1 -- 172.21.15.114:0/1806359905 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3671272581 0 0) 0x7f717c0d3af0 con 0x7f717c15f580 2024-04-28T13:07:35.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.405+0000 7ff59bfff640 1 --2- 172.21.15.114:0/2909486732 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5a40d28e0 0x7ff5a40d2fc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff58c0097d0 tx=0x7ff58c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68f9b96b22130dda server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.405+0000 7f7173fff640 1 -- 172.21.15.114:0/1806359905 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7168003520 con 0x7f717c15f580 2024-04-28T13:07:35.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.405+0000 7f42bf7fe640 1 -- 172.21.15.114:0/3914583639 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0037070 con 0x7f42c006f7f0 2024-04-28T13:07:35.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.405+0000 7ff5a1d9b640 1 -- 172.21.15.114:0/2909486732 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c037070 con 0x7ff5a40d28e0 2024-04-28T13:07:35.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.405+0000 7ff5a1d9b640 1 -- 172.21.15.114:0/2909486732 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff58c02ae50 con 0x7ff5a40d28e0 2024-04-28T13:07:35.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.405+0000 7f42bf7fe640 1 -- 172.21.15.114:0/3914583639 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b0032440 con 0x7f42c006f7f0 2024-04-28T13:07:35.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.405+0000 7ff5a1d9b640 1 -- 172.21.15.114:0/2909486732 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c037070 con 0x7ff5a40d28e0 2024-04-28T13:07:35.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.405+0000 7fb1cb42c640 1 -- 172.21.15.114:0/4051054639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1bc009190 msgr2=0x7fb1bc052f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.405+0000 7fb1cb42c640 1 --2- 172.21.15.114:0/4051054639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1bc009190 0x7fb1bc052f00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4050be0 tx=0x7fb1c40a6a50 comp rx=0 tx=0).stop 2024-04-28T13:07:35.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.405+0000 7fb1cb42c640 1 -- 172.21.15.114:0/4051054639 shutdown_connections 2024-04-28T13:07:35.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.405+0000 7fb1cb42c640 1 --2- 172.21.15.114:0/4051054639 >> v2:172.21.15.134:3300/0 conn(0x7fb1bc049070 0x7fb1bc0eb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.405+0000 7fb1cb42c640 1 --2- 172.21.15.114:0/4051054639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1bc009190 0x7fb1bc052f00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.405+0000 7fb1cb42c640 1 -- 172.21.15.114:0/4051054639 >> 172.21.15.114:0/4051054639 conn(0x7fb1bc01ef40 msgr2=0x7fb1bc055c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.406+0000 7f89a893e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f89a40d1080 0x7f89a40d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.406+0000 7f89a893e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89a40ae720 0x7f89a40aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.406+0000 7f89a893e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a4164670 con 0x7f89a415db80 2024-04-28T13:07:35.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.406+0000 7f89a893e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f89a4164950 con 0x7f89a40d1080 2024-04-28T13:07:35.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.406+0000 7f89a893e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f89a40adf20 con 0x7f89a40ae720 2024-04-28T13:07:35.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.405+0000 7f71810dc640 1 -- 172.21.15.114:0/1806359905 >> v2:172.21.15.134:3300/0 conn(0x7f717c0bae80 msgr2=0x7f717c0d5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:35.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.405+0000 7f7173fff640 1 -- 172.21.15.114:0/1806359905 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 830317917 0 0) 0x7f7168003520 con 0x7f717c15f580 2024-04-28T13:07:35.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.405+0000 7f71810dc640 1 --2- 172.21.15.114:0/1806359905 >> v2:172.21.15.134:3300/0 conn(0x7f717c0bae80 0x7f717c0d5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.405+0000 7f71810dc640 1 -- 172.21.15.114:0/1806359905 >> v1:172.21.15.114:6789/0 conn(0x7f717c15f580 legacy=0x7f717c0d32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.405+0000 7f71810dc640 1 -- 172.21.15.114:0/1806359905 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f717c0d4390 con 0x7f717c15f1a0 2024-04-28T13:07:35.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.405+0000 7f80227a7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f801c163670 0x7f801c073a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.405+0000 7f80227a7640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f801c0d0ea0 0x7f801c0d12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.405+0000 7f80227a7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f801c167430 con 0x7f801c0b3b50 2024-04-28T13:07:35.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.405+0000 7f80227a7640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f801c0700d0 con 0x7f801c163670 2024-04-28T13:07:35.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.405+0000 7f80227a7640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f801c0d1820 con 0x7f801c0d0ea0 2024-04-28T13:07:35.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.406+0000 7f8021fa6640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f801c0b3b50 0x7f801c0b3fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:43366/0 (socket says 172.21.15.114:43366) 2024-04-28T13:07:35.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.406+0000 7f8021fa6640 1 -- 172.21.15.114:0/4137612150 learned_addr learned my addr 172.21.15.114:0/4137612150 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:35.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.406+0000 7fb1cb42c640 1 -- 172.21.15.114:0/4051054639 shutdown_connections 2024-04-28T13:07:35.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.406+0000 7f8020fa4640 1 --2- 172.21.15.114:0/4137612150 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f801c0d0ea0 0x7f801c0d12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.406+0000 7fb1cb42c640 1 -- 172.21.15.114:0/4051054639 wait complete. 2024-04-28T13:07:35.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.406+0000 7f89a359e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89a40ae720 0x7f89a40aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.406+0000 7f89a359e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89a40ae720 0x7f89a40aeb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:58466/0 (socket says 172.21.15.114:58466) 2024-04-28T13:07:35.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.406+0000 7f89a359e640 1 -- 172.21.15.114:0/3040205046 learned_addr learned my addr 172.21.15.114:0/3040205046 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:35.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.406+0000 7f42bf7fe640 1 -- 172.21.15.114:0/3914583639 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0032810 con 0x7f42c006f7f0 2024-04-28T13:07:35.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.406+0000 7f42c586f640 1 -- 172.21.15.114:0/3914583639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42c006f7f0 msgr2=0x7f42c00730b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.406+0000 7f42c586f640 1 --2- 172.21.15.114:0/3914583639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42c006f7f0 0x7f42c00730b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f42b00097a0 tx=0x7f42b002a230 comp rx=0 tx=0).stop 2024-04-28T13:07:35.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.406+0000 7f42c586f640 1 -- 172.21.15.114:0/3914583639 shutdown_connections 2024-04-28T13:07:35.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.406+0000 7f42c586f640 1 --2- 172.21.15.114:0/3914583639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42c006f7f0 0x7f42c00730b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.406+0000 7f42c586f640 1 -- 172.21.15.114:0/3914583639 >> 172.21.15.114:0/3914583639 conn(0x7f42c00b3b20 msgr2=0x7f42c00b3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.406+0000 7f8020fa4640 1 -- 172.21.15.114:0/4137612150 >> v2:172.21.15.114:3300/0 conn(0x7f801c163670 msgr2=0x7f801c073a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:35.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.406+0000 7f8020fa4640 1 --2- 172.21.15.114:0/4137612150 >> v2:172.21.15.114:3300/0 conn(0x7f801c163670 0x7f801c073a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.406+0000 7f8020fa4640 1 -- 172.21.15.114:0/4137612150 >> v1:172.21.15.134:6789/0 conn(0x7f801c0b3b50 legacy=0x7f801c0b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:35.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.406+0000 7f8020fa4640 1 -- 172.21.15.114:0/4137612150 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f801c167710 con 0x7f801c0d0ea0 2024-04-28T13:07:35.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.406+0000 7f89a259c640 1 --2- 172.21.15.114:0/3040205046 >> v2:172.21.15.114:3300/0 conn(0x7f89a40d1080 0x7f89a40d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.407+0000 7f89a359e640 1 -- 172.21.15.114:0/3040205046 >> v2:172.21.15.114:3300/0 conn(0x7f89a40d1080 msgr2=0x7f89a40d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:35.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.407+0000 7f89a359e640 1 --2- 172.21.15.114:0/3040205046 >> v2:172.21.15.114:3300/0 conn(0x7f89a40d1080 0x7f89a40d1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.407+0000 7f89a359e640 1 -- 172.21.15.114:0/3040205046 >> v1:172.21.15.114:6789/0 conn(0x7f89a415db80 legacy=0x7f89a4163b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:35.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.407+0000 7f42c586f640 1 -- 172.21.15.114:0/3914583639 shutdown_connections 2024-04-28T13:07:35.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.407+0000 7f42c586f640 1 -- 172.21.15.114:0/3914583639 wait complete. 2024-04-28T13:07:35.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.407+0000 7f71810dc640 1 --2- 172.21.15.114:0/1806359905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f717c15f1a0 0x7f717c0d4b90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f717c0d1100 tx=0x7f716c02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b1d8adb5499c999 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.407+0000 7f7173fff640 1 -- 172.21.15.114:0/1806359905 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716c037070 con 0x7f717c15f1a0 2024-04-28T13:07:35.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.407+0000 7ff5a8d9d640 1 -- 172.21.15.114:0/2909486732 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5a40d28e0 msgr2=0x7ff5a40d2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.407+0000 7ff5a8d9d640 1 --2- 172.21.15.114:0/2909486732 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5a40d28e0 0x7ff5a40d2fc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff58c0097d0 tx=0x7ff58c02a100 comp rx=0 tx=0).stop 2024-04-28T13:07:35.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.407+0000 7f7173fff640 1 -- 172.21.15.114:0/1806359905 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f716c02abc0 con 0x7f717c15f1a0 2024-04-28T13:07:35.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.407+0000 7f7173fff640 1 -- 172.21.15.114:0/1806359905 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71740019f0 con 0x7f717c15f1a0 2024-04-28T13:07:35.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.408+0000 7f8020fa4640 1 --2- 172.21.15.114:0/4137612150 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f801c0d0ea0 0x7f801c0d12e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f800c0097a0 tx=0x7f800c02a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1318c0712fdd890 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.407+0000 7f89a359e640 1 -- 172.21.15.114:0/3040205046 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a40b5f90 con 0x7f89a40ae720 2024-04-28T13:07:35.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.408+0000 7fb1cb42c640 1 Processor -- start 2024-04-28T13:07:35.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.408+0000 7ff5a8d9d640 1 -- 172.21.15.114:0/2909486732 shutdown_connections 2024-04-28T13:07:35.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.408+0000 7ff5a8d9d640 1 --2- 172.21.15.114:0/2909486732 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5a40d28e0 0x7ff5a40d2fc0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.408+0000 7ff5a8d9d640 1 -- 172.21.15.114:0/2909486732 >> 172.21.15.114:0/2909486732 conn(0x7ff5a4062d70 msgr2=0x7ff5a4063150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.408+0000 7fb1cb42c640 1 -- start start 2024-04-28T13:07:35.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.408+0000 7ff5a8d9d640 1 -- 172.21.15.114:0/2909486732 shutdown_connections 2024-04-28T13:07:35.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.407+0000 7efd9f578640 1 Processor -- start 2024-04-28T13:07:35.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.408+0000 7efd9f578640 1 -- start start 2024-04-28T13:07:35.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.408+0000 7f8013fff640 1 -- 172.21.15.114:0/4137612150 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800c037070 con 0x7f801c0d0ea0 2024-04-28T13:07:35.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.408+0000 7f8013fff640 1 -- 172.21.15.114:0/4137612150 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f800c02ae40 con 0x7f801c0d0ea0 2024-04-28T13:07:35.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.408+0000 7f42c586f640 1 Processor -- start 2024-04-28T13:07:35.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.408+0000 7f7183340640 1 -- 172.21.15.114:0/1806359905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f717c15f1a0 msgr2=0x7f717c0d4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.408+0000 7f7183340640 1 --2- 172.21.15.114:0/1806359905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f717c15f1a0 0x7f717c0d4b90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f717c0d1100 tx=0x7f716c02a130 comp rx=0 tx=0).stop 2024-04-28T13:07:35.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.408+0000 7f42c586f640 1 -- start start 2024-04-28T13:07:35.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7f2b7b00b640 1 Processor -- start 2024-04-28T13:07:35.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.408+0000 7ff5a8d9d640 1 -- 172.21.15.114:0/2909486732 wait complete. 2024-04-28T13:07:35.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7f8013fff640 1 -- 172.21.15.114:0/4137612150 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800c032660 con 0x7f801c0d0ea0 2024-04-28T13:07:35.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7fb1cb42c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb1bc009190 0x7fb1bc0e4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7fb1cb42c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1bc048c40 0x7fb1bc0e3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7f89a359e640 1 --2- 172.21.15.114:0/3040205046 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89a40ae720 0x7f89a40aeb60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f899c009e50 tx=0x7f899c02a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b980fb3f9fdd2bf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7efd9f578640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efd980cedf0 0x7efd980cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7efd9f578640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efd980cdd80 0x7efd9815bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7efd9f578640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd980cf460 con 0x7efd980693f0 2024-04-28T13:07:35.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7efd9f578640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7efd980ce1f0 con 0x7efd980cedf0 2024-04-28T13:07:35.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7efd9f578640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7efd980cfa20 con 0x7efd980cdd80 2024-04-28T13:07:35.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7f80227a7640 1 -- 172.21.15.114:0/4137612150 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f801c0d0ea0 msgr2=0x7f801c0d12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7fb1cb42c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1bc049070 0x7fb1bc0e3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7efd9d314640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7efd980693f0 0x7efd9815f6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46896/0 (socket says 172.21.15.114:46896) 2024-04-28T13:07:35.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7efd9d314640 1 -- 172.21.15.114:0/1430820273 learned_addr learned my addr 172.21.15.114:0/1430820273 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:35.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7f7183340640 1 -- 172.21.15.114:0/1806359905 shutdown_connections 2024-04-28T13:07:35.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7f7183340640 1 --2- 172.21.15.114:0/1806359905 >> v2:172.21.15.134:3300/0 conn(0x7f717c0bae80 0x7f717c0d5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7f7183340640 1 --2- 172.21.15.114:0/1806359905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f717c15f1a0 0x7f717c0d4b90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7f7183340640 1 -- 172.21.15.114:0/1806359905 >> 172.21.15.114:0/1806359905 conn(0x7f717c0633a0 msgr2=0x7f717c06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7efd9db15640 1 --2- 172.21.15.114:0/1430820273 >> v2:172.21.15.134:3300/0 conn(0x7efd980cdd80 0x7efd9815bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7fb1cb42c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb1bc0367b0 con 0x7fb1bc049070 2024-04-28T13:07:35.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7fb1cb42c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb1bc0364d0 con 0x7fb1bc048c40 2024-04-28T13:07:35.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7fb1cb42c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb1bc0540a0 con 0x7fb1bc009190 2024-04-28T13:07:35.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7f80227a7640 1 --2- 172.21.15.114:0/4137612150 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f801c0d0ea0 0x7f801c0d12e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f800c0097a0 tx=0x7f800c02a130 comp rx=0 tx=0).stop 2024-04-28T13:07:35.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7fb1c89c7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1bc048c40 0x7fb1bc0e3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7f7183340640 1 -- 172.21.15.114:0/1806359905 shutdown_connections 2024-04-28T13:07:35.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7fb1c91c8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb1bc009190 0x7fb1bc0e4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7f7183340640 1 -- 172.21.15.114:0/1806359905 wait complete. 2024-04-28T13:07:35.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7fb1c89c7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1bc048c40 0x7fb1bc0e3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:49986/0 (socket says 172.21.15.114:49986) 2024-04-28T13:07:35.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7f80227a7640 1 -- 172.21.15.114:0/4137612150 shutdown_connections 2024-04-28T13:07:35.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7f80227a7640 1 --2- 172.21.15.114:0/4137612150 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f801c0d0ea0 0x7f801c0d12e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7f80227a7640 1 --2- 172.21.15.114:0/4137612150 >> v2:172.21.15.114:3300/0 conn(0x7f801c163670 0x7f801c073a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7f80227a7640 1 -- 172.21.15.114:0/4137612150 >> 172.21.15.114:0/4137612150 conn(0x7f801c06c530 msgr2=0x7f801c06c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7fb1c89c7640 1 -- 172.21.15.114:0/2658966716 learned_addr learned my addr 172.21.15.114:0/2658966716 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:35.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.410+0000 7fb1c99c9640 1 --2- 172.21.15.114:0/2658966716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1bc049070 0x7fb1bc0e3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.410+0000 7f80227a7640 1 -- 172.21.15.114:0/4137612150 shutdown_connections 2024-04-28T13:07:35.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.410+0000 7efd9db15640 1 -- 172.21.15.114:0/1430820273 >> v2:172.21.15.114:3300/0 conn(0x7efd980cedf0 msgr2=0x7efd980cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:35.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.410+0000 7efd9db15640 1 --2- 172.21.15.114:0/1430820273 >> v2:172.21.15.114:3300/0 conn(0x7efd980cedf0 0x7efd980cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.410+0000 7efd9db15640 1 -- 172.21.15.114:0/1430820273 >> v1:172.21.15.114:6789/0 conn(0x7efd980693f0 legacy=0x7efd9815f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.410+0000 7efd9db15640 1 -- 172.21.15.114:0/1430820273 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd980cf740 con 0x7efd980cdd80 2024-04-28T13:07:35.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.410+0000 7f42c586f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42c00b6060 0x7f42c015c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.410+0000 7f42c586f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42c015bfb0 0x7f42c00d1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.410+0000 7f42c586f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42c01498c0 0x7f42c00d1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.410+0000 7f42c586f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f42c00afad0 con 0x7f42c015bfb0 2024-04-28T13:07:35.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.410+0000 7f42c586f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f42c00b5860 con 0x7f42c00b6060 2024-04-28T13:07:35.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.410+0000 7fb1c89c7640 1 -- 172.21.15.114:0/2658966716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb1bc009190 msgr2=0x7fb1bc0e4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.410+0000 7fb1c89c7640 1 --2- 172.21.15.114:0/2658966716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb1bc009190 0x7fb1bc0e4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.410+0000 7f42c586f640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f42c00afc50 con 0x7f42c01498c0 2024-04-28T13:07:35.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.409+0000 7f2b7b00b640 1 -- start start 2024-04-28T13:07:35.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.410+0000 7f2b7b00b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2b6c0ead00 0x7f2b6c04fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.410+0000 7f2b7b00b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b6c006ea0 0x7f2b6c007330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.410+0000 7f2b7b00b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b6c053720 con 0x7f2b6c04ffd0 2024-04-28T13:07:35.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.410+0000 7f2b7b00b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f2b6c054330 con 0x7f2b6c0ead00 2024-04-28T13:07:35.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.410+0000 7f2b7b00b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2b6c053a00 con 0x7f2b6c006ea0 2024-04-28T13:07:35.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.410+0000 7fb1c89c7640 1 -- 172.21.15.114:0/2658966716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1bc049070 msgr2=0x7fb1bc0e3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.410+0000 7fb1c89c7640 1 --2- 172.21.15.114:0/2658966716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1bc049070 0x7fb1bc0e3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.410+0000 7fb1c89c7640 1 -- 172.21.15.114:0/2658966716 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1bc033fa0 con 0x7fb1bc048c40 2024-04-28T13:07:35.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.410+0000 7f42bffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42c015bfb0 0x7f42c00d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.410+0000 7f80227a7640 1 -- 172.21.15.114:0/4137612150 wait complete. 2024-04-28T13:07:35.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.410+0000 7f42bffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42c015bfb0 0x7f42c00d1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48184/0 (socket says 172.21.15.114:48184) 2024-04-28T13:07:35.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.410+0000 7f42bffff640 1 -- 172.21.15.114:0/3102320446 learned_addr learned my addr 172.21.15.114:0/3102320446 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:35.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.410+0000 7f89a1d9b640 1 -- 172.21.15.114:0/3040205046 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899c036070 con 0x7f89a40ae720 2024-04-28T13:07:35.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.410+0000 7f89a1d9b640 1 -- 172.21.15.114:0/3040205046 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f899c031600 con 0x7f89a40ae720 2024-04-28T13:07:35.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7f2b79808640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f2b6c04ffd0 0x7f2b6c037bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:43380/0 (socket says 172.21.15.114:43380) 2024-04-28T13:07:35.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.410+0000 7ff5a8d9d640 1 Processor -- start 2024-04-28T13:07:35.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.410+0000 7ff5a8d9d640 1 -- start start 2024-04-28T13:07:35.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7f2b79808640 1 -- 172.21.15.114:0/3975383548 learned_addr learned my addr 172.21.15.114:0/3975383548 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:35.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7f89a893e640 1 -- 172.21.15.114:0/3040205046 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89a40ae720 msgr2=0x7f89a40aeb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7f89a1d9b640 1 -- 172.21.15.114:0/3040205046 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899c036070 con 0x7f89a40ae720 2024-04-28T13:07:35.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.410+0000 7f42c486d640 1 --2- 172.21.15.114:0/3102320446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42c00b6060 0x7f42c015c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7f2b7a80a640 1 --2- 172.21.15.114:0/3975383548 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b6c006ea0 0x7f2b6c007330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7f89a893e640 1 --2- 172.21.15.114:0/3040205046 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89a40ae720 0x7f89a40aeb60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f899c009e50 tx=0x7f899c02a640 comp rx=0 tx=0).stop 2024-04-28T13:07:35.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7f2b7a009640 1 --2- 172.21.15.114:0/3975383548 >> v2:172.21.15.134:3300/0 conn(0x7f2b6c0ead00 0x7f2b6c04fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7fb1c89c7640 1 --2- 172.21.15.114:0/2658966716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1bc048c40 0x7fb1bc0e3220 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000c430 tx=0x7fb1c000c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7f89a893e640 1 -- 172.21.15.114:0/3040205046 shutdown_connections 2024-04-28T13:07:35.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7f89a893e640 1 --2- 172.21.15.114:0/3040205046 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89a40ae720 0x7f89a40aeb60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7f89a893e640 1 --2- 172.21.15.114:0/3040205046 >> v2:172.21.15.114:3300/0 conn(0x7f89a40d1080 0x7f89a40d1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7f89a893e640 1 -- 172.21.15.114:0/3040205046 >> 172.21.15.114:0/3040205046 conn(0x7f89a406c740 msgr2=0x7f89a406cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7efd9db15640 1 --2- 172.21.15.114:0/1430820273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd980cdd80 0x7efd9815bd50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efd980b2bd0 tx=0x7efd9002c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13530bb594ff9870 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7f42c506e640 1 --2- 172.21.15.114:0/3102320446 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42c01498c0 0x7f42c00d1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7f42c506e640 1 -- 172.21.15.114:0/3102320446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42c00b6060 msgr2=0x7f42c015c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7f42c506e640 1 --2- 172.21.15.114:0/3102320446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42c00b6060 0x7f42c015c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7f42c506e640 1 -- 172.21.15.114:0/3102320446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42c015bfb0 msgr2=0x7f42c00d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7f42c506e640 1 --2- 172.21.15.114:0/3102320446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42c015bfb0 0x7f42c00d1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7f42c506e640 1 -- 172.21.15.114:0/3102320446 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c014bde0 con 0x7f42c01498c0 2024-04-28T13:07:35.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7f42c486d640 1 --2- 172.21.15.114:0/3102320446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42c00b6060 0x7f42c015c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:07:35.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7f7183340640 1 Processor -- start 2024-04-28T13:07:35.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7f7183340640 1 -- start start 2024-04-28T13:07:35.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7ff5a8d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5a40d28e0 0x7ff5a41f9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7ff5a8d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5a40d3500 0x7ff5a4142d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7ff5a8d9d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5a41463d0 0x7ff5a40b7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7ff5a8d9d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a40d10a0 con 0x7ff5a40d28e0 2024-04-28T13:07:35.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7ff5a8d9d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a41467b0 con 0x7ff5a40d3500 2024-04-28T13:07:35.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7ff5a8d9d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff5a40717c0 con 0x7ff5a41463d0 2024-04-28T13:07:35.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7fb1b9ffb640 1 -- 172.21.15.114:0/2658966716 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0017070 con 0x7fb1bc048c40 2024-04-28T13:07:35.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7ff5a259c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5a40d28e0 0x7ff5a41f9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7ff5a259c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5a40d28e0 0x7ff5a41f9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48186/0 (socket says 172.21.15.114:48186) 2024-04-28T13:07:35.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7ff5a259c640 1 -- 172.21.15.114:0/4292779171 learned_addr learned my addr 172.21.15.114:0/4292779171 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:35.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7f2b79007640 1 -- 172.21.15.114:0/3975383548 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3072427891 0 0) 0x7f2b6c053720 con 0x7f2b6c04ffd0 2024-04-28T13:07:35.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7f2b79007640 1 -- 172.21.15.114:0/3975383548 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b60003520 con 0x7f2b6c04ffd0 2024-04-28T13:07:35.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7f2b7a80a640 1 -- 172.21.15.114:0/3975383548 >> v2:172.21.15.134:3300/0 conn(0x7f2b6c0ead00 msgr2=0x7f2b6c04fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:35.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7f2b7a80a640 1 --2- 172.21.15.114:0/3975383548 >> v2:172.21.15.134:3300/0 conn(0x7f2b6c0ead00 0x7f2b6c04fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7f2b7a80a640 1 -- 172.21.15.114:0/3975383548 >> v1:172.21.15.134:6789/0 conn(0x7f2b6c04ffd0 legacy=0x7f2b6c037bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7f2b7a80a640 1 -- 172.21.15.114:0/3975383548 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b6c053ce0 con 0x7f2b6c006ea0 2024-04-28T13:07:35.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.412+0000 7fb1cb42c640 1 -- 172.21.15.114:0/2658966716 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1bc033cc0 con 0x7fb1bc048c40 2024-04-28T13:07:35.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.411+0000 7ff59bfff640 1 --2- 172.21.15.114:0/4292779171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5a40d3500 0x7ff5a4142d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.412+0000 7ff5a2d9d640 1 --2- 172.21.15.114:0/4292779171 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5a41463d0 0x7ff5a40b7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.412+0000 7f42c506e640 1 --2- 172.21.15.114:0/3102320446 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42c01498c0 0x7f42c00d1ca0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f42c006e9b0 tx=0x7f42b00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.412+0000 7f89a893e640 1 -- 172.21.15.114:0/3040205046 shutdown_connections 2024-04-28T13:07:35.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.412+0000 7f89a893e640 1 -- 172.21.15.114:0/3040205046 wait complete. 2024-04-28T13:07:35.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.412+0000 7fb1cb42c640 1 -- 172.21.15.114:0/2658966716 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1bc0e47e0 con 0x7fb1bc048c40 2024-04-28T13:07:35.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.412+0000 7ff5a259c640 1 -- 172.21.15.114:0/4292779171 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5a41463d0 msgr2=0x7ff5a40b7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.412+0000 7efd8ffff640 1 -- 172.21.15.114:0/1430820273 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd90007740 con 0x7efd980cdd80 2024-04-28T13:07:35.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.412+0000 7efd8ffff640 1 -- 172.21.15.114:0/1430820273 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd900078e0 con 0x7efd980cdd80 2024-04-28T13:07:35.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.412+0000 7efd8ffff640 1 -- 172.21.15.114:0/1430820273 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd90007cb0 con 0x7efd980cdd80 2024-04-28T13:07:35.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.412+0000 7f42bd7fa640 1 -- 172.21.15.114:0/3102320446 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0043070 con 0x7f42c01498c0 2024-04-28T13:07:35.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.412+0000 7fb1b9ffb640 1 -- 172.21.15.114:0/2658966716 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1c0005ce0 con 0x7fb1bc048c40 2024-04-28T13:07:35.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.412+0000 7ff5a259c640 1 --2- 172.21.15.114:0/4292779171 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5a41463d0 0x7ff5a40b7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.412+0000 7ff5a259c640 1 -- 172.21.15.114:0/4292779171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5a40d3500 msgr2=0x7ff5a4142d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.412+0000 7ff5a259c640 1 --2- 172.21.15.114:0/4292779171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5a40d3500 0x7ff5a4142d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.412+0000 7ff5a259c640 1 -- 172.21.15.114:0/4292779171 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a413f9b0 con 0x7ff5a40d28e0 2024-04-28T13:07:35.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.412+0000 7fb1b9ffb640 1 -- 172.21.15.114:0/2658966716 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0007310 con 0x7fb1bc048c40 2024-04-28T13:07:35.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.412+0000 7f42c586f640 1 -- 172.21.15.114:0/3102320446 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42c014c080 con 0x7f42c01498c0 2024-04-28T13:07:35.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.412+0000 7f42c586f640 1 -- 172.21.15.114:0/3102320446 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f42c015eb60 con 0x7f42c01498c0 2024-04-28T13:07:35.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.412+0000 7f80227a7640 1 Processor -- start 2024-04-28T13:07:35.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.413+0000 7f80227a7640 1 -- start start 2024-04-28T13:07:35.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.412+0000 7f7183340640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f717c0bae80 0x7f717c0cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.412+0000 7f7183340640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f717c15f1a0 0x7f717c1fd620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.412+0000 7f7183340640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f717c15f580 0x7f717c0c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.412+0000 7f7183340640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f717c0d5820 con 0x7f717c0bae80 2024-04-28T13:07:35.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.412+0000 7f7183340640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f717c0d56a0 con 0x7f717c15f580 2024-04-28T13:07:35.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.412+0000 7f7183340640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f717c0d59a0 con 0x7f717c15f1a0 2024-04-28T13:07:35.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.413+0000 7f71810dc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f717c0bae80 0x7f717c0cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.413+0000 7f71810dc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f717c0bae80 0x7f717c0cb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48194/0 (socket says 172.21.15.114:48194) 2024-04-28T13:07:35.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.413+0000 7f71810dc640 1 -- 172.21.15.114:0/3760026219 learned_addr learned my addr 172.21.15.114:0/3760026219 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:35.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.412+0000 7ff5a259c640 1 --2- 172.21.15.114:0/4292779171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5a40d28e0 0x7ff5a41f9090 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff59400c430 tx=0x7ff59400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.413+0000 7f71808db640 1 --2- 172.21.15.114:0/3760026219 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f717c15f1a0 0x7f717c1fd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.413+0000 7efd9f578640 1 -- 172.21.15.114:0/1430820273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd980cdd80 msgr2=0x7efd9815bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.413+0000 7efd9f578640 1 --2- 172.21.15.114:0/1430820273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd980cdd80 0x7efd9815bd50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efd980b2bd0 tx=0x7efd9002c800 comp rx=0 tx=0).stop 2024-04-28T13:07:35.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.413+0000 7f71818dd640 1 --2- 172.21.15.114:0/3760026219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f717c15f580 0x7f717c0c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.413+0000 7efd9f578640 1 -- 172.21.15.114:0/1430820273 shutdown_connections 2024-04-28T13:07:35.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.413+0000 7efd9f578640 1 --2- 172.21.15.114:0/1430820273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd980cdd80 0x7efd9815bd50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.413+0000 7efd9f578640 1 --2- 172.21.15.114:0/1430820273 >> v2:172.21.15.114:3300/0 conn(0x7efd980cedf0 0x7efd980cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.413+0000 7efd9f578640 1 -- 172.21.15.114:0/1430820273 >> 172.21.15.114:0/1430820273 conn(0x7efd980b2c40 msgr2=0x7efd980b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.413+0000 7efd9f578640 1 -- 172.21.15.114:0/1430820273 shutdown_connections 2024-04-28T13:07:35.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.413+0000 7f71810dc640 1 -- 172.21.15.114:0/3760026219 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f717c15f1a0 msgr2=0x7f717c1fd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.413+0000 7f71810dc640 1 --2- 172.21.15.114:0/3760026219 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f717c15f1a0 0x7f717c1fd620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.413+0000 7f71810dc640 1 -- 172.21.15.114:0/3760026219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f717c15f580 msgr2=0x7f717c0c96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.413+0000 7f71810dc640 1 --2- 172.21.15.114:0/3760026219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f717c15f580 0x7f717c0c96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.413+0000 7f71810dc640 1 -- 172.21.15.114:0/3760026219 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f717c0c8eb0 con 0x7f717c0bae80 2024-04-28T13:07:35.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.413+0000 7f42bd7fa640 1 -- 172.21.15.114:0/3102320446 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b0038040 con 0x7f42c01498c0 2024-04-28T13:07:35.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.413+0000 7f42bd7fa640 1 -- 172.21.15.114:0/3102320446 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0037050 con 0x7f42c01498c0 2024-04-28T13:07:35.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.414+0000 7f2b7a80a640 1 --2- 172.21.15.114:0/3975383548 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b6c006ea0 0x7f2b6c007330 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2b74051930 tx=0x7f2b740a6940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4293839f3affb3d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.414+0000 7f71810dc640 1 --2- 172.21.15.114:0/3760026219 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f717c0bae80 0x7f717c0cb740 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f716c009890 tx=0x7f716c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.414+0000 7f7171ffb640 1 -- 172.21.15.114:0/3760026219 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716c037050 con 0x7f717c0bae80 2024-04-28T13:07:35.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.414+0000 7f7171ffb640 1 -- 172.21.15.114:0/3760026219 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f716c038040 con 0x7f717c0bae80 2024-04-28T13:07:35.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.414+0000 7f2b79007640 1 -- 172.21.15.114:0/3975383548 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b740b0020 con 0x7f2b6c006ea0 2024-04-28T13:07:35.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.414+0000 7f7183340640 1 -- 172.21.15.114:0/3760026219 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f717c0cac80 con 0x7f717c0bae80 2024-04-28T13:07:35.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.414+0000 7f7171ffb640 1 -- 172.21.15.114:0/3760026219 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716c004470 con 0x7f717c0bae80 2024-04-28T13:07:35.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.414+0000 7f2b79007640 1 -- 172.21.15.114:0/3975383548 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b740ac700 con 0x7f2b6c006ea0 2024-04-28T13:07:35.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.414+0000 7ff59affd640 1 -- 172.21.15.114:0/4292779171 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5940074e0 con 0x7ff5a40d28e0 2024-04-28T13:07:35.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.414+0000 7ff59affd640 1 -- 172.21.15.114:0/4292779171 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5940047e0 con 0x7ff5a40d28e0 2024-04-28T13:07:35.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.414+0000 7ff59affd640 1 -- 172.21.15.114:0/4292779171 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff594004c10 con 0x7ff5a40d28e0 2024-04-28T13:07:35.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.414+0000 7ff5a8d9d640 1 -- 172.21.15.114:0/4292779171 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5a413fc90 con 0x7ff5a40d28e0 2024-04-28T13:07:35.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.413+0000 7efd9f578640 1 -- 172.21.15.114:0/1430820273 wait complete. 2024-04-28T13:07:35.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.413+0000 7fb1cb42c640 1 -- 172.21.15.114:0/2658966716 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1a4005290 con 0x7fb1bc048c40 2024-04-28T13:07:35.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.414+0000 7fb1b9ffb640 1 -- 172.21.15.114:0/2658966716 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb1c001a070 con 0x7fb1bc048c40 2024-04-28T13:07:35.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.414+0000 7fb1b9ffb640 1 --2- 172.21.15.114:0/2658966716 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb1a806c9c0 0x7fb1a806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.415+0000 7fb1c91c8640 1 --2- 172.21.15.114:0/2658966716 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb1a806c9c0 0x7fb1a806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.415+0000 7fb1b9ffb640 1 -- 172.21.15.114:0/2658966716 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb1c008aef0 con 0x7fb1bc048c40 2024-04-28T13:07:35.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.415+0000 7f89a893e640 1 Processor -- start 2024-04-28T13:07:35.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.414+0000 7f42c586f640 1 -- 172.21.15.114:0/3102320446 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42a0005290 con 0x7f42c01498c0 2024-04-28T13:07:35.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.414+0000 7ff5a8d9d640 1 -- 172.21.15.114:0/4292779171 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5a4140250 con 0x7ff5a40d28e0 2024-04-28T13:07:35.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.414+0000 7f80227a7640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f801c0b3b50 0x7f801c15fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.414+0000 7f80227a7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f801c0d0ea0 0x7f801c160080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.414+0000 7f80227a7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f801c163670 0x7f801c0b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.414+0000 7f80227a7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f801c167100 con 0x7f801c163670 2024-04-28T13:07:35.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.414+0000 7f80227a7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f801c167cd0 con 0x7f801c0d0ea0 2024-04-28T13:07:35.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.414+0000 7f80227a7640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f801c167fb0 con 0x7f801c0b3b50 2024-04-28T13:07:35.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.415+0000 7f8020fa4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f801c0d0ea0 0x7f801c160080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.415+0000 7f8020fa4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f801c0d0ea0 0x7f801c160080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:50058/0 (socket says 172.21.15.114:50058) 2024-04-28T13:07:35.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.415+0000 7f8020fa4640 1 -- 172.21.15.114:0/3594869531 learned_addr learned my addr 172.21.15.114:0/3594869531 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:35.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.415+0000 7f80217a5640 1 --2- 172.21.15.114:0/3594869531 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f801c0b3b50 0x7f801c15fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.415+0000 7f8021fa6640 1 --2- 172.21.15.114:0/3594869531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f801c163670 0x7f801c0b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.416+0000 7f42bd7fa640 1 -- 172.21.15.114:0/3102320446 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f42b0046070 con 0x7f42c01498c0 2024-04-28T13:07:35.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.416+0000 7efd9f578640 1 Processor -- start 2024-04-28T13:07:35.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.416+0000 7f89a893e640 1 -- start start 2024-04-28T13:07:35.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.416+0000 7f8020fa4640 1 -- 172.21.15.114:0/3594869531 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f801c0b3b50 msgr2=0x7f801c15fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.416+0000 7f8020fa4640 1 --2- 172.21.15.114:0/3594869531 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f801c0b3b50 0x7f801c15fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.416+0000 7f8020fa4640 1 -- 172.21.15.114:0/3594869531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f801c163670 msgr2=0x7f801c0b0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.416+0000 7f8020fa4640 1 --2- 172.21.15.114:0/3594869531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f801c163670 0x7f801c0b0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.416+0000 7f8020fa4640 1 -- 172.21.15.114:0/3594869531 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f801c165f90 con 0x7f801c0d0ea0 2024-04-28T13:07:35.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.416+0000 7fb1c91c8640 1 --2- 172.21.15.114:0/2658966716 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb1a806c9c0 0x7fb1a806ee80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc00aeb0 tx=0x7fb1c40ac000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.416+0000 7ff598ff9640 1 -- 172.21.15.114:0/4292779171 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff57c005290 con 0x7ff5a40d28e0 2024-04-28T13:07:35.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.416+0000 7efd9f578640 1 -- start start 2024-04-28T13:07:35.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.416+0000 7f8020fa4640 1 --2- 172.21.15.114:0/3594869531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f801c0d0ea0 0x7f801c160080 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f800c0098c0 tx=0x7f800c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.416+0000 7f42bd7fa640 1 --2- 172.21.15.114:0/3102320446 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f42ac06c9f0 0x7f42ac06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.416+0000 7f2b79007640 1 -- 172.21.15.114:0/3975383548 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b740acaf0 con 0x7f2b6c006ea0 2024-04-28T13:07:35.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.415+0000 7f7183340640 1 -- 172.21.15.114:0/3760026219 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f717c0cb240 con 0x7f717c0bae80 2024-04-28T13:07:35.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7f89a893e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89a40ae720 0x7f89a4154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7f89a893e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89a40d1080 0x7f89a40b2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7f89a893e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89a415db80 0x7f89a40cf570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7f89a893e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f89a41643a0 con 0x7f89a40ae720 2024-04-28T13:07:35.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7f89a893e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f89a4164220 con 0x7f89a40d1080 2024-04-28T13:07:35.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7f89a893e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f89a40af0a0 con 0x7f89a415db80 2024-04-28T13:07:35.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7efd9f578640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd980693f0 0x7efd9814cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7efd9f578640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efd980cdd80 0x7efd9814c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7efd9f578640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd980cedf0 0x7efd98155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7efd9f578640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7efd9815c290 con 0x7efd980cedf0 2024-04-28T13:07:35.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7efd9f578640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efd9815f1a0 con 0x7efd980693f0 2024-04-28T13:07:35.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7efd9f578640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7efd9815c410 con 0x7efd980cdd80 2024-04-28T13:07:35.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7f89a259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89a40d1080 0x7f89a40b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7f89a359e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89a415db80 0x7f89a40cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7efd9d314640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd980693f0 0x7efd9814cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7efd9d314640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd980693f0 0x7efd9814cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:50076/0 (socket says 172.21.15.114:50076) 2024-04-28T13:07:35.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7efd9d314640 1 -- 172.21.15.114:0/1776607177 learned_addr learned my addr 172.21.15.114:0/1776607177 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:35.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7f89a359e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89a415db80 0x7f89a40cf570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:58522/0 (socket says 172.21.15.114:58522) 2024-04-28T13:07:35.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7f89a359e640 1 -- 172.21.15.114:0/21769621 learned_addr learned my addr 172.21.15.114:0/21769621 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:35.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7f2b7b00b640 1 -- 172.21.15.114:0/3975383548 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b6c006ea0 msgr2=0x7f2b6c007330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7f2b7b00b640 1 --2- 172.21.15.114:0/3975383548 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b6c006ea0 0x7f2b6c007330 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2b74051930 tx=0x7f2b740a6940 comp rx=0 tx=0).stop 2024-04-28T13:07:35.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7f42bd7fa640 1 -- 172.21.15.114:0/3102320446 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f42b00aba10 con 0x7f42c01498c0 2024-04-28T13:07:35.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7efd9d314640 1 -- 172.21.15.114:0/1776607177 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efd980cdd80 msgr2=0x7efd9814c200 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-28T13:07:35.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7efd9d314640 1 --2- 172.21.15.114:0/1776607177 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efd980cdd80 0x7efd9814c200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7efd9d314640 1 -- 172.21.15.114:0/1776607177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd980cedf0 msgr2=0x7efd98155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7efd9d314640 1 --2- 172.21.15.114:0/1776607177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd980cedf0 0x7efd98155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7efd9d314640 1 -- 172.21.15.114:0/1776607177 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd980cbec0 con 0x7efd980693f0 2024-04-28T13:07:35.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7f2b7b00b640 1 -- 172.21.15.114:0/3975383548 shutdown_connections 2024-04-28T13:07:35.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7f2b7b00b640 1 --2- 172.21.15.114:0/3975383548 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b6c006ea0 0x7f2b6c007330 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7f2b7b00b640 1 --2- 172.21.15.114:0/3975383548 >> v2:172.21.15.134:3300/0 conn(0x7f2b6c0ead00 0x7f2b6c04fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7f2b7b00b640 1 -- 172.21.15.114:0/3975383548 >> 172.21.15.114:0/3975383548 conn(0x7f2b6c009fb0 msgr2=0x7f2b6c00a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.418+0000 7f7183340640 1 -- 172.21.15.114:0/3760026219 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f717c06a3d0 con 0x7f717c0bae80 2024-04-28T13:07:35.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.418+0000 7efd9d314640 1 --2- 172.21.15.114:0/1776607177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd980693f0 0x7efd9814cc30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efd9400c460 tx=0x7efd9400c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.418+0000 7f7171ffb640 1 -- 172.21.15.114:0/3760026219 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f716c03c6d0 con 0x7f717c0bae80 2024-04-28T13:07:35.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.418+0000 7f89a2d9d640 1 --2- 172.21.15.114:0/21769621 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89a40ae720 0x7f89a4154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.418+0000 7f89a359e640 1 -- 172.21.15.114:0/21769621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89a40d1080 msgr2=0x7f89a40b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.418+0000 7f89a359e640 1 --2- 172.21.15.114:0/21769621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89a40d1080 0x7f89a40b2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.418+0000 7f89a359e640 1 -- 172.21.15.114:0/21769621 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89a40ae720 msgr2=0x7f89a4154ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.417+0000 7f42c486d640 1 --2- 172.21.15.114:0/3102320446 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f42ac06c9f0 0x7f42ac06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.418+0000 7f42c486d640 1 --2- 172.21.15.114:0/3102320446 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f42ac06c9f0 0x7f42ac06eeb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f42b8001560 tx=0x7f42b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.418+0000 7f89a359e640 1 --2- 172.21.15.114:0/21769621 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89a40ae720 0x7f89a4154ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.418+0000 7f89a359e640 1 -- 172.21.15.114:0/21769621 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a40b18e0 con 0x7f89a415db80 2024-04-28T13:07:35.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.418+0000 7f89a2d9d640 1 --2- 172.21.15.114:0/21769621 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89a40ae720 0x7f89a4154ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:35.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.418+0000 7ff59affd640 1 -- 172.21.15.114:0/4292779171 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff594011070 con 0x7ff5a40d28e0 2024-04-28T13:07:35.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.418+0000 7f2b7b00b640 1 -- 172.21.15.114:0/3975383548 shutdown_connections 2024-04-28T13:07:35.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.418+0000 7f7171ffb640 1 --2- 172.21.15.114:0/3760026219 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f716006c8f0 0x7f716006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.418+0000 7f2b7b00b640 1 -- 172.21.15.114:0/3975383548 wait complete. 2024-04-28T13:07:35.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.418+0000 7f89a359e640 1 --2- 172.21.15.114:0/21769621 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89a415db80 0x7f89a40cf570 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f899c009e50 tx=0x7f899c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.418+0000 7f71808db640 1 --2- 172.21.15.114:0/3760026219 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f716006c8f0 0x7f716006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.419+0000 7ff59affd640 1 --2- 172.21.15.114:0/4292779171 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff58406c9f0 0x7ff58406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.419+0000 7f71808db640 1 --2- 172.21.15.114:0/3760026219 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f716006c8f0 0x7f716006edb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f717c0d1580 tx=0x7f7174009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.419+0000 7ff59bfff640 1 --2- 172.21.15.114:0/4292779171 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff58406c9f0 0x7ff58406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.419+0000 7ff59affd640 1 -- 172.21.15.114:0/4292779171 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff59408bc60 con 0x7ff5a40d28e0 2024-04-28T13:07:35.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.419+0000 7ff59bfff640 1 --2- 172.21.15.114:0/4292779171 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff58406c9f0 0x7ff58406eeb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff58c034000 tx=0x7ff58c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.419+0000 7f2b7b00b640 1 Processor -- start 2024-04-28T13:07:35.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.419+0000 7f8011ffb640 1 -- 172.21.15.114:0/3594869531 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800c042070 con 0x7f801c0d0ea0 2024-04-28T13:07:35.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.419+0000 7f2b7b00b640 1 -- start start 2024-04-28T13:07:35.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.419+0000 7efd8dffb640 1 -- 172.21.15.114:0/1776607177 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd94017070 con 0x7efd980693f0 2024-04-28T13:07:35.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.419+0000 7f8011ffb640 1 -- 172.21.15.114:0/3594869531 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f800c03d850 con 0x7f801c0d0ea0 2024-04-28T13:07:35.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.420+0000 7f8011ffb640 1 -- 172.21.15.114:0/3594869531 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800c037040 con 0x7f801c0d0ea0 2024-04-28T13:07:35.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.420+0000 7fb1b9ffb640 1 -- 172.21.15.114:0/2658966716 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb1c0059300 con 0x7fb1bc048c40 2024-04-28T13:07:35.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.420+0000 7f80227a7640 1 -- 172.21.15.114:0/3594869531 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f801c166270 con 0x7f801c0d0ea0 2024-04-28T13:07:35.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.420+0000 7f80227a7640 1 -- 172.21.15.114:0/3594869531 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f801c166830 con 0x7f801c0d0ea0 2024-04-28T13:07:35.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.420+0000 7efd9f578640 1 -- 172.21.15.114:0/1776607177 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd980cc1a0 con 0x7efd980693f0 2024-04-28T13:07:35.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.420+0000 7efd8dffb640 1 -- 172.21.15.114:0/1776607177 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd94005ce0 con 0x7efd980693f0 2024-04-28T13:07:35.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.420+0000 7efd8dffb640 1 -- 172.21.15.114:0/1776607177 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd940072f0 con 0x7efd980693f0 2024-04-28T13:07:35.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.420+0000 7efd9f578640 1 -- 172.21.15.114:0/1776607177 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd9814c740 con 0x7efd980693f0 2024-04-28T13:07:35.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.421+0000 7f2b7b00b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b6c006ea0 0x7f2b6c035610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.421+0000 7f898b7fe640 1 -- 172.21.15.114:0/21769621 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899c036050 con 0x7f89a415db80 2024-04-28T13:07:35.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.421+0000 7f42bd7fa640 1 -- 172.21.15.114:0/3102320446 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f42b0079860 con 0x7f42c01498c0 2024-04-28T13:07:35.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.421+0000 7efd9f578640 1 -- 172.21.15.114:0/1776607177 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd98074010 con 0x7efd980693f0 2024-04-28T13:07:35.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.421+0000 7f7fff7fe640 1 -- 172.21.15.114:0/3594869531 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ff8005290 con 0x7f801c0d0ea0 2024-04-28T13:07:35.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.422+0000 7f2b7b00b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b6c04ffd0 0x7f2b6c04a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.422+0000 7f2b7b00b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b6c0ead00 0x7f2b6c0c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.422+0000 7f2b7b00b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6c054940 con 0x7f2b6c04ffd0 2024-04-28T13:07:35.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.422+0000 7f2b7b00b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6c0547c0 con 0x7f2b6c0ead00 2024-04-28T13:07:35.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.422+0000 7f2b7b00b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2b6c04f550 con 0x7f2b6c006ea0 2024-04-28T13:07:35.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.422+0000 7efd8dffb640 1 -- 172.21.15.114:0/1776607177 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efd9401a070 con 0x7efd980693f0 2024-04-28T13:07:35.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.422+0000 7f2b79808640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b6c04ffd0 0x7f2b6c04a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.422+0000 7f2b79808640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b6c04ffd0 0x7f2b6c04a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48236/0 (socket says 172.21.15.114:48236) 2024-04-28T13:07:35.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.422+0000 7f2b79808640 1 -- 172.21.15.114:0/1171858599 learned_addr learned my addr 172.21.15.114:0/1171858599 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:35.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.422+0000 7f2b7a80a640 1 --2- 172.21.15.114:0/1171858599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b6c0ead00 0x7f2b6c0c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.421+0000 7f89a893e640 1 -- 172.21.15.114:0/21769621 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89a40d0030 con 0x7f89a415db80 2024-04-28T13:07:35.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.421+0000 7f89a893e640 1 -- 172.21.15.114:0/21769621 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a40b1e40 con 0x7f89a415db80 2024-04-28T13:07:35.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.422+0000 7f898b7fe640 1 -- 172.21.15.114:0/21769621 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f899c037040 con 0x7f89a415db80 2024-04-28T13:07:35.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.422+0000 7f898b7fe640 1 -- 172.21.15.114:0/21769621 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899c009510 con 0x7f89a415db80 2024-04-28T13:07:35.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.422+0000 7f2b7a009640 1 --2- 172.21.15.114:0/1171858599 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b6c006ea0 0x7f2b6c035610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.422+0000 7efd8dffb640 1 --2- 172.21.15.114:0/1776607177 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7efd7c06c8f0 0x7efd7c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.422+0000 7f2b7a009640 1 -- 172.21.15.114:0/1171858599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b6c0ead00 msgr2=0x7f2b6c0c92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.422+0000 7f2b7a009640 1 --2- 172.21.15.114:0/1171858599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b6c0ead00 0x7f2b6c0c92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.422+0000 7f2b7a009640 1 -- 172.21.15.114:0/1171858599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b6c04ffd0 msgr2=0x7f2b6c04a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.422+0000 7f2b7a009640 1 --2- 172.21.15.114:0/1171858599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b6c04ffd0 0x7f2b6c04a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.423+0000 7efd8dffb640 1 -- 172.21.15.114:0/1776607177 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7efd9408aec0 con 0x7efd980693f0 2024-04-28T13:07:35.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.423+0000 7f89a893e640 1 -- 172.21.15.114:0/21769621 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8984005290 con 0x7f89a415db80 2024-04-28T13:07:35.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.423+0000 7efd9cb13640 1 --2- 172.21.15.114:0/1776607177 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7efd7c06c8f0 0x7efd7c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.422+0000 7f2b7a009640 1 -- 172.21.15.114:0/1171858599 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b6c0c7db0 con 0x7f2b6c006ea0 2024-04-28T13:07:35.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.423+0000 7f2b7a009640 1 --2- 172.21.15.114:0/1171858599 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b6c006ea0 0x7f2b6c035610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2b7000e8a0 tx=0x7f2b7000ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.423+0000 7f2b6affd640 1 -- 172.21.15.114:0/1171858599 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b70017070 con 0x7f2b6c006ea0 2024-04-28T13:07:35.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.423+0000 7f2b6affd640 1 -- 172.21.15.114:0/1171858599 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b7000c940 con 0x7f2b6c006ea0 2024-04-28T13:07:35.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.423+0000 7f2b6affd640 1 -- 172.21.15.114:0/1171858599 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b70009e60 con 0x7f2b6c006ea0 2024-04-28T13:07:35.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.423+0000 7f2b7b00b640 1 -- 172.21.15.114:0/1171858599 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b6c0c8090 con 0x7f2b6c006ea0 2024-04-28T13:07:35.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.423+0000 7f2b7b00b640 1 -- 172.21.15.114:0/1171858599 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b6c0c8650 con 0x7f2b6c006ea0 2024-04-28T13:07:35.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.423+0000 7efd9cb13640 1 --2- 172.21.15.114:0/1776607177 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7efd7c06c8f0 0x7efd7c06edb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efd981fca60 tx=0x7efd88006b80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.424+0000 7f8011ffb640 1 -- 172.21.15.114:0/3594869531 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f800c045070 con 0x7f801c0d0ea0 2024-04-28T13:07:35.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.424+0000 7f2b7a80a640 1 --2- 172.21.15.114:0/1171858599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b6c0ead00 0x7f2b6c0c92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:07:35.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.424+0000 7f8011ffb640 1 --2- 172.21.15.114:0/3594869531 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f800006c9c0 0x7f800006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.424+0000 7f8011ffb640 1 -- 172.21.15.114:0/3594869531 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f800c0ac1c0 con 0x7f801c0d0ea0 2024-04-28T13:07:35.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.424+0000 7f7171ffb640 1 -- 172.21.15.114:0/3760026219 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f716c0a9fe0 con 0x7f717c0bae80 2024-04-28T13:07:35.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.424+0000 7f2b7b00b640 1 -- 172.21.15.114:0/1171858599 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b6c005390 con 0x7f2b6c006ea0 2024-04-28T13:07:35.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.425+0000 7f80217a5640 1 --2- 172.21.15.114:0/3594869531 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f800006c9c0 0x7f800006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.425+0000 7ff59affd640 1 -- 172.21.15.114:0/4292779171 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff594059ab0 con 0x7ff5a40d28e0 2024-04-28T13:07:35.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.425+0000 7f80217a5640 1 --2- 172.21.15.114:0/3594869531 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f800006c9c0 0x7f800006ee80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8018009890 tx=0x7f8018008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.426+0000 7f898b7fe640 1 -- 172.21.15.114:0/21769621 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f899c044030 con 0x7f89a415db80 2024-04-28T13:07:35.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.426+0000 7f898b7fe640 1 --2- 172.21.15.114:0/21769621 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f899006c970 0x7f899006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.426+0000 7f898b7fe640 1 -- 172.21.15.114:0/21769621 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f899c0ac080 con 0x7f89a415db80 2024-04-28T13:07:35.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.426+0000 7f89a2d9d640 1 --2- 172.21.15.114:0/21769621 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f899006c970 0x7f899006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.427+0000 7f89a2d9d640 1 --2- 172.21.15.114:0/21769621 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f899006c970 0x7f899006ee30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8994006fd0 tx=0x7f8994008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.428+0000 7f898b7fe640 1 -- 172.21.15.114:0/21769621 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f89a40b18e0 con 0x7f89a415db80 2024-04-28T13:07:35.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.427+0000 7efd8dffb640 1 -- 172.21.15.114:0/1776607177 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7efd940592e0 con 0x7efd980693f0 2024-04-28T13:07:35.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.430+0000 7f2b6affd640 1 -- 172.21.15.114:0/1171858599 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2b7001a070 con 0x7f2b6c006ea0 2024-04-28T13:07:35.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.430+0000 7f7171ffb640 1 -- 172.21.15.114:0/3760026219 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f716c079780 con 0x7f717c0bae80 2024-04-28T13:07:35.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.430+0000 7f2b6affd640 1 --2- 172.21.15.114:0/1171858599 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2b5806c8f0 0x7f2b5806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:35.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.431+0000 7f2b6affd640 1 -- 172.21.15.114:0/1171858599 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2b7008c0d0 con 0x7f2b6c006ea0 2024-04-28T13:07:35.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.431+0000 7f2b79808640 1 --2- 172.21.15.114:0/1171858599 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2b5806c8f0 0x7f2b5806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:35.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.431+0000 7f2b79808640 1 --2- 172.21.15.114:0/1171858599 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2b5806c8f0 0x7f2b5806edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2b64007b50 tx=0x7f2b64007aa0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:35.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.432+0000 7f8011ffb640 1 -- 172.21.15.114:0/3594869531 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f800c07a660 con 0x7f801c0d0ea0 2024-04-28T13:07:35.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.433+0000 7f2b6affd640 1 -- 172.21.15.114:0/1171858599 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2b70059e90 con 0x7f2b6c006ea0 2024-04-28T13:07:35.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.836+0000 7f42c586f640 1 -- 172.21.15.114:0/3102320446 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f42a0005850 con 0x7f42c01498c0 2024-04-28T13:07:35.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.836+0000 7fb1cb42c640 1 -- 172.21.15.114:0/2658966716 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb1a4005580 con 0x7fb1bc048c40 2024-04-28T13:07:35.837 INFO:teuthology.orchestra.run.smithi114.stdout:55834574855 2024-04-28T13:07:35.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.837+0000 7f42bd7fa640 1 -- 172.21.15.114:0/3102320446 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f42b0080080 con 0x7f42c01498c0 2024-04-28T13:07:35.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.837+0000 7fb1b9ffb640 1 -- 172.21.15.114:0/2658966716 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb1c005cfb0 con 0x7fb1bc048c40 2024-04-28T13:07:35.837 INFO:teuthology.orchestra.run.smithi114.stdout:55834574856 2024-04-28T13:07:35.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.840+0000 7f42c586f640 1 -- 172.21.15.114:0/3102320446 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f42ac06c9f0 msgr2=0x7f42ac06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.840+0000 7f42c586f640 1 --2- 172.21.15.114:0/3102320446 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f42ac06c9f0 0x7f42ac06eeb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f42b8001560 tx=0x7f42b8009040 comp rx=0 tx=0).stop 2024-04-28T13:07:35.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.840+0000 7f42c586f640 1 -- 172.21.15.114:0/3102320446 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42c01498c0 msgr2=0x7f42c00d1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.841+0000 7f42c586f640 1 --2- 172.21.15.114:0/3102320446 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42c01498c0 0x7f42c00d1ca0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f42c006e9b0 tx=0x7f42b00046c0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.841+0000 7fb1cb42c640 1 -- 172.21.15.114:0/2658966716 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb1a806c9c0 msgr2=0x7fb1a806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.841+0000 7fb1cb42c640 1 --2- 172.21.15.114:0/2658966716 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb1a806c9c0 0x7fb1a806ee80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc00aeb0 tx=0x7fb1c40ac000 comp rx=0 tx=0).stop 2024-04-28T13:07:35.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.841+0000 7f42c586f640 1 -- 172.21.15.114:0/3102320446 shutdown_connections 2024-04-28T13:07:35.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.841+0000 7f42c586f640 1 --2- 172.21.15.114:0/3102320446 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42c01498c0 0x7f42c00d1ca0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.841+0000 7f42c586f640 1 --2- 172.21.15.114:0/3102320446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42c015bfb0 0x7f42c00d1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.841+0000 7f42c586f640 1 --2- 172.21.15.114:0/3102320446 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f42ac06c9f0 0x7f42ac06eeb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.841+0000 7f42c586f640 1 --2- 172.21.15.114:0/3102320446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42c00b6060 0x7f42c015c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.841+0000 7fb1cb42c640 1 -- 172.21.15.114:0/2658966716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1bc048c40 msgr2=0x7fb1bc0e3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.841+0000 7fb1cb42c640 1 --2- 172.21.15.114:0/2658966716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1bc048c40 0x7fb1bc0e3220 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000c430 tx=0x7fb1c000c8f0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.841+0000 7f42c586f640 1 -- 172.21.15.114:0/3102320446 >> 172.21.15.114:0/3102320446 conn(0x7f42c00b3b20 msgr2=0x7f42c014f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.841+0000 7fb1cb42c640 1 -- 172.21.15.114:0/2658966716 shutdown_connections 2024-04-28T13:07:35.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.841+0000 7fb1cb42c640 1 --2- 172.21.15.114:0/2658966716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1bc049070 0x7fb1bc0e3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.841+0000 7f42c586f640 1 -- 172.21.15.114:0/3102320446 shutdown_connections 2024-04-28T13:07:35.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.841+0000 7f42c586f640 1 -- 172.21.15.114:0/3102320446 wait complete. 2024-04-28T13:07:35.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.841+0000 7fb1cb42c640 1 --2- 172.21.15.114:0/2658966716 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb1a806c9c0 0x7fb1a806ee80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.841+0000 7fb1cb42c640 1 --2- 172.21.15.114:0/2658966716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1bc048c40 0x7fb1bc0e3220 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.841+0000 7fb1cb42c640 1 --2- 172.21.15.114:0/2658966716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb1bc009190 0x7fb1bc0e4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.841+0000 7fb1cb42c640 1 -- 172.21.15.114:0/2658966716 >> 172.21.15.114:0/2658966716 conn(0x7fb1bc01ef40 msgr2=0x7fb1bc0e5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.842+0000 7fb1cb42c640 1 -- 172.21.15.114:0/2658966716 shutdown_connections 2024-04-28T13:07:35.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.842+0000 7fb1cb42c640 1 -- 172.21.15.114:0/2658966716 wait complete. 2024-04-28T13:07:35.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.846+0000 7efd9f578640 1 -- 172.21.15.114:0/1776607177 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7efd980d0010 con 0x7efd980693f0 2024-04-28T13:07:35.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.846+0000 7f89a893e640 1 -- 172.21.15.114:0/21769621 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f8984005850 con 0x7f89a415db80 2024-04-28T13:07:35.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.846+0000 7efd8dffb640 1 -- 172.21.15.114:0/1776607177 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efd94058be0 con 0x7efd980693f0 2024-04-28T13:07:35.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.847+0000 7f898b7fe640 1 -- 172.21.15.114:0/21769621 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f899c02ae20 con 0x7f89a415db80 2024-04-28T13:07:35.847 INFO:teuthology.orchestra.run.smithi114.stdout:55834574855 2024-04-28T13:07:35.849 INFO:teuthology.orchestra.run.smithi114.stdout:55834574855 2024-04-28T13:07:35.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.850+0000 7efd9f578640 1 -- 172.21.15.114:0/1776607177 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7efd7c06c8f0 msgr2=0x7efd7c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.850+0000 7efd9f578640 1 --2- 172.21.15.114:0/1776607177 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7efd7c06c8f0 0x7efd7c06edb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efd981fca60 tx=0x7efd88006b80 comp rx=0 tx=0).stop 2024-04-28T13:07:35.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.850+0000 7efd9f578640 1 -- 172.21.15.114:0/1776607177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd980693f0 msgr2=0x7efd9814cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.850+0000 7efd9f578640 1 --2- 172.21.15.114:0/1776607177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd980693f0 0x7efd9814cc30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efd9400c460 tx=0x7efd9400c920 comp rx=0 tx=0).stop 2024-04-28T13:07:35.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.851+0000 7efd9f578640 1 -- 172.21.15.114:0/1776607177 shutdown_connections 2024-04-28T13:07:35.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.851+0000 7efd9f578640 1 --2- 172.21.15.114:0/1776607177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd980cedf0 0x7efd98155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.851+0000 7efd9f578640 1 --2- 172.21.15.114:0/1776607177 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efd980cdd80 0x7efd9814c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.851+0000 7efd9f578640 1 --2- 172.21.15.114:0/1776607177 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7efd7c06c8f0 0x7efd7c06edb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.851+0000 7efd9f578640 1 --2- 172.21.15.114:0/1776607177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd980693f0 0x7efd9814cc30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.851+0000 7efd9f578640 1 -- 172.21.15.114:0/1776607177 >> 172.21.15.114:0/1776607177 conn(0x7efd980b2c40 msgr2=0x7efd980b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.851+0000 7efd9f578640 1 -- 172.21.15.114:0/1776607177 shutdown_connections 2024-04-28T13:07:35.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.851+0000 7efd9f578640 1 -- 172.21.15.114:0/1776607177 wait complete. 2024-04-28T13:07:35.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.851+0000 7f89a893e640 1 -- 172.21.15.114:0/21769621 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f899006c970 msgr2=0x7f899006ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.851+0000 7f89a893e640 1 --2- 172.21.15.114:0/21769621 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f899006c970 0x7f899006ee30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8994006fd0 tx=0x7f8994008040 comp rx=0 tx=0).stop 2024-04-28T13:07:35.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.851+0000 7f89a893e640 1 -- 172.21.15.114:0/21769621 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89a415db80 msgr2=0x7f89a40cf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.851+0000 7f89a893e640 1 --2- 172.21.15.114:0/21769621 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89a415db80 0x7f89a40cf570 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f899c009e50 tx=0x7f899c004a40 comp rx=0 tx=0).stop 2024-04-28T13:07:35.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.851+0000 7f89a893e640 1 -- 172.21.15.114:0/21769621 shutdown_connections 2024-04-28T13:07:35.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.851+0000 7f89a893e640 1 --2- 172.21.15.114:0/21769621 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89a415db80 0x7f89a40cf570 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.851+0000 7f89a893e640 1 --2- 172.21.15.114:0/21769621 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f899006c970 0x7f899006ee30 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8994006fd0 tx=0x7f8994008040 comp rx=0 tx=0).stop 2024-04-28T13:07:35.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.851+0000 7f89a893e640 1 --2- 172.21.15.114:0/21769621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89a40d1080 0x7f89a40b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.851+0000 7f89a893e640 1 --2- 172.21.15.114:0/21769621 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89a40ae720 0x7f89a4154ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.851+0000 7f89a893e640 1 -- 172.21.15.114:0/21769621 >> 172.21.15.114:0/21769621 conn(0x7f89a406c740 msgr2=0x7f89a40afd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.851+0000 7f89a893e640 1 -- 172.21.15.114:0/21769621 shutdown_connections 2024-04-28T13:07:35.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.851+0000 7f89a893e640 1 -- 172.21.15.114:0/21769621 wait complete. 2024-04-28T13:07:35.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.851+0000 7ff598ff9640 1 -- 172.21.15.114:0/4292779171 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7ff57c005850 con 0x7ff5a40d28e0 2024-04-28T13:07:35.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.852+0000 7ff59affd640 1 -- 172.21.15.114:0/4292779171 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff59405ddb0 con 0x7ff5a40d28e0 2024-04-28T13:07:35.853 INFO:teuthology.orchestra.run.smithi114.stdout:55834574855 2024-04-28T13:07:35.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.855+0000 7ff5a8d9d640 1 -- 172.21.15.114:0/4292779171 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff58406c9f0 msgr2=0x7ff58406eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.856+0000 7ff5a8d9d640 1 --2- 172.21.15.114:0/4292779171 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff58406c9f0 0x7ff58406eeb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff58c034000 tx=0x7ff58c02e000 comp rx=0 tx=0).stop 2024-04-28T13:07:35.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.856+0000 7ff5a8d9d640 1 -- 172.21.15.114:0/4292779171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5a40d28e0 msgr2=0x7ff5a41f9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.856+0000 7ff5a8d9d640 1 --2- 172.21.15.114:0/4292779171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5a40d28e0 0x7ff5a41f9090 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff59400c430 tx=0x7ff59400c8f0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.856+0000 7ff5a8d9d640 1 -- 172.21.15.114:0/4292779171 shutdown_connections 2024-04-28T13:07:35.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.856+0000 7ff5a8d9d640 1 --2- 172.21.15.114:0/4292779171 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5a41463d0 0x7ff5a40b7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.856+0000 7ff5a8d9d640 1 --2- 172.21.15.114:0/4292779171 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff58406c9f0 0x7ff58406eeb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.856+0000 7ff5a8d9d640 1 --2- 172.21.15.114:0/4292779171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5a40d3500 0x7ff5a4142d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.856+0000 7ff5a8d9d640 1 --2- 172.21.15.114:0/4292779171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5a40d28e0 0x7ff5a41f9090 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.856+0000 7ff5a8d9d640 1 -- 172.21.15.114:0/4292779171 >> 172.21.15.114:0/4292779171 conn(0x7ff5a4062d70 msgr2=0x7ff5a40ca100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.857+0000 7f7183340640 1 -- 172.21.15.114:0/3760026219 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f717c073860 con 0x7f717c0bae80 2024-04-28T13:07:35.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.857+0000 7ff5a8d9d640 1 -- 172.21.15.114:0/4292779171 shutdown_connections 2024-04-28T13:07:35.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.857+0000 7ff5a8d9d640 1 -- 172.21.15.114:0/4292779171 wait complete. 2024-04-28T13:07:35.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.857+0000 7f7171ffb640 1 -- 172.21.15.114:0/3760026219 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f716c07da80 con 0x7f717c0bae80 2024-04-28T13:07:35.858 INFO:teuthology.orchestra.run.smithi114.stdout:55834574855 2024-04-28T13:07:35.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.858+0000 7f2b7b00b640 1 -- 172.21.15.114:0/1171858599 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f2b6c0348e0 con 0x7f2b6c006ea0 2024-04-28T13:07:35.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.859+0000 7f2b6affd640 1 -- 172.21.15.114:0/1171858599 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2b7005e190 con 0x7f2b6c006ea0 2024-04-28T13:07:35.859 INFO:teuthology.orchestra.run.smithi114.stdout:55834574854 2024-04-28T13:07:35.860 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.5 2024-04-28T13:07:35.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.861+0000 7f7183340640 1 -- 172.21.15.114:0/3760026219 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f716006c8f0 msgr2=0x7f716006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.861+0000 7f7183340640 1 --2- 172.21.15.114:0/3760026219 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f716006c8f0 0x7f716006edb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f717c0d1580 tx=0x7f7174009040 comp rx=0 tx=0).stop 2024-04-28T13:07:35.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.861+0000 7f7183340640 1 -- 172.21.15.114:0/3760026219 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f717c0bae80 msgr2=0x7f717c0cb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.861+0000 7f7183340640 1 --2- 172.21.15.114:0/3760026219 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f717c0bae80 0x7f717c0cb740 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f716c009890 tx=0x7f716c0046c0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.861+0000 7f7183340640 1 -- 172.21.15.114:0/3760026219 shutdown_connections 2024-04-28T13:07:35.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.861+0000 7f7183340640 1 --2- 172.21.15.114:0/3760026219 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f716006c8f0 0x7f716006edb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.861+0000 7f7183340640 1 --2- 172.21.15.114:0/3760026219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f717c15f580 0x7f717c0c96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.861+0000 7f7183340640 1 --2- 172.21.15.114:0/3760026219 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f717c15f1a0 0x7f717c1fd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.861+0000 7f7183340640 1 --2- 172.21.15.114:0/3760026219 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f717c0bae80 0x7f717c0cb740 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.861+0000 7f7183340640 1 -- 172.21.15.114:0/3760026219 >> 172.21.15.114:0/3760026219 conn(0x7f717c0633a0 msgr2=0x7f717c15e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.861+0000 7f7183340640 1 -- 172.21.15.114:0/3760026219 shutdown_connections 2024-04-28T13:07:35.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.861+0000 7f7183340640 1 -- 172.21.15.114:0/3760026219 wait complete. 2024-04-28T13:07:35.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.1 2024-04-28T13:07:35.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.862+0000 7f2b7b00b640 1 -- 172.21.15.114:0/1171858599 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2b5806c8f0 msgr2=0x7f2b5806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.862+0000 7f2b7b00b640 1 --2- 172.21.15.114:0/1171858599 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2b5806c8f0 0x7f2b5806edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2b64007b50 tx=0x7f2b64007aa0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.862+0000 7f2b7b00b640 1 -- 172.21.15.114:0/1171858599 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b6c006ea0 msgr2=0x7f2b6c035610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.862+0000 7f2b7b00b640 1 --2- 172.21.15.114:0/1171858599 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b6c006ea0 0x7f2b6c035610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2b7000e8a0 tx=0x7f2b7000ed60 comp rx=0 tx=0).stop 2024-04-28T13:07:35.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.862+0000 7f2b7b00b640 1 -- 172.21.15.114:0/1171858599 shutdown_connections 2024-04-28T13:07:35.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.862+0000 7f2b7b00b640 1 --2- 172.21.15.114:0/1171858599 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2b5806c8f0 0x7f2b5806edb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.862+0000 7f2b7b00b640 1 --2- 172.21.15.114:0/1171858599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b6c0ead00 0x7f2b6c0c92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.862+0000 7f2b7b00b640 1 --2- 172.21.15.114:0/1171858599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b6c04ffd0 0x7f2b6c04a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.862+0000 7f2b7b00b640 1 --2- 172.21.15.114:0/1171858599 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b6c006ea0 0x7f2b6c035610 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.862+0000 7f2b7b00b640 1 -- 172.21.15.114:0/1171858599 >> 172.21.15.114:0/1171858599 conn(0x7f2b6c009fb0 msgr2=0x7f2b6c03a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.862+0000 7f2b7b00b640 1 -- 172.21.15.114:0/1171858599 shutdown_connections 2024-04-28T13:07:35.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.862+0000 7f2b7b00b640 1 -- 172.21.15.114:0/1171858599 wait complete. 2024-04-28T13:07:35.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.863+0000 7f7fff7fe640 1 -- 172.21.15.114:0/3594869531 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f7ff8005580 con 0x7f801c0d0ea0 2024-04-28T13:07:35.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.864+0000 7f8011ffb640 1 -- 172.21.15.114:0/3594869531 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f800c079f60 con 0x7f801c0d0ea0 2024-04-28T13:07:35.865 INFO:teuthology.orchestra.run.smithi114.stdout:55834574856 2024-04-28T13:07:35.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.867+0000 7f7fff7fe640 1 -- 172.21.15.114:0/3594869531 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f800006c9c0 msgr2=0x7f800006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.867+0000 7f7fff7fe640 1 --2- 172.21.15.114:0/3594869531 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f800006c9c0 0x7f800006ee80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8018009890 tx=0x7f8018008040 comp rx=0 tx=0).stop 2024-04-28T13:07:35.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.867+0000 7f7fff7fe640 1 -- 172.21.15.114:0/3594869531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f801c0d0ea0 msgr2=0x7f801c160080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:35.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.867+0000 7f7fff7fe640 1 --2- 172.21.15.114:0/3594869531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f801c0d0ea0 0x7f801c160080 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f800c0098c0 tx=0x7f800c0046c0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.868+0000 7f7fff7fe640 1 -- 172.21.15.114:0/3594869531 shutdown_connections 2024-04-28T13:07:35.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.868+0000 7f7fff7fe640 1 --2- 172.21.15.114:0/3594869531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f801c163670 0x7f801c0b0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.868+0000 7f7fff7fe640 1 --2- 172.21.15.114:0/3594869531 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f800006c9c0 0x7f800006ee80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.868+0000 7f7fff7fe640 1 --2- 172.21.15.114:0/3594869531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f801c0d0ea0 0x7f801c160080 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.868+0000 7f7fff7fe640 1 --2- 172.21.15.114:0/3594869531 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f801c0b3b50 0x7f801c15fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:35.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.868+0000 7f7fff7fe640 1 -- 172.21.15.114:0/3594869531 >> 172.21.15.114:0/3594869531 conn(0x7f801c06c530 msgr2=0x7f801c15e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:35.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.868+0000 7f7fff7fe640 1 -- 172.21.15.114:0/3594869531 shutdown_connections 2024-04-28T13:07:35.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:35.868+0000 7f7fff7fe640 1 -- 172.21.15.114:0/3594869531 wait complete. 2024-04-28T13:07:35.870 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.7 2024-04-28T13:07:35.872 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.6 2024-04-28T13:07:35.878 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2024-04-28T13:07:35.878 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.0 2024-04-28T13:07:35.880 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2024-04-28T13:07:35.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2024-04-28T13:07:36.862 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-28T13:07:36.864 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-28T13:07:36.871 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-28T13:07:36.873 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-28T13:07:36.878 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-28T13:07:36.879 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-28T13:07:36.881 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-28T13:07:36.881 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-28T13:07:37.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.010+0000 7f9cac911640 1 Processor -- start 2024-04-28T13:07:37.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.010+0000 7f9cac911640 1 -- start start 2024-04-28T13:07:37.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.011+0000 7f9cac911640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ca815b130 0x7f9ca8071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.011+0000 7f9cac911640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9ca80d05a0 0x7f9ca815ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.011+0000 7f9cac911640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9ca80cb360 0x7f9ca80cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.011+0000 7f9cac911640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f9ca815f240 con 0x7f9ca80cb360 2024-04-28T13:07:37.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.011+0000 7f9cac911640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f9ca815f4e0 con 0x7f9ca80d05a0 2024-04-28T13:07:37.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.012+0000 7f9cac911640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f9ca815f7c0 con 0x7f9ca815b130 2024-04-28T13:07:37.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.012+0000 7f9ca6d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9ca80cb360 0x7f9ca80cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.012+0000 7f9ca6d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9ca80cb360 0x7f9ca80cb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48238/0 (socket says 172.21.15.114:48238) 2024-04-28T13:07:37.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.012+0000 7f9ca6d9d640 1 -- 172.21.15.114:0/3722557190 learned_addr learned my addr 172.21.15.114:0/3722557190 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:37.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.012+0000 7f9ca5d9b640 1 --2- 172.21.15.114:0/3722557190 >> v2:172.21.15.134:3300/0 conn(0x7f9ca80d05a0 0x7f9ca815ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.012+0000 7f9ca659c640 1 --2- 172.21.15.114:0/3722557190 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ca815b130 0x7f9ca8071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.011+0000 7f171f19d640 1 Processor -- start 2024-04-28T13:07:37.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.011+0000 7f171f19d640 1 -- start start 2024-04-28T13:07:37.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.012+0000 7f171f19d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f171815f230 0x7f17180bac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.012+0000 7f171f19d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f17180d22a0 0x7f17180b82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.012+0000 7f171f19d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17180ba670 con 0x7f171815f610 2024-04-28T13:07:37.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.012+0000 7f171f19d640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f17180b9830 con 0x7f17180d22a0 2024-04-28T13:07:37.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.012+0000 7f171f19d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f17180b9af0 con 0x7f171815f230 2024-04-28T13:07:37.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.012+0000 7f171d73a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f17180d22a0 0x7f17180b82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.012+0000 7f171d73a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f17180d22a0 0x7f17180b82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48248/0 (socket says 172.21.15.114:48248) 2024-04-28T13:07:37.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.012+0000 7f171d73a640 1 -- 172.21.15.114:0/1914580305 learned_addr learned my addr 172.21.15.114:0/1914580305 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:37.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.013+0000 7f9ca6d9d640 1 -- 172.21.15.114:0/3722557190 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ca815b130 msgr2=0x7f9ca8071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:37.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.013+0000 7f9ca6d9d640 1 --2- 172.21.15.114:0/3722557190 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ca815b130 0x7f9ca8071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.013+0000 7f9ca6d9d640 1 -- 172.21.15.114:0/3722557190 >> v2:172.21.15.134:3300/0 conn(0x7f9ca80d05a0 msgr2=0x7f9ca815ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:37.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.013+0000 7f9ca6d9d640 1 --2- 172.21.15.114:0/3722557190 >> v2:172.21.15.134:3300/0 conn(0x7f9ca80d05a0 0x7f9ca815ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.013+0000 7f9ca6d9d640 1 -- 172.21.15.114:0/3722557190 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca815faa0 con 0x7f9ca80cb360 2024-04-28T13:07:37.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.013+0000 7f171cf39640 1 --2- 172.21.15.114:0/1914580305 >> v2:172.21.15.134:3300/0 conn(0x7f171815f230 0x7f17180bac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.014+0000 7f9ca6d9d640 1 --2- 172.21.15.114:0/3722557190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ca80cb360 0x7f9ca80cb7f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9ca80d1d20 tx=0x7f9c9c02a1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ef5c08c94af5cb server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:37.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.013+0000 7f171d73a640 1 -- 172.21.15.114:0/1914580305 >> v2:172.21.15.134:3300/0 conn(0x7f171815f230 msgr2=0x7f17180bac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:37.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.013+0000 7f171d73a640 1 --2- 172.21.15.114:0/1914580305 >> v2:172.21.15.134:3300/0 conn(0x7f171815f230 0x7f17180bac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.013+0000 7f171d73a640 1 -- 172.21.15.114:0/1914580305 >> v1:172.21.15.134:6789/0 conn(0x7f171815f610 legacy=0x7f17180d1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:37.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.013+0000 7f171d73a640 1 -- 172.21.15.114:0/1914580305 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17180b9dd0 con 0x7f17180d22a0 2024-04-28T13:07:37.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.014+0000 7f9ca559a640 1 -- 172.21.15.114:0/3722557190 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c037070 con 0x7f9ca80cb360 2024-04-28T13:07:37.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.015+0000 7f171d73a640 1 --2- 172.21.15.114:0/1914580305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17180d22a0 0x7f17180b82e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f171808e090 tx=0x7f171002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176fb89471bfb21e server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:37.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.015+0000 7f9ca559a640 1 -- 172.21.15.114:0/3722557190 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c9c032440 con 0x7f9ca80cb360 2024-04-28T13:07:37.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.015+0000 7f17177fe640 1 -- 172.21.15.114:0/1914580305 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1710036070 con 0x7f17180d22a0 2024-04-28T13:07:37.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.015+0000 7f17177fe640 1 -- 172.21.15.114:0/1914580305 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1710031600 con 0x7f17180d22a0 2024-04-28T13:07:37.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.016+0000 7f9cac911640 1 -- 172.21.15.114:0/3722557190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ca80cb360 msgr2=0x7f9ca80cb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.016+0000 7f9cac911640 1 --2- 172.21.15.114:0/3722557190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ca80cb360 0x7f9ca80cb7f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9ca80d1d20 tx=0x7f9c9c02a1d0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.016+0000 7f171f19d640 1 -- 172.21.15.114:0/1914580305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17180d22a0 msgr2=0x7f17180b82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.016+0000 7f171f19d640 1 --2- 172.21.15.114:0/1914580305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17180d22a0 0x7f17180b82e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f171808e090 tx=0x7f171002a710 comp rx=0 tx=0).stop 2024-04-28T13:07:37.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.016+0000 7f9cac911640 1 -- 172.21.15.114:0/3722557190 shutdown_connections 2024-04-28T13:07:37.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.016+0000 7f9cac911640 1 --2- 172.21.15.114:0/3722557190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ca80cb360 0x7f9ca80cb7f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.016+0000 7f9cac911640 1 --2- 172.21.15.114:0/3722557190 >> v2:172.21.15.134:3300/0 conn(0x7f9ca80d05a0 0x7f9ca815ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.016+0000 7f9cac911640 1 --2- 172.21.15.114:0/3722557190 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ca815b130 0x7f9ca8071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.016+0000 7f9cac911640 1 -- 172.21.15.114:0/3722557190 >> 172.21.15.114:0/3722557190 conn(0x7f9ca80b2820 msgr2=0x7f9ca80b2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:37.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.017+0000 7f9cac911640 1 -- 172.21.15.114:0/3722557190 shutdown_connections 2024-04-28T13:07:37.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.017+0000 7f9cac911640 1 -- 172.21.15.114:0/3722557190 wait complete. 2024-04-28T13:07:37.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.018+0000 7f171f19d640 1 -- 172.21.15.114:0/1914580305 shutdown_connections 2024-04-28T13:07:37.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.018+0000 7f171f19d640 1 --2- 172.21.15.114:0/1914580305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17180d22a0 0x7f17180b82e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.018+0000 7f171f19d640 1 --2- 172.21.15.114:0/1914580305 >> v2:172.21.15.134:3300/0 conn(0x7f171815f230 0x7f17180bac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.018+0000 7f171f19d640 1 -- 172.21.15.114:0/1914580305 >> 172.21.15.114:0/1914580305 conn(0x7f1718063190 msgr2=0x7f17180635a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:37.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.018+0000 7f171f19d640 1 -- 172.21.15.114:0/1914580305 shutdown_connections 2024-04-28T13:07:37.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.019+0000 7f9cac911640 1 Processor -- start 2024-04-28T13:07:37.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.019+0000 7f9cac911640 1 -- start start 2024-04-28T13:07:37.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.021+0000 7f9cac911640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ca80cb360 0x7f9ca8151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.021+0000 7f9cac911640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ca80d05a0 0x7f9ca815c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.021+0000 7f9ca659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ca80cb360 0x7f9ca8151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.021+0000 7f9ca5d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ca80d05a0 0x7f9ca815c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.021+0000 7f9ca5d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ca80d05a0 0x7f9ca815c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48260/0 (socket says 172.21.15.114:48260) 2024-04-28T13:07:37.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.021+0000 7f9ca659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ca80cb360 0x7f9ca8151fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:50102/0 (socket says 172.21.15.114:50102) 2024-04-28T13:07:37.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.021+0000 7f9ca5d9b640 1 -- 172.21.15.114:0/3591820070 learned_addr learned my addr 172.21.15.114:0/3591820070 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:37.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.021+0000 7f9cac911640 1 --2- 172.21.15.114:0/3591820070 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ca815b130 0x7f9ca80720d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.022+0000 7f9cac911640 1 -- 172.21.15.114:0/3591820070 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca80b3310 con 0x7f9ca80d05a0 2024-04-28T13:07:37.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.022+0000 7f9cac911640 1 -- 172.21.15.114:0/3591820070 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca815b510 con 0x7f9ca80cb360 2024-04-28T13:07:37.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.022+0000 7f9ca6d9d640 1 --2- 172.21.15.114:0/3591820070 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ca815b130 0x7f9ca80720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.022+0000 7f9cac911640 1 -- 172.21.15.114:0/3591820070 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f9ca80b3490 con 0x7f9ca815b130 2024-04-28T13:07:37.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.019+0000 7f171f19d640 1 -- 172.21.15.114:0/1914580305 wait complete. 2024-04-28T13:07:37.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.020+0000 7f171f19d640 1 Processor -- start 2024-04-28T13:07:37.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.020+0000 7f171f19d640 1 -- start start 2024-04-28T13:07:37.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.022+0000 7f171f19d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17180d22a0 0x7f17180cb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.022+0000 7f171f19d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f171815f230 0x7f17180b8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.022+0000 7f171f19d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f171815f610 0x7f17180b8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.022+0000 7f171f19d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f17180d4590 con 0x7f171815f610 2024-04-28T13:07:37.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.022+0000 7f171f19d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f17180ba390 con 0x7f17180d22a0 2024-04-28T13:07:37.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.022+0000 7f171f19d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f17180d4710 con 0x7f171815f230 2024-04-28T13:07:37.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.022+0000 7f171cf39640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17180d22a0 0x7f17180cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.023+0000 7f171d73a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f171815f610 0x7f17180b8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.023+0000 7f171d73a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f171815f610 0x7f17180b8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48268/0 (socket says 172.21.15.114:48268) 2024-04-28T13:07:37.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.023+0000 7f171d73a640 1 -- 172.21.15.114:0/1394394370 learned_addr learned my addr 172.21.15.114:0/1394394370 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:37.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.023+0000 7f171d73a640 1 -- 172.21.15.114:0/1394394370 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f171815f230 msgr2=0x7f17180b8840 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-28T13:07:37.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.023+0000 7f171d73a640 1 --2- 172.21.15.114:0/1394394370 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f171815f230 0x7f17180b8840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.023+0000 7f171d73a640 1 -- 172.21.15.114:0/1394394370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17180d22a0 msgr2=0x7f17180cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.023+0000 7f171d73a640 1 --2- 172.21.15.114:0/1394394370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17180d22a0 0x7f17180cb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.023+0000 7f171d73a640 1 -- 172.21.15.114:0/1394394370 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1718150c30 con 0x7f171815f610 2024-04-28T13:07:37.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.023+0000 7f171d73a640 1 --2- 172.21.15.114:0/1394394370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f171815f610 0x7f17180b8d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1710009f40 tx=0x7f1710004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:37.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.024+0000 7f17157fa640 1 -- 172.21.15.114:0/1394394370 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1710036050 con 0x7f171815f610 2024-04-28T13:07:37.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.024+0000 7f17157fa640 1 -- 172.21.15.114:0/1394394370 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1710037040 con 0x7f171815f610 2024-04-28T13:07:37.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.023+0000 7f9ca5d9b640 1 -- 172.21.15.114:0/3591820070 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ca815b130 msgr2=0x7f9ca80720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.023+0000 7f9ca5d9b640 1 --2- 172.21.15.114:0/3591820070 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ca815b130 0x7f9ca80720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.023+0000 7f9ca5d9b640 1 -- 172.21.15.114:0/3591820070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ca80cb360 msgr2=0x7f9ca8151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.023+0000 7f9ca5d9b640 1 --2- 172.21.15.114:0/3591820070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ca80cb360 0x7f9ca8151fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.023+0000 7f9ca5d9b640 1 -- 172.21.15.114:0/3591820070 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca815ca30 con 0x7f9ca80d05a0 2024-04-28T13:07:37.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.023+0000 7f9ca5d9b640 1 --2- 172.21.15.114:0/3591820070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ca80d05a0 0x7f9ca815c4f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9ca000efa0 tx=0x7f9ca000c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:37.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.024+0000 7f9c96ffd640 1 -- 172.21.15.114:0/3591820070 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0018020 con 0x7f9ca80d05a0 2024-04-28T13:07:37.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.025+0000 7f9cac911640 1 -- 172.21.15.114:0/3591820070 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ca8073020 con 0x7f9ca80d05a0 2024-04-28T13:07:37.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.025+0000 7f9cac911640 1 -- 172.21.15.114:0/3591820070 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ca8152930 con 0x7f9ca80d05a0 2024-04-28T13:07:37.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.026+0000 7f9c96ffd640 1 -- 172.21.15.114:0/3591820070 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ca0014480 con 0x7f9ca80d05a0 2024-04-28T13:07:37.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.025+0000 7f171f19d640 1 -- 172.21.15.114:0/1394394370 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17180cd730 con 0x7f171815f610 2024-04-28T13:07:37.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.025+0000 7f171f19d640 1 -- 172.21.15.114:0/1394394370 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17180cab30 con 0x7f171815f610 2024-04-28T13:07:37.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.027+0000 7f17157fa640 1 -- 172.21.15.114:0/1394394370 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1710009510 con 0x7f171815f610 2024-04-28T13:07:37.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.027+0000 7f9c96ffd640 1 -- 172.21.15.114:0/3591820070 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0014850 con 0x7f9ca80d05a0 2024-04-28T13:07:37.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.029+0000 7f9c96ffd640 1 -- 172.21.15.114:0/3591820070 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9ca001b020 con 0x7f9ca80d05a0 2024-04-28T13:07:37.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.029+0000 7f9c96ffd640 1 --2- 172.21.15.114:0/3591820070 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9c8806c9f0 0x7f9c8806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.029+0000 7f9c96ffd640 1 -- 172.21.15.114:0/3591820070 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9ca008c3c0 con 0x7f9ca80d05a0 2024-04-28T13:07:37.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.030+0000 7f9c94ff9640 1 -- 172.21.15.114:0/3591820070 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c8c005290 con 0x7f9ca80d05a0 2024-04-28T13:07:37.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.029+0000 7f17157fa640 1 -- 172.21.15.114:0/1394394370 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f17100317f0 con 0x7f171815f610 2024-04-28T13:07:37.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.030+0000 7f17157fa640 1 --2- 172.21.15.114:0/1394394370 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f170406c9f0 0x7f170406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.030+0000 7f17157fa640 1 -- 172.21.15.114:0/1394394370 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f17100b4bf0 con 0x7f171815f610 2024-04-28T13:07:37.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.030+0000 7f171cf39640 1 --2- 172.21.15.114:0/1394394370 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f170406c9f0 0x7f170406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.030+0000 7f171f19d640 1 -- 172.21.15.114:0/1394394370 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1718075c40 con 0x7f171815f610 2024-04-28T13:07:37.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.031+0000 7f171cf39640 1 --2- 172.21.15.114:0/1394394370 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f170406c9f0 0x7f170406eeb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1708006fd0 tx=0x7f1708008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:37.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.030+0000 7f9ca659c640 1 --2- 172.21.15.114:0/3591820070 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9c8806c9f0 0x7f9c8806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.032+0000 7f9ca659c640 1 --2- 172.21.15.114:0/3591820070 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9c8806c9f0 0x7f9c8806eeb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9ca80b1160 tx=0x7f9c9800d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:37.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.036+0000 7f9c96ffd640 1 -- 172.21.15.114:0/3591820070 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9ca0022070 con 0x7f9ca80d05a0 2024-04-28T13:07:37.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.044+0000 7f17157fa640 1 -- 172.21.15.114:0/1394394370 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1710083090 con 0x7f171815f610 2024-04-28T13:07:37.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.075+0000 7f87c52d7640 1 Processor -- start 2024-04-28T13:07:37.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.075+0000 7f95f959d640 1 Processor -- start 2024-04-28T13:07:37.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.075+0000 7f87c52d7640 1 -- start start 2024-04-28T13:07:37.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.075+0000 7f808ea5b640 1 Processor -- start 2024-04-28T13:07:37.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.075+0000 7f808ea5b640 1 -- start start 2024-04-28T13:07:37.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.076+0000 7f87c52d7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f87c00d0ea0 0x7f87c00d1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.076+0000 7f87c52d7640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f87c0072210 0x7f87c00726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.076+0000 7f87c52d7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87c0074190 con 0x7f87c0163670 2024-04-28T13:07:37.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.076+0000 7f87c52d7640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f87c00700d0 con 0x7f87c00d0ea0 2024-04-28T13:07:37.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.076+0000 7f87c52d7640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f87c00d1850 con 0x7f87c0072210 2024-04-28T13:07:37.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.076+0000 7f808ea5b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f808806e560 0x7f8088072100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.076+0000 7f808ea5b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8088164720 0x7f808806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.076+0000 7f808ea5b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f808806ee80 con 0x7f8088167290 2024-04-28T13:07:37.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.076+0000 7f808ea5b640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f8088072780 con 0x7f8088164720 2024-04-28T13:07:37.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.076+0000 7f808ea5b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f8088164b60 con 0x7f808806e560 2024-04-28T13:07:37.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.077+0000 7f87c4ad6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f87c0072210 0x7f87c00726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.075+0000 7f95f959d640 1 -- start start 2024-04-28T13:07:37.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.077+0000 7f95f959d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95ec0df1c0 0x7f95ec04fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.077+0000 7f95f959d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f95ec0dfcb0 0x7f95ec005ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.077+0000 7f95f959d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95ec0e00e0 con 0x7f95ec054690 2024-04-28T13:07:37.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.077+0000 7f95f959d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f95ec053310 con 0x7f95ec0dfcb0 2024-04-28T13:07:37.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.077+0000 7f95f959d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f95ec0535f0 con 0x7f95ec0df1c0 2024-04-28T13:07:37.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.077+0000 7f808cff8640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f8088167290 0x7f80881676c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:43400/0 (socket says 172.21.15.114:43400) 2024-04-28T13:07:37.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.077+0000 7f808cff8640 1 -- 172.21.15.114:0/1613025984 learned_addr learned my addr 172.21.15.114:0/1613025984 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:37.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.077+0000 7f95f2ffd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95ec0df1c0 0x7f95ec04fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.077+0000 7f95f2ffd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95ec0df1c0 0x7f95ec04fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:58592/0 (socket says 172.21.15.114:58592) 2024-04-28T13:07:37.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.077+0000 7f95f2ffd640 1 -- 172.21.15.114:0/1288888959 learned_addr learned my addr 172.21.15.114:0/1288888959 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:37.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.077+0000 7f87c4ad6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f87c0072210 0x7f87c00726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:58578/0 (socket says 172.21.15.114:58578) 2024-04-28T13:07:37.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.077+0000 7f87c4ad6640 1 -- 172.21.15.114:0/406653986 learned_addr learned my addr 172.21.15.114:0/406653986 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:37.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.077+0000 7f87bf7fe640 1 --2- 172.21.15.114:0/406653986 >> v2:172.21.15.114:3300/0 conn(0x7f87c00d0ea0 0x7f87c00d1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.077+0000 7f87bffff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f87c0163670 0x7f87c0073a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46898/0 (socket says 172.21.15.114:46898) 2024-04-28T13:07:37.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.077+0000 7f8087fff640 1 --2- 172.21.15.114:0/1613025984 >> v2:172.21.15.134:3300/0 conn(0x7f808806e560 0x7f8088072100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.077+0000 7f95f37fe640 1 --2- 172.21.15.114:0/1288888959 >> v2:172.21.15.134:3300/0 conn(0x7f95ec0dfcb0 0x7f95ec005ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.077+0000 7f87c4ad6640 1 -- 172.21.15.114:0/406653986 >> v2:172.21.15.114:3300/0 conn(0x7f87c00d0ea0 msgr2=0x7f87c00d1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:37.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.077+0000 7f87c4ad6640 1 --2- 172.21.15.114:0/406653986 >> v2:172.21.15.114:3300/0 conn(0x7f87c00d0ea0 0x7f87c00d1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.077+0000 7f87c4ad6640 1 -- 172.21.15.114:0/406653986 >> v1:172.21.15.114:6789/0 conn(0x7f87c0163670 legacy=0x7f87c0073a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.077+0000 7f87c4ad6640 1 -- 172.21.15.114:0/406653986 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c0167430 con 0x7f87c0072210 2024-04-28T13:07:37.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.077+0000 7f95f2ffd640 1 -- 172.21.15.114:0/1288888959 >> v2:172.21.15.134:3300/0 conn(0x7f95ec0dfcb0 msgr2=0x7f95ec005ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:37.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.077+0000 7f95f2ffd640 1 --2- 172.21.15.114:0/1288888959 >> v2:172.21.15.134:3300/0 conn(0x7f95ec0dfcb0 0x7f95ec005ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.077+0000 7f95f2ffd640 1 -- 172.21.15.114:0/1288888959 >> v1:172.21.15.134:6789/0 conn(0x7f95ec054690 legacy=0x7f95ec0df5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.077+0000 7f80877fe640 1 --2- 172.21.15.114:0/1613025984 >> v2:172.21.15.114:3300/0 conn(0x7f8088164720 0x7f808806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.078+0000 7f95f2ffd640 1 -- 172.21.15.114:0/1288888959 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95ec0538d0 con 0x7f95ec0df1c0 2024-04-28T13:07:37.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.078+0000 7f95f37fe640 1 --2- 172.21.15.114:0/1288888959 >> v2:172.21.15.134:3300/0 conn(0x7f95ec0dfcb0 0x7f95ec005ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:07:37.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.078+0000 7f2db62c0640 1 Processor -- start 2024-04-28T13:07:37.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.078+0000 7f8087fff640 1 -- 172.21.15.114:0/1613025984 >> v2:172.21.15.114:3300/0 conn(0x7f8088164720 msgr2=0x7f808806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:37.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.078+0000 7f8087fff640 1 --2- 172.21.15.114:0/1613025984 >> v2:172.21.15.114:3300/0 conn(0x7f8088164720 0x7f808806e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.078+0000 7f8087fff640 1 -- 172.21.15.114:0/1613025984 >> v1:172.21.15.134:6789/0 conn(0x7f8088167290 legacy=0x7f80881676c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:37.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.078+0000 7f8087fff640 1 -- 172.21.15.114:0/1613025984 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8088072a40 con 0x7f808806e560 2024-04-28T13:07:37.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.078+0000 7f2db62c0640 1 -- start start 2024-04-28T13:07:37.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.078+0000 7f95f2ffd640 1 --2- 172.21.15.114:0/1288888959 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95ec0df1c0 0x7f95ec04fff0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f95e8007360 tx=0x7f95e802a140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71088c388c3b2e05 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:37.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.078+0000 7ff5cbfff640 1 Processor -- start 2024-04-28T13:07:37.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.079+0000 7f95f1ffb640 1 -- 172.21.15.114:0/1288888959 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e80089e0 con 0x7f95ec0df1c0 2024-04-28T13:07:37.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.079+0000 7f87c4ad6640 1 --2- 172.21.15.114:0/406653986 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f87c0072210 0x7f87c00726a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f87b8009e50 tx=0x7f87b802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=488af23b121f8710 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:37.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.079+0000 7f95f1ffb640 1 -- 172.21.15.114:0/1288888959 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95e8008b80 con 0x7f95ec0df1c0 2024-04-28T13:07:37.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.079+0000 7f95f1ffb640 1 -- 172.21.15.114:0/1288888959 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e800a0d0 con 0x7f95ec0df1c0 2024-04-28T13:07:37.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.079+0000 7ff5cbfff640 1 -- start start 2024-04-28T13:07:37.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.079+0000 7f87beffd640 1 -- 172.21.15.114:0/406653986 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b8036070 con 0x7f87c0072210 2024-04-28T13:07:37.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.079+0000 7f87beffd640 1 -- 172.21.15.114:0/406653986 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87b8031600 con 0x7f87c0072210 2024-04-28T13:07:37.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.079+0000 7f2db62c0640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2da803ad50 0x7f2da8054cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.079+0000 7f2db62c0640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2da8050090 0x7f2da8050520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.079+0000 7f2db62c0640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2da8053c30 con 0x7f2da80df6f0 2024-04-28T13:07:37.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.079+0000 7f2db62c0640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f2da8053f10 con 0x7f2da8050090 2024-04-28T13:07:37.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.079+0000 7f2db62c0640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2da80541f0 con 0x7f2da803ad50 2024-04-28T13:07:37.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.080+0000 7f2db4abd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2da803ad50 0x7f2da8054cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.080+0000 7f2db4abd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2da803ad50 0x7f2da8054cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:58594/0 (socket says 172.21.15.114:58594) 2024-04-28T13:07:37.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.080+0000 7f87beffd640 1 -- 172.21.15.114:0/406653986 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b80319d0 con 0x7f87c0072210 2024-04-28T13:07:37.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.080+0000 7f2db4abd640 1 -- 172.21.15.114:0/1495653643 learned_addr learned my addr 172.21.15.114:0/1495653643 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:37.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.080+0000 7f438495f640 1 Processor -- start 2024-04-28T13:07:37.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.080+0000 7f2db5abf640 1 --2- 172.21.15.114:0/1495653643 >> v2:172.21.15.134:3300/0 conn(0x7f2da8050090 0x7f2da8050520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.080+0000 7f438495f640 1 -- start start 2024-04-28T13:07:37.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.080+0000 7ff5cbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff5cc15f1f0 0x7ff5cc0b5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.080+0000 7f87c52d7640 1 -- 172.21.15.114:0/406653986 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f87c0072210 msgr2=0x7f87c00726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.080+0000 7f87c52d7640 1 --2- 172.21.15.114:0/406653986 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f87c0072210 0x7f87c00726a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f87b8009e50 tx=0x7f87b802a710 comp rx=0 tx=0).stop 2024-04-28T13:07:37.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.080+0000 7ff5cbfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff5cc0d2410 0x7ff5cc0d2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.080+0000 7ff5cbfff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5cc15f5d0 con 0x7ff5cc0d18a0 2024-04-28T13:07:37.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.080+0000 7ff5cbfff640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7ff5cc0b5730 con 0x7ff5cc15f1f0 2024-04-28T13:07:37.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.080+0000 7ff5cbfff640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ff5cc0b4b20 con 0x7ff5cc0d2410 2024-04-28T13:07:37.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.080+0000 7f87c52d7640 1 -- 172.21.15.114:0/406653986 shutdown_connections 2024-04-28T13:07:37.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.080+0000 7f87c52d7640 1 --2- 172.21.15.114:0/406653986 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f87c0072210 0x7f87c00726a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.080+0000 7f87c52d7640 1 --2- 172.21.15.114:0/406653986 >> v2:172.21.15.114:3300/0 conn(0x7f87c00d0ea0 0x7f87c00d1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.080+0000 7f87c52d7640 1 -- 172.21.15.114:0/406653986 >> 172.21.15.114:0/406653986 conn(0x7f87c006c530 msgr2=0x7f87c006c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:37.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.080+0000 7ff5caffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff5cc15f1f0 0x7ff5cc0b5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.080+0000 7ff5caffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff5cc15f1f0 0x7ff5cc0b5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48292/0 (socket says 172.21.15.114:48292) 2024-04-28T13:07:37.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.080+0000 7ff5caffd640 1 -- 172.21.15.114:0/3832351013 learned_addr learned my addr 172.21.15.114:0/3832351013 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:37.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.080+0000 7f2db4abd640 1 -- 172.21.15.114:0/1495653643 >> v2:172.21.15.134:3300/0 conn(0x7f2da8050090 msgr2=0x7f2da8050520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:37.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.080+0000 7f2db4abd640 1 --2- 172.21.15.114:0/1495653643 >> v2:172.21.15.134:3300/0 conn(0x7f2da8050090 0x7f2da8050520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.080+0000 7f2db4abd640 1 -- 172.21.15.114:0/1495653643 >> v1:172.21.15.114:6789/0 conn(0x7f2da80df6f0 legacy=0x7f2da8053400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.080+0000 7f2db4abd640 1 -- 172.21.15.114:0/1495653643 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2da80544d0 con 0x7f2da803ad50 2024-04-28T13:07:37.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.081+0000 7f8087fff640 1 --2- 172.21.15.114:0/1613025984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f808806e560 0x7f8088072100 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f80880b3770 tx=0x7f808002a640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcbfa4c920bc9424 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:37.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.081+0000 7ff5cb7fe640 1 --2- 172.21.15.114:0/3832351013 >> v2:172.21.15.134:3300/0 conn(0x7ff5cc0d2410 0x7ff5cc0d2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.081+0000 7ff5caffd640 1 -- 172.21.15.114:0/3832351013 >> v2:172.21.15.134:3300/0 conn(0x7ff5cc0d2410 msgr2=0x7ff5cc0d2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:37.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.081+0000 7ff5caffd640 1 --2- 172.21.15.114:0/3832351013 >> v2:172.21.15.134:3300/0 conn(0x7ff5cc0d2410 0x7ff5cc0d2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.081+0000 7ff5caffd640 1 -- 172.21.15.114:0/3832351013 >> v1:172.21.15.114:6789/0 conn(0x7ff5cc0d18a0 legacy=0x7ff5cc0d1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.081+0000 7ff5c9ffb640 1 -- 172.21.15.114:0/3832351013 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3093796849 0 0) 0x7ff5cc15f5d0 con 0x7ff5cc0d18a0 2024-04-28T13:07:37.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.081+0000 7f8086ffd640 1 -- 172.21.15.114:0/1613025984 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8080007740 con 0x7f808806e560 2024-04-28T13:07:37.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.081+0000 7ff5caffd640 1 -- 172.21.15.114:0/3832351013 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5cc0b4e00 con 0x7ff5cc15f1f0 2024-04-28T13:07:37.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.081+0000 7f2db4abd640 1 --2- 172.21.15.114:0/1495653643 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2da803ad50 0x7f2da8054cd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2db0063ef0 tx=0x7f2db00a8bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbef0619e33a839a server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:37.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.081+0000 7f8086ffd640 1 -- 172.21.15.114:0/1613025984 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80800078e0 con 0x7f808806e560 2024-04-28T13:07:37.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.081+0000 7f8086ffd640 1 -- 172.21.15.114:0/1613025984 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8080007cf0 con 0x7f808806e560 2024-04-28T13:07:37.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.081+0000 7f438495f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f43780dfec0 0x7f4378052600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.081+0000 7f2da7fff640 1 -- 172.21.15.114:0/1495653643 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db00aa9e0 con 0x7f2da803ad50 2024-04-28T13:07:37.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.081+0000 7f2da7fff640 1 -- 172.21.15.114:0/1495653643 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2db00aab80 con 0x7f2da803ad50 2024-04-28T13:07:37.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.081+0000 7f2da7fff640 1 -- 172.21.15.114:0/1495653643 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db00a9440 con 0x7f2da803ad50 2024-04-28T13:07:37.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.081+0000 7f438495f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4378050270 0x7f43780506f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.081+0000 7f438495f640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4378039dd0 con 0x7f43780398d0 2024-04-28T13:07:37.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.081+0000 7f438495f640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f437803a0b0 con 0x7f43780dfec0 2024-04-28T13:07:37.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.081+0000 7f438495f640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f437804f080 con 0x7f4378050270 2024-04-28T13:07:37.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.081+0000 7f437dd9b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f43780398d0 0x7f437804fb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46918/0 (socket says 172.21.15.114:46918) 2024-04-28T13:07:37.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.081+0000 7f437dd9b640 1 -- 172.21.15.114:0/657980036 learned_addr learned my addr 172.21.15.114:0/657980036 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:37.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.081+0000 7f437e59c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f43780dfec0 0x7f4378052600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.082+0000 7f437ed9d640 1 --2- 172.21.15.114:0/657980036 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4378050270 0x7f43780506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.082+0000 7f437e59c640 1 -- 172.21.15.114:0/657980036 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4378050270 msgr2=0x7f43780506f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:37.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.082+0000 7f437e59c640 1 --2- 172.21.15.114:0/657980036 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4378050270 0x7f43780506f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.082+0000 7ff5caffd640 1 --2- 172.21.15.114:0/3832351013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5cc15f1f0 0x7ff5cc0b5bc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc08e760 tx=0x7ff5b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9cd34cfb77840 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:37.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.081+0000 7f95f959d640 1 -- 172.21.15.114:0/1288888959 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95ec0df1c0 msgr2=0x7f95ec04fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.082+0000 7f95f959d640 1 --2- 172.21.15.114:0/1288888959 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95ec0df1c0 0x7f95ec04fff0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f95e8007360 tx=0x7f95e802a140 comp rx=0 tx=0).stop 2024-04-28T13:07:37.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.082+0000 7f437e59c640 1 -- 172.21.15.114:0/657980036 >> v1:172.21.15.114:6789/0 conn(0x7f43780398d0 legacy=0x7f437804fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.082+0000 7f437e59c640 1 -- 172.21.15.114:0/657980036 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f437804f360 con 0x7f43780dfec0 2024-04-28T13:07:37.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.082+0000 7f808ea5b640 1 -- 172.21.15.114:0/1613025984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f808806e560 msgr2=0x7f8088072100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.082+0000 7f808ea5b640 1 --2- 172.21.15.114:0/1613025984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f808806e560 0x7f8088072100 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f80880b3770 tx=0x7f808002a640 comp rx=0 tx=0).stop 2024-04-28T13:07:37.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.082+0000 7f87c52d7640 1 -- 172.21.15.114:0/406653986 shutdown_connections 2024-04-28T13:07:37.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.082+0000 7f808ea5b640 1 -- 172.21.15.114:0/1613025984 shutdown_connections 2024-04-28T13:07:37.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.082+0000 7f808ea5b640 1 --2- 172.21.15.114:0/1613025984 >> v2:172.21.15.114:3300/0 conn(0x7f8088164720 0x7f808806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.082+0000 7f808ea5b640 1 --2- 172.21.15.114:0/1613025984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f808806e560 0x7f8088072100 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.082+0000 7f808ea5b640 1 -- 172.21.15.114:0/1613025984 >> 172.21.15.114:0/1613025984 conn(0x7f80880b2b60 msgr2=0x7f80880b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:37.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.082+0000 7f95f959d640 1 -- 172.21.15.114:0/1288888959 shutdown_connections 2024-04-28T13:07:37.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.082+0000 7f95f959d640 1 --2- 172.21.15.114:0/1288888959 >> v2:172.21.15.134:3300/0 conn(0x7f95ec0dfcb0 0x7f95ec005ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.082+0000 7f95f959d640 1 --2- 172.21.15.114:0/1288888959 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95ec0df1c0 0x7f95ec04fff0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.082+0000 7f95f959d640 1 -- 172.21.15.114:0/1288888959 >> 172.21.15.114:0/1288888959 conn(0x7f95ec009fe0 msgr2=0x7f95ec00a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:37.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.082+0000 7f2db62c0640 1 -- 172.21.15.114:0/1495653643 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2da803ad50 msgr2=0x7f2da8054cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.082+0000 7f2db62c0640 1 --2- 172.21.15.114:0/1495653643 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2da803ad50 0x7f2da8054cd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2db0063ef0 tx=0x7f2db00a8bc0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.082+0000 7f2db62c0640 1 -- 172.21.15.114:0/1495653643 shutdown_connections 2024-04-28T13:07:37.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.082+0000 7f2db62c0640 1 --2- 172.21.15.114:0/1495653643 >> v2:172.21.15.134:3300/0 conn(0x7f2da8050090 0x7f2da8050520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.082+0000 7f2db62c0640 1 --2- 172.21.15.114:0/1495653643 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2da803ad50 0x7f2da8054cd0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.082+0000 7f2db62c0640 1 -- 172.21.15.114:0/1495653643 >> 172.21.15.114:0/1495653643 conn(0x7f2da8055350 msgr2=0x7f2da8055760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:37.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.083+0000 7f2db62c0640 1 -- 172.21.15.114:0/1495653643 shutdown_connections 2024-04-28T13:07:37.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.083+0000 7f2db62c0640 1 -- 172.21.15.114:0/1495653643 wait complete. 2024-04-28T13:07:37.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.083+0000 7f808ea5b640 1 -- 172.21.15.114:0/1613025984 shutdown_connections 2024-04-28T13:07:37.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.082+0000 7f87c52d7640 1 -- 172.21.15.114:0/406653986 wait complete. 2024-04-28T13:07:37.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.083+0000 7f95f959d640 1 -- 172.21.15.114:0/1288888959 shutdown_connections 2024-04-28T13:07:37.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.083+0000 7ff5c9ffb640 1 -- 172.21.15.114:0/3832351013 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4037070 con 0x7ff5cc15f1f0 2024-04-28T13:07:37.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.083+0000 7f437e59c640 1 --2- 172.21.15.114:0/657980036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43780dfec0 0x7f4378052600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f43740097a0 tx=0x7f437402c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb66b02b57d89034 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:37.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.083+0000 7ff5c9ffb640 1 -- 172.21.15.114:0/3832351013 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5b4032440 con 0x7ff5cc15f1f0 2024-04-28T13:07:37.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.083+0000 7f437d59a640 1 -- 172.21.15.114:0/657980036 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4374039070 con 0x7f43780dfec0 2024-04-28T13:07:37.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.084+0000 7f437d59a640 1 -- 172.21.15.114:0/657980036 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f437402ce50 con 0x7f43780dfec0 2024-04-28T13:07:37.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.084+0000 7ff5cbfff640 1 -- 172.21.15.114:0/3832351013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5cc15f1f0 msgr2=0x7ff5cc0b5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.084+0000 7ff5c9ffb640 1 -- 172.21.15.114:0/3832351013 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4037070 con 0x7ff5cc15f1f0 2024-04-28T13:07:37.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.084+0000 7ff5cbfff640 1 --2- 172.21.15.114:0/3832351013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5cc15f1f0 0x7ff5cc0b5bc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc08e760 tx=0x7ff5b402a270 comp rx=0 tx=0).stop 2024-04-28T13:07:37.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.084+0000 7f87c52d7640 1 Processor -- start 2024-04-28T13:07:37.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.084+0000 7f2db62c0640 1 Processor -- start 2024-04-28T13:07:37.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.084+0000 7f437d59a640 1 -- 172.21.15.114:0/657980036 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4374039070 con 0x7f43780dfec0 2024-04-28T13:07:37.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.084+0000 7f2db62c0640 1 -- start start 2024-04-28T13:07:37.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.083+0000 7f808ea5b640 1 -- 172.21.15.114:0/1613025984 wait complete. 2024-04-28T13:07:37.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.085+0000 7ff5cbfff640 1 -- 172.21.15.114:0/3832351013 shutdown_connections 2024-04-28T13:07:37.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.085+0000 7ff5cbfff640 1 --2- 172.21.15.114:0/3832351013 >> v2:172.21.15.134:3300/0 conn(0x7ff5cc0d2410 0x7ff5cc0d2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.085+0000 7ff5cbfff640 1 --2- 172.21.15.114:0/3832351013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5cc15f1f0 0x7ff5cc0b5bc0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.085+0000 7ff5cbfff640 1 -- 172.21.15.114:0/3832351013 >> 172.21.15.114:0/3832351013 conn(0x7ff5cc08ea70 msgr2=0x7ff5cc09e390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:37.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.084+0000 7f808ea5b640 1 Processor -- start 2024-04-28T13:07:37.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.085+0000 7f87c52d7640 1 -- start start 2024-04-28T13:07:37.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.085+0000 7f438495f640 1 -- 172.21.15.114:0/657980036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43780dfec0 msgr2=0x7f4378052600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.083+0000 7f95f959d640 1 -- 172.21.15.114:0/1288888959 wait complete. 2024-04-28T13:07:37.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.085+0000 7f95f959d640 1 Processor -- start 2024-04-28T13:07:37.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.085+0000 7f438495f640 1 --2- 172.21.15.114:0/657980036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43780dfec0 0x7f4378052600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f43740097a0 tx=0x7f437402c300 comp rx=0 tx=0).stop 2024-04-28T13:07:37.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.085+0000 7f438495f640 1 -- 172.21.15.114:0/657980036 shutdown_connections 2024-04-28T13:07:37.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.085+0000 7f438495f640 1 --2- 172.21.15.114:0/657980036 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4378050270 0x7f43780506f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.085+0000 7f438495f640 1 --2- 172.21.15.114:0/657980036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43780dfec0 0x7f4378052600 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.085+0000 7f438495f640 1 -- 172.21.15.114:0/657980036 >> 172.21.15.114:0/657980036 conn(0x7f4378009fb0 msgr2=0x7f437800a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:37.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.085+0000 7ff5cbfff640 1 -- 172.21.15.114:0/3832351013 shutdown_connections 2024-04-28T13:07:37.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.085+0000 7f2db62c0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2da803ad50 0x7f2da804d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.085+0000 7f2db62c0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2da8050090 0x7f2da8036b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.085+0000 7ff5cbfff640 1 -- 172.21.15.114:0/3832351013 wait complete. 2024-04-28T13:07:37.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.086+0000 7f2db62c0640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2da80df6f0 0x7f2da80d6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.085+0000 7f95f959d640 1 -- start start 2024-04-28T13:07:37.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.086+0000 7f2db62c0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2da80063c0 con 0x7f2da803ad50 2024-04-28T13:07:37.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.086+0000 7f2db62c0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2da8006240 con 0x7f2da8050090 2024-04-28T13:07:37.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.086+0000 7f2db62c0640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2da8006540 con 0x7f2da80df6f0 2024-04-28T13:07:37.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.085+0000 7f808ea5b640 1 -- start start 2024-04-28T13:07:37.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.086+0000 7f2db5abf640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2da80df6f0 0x7f2da80d6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.086+0000 7f87c52d7640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f87c0072210 0x7f87c01654b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.086+0000 7f87c52d7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87c00d0ea0 0x7f87c01659f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.086+0000 7f2db5abf640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2da80df6f0 0x7f2da80d6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:58606/0 (socket says 172.21.15.114:58606) 2024-04-28T13:07:37.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.086+0000 7f2db5abf640 1 -- 172.21.15.114:0/2647236793 learned_addr learned my addr 172.21.15.114:0/2647236793 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:37.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.086+0000 7f87c52d7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87c0163670 0x7f87c01eced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.086+0000 7f2db52be640 1 --2- 172.21.15.114:0/2647236793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2da803ad50 0x7f2da804d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.086+0000 7f808ea5b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f808806e560 0x7f8088162620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.086+0000 7f87c52d7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f87c0167cd0 con 0x7f87c0163670 2024-04-28T13:07:37.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.086+0000 7f87c52d7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f87c01679f0 con 0x7f87c00d0ea0 2024-04-28T13:07:37.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.086+0000 7f87c52d7640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f87c0167100 con 0x7f87c0072210 2024-04-28T13:07:37.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.086+0000 7f87c4ad6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87c0163670 0x7f87c01eced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.086+0000 7f438495f640 1 -- 172.21.15.114:0/657980036 shutdown_connections 2024-04-28T13:07:37.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.086+0000 7f2db52be640 1 -- 172.21.15.114:0/2647236793 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2da80df6f0 msgr2=0x7f2da80d6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.086+0000 7f95f959d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95ec054690 0x7f95ec0d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.086+0000 7f95f959d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95ec0df1c0 0x7f95ec04a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.086+0000 7f87c4ad6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87c0163670 0x7f87c01eced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48320/0 (socket says 172.21.15.114:48320) 2024-04-28T13:07:37.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.086+0000 7f87c4ad6640 1 -- 172.21.15.114:0/2819595851 learned_addr learned my addr 172.21.15.114:0/2819595851 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:37.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.086+0000 7f2db52be640 1 --2- 172.21.15.114:0/2647236793 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2da80df6f0 0x7f2da80d6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.086+0000 7f2db52be640 1 -- 172.21.15.114:0/2647236793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2da8050090 msgr2=0x7f2da8036b20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-28T13:07:37.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.087+0000 7f95f959d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95ec0dfcb0 0x7f95ec039640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.087+0000 7f95f27fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95ec0df1c0 0x7f95ec04a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.087+0000 7f95f27fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95ec0df1c0 0x7f95ec04a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48322/0 (socket says 172.21.15.114:48322) 2024-04-28T13:07:37.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.087+0000 7f95f27fc640 1 -- 172.21.15.114:0/3347358610 learned_addr learned my addr 172.21.15.114:0/3347358610 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:37.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.086+0000 7f2db52be640 1 --2- 172.21.15.114:0/2647236793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2da8050090 0x7f2da8036b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.086+0000 7f2db52be640 1 -- 172.21.15.114:0/2647236793 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2da8037290 con 0x7f2da803ad50 2024-04-28T13:07:37.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.086+0000 7f2db5abf640 1 --2- 172.21.15.114:0/2647236793 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2da80df6f0 0x7f2da80d6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:07:37.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.087+0000 7f95f959d640 1 -- 172.21.15.114:0/3347358610 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec054170 con 0x7f95ec0df1c0 2024-04-28T13:07:37.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.087+0000 7f2db52be640 1 --2- 172.21.15.114:0/2647236793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2da803ad50 0x7f2da804d150 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2da000c390 tx=0x7f2da000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:37.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.087+0000 7f95f959d640 1 -- 172.21.15.114:0/3347358610 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec053e90 con 0x7f95ec054690 2024-04-28T13:07:37.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.087+0000 7f95f959d640 1 -- 172.21.15.114:0/3347358610 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f95ec050530 con 0x7f95ec0dfcb0 2024-04-28T13:07:37.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.087+0000 7f2da5ffb640 1 -- 172.21.15.114:0/2647236793 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da0017070 con 0x7f2da803ad50 2024-04-28T13:07:37.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.087+0000 7f87bf7fe640 1 --2- 172.21.15.114:0/2819595851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87c00d0ea0 0x7f87c01659f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.087+0000 7f2da5ffb640 1 -- 172.21.15.114:0/2647236793 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2da00052d0 con 0x7f2da803ad50 2024-04-28T13:07:37.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.087+0000 7f2db62c0640 1 -- 172.21.15.114:0/2647236793 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2da8034ee0 con 0x7f2da803ad50 2024-04-28T13:07:37.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.088+0000 7f2db62c0640 1 -- 172.21.15.114:0/2647236793 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2da8035180 con 0x7f2da803ad50 2024-04-28T13:07:37.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.087+0000 7f95f2ffd640 1 --2- 172.21.15.114:0/3347358610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95ec054690 0x7f95ec0d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.087+0000 7f95f37fe640 1 --2- 172.21.15.114:0/3347358610 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95ec0dfcb0 0x7f95ec039640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.087+0000 7f95f27fc640 1 -- 172.21.15.114:0/3347358610 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95ec0dfcb0 msgr2=0x7f95ec039640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.087+0000 7f95f27fc640 1 --2- 172.21.15.114:0/3347358610 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95ec0dfcb0 0x7f95ec039640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.087+0000 7f95f27fc640 1 -- 172.21.15.114:0/3347358610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95ec054690 msgr2=0x7f95ec0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.087+0000 7f95f27fc640 1 --2- 172.21.15.114:0/3347358610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95ec054690 0x7f95ec0d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.088+0000 7f95f27fc640 1 -- 172.21.15.114:0/3347358610 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95ec04bfa0 con 0x7f95ec0df1c0 2024-04-28T13:07:37.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.088+0000 7f95f27fc640 1 --2- 172.21.15.114:0/3347358610 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95ec0df1c0 0x7f95ec04a3f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f95f406c300 tx=0x7f95f4069ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:37.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.086+0000 7f808ea5b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8088164720 0x7f8088160d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.086+0000 7f808ea5b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8088167290 0x7f80880aa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.087+0000 7f808ea5b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f80880732e0 con 0x7f8088164720 2024-04-28T13:07:37.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.087+0000 7f808ea5b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8088073000 con 0x7f8088167290 2024-04-28T13:07:37.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.087+0000 7f808ea5b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f80880b6a90 con 0x7f808806e560 2024-04-28T13:07:37.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.087+0000 7f808cff8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8088167290 0x7f80880aa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.087+0000 7f808cff8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8088167290 0x7f80880aa6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:50206/0 (socket says 172.21.15.114:50206) 2024-04-28T13:07:37.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.087+0000 7f808cff8640 1 -- 172.21.15.114:0/32643222 learned_addr learned my addr 172.21.15.114:0/32643222 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:37.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.087+0000 7f8087fff640 1 --2- 172.21.15.114:0/32643222 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f808806e560 0x7f8088162620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.088+0000 7f808cff8640 1 -- 172.21.15.114:0/32643222 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f808806e560 msgr2=0x7f8088162620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.088+0000 7f808cff8640 1 --2- 172.21.15.114:0/32643222 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f808806e560 0x7f8088162620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.088+0000 7f808cff8640 1 -- 172.21.15.114:0/32643222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8088164720 msgr2=0x7f8088160d30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-28T13:07:37.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.088+0000 7f808cff8640 1 --2- 172.21.15.114:0/32643222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8088164720 0x7f8088160d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.088+0000 7f808cff8640 1 -- 172.21.15.114:0/32643222 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8088161580 con 0x7f8088167290 2024-04-28T13:07:37.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.086+0000 7f438495f640 1 -- 172.21.15.114:0/657980036 wait complete. 2024-04-28T13:07:37.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.089+0000 7f438495f640 1 Processor -- start 2024-04-28T13:07:37.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.089+0000 7f2da5ffb640 1 -- 172.21.15.114:0/2647236793 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da0003810 con 0x7f2da803ad50 2024-04-28T13:07:37.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.088+0000 7f87c4ad6640 1 -- 172.21.15.114:0/2819595851 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f87c0072210 msgr2=0x7f87c01654b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-28T13:07:37.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.088+0000 7f87c4ad6640 1 --2- 172.21.15.114:0/2819595851 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f87c0072210 0x7f87c01654b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.088+0000 7f87c4ad6640 1 -- 172.21.15.114:0/2819595851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87c00d0ea0 msgr2=0x7f87c01659f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.088+0000 7f87c4ad6640 1 --2- 172.21.15.114:0/2819595851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87c00d0ea0 0x7f87c01659f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.088+0000 7f87c4ad6640 1 -- 172.21.15.114:0/2819595851 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c0166170 con 0x7f87c0163670 2024-04-28T13:07:37.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.087+0000 7ff5cbfff640 1 Processor -- start 2024-04-28T13:07:37.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.087+0000 7ff5cbfff640 1 -- start start 2024-04-28T13:07:37.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.088+0000 7ff5cbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5cc0d18a0 0x7ff5cc15b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.088+0000 7ff5cbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5cc0d2410 0x7ff5cc0a0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.089+0000 7ff5cbfff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5cc15f1f0 0x7ff5cc160dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.089+0000 7ff5cbfff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff5cc0b46d0 con 0x7ff5cc0d2410 2024-04-28T13:07:37.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.089+0000 7ff5cbfff640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff5cc0b53c0 con 0x7ff5cc0d18a0 2024-04-28T13:07:37.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.089+0000 7ff5cbfff640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff5cc0b4850 con 0x7ff5cc15f1f0 2024-04-28T13:07:37.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.089+0000 7f95db7fe640 1 -- 172.21.15.114:0/3347358610 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f4070db0 con 0x7f95ec0df1c0 2024-04-28T13:07:37.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.089+0000 7f95f959d640 1 -- 172.21.15.114:0/3347358610 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95ec04c280 con 0x7f95ec0df1c0 2024-04-28T13:07:37.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.089+0000 7f95f959d640 1 -- 172.21.15.114:0/3347358610 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95ec04c840 con 0x7f95ec0df1c0 2024-04-28T13:07:37.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.089+0000 7f95db7fe640 1 -- 172.21.15.114:0/3347358610 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95f4074130 con 0x7f95ec0df1c0 2024-04-28T13:07:37.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.089+0000 7f95db7fe640 1 -- 172.21.15.114:0/3347358610 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f4074520 con 0x7f95ec0df1c0 2024-04-28T13:07:37.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.089+0000 7f438495f640 1 -- start start 2024-04-28T13:07:37.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.089+0000 7f808cff8640 1 --2- 172.21.15.114:0/32643222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8088167290 0x7f80880aa6b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f807c00c3e0 tx=0x7f807c00c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:37.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.089+0000 7f8084ff9640 1 -- 172.21.15.114:0/32643222 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807c028070 con 0x7f8088167290 2024-04-28T13:07:37.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.089+0000 7f808ea5b640 1 -- 172.21.15.114:0/32643222 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80881618c0 con 0x7f8088167290 2024-04-28T13:07:37.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.089+0000 7f808ea5b640 1 -- 172.21.15.114:0/32643222 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8088162100 con 0x7f8088167290 2024-04-28T13:07:37.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.090+0000 7f8084ff9640 1 -- 172.21.15.114:0/32643222 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f807c005ae0 con 0x7f8088167290 2024-04-28T13:07:37.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.090+0000 7f8084ff9640 1 -- 172.21.15.114:0/32643222 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807c0070d0 con 0x7f8088167290 2024-04-28T13:07:37.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.090+0000 7f2db62c0640 1 -- 172.21.15.114:0/2647236793 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d90005290 con 0x7f2da803ad50 2024-04-28T13:07:37.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.090+0000 7f87c4ad6640 1 --2- 172.21.15.114:0/2819595851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87c0163670 0x7f87c01eced0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f87b8009f70 tx=0x7f87b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:37.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.089+0000 7ff5caffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5cc0d18a0 0x7ff5cc15b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.089+0000 7ff5cb7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5cc15f1f0 0x7ff5cc160dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.089+0000 7ff5caffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5cc0d18a0 0x7ff5cc15b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:50212/0 (socket says 172.21.15.114:50212) 2024-04-28T13:07:37.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.089+0000 7ff5caffd640 1 -- 172.21.15.114:0/1450648851 learned_addr learned my addr 172.21.15.114:0/1450648851 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:37.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.090+0000 7ff5ca7fc640 1 --2- 172.21.15.114:0/1450648851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5cc0d2410 0x7ff5cc0a0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.090+0000 7f2da5ffb640 1 -- 172.21.15.114:0/2647236793 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2da001a070 con 0x7f2da803ad50 2024-04-28T13:07:37.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.090+0000 7ff5cb7fe640 1 -- 172.21.15.114:0/1450648851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5cc0d18a0 msgr2=0x7ff5cc15b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.090+0000 7ff5cb7fe640 1 --2- 172.21.15.114:0/1450648851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5cc0d18a0 0x7ff5cc15b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.090+0000 7ff5cb7fe640 1 -- 172.21.15.114:0/1450648851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5cc0d2410 msgr2=0x7ff5cc0a0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.090+0000 7ff5cb7fe640 1 --2- 172.21.15.114:0/1450648851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5cc0d2410 0x7ff5cc0a0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.090+0000 7ff5cb7fe640 1 -- 172.21.15.114:0/1450648851 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5cc0a0ce0 con 0x7ff5cc15f1f0 2024-04-28T13:07:37.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.091+0000 7ff5cb7fe640 1 --2- 172.21.15.114:0/1450648851 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5cc15f1f0 0x7ff5cc160dc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff5c400ef90 tx=0x7ff5c400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:37.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.091+0000 7f2da5ffb640 1 --2- 172.21.15.114:0/2647236793 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2d9406c8f0 0x7f2d9406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.091+0000 7ff5c37fe640 1 -- 172.21.15.114:0/1450648851 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4018020 con 0x7ff5cc15f1f0 2024-04-28T13:07:37.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.091+0000 7f2da5ffb640 1 -- 172.21.15.114:0/2647236793 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2da008ad00 con 0x7f2da803ad50 2024-04-28T13:07:37.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.091+0000 7ff5c37fe640 1 -- 172.21.15.114:0/1450648851 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5c4014480 con 0x7ff5cc15f1f0 2024-04-28T13:07:37.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.091+0000 7ff5c37fe640 1 -- 172.21.15.114:0/1450648851 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4014870 con 0x7ff5cc15f1f0 2024-04-28T13:07:37.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.092+0000 7f95f959d640 1 -- 172.21.15.114:0/3347358610 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95d4005290 con 0x7f95ec0df1c0 2024-04-28T13:07:37.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.092+0000 7f8084ff9640 1 -- 172.21.15.114:0/32643222 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f807c02b070 con 0x7f8088167290 2024-04-28T13:07:37.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.092+0000 7ff5cbfff640 1 -- 172.21.15.114:0/1450648851 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5cc0ce310 con 0x7ff5cc15f1f0 2024-04-28T13:07:37.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.092+0000 7ff5cbfff640 1 -- 172.21.15.114:0/1450648851 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5cc0ce8d0 con 0x7ff5cc15f1f0 2024-04-28T13:07:37.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.092+0000 7f438495f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43780398d0 0x7f4378185600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.092+0000 7f2db4abd640 1 --2- 172.21.15.114:0/2647236793 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2d9406c8f0 0x7f2d9406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.092+0000 7f438495f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4378050270 0x7f43780dbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.092+0000 7f438495f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43780dfec0 0x7f43780dc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.092+0000 7f437dd9b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4378050270 0x7f43780dbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.092+0000 7f437dd9b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4378050270 0x7f43780dbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:58654/0 (socket says 172.21.15.114:58654) 2024-04-28T13:07:37.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.092+0000 7f437dd9b640 1 -- 172.21.15.114:0/2790078759 learned_addr learned my addr 172.21.15.114:0/2790078759 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:37.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.093+0000 7f438495f640 1 -- 172.21.15.114:0/2790078759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4378052b40 con 0x7f43780dfec0 2024-04-28T13:07:37.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.093+0000 7f438495f640 1 -- 172.21.15.114:0/2790078759 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f43780e02a0 con 0x7f43780398d0 2024-04-28T13:07:37.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.093+0000 7f438495f640 1 -- 172.21.15.114:0/2790078759 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f4378052cc0 con 0x7f4378050270 2024-04-28T13:07:37.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.093+0000 7f95db7fe640 1 -- 172.21.15.114:0/3347358610 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f95f40746c0 con 0x7f95ec0df1c0 2024-04-28T13:07:37.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.093+0000 7f437ed9d640 1 --2- 172.21.15.114:0/2790078759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43780dfec0 0x7f43780dc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.093+0000 7f2db4abd640 1 --2- 172.21.15.114:0/2647236793 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2d9406c8f0 0x7f2d9406edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2da8054370 tx=0x7f2db00ae000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:37.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.093+0000 7f95db7fe640 1 --2- 172.21.15.114:0/3347358610 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f95e006c9f0 0x7f95e006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.093+0000 7ff5cbfff640 1 -- 172.21.15.114:0/1450648851 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5cc0693f0 con 0x7ff5cc15f1f0 2024-04-28T13:07:37.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.093+0000 7f95db7fe640 1 -- 172.21.15.114:0/3347358610 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f95f41080d0 con 0x7f95ec0df1c0 2024-04-28T13:07:37.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.092+0000 7f808ea5b640 1 -- 172.21.15.114:0/32643222 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8068005290 con 0x7f8088167290 2024-04-28T13:07:37.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.092+0000 7f8084ff9640 1 --2- 172.21.15.114:0/32643222 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f807406c940 0x7f807406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.092+0000 7f8084ff9640 1 -- 172.21.15.114:0/32643222 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f807c09bd40 con 0x7f8088167290 2024-04-28T13:07:37.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.093+0000 7f8087fff640 1 --2- 172.21.15.114:0/32643222 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f807406c940 0x7f807406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.094+0000 7f95f2ffd640 1 --2- 172.21.15.114:0/3347358610 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f95e006c9f0 0x7f95e006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.093+0000 7f437ed9d640 1 -- 172.21.15.114:0/2790078759 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4378050270 msgr2=0x7f43780dbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.093+0000 7f437ed9d640 1 --2- 172.21.15.114:0/2790078759 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4378050270 0x7f43780dbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.093+0000 7f437ed9d640 1 -- 172.21.15.114:0/2790078759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43780398d0 msgr2=0x7f4378185600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-28T13:07:37.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.093+0000 7f437ed9d640 1 --2- 172.21.15.114:0/2790078759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43780398d0 0x7f4378185600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.093+0000 7f437ed9d640 1 -- 172.21.15.114:0/2790078759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43780dc9c0 con 0x7f43780dfec0 2024-04-28T13:07:37.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.094+0000 7f437ed9d640 1 --2- 172.21.15.114:0/2790078759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43780dfec0 0x7f43780dc390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4380000b60 tx=0x7f4380069ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:37.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.094+0000 7f95f2ffd640 1 --2- 172.21.15.114:0/3347358610 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f95e006c9f0 0x7f95e006eeb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f95e8033000 tx=0x7f95e802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:37.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.095+0000 7f8087fff640 1 --2- 172.21.15.114:0/32643222 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f807406c940 0x7f807406ee00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8080034000 tx=0x7f808002f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:37.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.095+0000 7ff5c37fe640 1 -- 172.21.15.114:0/1450648851 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff5c4005d10 con 0x7ff5cc15f1f0 2024-04-28T13:07:37.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.096+0000 7ff5c37fe640 1 --2- 172.21.15.114:0/1450648851 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff5ac06c970 0x7ff5ac06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.096+0000 7ff5caffd640 1 --2- 172.21.15.114:0/1450648851 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff5ac06c970 0x7ff5ac06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.096+0000 7ff5c37fe640 1 -- 172.21.15.114:0/1450648851 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff5c408c770 con 0x7ff5cc15f1f0 2024-04-28T13:07:37.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.096+0000 7ff5caffd640 1 --2- 172.21.15.114:0/1450648851 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff5ac06c970 0x7ff5ac06ee30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0ce2a0 tx=0x7ff5b4041040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:37.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.097+0000 7f87bcff9640 1 -- 172.21.15.114:0/2819595851 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b8041020 con 0x7f87c0163670 2024-04-28T13:07:37.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.097+0000 7f2da5ffb640 1 -- 172.21.15.114:0/2647236793 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2da0058ad0 con 0x7f2da803ad50 2024-04-28T13:07:37.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.097+0000 7f87c52d7640 1 -- 172.21.15.114:0/2819595851 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87c009cfa0 con 0x7f87c0163670 2024-04-28T13:07:37.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.097+0000 7f8084ff9640 1 -- 172.21.15.114:0/32643222 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f80881618c0 con 0x7f8088167290 2024-04-28T13:07:37.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.098+0000 7f87c52d7640 1 -- 172.21.15.114:0/2819595851 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87c009d560 con 0x7f87c0163670 2024-04-28T13:07:37.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.099+0000 7f87c52d7640 1 -- 172.21.15.114:0/2819595851 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87c006a3d0 con 0x7f87c0163670 2024-04-28T13:07:37.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.102+0000 7f436effd640 1 -- 172.21.15.114:0/2790078759 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438009a070 con 0x7f43780dfec0 2024-04-28T13:07:37.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.102+0000 7f87bcff9640 1 -- 172.21.15.114:0/2819595851 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87b8031600 con 0x7f87c0163670 2024-04-28T13:07:37.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.102+0000 7f438495f640 1 -- 172.21.15.114:0/2790078759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43780dcca0 con 0x7f43780dfec0 2024-04-28T13:07:37.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.102+0000 7f87bcff9640 1 -- 172.21.15.114:0/2819595851 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b8036040 con 0x7f87c0163670 2024-04-28T13:07:37.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.102+0000 7f438495f640 1 -- 172.21.15.114:0/2790078759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43780dd260 con 0x7f43780dfec0 2024-04-28T13:07:37.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.102+0000 7f95db7fe640 1 -- 172.21.15.114:0/3347358610 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f95f4090030 con 0x7f95ec0df1c0 2024-04-28T13:07:37.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.103+0000 7f436effd640 1 -- 172.21.15.114:0/2790078759 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f438006f450 con 0x7f43780dfec0 2024-04-28T13:07:37.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.104+0000 7f436effd640 1 -- 172.21.15.114:0/2790078759 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43800a4060 con 0x7f43780dfec0 2024-04-28T13:07:37.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.105+0000 7f87bcff9640 1 -- 172.21.15.114:0/2819595851 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f87b8044020 con 0x7f87c0163670 2024-04-28T13:07:37.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.105+0000 7f436effd640 1 -- 172.21.15.114:0/2790078759 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f438009d070 con 0x7f43780dfec0 2024-04-28T13:07:37.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.105+0000 7f438495f640 1 -- 172.21.15.114:0/2790078759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4364005290 con 0x7f43780dfec0 2024-04-28T13:07:37.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.105+0000 7f87bcff9640 1 --2- 172.21.15.114:0/2819595851 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f87ac06c920 0x7f87ac06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.105+0000 7f436effd640 1 --2- 172.21.15.114:0/2790078759 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f436006c8f0 0x7f436006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.106+0000 7f437e59c640 1 --2- 172.21.15.114:0/2790078759 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f436006c8f0 0x7f436006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.106+0000 7f87bffff640 1 --2- 172.21.15.114:0/2819595851 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f87ac06c920 0x7f87ac06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.106+0000 7f87bcff9640 1 -- 172.21.15.114:0/2819595851 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f87b80acef0 con 0x7f87c0163670 2024-04-28T13:07:37.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.106+0000 7f437e59c640 1 --2- 172.21.15.114:0/2790078759 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f436006c8f0 0x7f436006edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4374036000 tx=0x7f4374030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:37.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.107+0000 7f87bffff640 1 --2- 172.21.15.114:0/2819595851 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f87ac06c920 0x7f87ac06ede0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f87c0161d60 tx=0x7f87b00079c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:37.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.107+0000 7ff5c37fe640 1 -- 172.21.15.114:0/1450648851 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff5cc0693f0 con 0x7ff5cc15f1f0 2024-04-28T13:07:37.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.115+0000 7f436effd640 1 -- 172.21.15.114:0/2790078759 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4380106650 con 0x7f43780dfec0 2024-04-28T13:07:37.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.117+0000 7f87bcff9640 1 -- 172.21.15.114:0/2819595851 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f87b804b030 con 0x7f87c0163670 2024-04-28T13:07:37.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.123+0000 7f436effd640 1 -- 172.21.15.114:0/2790078759 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4380092070 con 0x7f43780dfec0 2024-04-28T13:07:37.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.435+0000 7f9c94ff9640 1 -- 172.21.15.114:0/3591820070 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f9c8c005580 con 0x7f9ca80d05a0 2024-04-28T13:07:37.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.436+0000 7f9c96ffd640 1 -- 172.21.15.114:0/3591820070 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9ca0010040 con 0x7f9ca80d05a0 2024-04-28T13:07:37.436 INFO:teuthology.orchestra.run.smithi114.stdout:55834574856 2024-04-28T13:07:37.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.439+0000 7f9cac911640 1 -- 172.21.15.114:0/3591820070 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9c8806c9f0 msgr2=0x7f9c8806eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.439+0000 7f9cac911640 1 --2- 172.21.15.114:0/3591820070 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9c8806c9f0 0x7f9c8806eeb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9ca80b1160 tx=0x7f9c9800d040 comp rx=0 tx=0).stop 2024-04-28T13:07:37.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.439+0000 7f9cac911640 1 -- 172.21.15.114:0/3591820070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ca80d05a0 msgr2=0x7f9ca815c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.439+0000 7f9cac911640 1 --2- 172.21.15.114:0/3591820070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ca80d05a0 0x7f9ca815c4f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9ca000efa0 tx=0x7f9ca000c550 comp rx=0 tx=0).stop 2024-04-28T13:07:37.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.440+0000 7f171f19d640 1 -- 172.21.15.114:0/1394394370 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f17180cd500 con 0x7f171815f610 2024-04-28T13:07:37.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.440+0000 7f9cac911640 1 -- 172.21.15.114:0/3591820070 shutdown_connections 2024-04-28T13:07:37.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.440+0000 7f9cac911640 1 --2- 172.21.15.114:0/3591820070 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ca815b130 0x7f9ca80720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.440+0000 7f17157fa640 1 -- 172.21.15.114:0/1394394370 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1710082990 con 0x7f171815f610 2024-04-28T13:07:37.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.440+0000 7f9cac911640 1 --2- 172.21.15.114:0/3591820070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ca80d05a0 0x7f9ca815c4f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.440+0000 7f9cac911640 1 --2- 172.21.15.114:0/3591820070 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9c8806c9f0 0x7f9c8806eeb0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.440+0000 7f9cac911640 1 --2- 172.21.15.114:0/3591820070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ca80cb360 0x7f9ca8151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.440+0000 7f9cac911640 1 -- 172.21.15.114:0/3591820070 >> 172.21.15.114:0/3591820070 conn(0x7f9ca80b2820 msgr2=0x7f9ca80b06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:37.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.440+0000 7f9cac911640 1 -- 172.21.15.114:0/3591820070 shutdown_connections 2024-04-28T13:07:37.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.440+0000 7f9cac911640 1 -- 172.21.15.114:0/3591820070 wait complete. 2024-04-28T13:07:37.442 INFO:teuthology.orchestra.run.smithi114.stdout:55834574857 2024-04-28T13:07:37.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.444+0000 7f171f19d640 1 -- 172.21.15.114:0/1394394370 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f170406c9f0 msgr2=0x7f170406eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.444+0000 7f171f19d640 1 --2- 172.21.15.114:0/1394394370 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f170406c9f0 0x7f170406eeb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1708006fd0 tx=0x7f1708008040 comp rx=0 tx=0).stop 2024-04-28T13:07:37.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.444+0000 7f171f19d640 1 -- 172.21.15.114:0/1394394370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f171815f610 msgr2=0x7f17180b8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.444+0000 7f171f19d640 1 --2- 172.21.15.114:0/1394394370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f171815f610 0x7f17180b8d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1710009f40 tx=0x7f1710004a40 comp rx=0 tx=0).stop 2024-04-28T13:07:37.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.445+0000 7f171f19d640 1 -- 172.21.15.114:0/1394394370 shutdown_connections 2024-04-28T13:07:37.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.445+0000 7f171f19d640 1 --2- 172.21.15.114:0/1394394370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f171815f610 0x7f17180b8d80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.445+0000 7f171f19d640 1 --2- 172.21.15.114:0/1394394370 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f171815f230 0x7f17180b8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.445+0000 7f171f19d640 1 --2- 172.21.15.114:0/1394394370 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f170406c9f0 0x7f170406eeb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.445+0000 7f171f19d640 1 --2- 172.21.15.114:0/1394394370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17180d22a0 0x7f17180cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.445+0000 7f171f19d640 1 -- 172.21.15.114:0/1394394370 >> 172.21.15.114:0/1394394370 conn(0x7f1718063190 msgr2=0x7f171806d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:37.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.445+0000 7f171f19d640 1 -- 172.21.15.114:0/1394394370 shutdown_connections 2024-04-28T13:07:37.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.445+0000 7f171f19d640 1 -- 172.21.15.114:0/1394394370 wait complete. 2024-04-28T13:07:37.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2024-04-28T13:07:37.458 DEBUG:teuthology.parallel:result is None 2024-04-28T13:07:37.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2024-04-28T13:07:37.462 DEBUG:teuthology.parallel:result is None 2024-04-28T13:07:37.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.489+0000 7f438495f640 1 -- 172.21.15.114:0/2790078759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f4364005580 con 0x7f43780dfec0 2024-04-28T13:07:37.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.489+0000 7f436effd640 1 -- 172.21.15.114:0/2790078759 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f43800d5df0 con 0x7f43780dfec0 2024-04-28T13:07:37.489 INFO:teuthology.orchestra.run.smithi114.stdout:55834574855 2024-04-28T13:07:37.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.491+0000 7f87c52d7640 1 -- 172.21.15.114:0/2819595851 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f87c00b5c70 con 0x7f87c0163670 2024-04-28T13:07:37.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.491+0000 7f438495f640 1 -- 172.21.15.114:0/2790078759 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f436006c8f0 msgr2=0x7f436006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.491+0000 7f438495f640 1 --2- 172.21.15.114:0/2790078759 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f436006c8f0 0x7f436006edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4374036000 tx=0x7f4374030000 comp rx=0 tx=0).stop 2024-04-28T13:07:37.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.492+0000 7f438495f640 1 -- 172.21.15.114:0/2790078759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43780dfec0 msgr2=0x7f43780dc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.492+0000 7f438495f640 1 --2- 172.21.15.114:0/2790078759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43780dfec0 0x7f43780dc390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4380000b60 tx=0x7f4380069ed0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.492+0000 7f438495f640 1 -- 172.21.15.114:0/2790078759 shutdown_connections 2024-04-28T13:07:37.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.492+0000 7f438495f640 1 --2- 172.21.15.114:0/2790078759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43780dfec0 0x7f43780dc390 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.492+0000 7f438495f640 1 --2- 172.21.15.114:0/2790078759 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4378050270 0x7f43780dbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.492+0000 7f438495f640 1 --2- 172.21.15.114:0/2790078759 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f436006c8f0 0x7f436006edb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.492+0000 7f438495f640 1 --2- 172.21.15.114:0/2790078759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43780398d0 0x7f4378185600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.492+0000 7f438495f640 1 -- 172.21.15.114:0/2790078759 >> 172.21.15.114:0/2790078759 conn(0x7f4378009fb0 msgr2=0x7f4378004930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:37.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.492+0000 7f87bcff9640 1 -- 172.21.15.114:0/2819595851 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f87b807b390 con 0x7f87c0163670 2024-04-28T13:07:37.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.492+0000 7f438495f640 1 -- 172.21.15.114:0/2790078759 shutdown_connections 2024-04-28T13:07:37.493 INFO:teuthology.orchestra.run.smithi114.stdout:55834574856 2024-04-28T13:07:37.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.492+0000 7f438495f640 1 -- 172.21.15.114:0/2790078759 wait complete. 2024-04-28T13:07:37.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.495+0000 7f87c52d7640 1 -- 172.21.15.114:0/2819595851 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f87ac06c920 msgr2=0x7f87ac06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.495+0000 7f87c52d7640 1 --2- 172.21.15.114:0/2819595851 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f87ac06c920 0x7f87ac06ede0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f87c0161d60 tx=0x7f87b00079c0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.495+0000 7f87c52d7640 1 -- 172.21.15.114:0/2819595851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87c0163670 msgr2=0x7f87c01eced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.495+0000 7f87c52d7640 1 --2- 172.21.15.114:0/2819595851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87c0163670 0x7f87c01eced0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f87b8009f70 tx=0x7f87b8004a40 comp rx=0 tx=0).stop 2024-04-28T13:07:37.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.495+0000 7f87c52d7640 1 -- 172.21.15.114:0/2819595851 shutdown_connections 2024-04-28T13:07:37.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.495+0000 7f87c52d7640 1 --2- 172.21.15.114:0/2819595851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87c0163670 0x7f87c01eced0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.495+0000 7f87c52d7640 1 --2- 172.21.15.114:0/2819595851 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f87ac06c920 0x7f87ac06ede0 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f87c0161d60 tx=0x7f87b00079c0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.495+0000 7f87c52d7640 1 --2- 172.21.15.114:0/2819595851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87c00d0ea0 0x7f87c01659f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.495+0000 7f87c52d7640 1 --2- 172.21.15.114:0/2819595851 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f87c0072210 0x7f87c01654b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.495+0000 7f87c52d7640 1 -- 172.21.15.114:0/2819595851 >> 172.21.15.114:0/2819595851 conn(0x7f87c006c530 msgr2=0x7f87c0160c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:37.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.495+0000 7f87c52d7640 1 -- 172.21.15.114:0/2819595851 shutdown_connections 2024-04-28T13:07:37.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.495+0000 7f87c52d7640 1 -- 172.21.15.114:0/2819595851 wait complete. 2024-04-28T13:07:37.507 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2024-04-28T13:07:37.507 DEBUG:teuthology.parallel:result is None 2024-04-28T13:07:37.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2024-04-28T13:07:37.509 DEBUG:teuthology.parallel:result is None 2024-04-28T13:07:37.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.524+0000 7f808ea5b640 1 -- 172.21.15.114:0/32643222 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8068005580 con 0x7f8088167290 2024-04-28T13:07:37.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.524+0000 7f8084ff9640 1 -- 172.21.15.114:0/32643222 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f807c069b90 con 0x7f8088167290 2024-04-28T13:07:37.524 INFO:teuthology.orchestra.run.smithi114.stdout:55834574857 2024-04-28T13:07:37.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.527+0000 7f808ea5b640 1 -- 172.21.15.114:0/32643222 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f807406c940 msgr2=0x7f807406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.527+0000 7f808ea5b640 1 --2- 172.21.15.114:0/32643222 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f807406c940 0x7f807406ee00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8080034000 tx=0x7f808002f000 comp rx=0 tx=0).stop 2024-04-28T13:07:37.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.527+0000 7f808ea5b640 1 -- 172.21.15.114:0/32643222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8088167290 msgr2=0x7f80880aa6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.527+0000 7f808ea5b640 1 --2- 172.21.15.114:0/32643222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8088167290 0x7f80880aa6b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f807c00c3e0 tx=0x7f807c00c8a0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.527+0000 7f808ea5b640 1 -- 172.21.15.114:0/32643222 shutdown_connections 2024-04-28T13:07:37.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.527+0000 7f808ea5b640 1 --2- 172.21.15.114:0/32643222 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f807406c940 0x7f807406ee00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.527+0000 7f808ea5b640 1 --2- 172.21.15.114:0/32643222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8088167290 0x7f80880aa6b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.527+0000 7f808ea5b640 1 --2- 172.21.15.114:0/32643222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8088164720 0x7f8088160d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.527+0000 7f808ea5b640 1 --2- 172.21.15.114:0/32643222 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f808806e560 0x7f8088162620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.527+0000 7f808ea5b640 1 -- 172.21.15.114:0/32643222 >> 172.21.15.114:0/32643222 conn(0x7f80880b2b60 msgr2=0x7f80880b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:37.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.527+0000 7f808ea5b640 1 -- 172.21.15.114:0/32643222 shutdown_connections 2024-04-28T13:07:37.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.527+0000 7f808ea5b640 1 -- 172.21.15.114:0/32643222 wait complete. 2024-04-28T13:07:37.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.528+0000 7f95f959d640 1 -- 172.21.15.114:0/3347358610 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f95d4005580 con 0x7f95ec0df1c0 2024-04-28T13:07:37.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.528+0000 7f95db7fe640 1 -- 172.21.15.114:0/3347358610 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f95ec0e00e0 con 0x7f95ec0df1c0 2024-04-28T13:07:37.529 INFO:teuthology.orchestra.run.smithi114.stdout:55834574856 2024-04-28T13:07:37.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.531+0000 7ff5cbfff640 1 -- 172.21.15.114:0/1450648851 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff5cc0b5ec0 con 0x7ff5cc15f1f0 2024-04-28T13:07:37.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.531+0000 7ff5c37fe640 1 -- 172.21.15.114:0/1450648851 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff5cc0b5ec0 con 0x7ff5cc15f1f0 2024-04-28T13:07:37.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.531+0000 7f95f959d640 1 -- 172.21.15.114:0/3347358610 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f95e006c9f0 msgr2=0x7f95e006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.531+0000 7f95f959d640 1 --2- 172.21.15.114:0/3347358610 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f95e006c9f0 0x7f95e006eeb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f95e8033000 tx=0x7f95e802e000 comp rx=0 tx=0).stop 2024-04-28T13:07:37.531 INFO:teuthology.orchestra.run.smithi114.stdout:55834574856 2024-04-28T13:07:37.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.531+0000 7f95f959d640 1 -- 172.21.15.114:0/3347358610 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95ec0df1c0 msgr2=0x7f95ec04a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.531+0000 7f95f959d640 1 --2- 172.21.15.114:0/3347358610 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95ec0df1c0 0x7f95ec04a3f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f95f406c300 tx=0x7f95f4069ed0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.531+0000 7f2db62c0640 1 -- 172.21.15.114:0/2647236793 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f2d90005580 con 0x7f2da803ad50 2024-04-28T13:07:37.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.532+0000 7f95f959d640 1 -- 172.21.15.114:0/3347358610 shutdown_connections 2024-04-28T13:07:37.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.532+0000 7f95f959d640 1 --2- 172.21.15.114:0/3347358610 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95ec0dfcb0 0x7f95ec039640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.532+0000 7f95f959d640 1 --2- 172.21.15.114:0/3347358610 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95ec0df1c0 0x7f95ec04a3f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.532+0000 7f95f959d640 1 --2- 172.21.15.114:0/3347358610 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f95e006c9f0 0x7f95e006eeb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.532+0000 7f95f959d640 1 --2- 172.21.15.114:0/3347358610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95ec054690 0x7f95ec0d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.532+0000 7f95f959d640 1 -- 172.21.15.114:0/3347358610 >> 172.21.15.114:0/3347358610 conn(0x7f95ec009fe0 msgr2=0x7f95ec0df5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:37.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.532+0000 7f95f959d640 1 -- 172.21.15.114:0/3347358610 shutdown_connections 2024-04-28T13:07:37.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.532+0000 7f95f959d640 1 -- 172.21.15.114:0/3347358610 wait complete. 2024-04-28T13:07:37.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.532+0000 7f2da5ffb640 1 -- 172.21.15.114:0/2647236793 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2da005cdd0 con 0x7f2da803ad50 2024-04-28T13:07:37.534 INFO:teuthology.orchestra.run.smithi114.stdout:55834574856 2024-04-28T13:07:37.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.535+0000 7ff5cbfff640 1 -- 172.21.15.114:0/1450648851 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff5ac06c970 msgr2=0x7ff5ac06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.535+0000 7ff5cbfff640 1 --2- 172.21.15.114:0/1450648851 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff5ac06c970 0x7ff5ac06ee30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0ce2a0 tx=0x7ff5b4041040 comp rx=0 tx=0).stop 2024-04-28T13:07:37.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.535+0000 7ff5cbfff640 1 -- 172.21.15.114:0/1450648851 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5cc15f1f0 msgr2=0x7ff5cc160dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.535+0000 7ff5cbfff640 1 --2- 172.21.15.114:0/1450648851 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5cc15f1f0 0x7ff5cc160dc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff5c400ef90 tx=0x7ff5c400c490 comp rx=0 tx=0).stop 2024-04-28T13:07:37.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.535+0000 7f2db62c0640 1 -- 172.21.15.114:0/2647236793 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2d9406c8f0 msgr2=0x7f2d9406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.535+0000 7f2db62c0640 1 --2- 172.21.15.114:0/2647236793 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2d9406c8f0 0x7f2d9406edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2da8054370 tx=0x7f2db00ae000 comp rx=0 tx=0).stop 2024-04-28T13:07:37.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.535+0000 7f2db62c0640 1 -- 172.21.15.114:0/2647236793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2da803ad50 msgr2=0x7f2da804d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.535+0000 7f2db62c0640 1 --2- 172.21.15.114:0/2647236793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2da803ad50 0x7f2da804d150 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2da000c390 tx=0x7f2da000c850 comp rx=0 tx=0).stop 2024-04-28T13:07:37.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.535+0000 7ff5cbfff640 1 -- 172.21.15.114:0/1450648851 shutdown_connections 2024-04-28T13:07:37.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.535+0000 7ff5cbfff640 1 --2- 172.21.15.114:0/1450648851 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5cc15f1f0 0x7ff5cc160dc0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.535+0000 7ff5cbfff640 1 --2- 172.21.15.114:0/1450648851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5cc0d2410 0x7ff5cc0a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.535+0000 7ff5cbfff640 1 --2- 172.21.15.114:0/1450648851 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff5ac06c970 0x7ff5ac06ee30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.535+0000 7ff5cbfff640 1 --2- 172.21.15.114:0/1450648851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5cc0d18a0 0x7ff5cc15b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.535+0000 7ff5cbfff640 1 -- 172.21.15.114:0/1450648851 >> 172.21.15.114:0/1450648851 conn(0x7ff5cc08ea70 msgr2=0x7ff5cc06cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:37.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.535+0000 7f2db62c0640 1 -- 172.21.15.114:0/2647236793 shutdown_connections 2024-04-28T13:07:37.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.535+0000 7f2db62c0640 1 --2- 172.21.15.114:0/2647236793 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2da80df6f0 0x7f2da80d6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.535+0000 7f2db62c0640 1 --2- 172.21.15.114:0/2647236793 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2d9406c8f0 0x7f2d9406edb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.535+0000 7f2db62c0640 1 --2- 172.21.15.114:0/2647236793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2da8050090 0x7f2da8036b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.535+0000 7ff5cbfff640 1 -- 172.21.15.114:0/1450648851 shutdown_connections 2024-04-28T13:07:37.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.535+0000 7f2db62c0640 1 --2- 172.21.15.114:0/2647236793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2da803ad50 0x7f2da804d150 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.535+0000 7f2db62c0640 1 -- 172.21.15.114:0/2647236793 >> 172.21.15.114:0/2647236793 conn(0x7f2da8055350 msgr2=0x7f2da8049390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:37.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.535+0000 7f2db62c0640 1 -- 172.21.15.114:0/2647236793 shutdown_connections 2024-04-28T13:07:37.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.535+0000 7ff5cbfff640 1 -- 172.21.15.114:0/1450648851 wait complete. 2024-04-28T13:07:37.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.535+0000 7f2db62c0640 1 -- 172.21.15.114:0/2647236793 wait complete. 2024-04-28T13:07:37.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2024-04-28T13:07:37.543 DEBUG:teuthology.parallel:result is None 2024-04-28T13:07:37.549 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2024-04-28T13:07:37.550 DEBUG:teuthology.parallel:result is None 2024-04-28T13:07:37.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2024-04-28T13:07:37.550 DEBUG:teuthology.parallel:result is None 2024-04-28T13:07:37.551 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.7 2024-04-28T13:07:37.551 DEBUG:teuthology.parallel:result is None 2024-04-28T13:07:37.551 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-28T13:07:37.552 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-28T13:07:37.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.688+0000 7f7d5f92b640 1 Processor -- start 2024-04-28T13:07:37.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.688+0000 7f7d5f92b640 1 -- start start 2024-04-28T13:07:37.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.689+0000 7f7d5f92b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7d5815f5a0 0x7f7d580baef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.689+0000 7f7d5f92b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7d580b8e50 0x7f7d580cff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.689+0000 7f7d5f92b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d580d04c0 0x7f7d580b6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.689+0000 7f7d5f92b640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f7d580d0930 con 0x7f7d580b8e50 2024-04-28T13:07:37.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.689+0000 7f7d5f92b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f7d580ba720 con 0x7f7d5815f5a0 2024-04-28T13:07:37.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.689+0000 7f7d5f92b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f7d580b9680 con 0x7f7d580d04c0 2024-04-28T13:07:37.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.689+0000 7f7d5cec6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7d580b8e50 0x7f7d580cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.689+0000 7f7d5cec6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7d580b8e50 0x7f7d580cff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48368/0 (socket says 172.21.15.114:48368) 2024-04-28T13:07:37.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.689+0000 7f7d5cec6640 1 -- 172.21.15.114:0/959961390 learned_addr learned my addr 172.21.15.114:0/959961390 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:37.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.689+0000 7f7d5cec6640 1 -- 172.21.15.114:0/959961390 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d580d04c0 msgr2=0x7f7d580b6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:37.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.689+0000 7f7d5cec6640 1 --2- 172.21.15.114:0/959961390 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d580d04c0 0x7f7d580b6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.689+0000 7f7d5cec6640 1 -- 172.21.15.114:0/959961390 >> v2:172.21.15.134:3300/0 conn(0x7f7d5815f5a0 msgr2=0x7f7d580baef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:37.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.689+0000 7f7d5cec6640 1 --2- 172.21.15.114:0/959961390 >> v2:172.21.15.134:3300/0 conn(0x7f7d5815f5a0 0x7f7d580baef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.689+0000 7f7d5cec6640 1 -- 172.21.15.114:0/959961390 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d580b9960 con 0x7f7d580b8e50 2024-04-28T13:07:37.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.690+0000 7f7d5cec6640 1 --2- 172.21.15.114:0/959961390 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d580b8e50 0x7f7d580cff80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7d580d2e10 tx=0x7f7d4802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e215c495fde74f67 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:37.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.690+0000 7f7d4ffff640 1 -- 172.21.15.114:0/959961390 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d48037070 con 0x7f7d580b8e50 2024-04-28T13:07:37.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.690+0000 7f7d4ffff640 1 -- 172.21.15.114:0/959961390 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d48032440 con 0x7f7d580b8e50 2024-04-28T13:07:37.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.690+0000 7f7d4ffff640 1 -- 172.21.15.114:0/959961390 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d48032810 con 0x7f7d580b8e50 2024-04-28T13:07:37.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.690+0000 7f7d5f92b640 1 -- 172.21.15.114:0/959961390 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d580b8e50 msgr2=0x7f7d580cff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.690+0000 7f7d5f92b640 1 --2- 172.21.15.114:0/959961390 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d580b8e50 0x7f7d580cff80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7d580d2e10 tx=0x7f7d4802a140 comp rx=0 tx=0).stop 2024-04-28T13:07:37.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.690+0000 7f7d5f92b640 1 -- 172.21.15.114:0/959961390 shutdown_connections 2024-04-28T13:07:37.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.690+0000 7f7d5f92b640 1 --2- 172.21.15.114:0/959961390 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d580d04c0 0x7f7d580b6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.690+0000 7f7d5f92b640 1 --2- 172.21.15.114:0/959961390 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d580b8e50 0x7f7d580cff80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.690+0000 7f7d5f92b640 1 --2- 172.21.15.114:0/959961390 >> v2:172.21.15.134:3300/0 conn(0x7f7d5815f5a0 0x7f7d580baef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.690+0000 7f7d5f92b640 1 -- 172.21.15.114:0/959961390 >> 172.21.15.114:0/959961390 conn(0x7f7d58063160 msgr2=0x7f7d58063570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:37.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.691+0000 7f7d5f92b640 1 -- 172.21.15.114:0/959961390 shutdown_connections 2024-04-28T13:07:37.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.691+0000 7f7d5f92b640 1 -- 172.21.15.114:0/959961390 wait complete. 2024-04-28T13:07:37.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.692+0000 7f7d5f92b640 1 Processor -- start 2024-04-28T13:07:37.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.692+0000 7f7d5f92b640 1 -- start start 2024-04-28T13:07:37.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.692+0000 7f7d5f92b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d580b8e50 0x7f7d580b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.692+0000 7f7d5f92b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d580d04c0 0x7f7d580cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.692+0000 7f7d5f92b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d5815f5a0 0x7f7d58161cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.692+0000 7f7d5f92b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7d580ba200 con 0x7f7d580d04c0 2024-04-28T13:07:37.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.692+0000 7f7d5f92b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7d580b9f20 con 0x7f7d580b8e50 2024-04-28T13:07:37.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.692+0000 7f7d5f92b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f7d580b92a0 con 0x7f7d5815f5a0 2024-04-28T13:07:37.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.692+0000 7f7d5cec6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d580d04c0 0x7f7d580cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.692+0000 7f7d5cec6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d580d04c0 0x7f7d580cd3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48376/0 (socket says 172.21.15.114:48376) 2024-04-28T13:07:37.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.693+0000 7f7d5cec6640 1 -- 172.21.15.114:0/2306576551 learned_addr learned my addr 172.21.15.114:0/2306576551 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:37.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.693+0000 7f7d5cec6640 1 -- 172.21.15.114:0/2306576551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d5815f5a0 msgr2=0x7f7d58161cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.693+0000 7f7d5cec6640 1 --2- 172.21.15.114:0/2306576551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d5815f5a0 0x7f7d58161cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.693+0000 7f7d5cec6640 1 -- 172.21.15.114:0/2306576551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d580b8e50 msgr2=0x7f7d580b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.693+0000 7f7d5cec6640 1 --2- 172.21.15.114:0/2306576551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d580b8e50 0x7f7d580b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.693+0000 7f7d5cec6640 1 -- 172.21.15.114:0/2306576551 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d580cdd40 con 0x7f7d580d04c0 2024-04-28T13:07:37.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.693+0000 7f7d5cec6640 1 --2- 172.21.15.114:0/2306576551 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d580d04c0 0x7f7d580cd3d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7d4802a180 tx=0x7f7d480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:37.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.693+0000 7f7d4dffb640 1 -- 172.21.15.114:0/2306576551 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d48041070 con 0x7f7d580d04c0 2024-04-28T13:07:37.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.693+0000 7f7d4dffb640 1 -- 172.21.15.114:0/2306576551 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d4803c870 con 0x7f7d580d04c0 2024-04-28T13:07:37.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.693+0000 7f7d5f92b640 1 -- 172.21.15.114:0/2306576551 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d580ce020 con 0x7f7d580d04c0 2024-04-28T13:07:37.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.693+0000 7f7d4dffb640 1 -- 172.21.15.114:0/2306576551 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d48037040 con 0x7f7d580d04c0 2024-04-28T13:07:37.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.693+0000 7f7d5f92b640 1 -- 172.21.15.114:0/2306576551 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d580ce5e0 con 0x7f7d580d04c0 2024-04-28T13:07:37.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.694+0000 7f7d5f92b640 1 -- 172.21.15.114:0/2306576551 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d580cc180 con 0x7f7d580d04c0 2024-04-28T13:07:37.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.695+0000 7f7d4dffb640 1 -- 172.21.15.114:0/2306576551 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7d48044070 con 0x7f7d580d04c0 2024-04-28T13:07:37.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.695+0000 7f7d4dffb640 1 --2- 172.21.15.114:0/2306576551 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7d3c06c8f0 0x7f7d3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:37.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.695+0000 7f7d4dffb640 1 -- 172.21.15.114:0/2306576551 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7d480ac6d0 con 0x7f7d580d04c0 2024-04-28T13:07:37.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.695+0000 7f7d5d6c7640 1 --2- 172.21.15.114:0/2306576551 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7d3c06c8f0 0x7f7d3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:37.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.695+0000 7f7d5d6c7640 1 --2- 172.21.15.114:0/2306576551 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7d3c06c8f0 0x7f7d3c06edb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7d5815b790 tx=0x7f7d54006c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:37.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.699+0000 7f7d4dffb640 1 -- 172.21.15.114:0/2306576551 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7d4807ab90 con 0x7f7d580d04c0 2024-04-28T13:07:37.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.871+0000 7f7d5f92b640 1 -- 172.21.15.114:0/2306576551 --> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7d5806a3d0 con 0x7f7d3c06c8f0 2024-04-28T13:07:37.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.876+0000 7f7d4dffb640 1 -- 172.21.15.114:0/2306576551 <== mgr.4104 v2:172.21.15.114:6832/2240257326 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251837 (secure 0 0 0) 0x7f7d5806a3d0 con 0x7f7d3c06c8f0 2024-04-28T13:07:37.878 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:37.880 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-04-28T13:07:37.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.879+0000 7f7d5f92b640 1 -- 172.21.15.114:0/2306576551 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7d3c06c8f0 msgr2=0x7f7d3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.879+0000 7f7d5f92b640 1 --2- 172.21.15.114:0/2306576551 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7d3c06c8f0 0x7f7d3c06edb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7d5815b790 tx=0x7f7d54006c90 comp rx=0 tx=0).stop 2024-04-28T13:07:37.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.879+0000 7f7d5f92b640 1 -- 172.21.15.114:0/2306576551 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d580d04c0 msgr2=0x7f7d580cd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:37.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.879+0000 7f7d5f92b640 1 --2- 172.21.15.114:0/2306576551 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d580d04c0 0x7f7d580cd3d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7d4802a180 tx=0x7f7d480046c0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.879+0000 7f7d5f92b640 1 -- 172.21.15.114:0/2306576551 shutdown_connections 2024-04-28T13:07:37.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.879+0000 7f7d5f92b640 1 --2- 172.21.15.114:0/2306576551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d5815f5a0 0x7f7d58161cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.879+0000 7f7d5f92b640 1 --2- 172.21.15.114:0/2306576551 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d580d04c0 0x7f7d580cd3d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.879+0000 7f7d5f92b640 1 --2- 172.21.15.114:0/2306576551 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7d3c06c8f0 0x7f7d3c06edb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.879+0000 7f7d5f92b640 1 --2- 172.21.15.114:0/2306576551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d580b8e50 0x7f7d580b4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:37.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.879+0000 7f7d5f92b640 1 -- 172.21.15.114:0/2306576551 >> 172.21.15.114:0/2306576551 conn(0x7f7d58063160 msgr2=0x7f7d5815c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:37.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.879+0000 7f7d5f92b640 1 -- 172.21.15.114:0/2306576551 shutdown_connections 2024-04-28T13:07:37.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:37.879+0000 7f7d5f92b640 1 -- 172.21.15.114:0/2306576551 wait complete. 2024-04-28T13:07:37.890 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-04-28T13:07:36.709392+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219104,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755616,"statfs":{"total":773094113280,"available":772869750784,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002025"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021526+0000","last_change":"2024-04-28T13:07:26.313967+0000","last_active":"2024-04-28T13:07:28.021526+0000","last_peered":"2024-04-28T13:07:28.021526+0000","last_clean":"2024-04-28T13:07:28.021526+0000","last_became_active":"2024-04-28T13:07:26.309492+0000","last_became_peered":"2024-04-28T13:07:26.309492+0000","last_unstale":"2024-04-28T13:07:28.021526+0000","last_undegraded":"2024-04-28T13:07:28.021526+0000","last_fullsized":"2024-04-28T13:07:28.021526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:39:10.176279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298698+0000","last_change":"2024-04-28T13:07:26.309087+0000","last_active":"2024-04-28T13:07:27.298698+0000","last_peered":"2024-04-28T13:07:27.298698+0000","last_clean":"2024-04-28T13:07:27.298698+0000","last_became_active":"2024-04-28T13:07:26.308799+0000","last_became_peered":"2024-04-28T13:07:26.308799+0000","last_unstale":"2024-04-28T13:07:27.298698+0000","last_undegraded":"2024-04-28T13:07:27.298698+0000","last_fullsized":"2024-04-28T13:07:27.298698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:15:46.081328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519230+0000","last_change":"2024-04-28T13:07:26.310735+0000","last_active":"2024-04-28T13:07:27.519230+0000","last_peered":"2024-04-28T13:07:27.519230+0000","last_clean":"2024-04-28T13:07:27.519230+0000","last_became_active":"2024-04-28T13:07:26.310442+0000","last_became_peered":"2024-04-28T13:07:26.310442+0000","last_unstale":"2024-04-28T13:07:27.519230+0000","last_undegraded":"2024-04-28T13:07:27.519230+0000","last_fullsized":"2024-04-28T13:07:27.519230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:59:35.713480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299050+0000","last_change":"2024-04-28T13:07:26.316425+0000","last_active":"2024-04-28T13:07:27.299050+0000","last_peered":"2024-04-28T13:07:27.299050+0000","last_clean":"2024-04-28T13:07:27.299050+0000","last_became_active":"2024-04-28T13:07:26.316055+0000","last_became_peered":"2024-04-28T13:07:26.316055+0000","last_unstale":"2024-04-28T13:07:27.299050+0000","last_undegraded":"2024-04-28T13:07:27.299050+0000","last_fullsized":"2024-04-28T13:07:27.299050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:17:42.011752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020050+0000","last_change":"2024-04-28T13:07:26.315472+0000","last_active":"2024-04-28T13:07:28.020050+0000","last_peered":"2024-04-28T13:07:28.020050+0000","last_clean":"2024-04-28T13:07:28.020050+0000","last_became_active":"2024-04-28T13:07:26.315216+0000","last_became_peered":"2024-04-28T13:07:26.315216+0000","last_unstale":"2024-04-28T13:07:28.020050+0000","last_undegraded":"2024-04-28T13:07:28.020050+0000","last_fullsized":"2024-04-28T13:07:28.020050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T13:30:05.831084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298986+0000","last_change":"2024-04-28T13:07:26.313012+0000","last_active":"2024-04-28T13:07:27.298986+0000","last_peered":"2024-04-28T13:07:27.298986+0000","last_clean":"2024-04-28T13:07:27.298986+0000","last_became_active":"2024-04-28T13:07:26.312724+0000","last_became_peered":"2024-04-28T13:07:26.312724+0000","last_unstale":"2024-04-28T13:07:27.298986+0000","last_undegraded":"2024-04-28T13:07:27.298986+0000","last_fullsized":"2024-04-28T13:07:27.298986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:34:15.706993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019989+0000","last_change":"2024-04-28T13:07:26.314352+0000","last_active":"2024-04-28T13:07:28.019989+0000","last_peered":"2024-04-28T13:07:28.019989+0000","last_clean":"2024-04-28T13:07:28.019989+0000","last_became_active":"2024-04-28T13:07:26.314068+0000","last_became_peered":"2024-04-28T13:07:26.314068+0000","last_unstale":"2024-04-28T13:07:28.019989+0000","last_undegraded":"2024-04-28T13:07:28.019989+0000","last_fullsized":"2024-04-28T13:07:28.019989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:34:15.706993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019405+0000","last_change":"2024-04-28T13:07:26.308898+0000","last_active":"2024-04-28T13:07:28.019405+0000","last_peered":"2024-04-28T13:07:28.019405+0000","last_clean":"2024-04-28T13:07:28.019405+0000","last_became_active":"2024-04-28T13:07:26.308567+0000","last_became_peered":"2024-04-28T13:07:26.308567+0000","last_unstale":"2024-04-28T13:07:28.019405+0000","last_undegraded":"2024-04-28T13:07:28.019405+0000","last_fullsized":"2024-04-28T13:07:28.019405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:37:35.063109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021532+0000","last_change":"2024-04-28T13:07:26.313669+0000","last_active":"2024-04-28T13:07:28.021532+0000","last_peered":"2024-04-28T13:07:28.021532+0000","last_clean":"2024-04-28T13:07:28.021532+0000","last_became_active":"2024-04-28T13:07:26.307908+0000","last_became_peered":"2024-04-28T13:07:26.307908+0000","last_unstale":"2024-04-28T13:07:28.021532+0000","last_undegraded":"2024-04-28T13:07:28.021532+0000","last_fullsized":"2024-04-28T13:07:28.021532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:04:24.766267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021321+0000","last_change":"2024-04-28T13:07:26.307257+0000","last_active":"2024-04-28T13:07:28.021321+0000","last_peered":"2024-04-28T13:07:28.021321+0000","last_clean":"2024-04-28T13:07:28.021321+0000","last_became_active":"2024-04-28T13:07:26.306866+0000","last_became_peered":"2024-04-28T13:07:26.306866+0000","last_unstale":"2024-04-28T13:07:28.021321+0000","last_undegraded":"2024-04-28T13:07:28.021321+0000","last_fullsized":"2024-04-28T13:07:28.021321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T16:06:41.543332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020923+0000","last_change":"2024-04-28T13:07:26.309606+0000","last_active":"2024-04-28T13:07:28.020923+0000","last_peered":"2024-04-28T13:07:28.020923+0000","last_clean":"2024-04-28T13:07:28.020923+0000","last_became_active":"2024-04-28T13:07:26.309338+0000","last_became_peered":"2024-04-28T13:07:26.309338+0000","last_unstale":"2024-04-28T13:07:28.020923+0000","last_undegraded":"2024-04-28T13:07:28.020923+0000","last_fullsized":"2024-04-28T13:07:28.020923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:28:05.357255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020781+0000","last_change":"2024-04-28T13:07:26.308307+0000","last_active":"2024-04-28T13:07:28.020781+0000","last_peered":"2024-04-28T13:07:28.020781+0000","last_clean":"2024-04-28T13:07:28.020781+0000","last_became_active":"2024-04-28T13:07:26.307664+0000","last_became_peered":"2024-04-28T13:07:26.307664+0000","last_unstale":"2024-04-28T13:07:28.020781+0000","last_undegraded":"2024-04-28T13:07:28.020781+0000","last_fullsized":"2024-04-28T13:07:28.020781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:18:37.751080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019688+0000","last_change":"2024-04-28T13:07:26.311807+0000","last_active":"2024-04-28T13:07:28.019688+0000","last_peered":"2024-04-28T13:07:28.019688+0000","last_clean":"2024-04-28T13:07:28.019688+0000","last_became_active":"2024-04-28T13:07:26.310515+0000","last_became_peered":"2024-04-28T13:07:26.310515+0000","last_unstale":"2024-04-28T13:07:28.019688+0000","last_undegraded":"2024-04-28T13:07:28.019688+0000","last_fullsized":"2024-04-28T13:07:28.019688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:28:05.357255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519030+0000","last_change":"2024-04-28T13:07:26.315421+0000","last_active":"2024-04-28T13:07:27.519030+0000","last_peered":"2024-04-28T13:07:27.519030+0000","last_clean":"2024-04-28T13:07:27.519030+0000","last_became_active":"2024-04-28T13:07:26.315112+0000","last_became_peered":"2024-04-28T13:07:26.315112+0000","last_unstale":"2024-04-28T13:07:27.519030+0000","last_undegraded":"2024-04-28T13:07:27.519030+0000","last_fullsized":"2024-04-28T13:07:27.519030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:27:11.373413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298416+0000","last_change":"2024-04-28T13:07:26.297276+0000","last_active":"2024-04-28T13:07:27.298416+0000","last_peered":"2024-04-28T13:07:27.298416+0000","last_clean":"2024-04-28T13:07:27.298416+0000","last_became_active":"2024-04-28T13:07:26.297008+0000","last_became_peered":"2024-04-28T13:07:26.297008+0000","last_unstale":"2024-04-28T13:07:27.298416+0000","last_undegraded":"2024-04-28T13:07:27.298416+0000","last_fullsized":"2024-04-28T13:07:27.298416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:59:35.713480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298922+0000","last_change":"2024-04-28T13:07:26.312387+0000","last_active":"2024-04-28T13:07:27.298922+0000","last_peered":"2024-04-28T13:07:27.298922+0000","last_clean":"2024-04-28T13:07:27.298922+0000","last_became_active":"2024-04-28T13:07:26.312111+0000","last_became_peered":"2024-04-28T13:07:26.312111+0000","last_unstale":"2024-04-28T13:07:27.298922+0000","last_undegraded":"2024-04-28T13:07:27.298922+0000","last_fullsized":"2024-04-28T13:07:27.298922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:17:21.385726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299713+0000","last_change":"2024-04-28T13:07:26.306073+0000","last_active":"2024-04-28T13:07:27.299713+0000","last_peered":"2024-04-28T13:07:27.299713+0000","last_clean":"2024-04-28T13:07:27.299713+0000","last_became_active":"2024-04-28T13:07:26.305799+0000","last_became_peered":"2024-04-28T13:07:26.305799+0000","last_unstale":"2024-04-28T13:07:27.299713+0000","last_undegraded":"2024-04-28T13:07:27.299713+0000","last_fullsized":"2024-04-28T13:07:27.299713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:04:24.766267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019321+0000","last_change":"2024-04-28T13:07:26.308368+0000","last_active":"2024-04-28T13:07:28.019321+0000","last_peered":"2024-04-28T13:07:28.019321+0000","last_clean":"2024-04-28T13:07:28.019321+0000","last_became_active":"2024-04-28T13:07:26.308098+0000","last_became_peered":"2024-04-28T13:07:26.308098+0000","last_unstale":"2024-04-28T13:07:28.019321+0000","last_undegraded":"2024-04-28T13:07:28.019321+0000","last_fullsized":"2024-04-28T13:07:28.019321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:48:49.408457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021412+0000","last_change":"2024-04-28T13:07:26.307438+0000","last_active":"2024-04-28T13:07:28.021412+0000","last_peered":"2024-04-28T13:07:28.021412+0000","last_clean":"2024-04-28T13:07:28.021412+0000","last_became_active":"2024-04-28T13:07:26.306984+0000","last_became_peered":"2024-04-28T13:07:26.306984+0000","last_unstale":"2024-04-28T13:07:28.021412+0000","last_undegraded":"2024-04-28T13:07:28.021412+0000","last_fullsized":"2024-04-28T13:07:28.021412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T16:22:52.630763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020405+0000","last_change":"2024-04-28T13:07:26.309790+0000","last_active":"2024-04-28T13:07:28.020405+0000","last_peered":"2024-04-28T13:07:28.020405+0000","last_clean":"2024-04-28T13:07:28.020405+0000","last_became_active":"2024-04-28T13:07:26.309521+0000","last_became_peered":"2024-04-28T13:07:26.309521+0000","last_unstale":"2024-04-28T13:07:28.020405+0000","last_undegraded":"2024-04-28T13:07:28.020405+0000","last_fullsized":"2024-04-28T13:07:28.020405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:59:35.713480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519103+0000","last_change":"2024-04-28T13:07:26.318544+0000","last_active":"2024-04-28T13:07:27.519103+0000","last_peered":"2024-04-28T13:07:27.519103+0000","last_clean":"2024-04-28T13:07:27.519103+0000","last_became_active":"2024-04-28T13:07:26.318279+0000","last_became_peered":"2024-04-28T13:07:26.318279+0000","last_unstale":"2024-04-28T13:07:27.519103+0000","last_undegraded":"2024-04-28T13:07:27.519103+0000","last_fullsized":"2024-04-28T13:07:27.519103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:37:35.063109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299378+0000","last_change":"2024-04-28T13:07:26.309606+0000","last_active":"2024-04-28T13:07:27.299378+0000","last_peered":"2024-04-28T13:07:27.299378+0000","last_clean":"2024-04-28T13:07:27.299378+0000","last_became_active":"2024-04-28T13:07:26.309338+0000","last_became_peered":"2024-04-28T13:07:26.309338+0000","last_unstale":"2024-04-28T13:07:27.299378+0000","last_undegraded":"2024-04-28T13:07:27.299378+0000","last_fullsized":"2024-04-28T13:07:27.299378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:10:44.035551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019649+0000","last_change":"2024-04-28T13:07:26.307514+0000","last_active":"2024-04-28T13:07:28.019649+0000","last_peered":"2024-04-28T13:07:28.019649+0000","last_clean":"2024-04-28T13:07:28.019649+0000","last_became_active":"2024-04-28T13:07:26.307215+0000","last_became_peered":"2024-04-28T13:07:26.307215+0000","last_unstale":"2024-04-28T13:07:28.019649+0000","last_undegraded":"2024-04-28T13:07:28.019649+0000","last_fullsized":"2024-04-28T13:07:28.019649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:59:35.713480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298920+0000","last_change":"2024-04-28T13:07:26.303832+0000","last_active":"2024-04-28T13:07:27.298920+0000","last_peered":"2024-04-28T13:07:27.298920+0000","last_clean":"2024-04-28T13:07:27.298920+0000","last_became_active":"2024-04-28T13:07:26.303498+0000","last_became_peered":"2024-04-28T13:07:26.303498+0000","last_unstale":"2024-04-28T13:07:27.298920+0000","last_undegraded":"2024-04-28T13:07:27.298920+0000","last_fullsized":"2024-04-28T13:07:27.298920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:15:46.081328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019826+0000","last_change":"2024-04-28T13:07:26.306835+0000","last_active":"2024-04-28T13:07:28.019826+0000","last_peered":"2024-04-28T13:07:28.019826+0000","last_clean":"2024-04-28T13:07:28.019826+0000","last_became_active":"2024-04-28T13:07:26.306535+0000","last_became_peered":"2024-04-28T13:07:26.306535+0000","last_unstale":"2024-04-28T13:07:28.019826+0000","last_undegraded":"2024-04-28T13:07:28.019826+0000","last_fullsized":"2024-04-28T13:07:28.019826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:17:21.385726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021476+0000","last_change":"2024-04-28T13:07:26.316514+0000","last_active":"2024-04-28T13:07:28.021476+0000","last_peered":"2024-04-28T13:07:28.021476+0000","last_clean":"2024-04-28T13:07:28.021476+0000","last_became_active":"2024-04-28T13:07:26.316249+0000","last_became_peered":"2024-04-28T13:07:26.316249+0000","last_unstale":"2024-04-28T13:07:28.021476+0000","last_undegraded":"2024-04-28T13:07:28.021476+0000","last_fullsized":"2024-04-28T13:07:28.021476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:15:46.081328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298512+0000","last_change":"2024-04-28T13:07:26.297829+0000","last_active":"2024-04-28T13:07:27.298512+0000","last_peered":"2024-04-28T13:07:27.298512+0000","last_clean":"2024-04-28T13:07:27.298512+0000","last_became_active":"2024-04-28T13:07:26.297468+0000","last_became_peered":"2024-04-28T13:07:26.297468+0000","last_unstale":"2024-04-28T13:07:27.298512+0000","last_undegraded":"2024-04-28T13:07:27.298512+0000","last_fullsized":"2024-04-28T13:07:27.298512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T16:06:41.543332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019812+0000","last_change":"2024-04-28T13:07:26.313763+0000","last_active":"2024-04-28T13:07:28.019812+0000","last_peered":"2024-04-28T13:07:28.019812+0000","last_clean":"2024-04-28T13:07:28.019812+0000","last_became_active":"2024-04-28T13:07:26.313337+0000","last_became_peered":"2024-04-28T13:07:26.313337+0000","last_unstale":"2024-04-28T13:07:28.019812+0000","last_undegraded":"2024-04-28T13:07:28.019812+0000","last_fullsized":"2024-04-28T13:07:28.019812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:15:46.081328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519145+0000","last_change":"2024-04-28T13:07:26.317540+0000","last_active":"2024-04-28T13:07:27.519145+0000","last_peered":"2024-04-28T13:07:27.519145+0000","last_clean":"2024-04-28T13:07:27.519145+0000","last_became_active":"2024-04-28T13:07:26.316912+0000","last_became_peered":"2024-04-28T13:07:26.316912+0000","last_unstale":"2024-04-28T13:07:27.519145+0000","last_undegraded":"2024-04-28T13:07:27.519145+0000","last_fullsized":"2024-04-28T13:07:27.519145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:48:54.699408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299350+0000","last_change":"2024-04-28T13:07:26.311313+0000","last_active":"2024-04-28T13:07:27.299350+0000","last_peered":"2024-04-28T13:07:27.299350+0000","last_clean":"2024-04-28T13:07:27.299350+0000","last_became_active":"2024-04-28T13:07:26.310960+0000","last_became_peered":"2024-04-28T13:07:26.310960+0000","last_unstale":"2024-04-28T13:07:27.299350+0000","last_undegraded":"2024-04-28T13:07:27.299350+0000","last_fullsized":"2024-04-28T13:07:27.299350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:00:58.728022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019235+0000","last_change":"2024-04-28T13:07:26.306545+0000","last_active":"2024-04-28T13:07:28.019235+0000","last_peered":"2024-04-28T13:07:28.019235+0000","last_clean":"2024-04-28T13:07:28.019235+0000","last_became_active":"2024-04-28T13:07:26.306242+0000","last_became_peered":"2024-04-28T13:07:26.306242+0000","last_unstale":"2024-04-28T13:07:28.019235+0000","last_undegraded":"2024-04-28T13:07:28.019235+0000","last_fullsized":"2024-04-28T13:07:28.019235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T20:04:56.915910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019926+0000","last_change":"2024-04-28T13:07:26.314926+0000","last_active":"2024-04-28T13:07:28.019926+0000","last_peered":"2024-04-28T13:07:28.019926+0000","last_clean":"2024-04-28T13:07:28.019926+0000","last_became_active":"2024-04-28T13:07:26.314391+0000","last_became_peered":"2024-04-28T13:07:26.314391+0000","last_unstale":"2024-04-28T13:07:28.019926+0000","last_undegraded":"2024-04-28T13:07:28.019926+0000","last_fullsized":"2024-04-28T13:07:28.019926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:27:11.373413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020208+0000","last_change":"2024-04-28T13:07:26.303423+0000","last_active":"2024-04-28T13:07:28.020208+0000","last_peered":"2024-04-28T13:07:28.020208+0000","last_clean":"2024-04-28T13:07:28.020208+0000","last_became_active":"2024-04-28T13:07:26.302361+0000","last_became_peered":"2024-04-28T13:07:26.302361+0000","last_unstale":"2024-04-28T13:07:28.020208+0000","last_undegraded":"2024-04-28T13:07:28.020208+0000","last_fullsized":"2024-04-28T13:07:28.020208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:45:56.180751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019816+0000","last_change":"2024-04-28T13:07:25.306186+0000","last_active":"2024-04-28T13:07:28.019816+0000","last_peered":"2024-04-28T13:07:28.019816+0000","last_clean":"2024-04-28T13:07:28.019816+0000","last_became_active":"2024-04-28T13:07:25.305761+0000","last_became_peered":"2024-04-28T13:07:25.305761+0000","last_unstale":"2024-04-28T13:07:28.019816+0000","last_undegraded":"2024-04-28T13:07:28.019816+0000","last_fullsized":"2024-04-28T13:07:28.019816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:01:05.000996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519234+0000","last_change":"2024-04-28T13:07:26.317195+0000","last_active":"2024-04-28T13:07:27.519234+0000","last_peered":"2024-04-28T13:07:27.519234+0000","last_clean":"2024-04-28T13:07:27.519234+0000","last_became_active":"2024-04-28T13:07:26.316432+0000","last_became_peered":"2024-04-28T13:07:26.316432+0000","last_unstale":"2024-04-28T13:07:27.519234+0000","last_undegraded":"2024-04-28T13:07:27.519234+0000","last_fullsized":"2024-04-28T13:07:27.519234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T16:06:41.543332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020047+0000","last_change":"2024-04-28T13:07:25.303307+0000","last_active":"2024-04-28T13:07:28.020047+0000","last_peered":"2024-04-28T13:07:28.020047+0000","last_clean":"2024-04-28T13:07:28.020047+0000","last_became_active":"2024-04-28T13:07:25.302669+0000","last_became_peered":"2024-04-28T13:07:25.302669+0000","last_unstale":"2024-04-28T13:07:28.020047+0000","last_undegraded":"2024-04-28T13:07:28.020047+0000","last_fullsized":"2024-04-28T13:07:28.020047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:34:02.814463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019548+0000","last_change":"2024-04-28T13:07:25.305429+0000","last_active":"2024-04-28T13:07:28.019548+0000","last_peered":"2024-04-28T13:07:28.019548+0000","last_clean":"2024-04-28T13:07:28.019548+0000","last_became_active":"2024-04-28T13:07:25.305121+0000","last_became_peered":"2024-04-28T13:07:25.305121+0000","last_unstale":"2024-04-28T13:07:28.019548+0000","last_undegraded":"2024-04-28T13:07:28.019548+0000","last_fullsized":"2024-04-28T13:07:28.019548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:49:52.826796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019378+0000","last_change":"2024-04-28T13:07:26.312253+0000","last_active":"2024-04-28T13:07:28.019378+0000","last_peered":"2024-04-28T13:07:28.019378+0000","last_clean":"2024-04-28T13:07:28.019378+0000","last_became_active":"2024-04-28T13:07:26.310573+0000","last_became_peered":"2024-04-28T13:07:26.310573+0000","last_unstale":"2024-04-28T13:07:28.019378+0000","last_undegraded":"2024-04-28T13:07:28.019378+0000","last_fullsized":"2024-04-28T13:07:28.019378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:27:11.373413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299130+0000","last_change":"2024-04-28T13:07:25.301794+0000","last_active":"2024-04-28T13:07:27.299130+0000","last_peered":"2024-04-28T13:07:27.299130+0000","last_clean":"2024-04-28T13:07:27.299130+0000","last_became_active":"2024-04-28T13:07:25.301463+0000","last_became_peered":"2024-04-28T13:07:25.301463+0000","last_unstale":"2024-04-28T13:07:27.299130+0000","last_undegraded":"2024-04-28T13:07:27.299130+0000","last_fullsized":"2024-04-28T13:07:27.299130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:15:37.155770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298405+0000","last_change":"2024-04-28T13:07:26.296566+0000","last_active":"2024-04-28T13:07:27.298405+0000","last_peered":"2024-04-28T13:07:27.298405+0000","last_clean":"2024-04-28T13:07:27.298405+0000","last_became_active":"2024-04-28T13:07:26.296273+0000","last_became_peered":"2024-04-28T13:07:26.296273+0000","last_unstale":"2024-04-28T13:07:27.298405+0000","last_undegraded":"2024-04-28T13:07:27.298405+0000","last_fullsized":"2024-04-28T13:07:27.298405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:48:54.699408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021606+0000","last_change":"2024-04-28T13:07:25.308017+0000","last_active":"2024-04-28T13:07:28.021606+0000","last_peered":"2024-04-28T13:07:28.021606+0000","last_clean":"2024-04-28T13:07:28.021606+0000","last_became_active":"2024-04-28T13:07:25.307704+0000","last_became_peered":"2024-04-28T13:07:25.307704+0000","last_unstale":"2024-04-28T13:07:28.021606+0000","last_undegraded":"2024-04-28T13:07:28.021606+0000","last_fullsized":"2024-04-28T13:07:28.021606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:57:54.511728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299240+0000","last_change":"2024-04-28T13:07:26.305171+0000","last_active":"2024-04-28T13:07:27.299240+0000","last_peered":"2024-04-28T13:07:27.299240+0000","last_clean":"2024-04-28T13:07:27.299240+0000","last_became_active":"2024-04-28T13:07:26.304900+0000","last_became_peered":"2024-04-28T13:07:26.304900+0000","last_unstale":"2024-04-28T13:07:27.299240+0000","last_undegraded":"2024-04-28T13:07:27.299240+0000","last_fullsized":"2024-04-28T13:07:27.299240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:06:39.922627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299510+0000","last_change":"2024-04-28T13:07:25.307177+0000","last_active":"2024-04-28T13:07:27.299510+0000","last_peered":"2024-04-28T13:07:27.299510+0000","last_clean":"2024-04-28T13:07:27.299510+0000","last_became_active":"2024-04-28T13:07:25.306922+0000","last_became_peered":"2024-04-28T13:07:25.306922+0000","last_unstale":"2024-04-28T13:07:27.299510+0000","last_undegraded":"2024-04-28T13:07:27.299510+0000","last_fullsized":"2024-04-28T13:07:27.299510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:34:02.814463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519315+0000","last_change":"2024-04-28T13:07:26.308975+0000","last_active":"2024-04-28T13:07:27.519315+0000","last_peered":"2024-04-28T13:07:27.519315+0000","last_clean":"2024-04-28T13:07:27.519315+0000","last_became_active":"2024-04-28T13:07:26.308715+0000","last_became_peered":"2024-04-28T13:07:26.308715+0000","last_unstale":"2024-04-28T13:07:27.519315+0000","last_undegraded":"2024-04-28T13:07:27.519315+0000","last_fullsized":"2024-04-28T13:07:27.519315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:17:21.385726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298608+0000","last_change":"2024-04-28T13:07:25.307356+0000","last_active":"2024-04-28T13:07:27.298608+0000","last_peered":"2024-04-28T13:07:27.298608+0000","last_clean":"2024-04-28T13:07:27.298608+0000","last_became_active":"2024-04-28T13:07:25.307108+0000","last_became_peered":"2024-04-28T13:07:25.307108+0000","last_unstale":"2024-04-28T13:07:27.298608+0000","last_undegraded":"2024-04-28T13:07:27.298608+0000","last_fullsized":"2024-04-28T13:07:27.298608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:57:54.511728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020935+0000","last_change":"2024-04-28T13:07:26.306801+0000","last_active":"2024-04-28T13:07:28.020935+0000","last_peered":"2024-04-28T13:07:28.020935+0000","last_clean":"2024-04-28T13:07:28.020935+0000","last_became_active":"2024-04-28T13:07:26.306051+0000","last_became_peered":"2024-04-28T13:07:26.306051+0000","last_unstale":"2024-04-28T13:07:28.020935+0000","last_undegraded":"2024-04-28T13:07:28.020935+0000","last_fullsized":"2024-04-28T13:07:28.020935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T20:04:56.915910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020644+0000","last_change":"2024-04-28T13:07:25.304551+0000","last_active":"2024-04-28T13:07:28.020644+0000","last_peered":"2024-04-28T13:07:28.020644+0000","last_clean":"2024-04-28T13:07:28.020644+0000","last_became_active":"2024-04-28T13:07:25.304117+0000","last_became_peered":"2024-04-28T13:07:25.304117+0000","last_unstale":"2024-04-28T13:07:28.020644+0000","last_undegraded":"2024-04-28T13:07:28.020644+0000","last_fullsized":"2024-04-28T13:07:28.020644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:45:55.171349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021023+0000","last_change":"2024-04-28T13:07:26.301509+0000","last_active":"2024-04-28T13:07:28.021023+0000","last_peered":"2024-04-28T13:07:28.021023+0000","last_clean":"2024-04-28T13:07:28.021023+0000","last_became_active":"2024-04-28T13:07:26.301221+0000","last_became_peered":"2024-04-28T13:07:26.301221+0000","last_unstale":"2024-04-28T13:07:28.021023+0000","last_undegraded":"2024-04-28T13:07:28.021023+0000","last_fullsized":"2024-04-28T13:07:28.021023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:00:58.728022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519255+0000","last_change":"2024-04-28T13:07:25.297320+0000","last_active":"2024-04-28T13:07:27.519255+0000","last_peered":"2024-04-28T13:07:27.519255+0000","last_clean":"2024-04-28T13:07:27.519255+0000","last_became_active":"2024-04-28T13:07:25.297037+0000","last_became_peered":"2024-04-28T13:07:25.297037+0000","last_unstale":"2024-04-28T13:07:27.519255+0000","last_undegraded":"2024-04-28T13:07:27.519255+0000","last_fullsized":"2024-04-28T13:07:27.519255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:01:05.000996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519019+0000","last_change":"2024-04-28T13:07:26.317885+0000","last_active":"2024-04-28T13:07:27.519019+0000","last_peered":"2024-04-28T13:07:27.519019+0000","last_clean":"2024-04-28T13:07:27.519019+0000","last_became_active":"2024-04-28T13:07:26.317583+0000","last_became_peered":"2024-04-28T13:07:26.317583+0000","last_unstale":"2024-04-28T13:07:27.519019+0000","last_undegraded":"2024-04-28T13:07:27.519019+0000","last_fullsized":"2024-04-28T13:07:27.519019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:03:37.479826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299720+0000","last_change":"2024-04-28T13:07:25.305697+0000","last_active":"2024-04-28T13:07:27.299720+0000","last_peered":"2024-04-28T13:07:27.299720+0000","last_clean":"2024-04-28T13:07:27.299720+0000","last_became_active":"2024-04-28T13:07:25.304315+0000","last_became_peered":"2024-04-28T13:07:25.304315+0000","last_unstale":"2024-04-28T13:07:27.299720+0000","last_undegraded":"2024-04-28T13:07:27.299720+0000","last_fullsized":"2024-04-28T13:07:27.299720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:57:54.511728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020601+0000","last_change":"2024-04-28T13:07:26.314531+0000","last_active":"2024-04-28T13:07:28.020601+0000","last_peered":"2024-04-28T13:07:28.020601+0000","last_clean":"2024-04-28T13:07:28.020601+0000","last_became_active":"2024-04-28T13:07:26.314257+0000","last_became_peered":"2024-04-28T13:07:26.314257+0000","last_unstale":"2024-04-28T13:07:28.020601+0000","last_undegraded":"2024-04-28T13:07:28.020601+0000","last_fullsized":"2024-04-28T13:07:28.020601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:06:39.922627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020115+0000","last_change":"2024-04-28T13:07:25.295863+0000","last_active":"2024-04-28T13:07:28.020115+0000","last_peered":"2024-04-28T13:07:28.020115+0000","last_clean":"2024-04-28T13:07:28.020115+0000","last_became_active":"2024-04-28T13:07:25.295475+0000","last_became_peered":"2024-04-28T13:07:25.295475+0000","last_unstale":"2024-04-28T13:07:28.020115+0000","last_undegraded":"2024-04-28T13:07:28.020115+0000","last_fullsized":"2024-04-28T13:07:28.020115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:15:37.155770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020204+0000","last_change":"2024-04-28T13:07:26.314673+0000","last_active":"2024-04-28T13:07:28.020204+0000","last_peered":"2024-04-28T13:07:28.020204+0000","last_clean":"2024-04-28T13:07:28.020204+0000","last_became_active":"2024-04-28T13:07:26.314038+0000","last_became_peered":"2024-04-28T13:07:26.314038+0000","last_unstale":"2024-04-28T13:07:28.020204+0000","last_undegraded":"2024-04-28T13:07:28.020204+0000","last_fullsized":"2024-04-28T13:07:28.020204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:48:54.699408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019157+0000","last_change":"2024-04-28T13:07:25.295521+0000","last_active":"2024-04-28T13:07:28.019157+0000","last_peered":"2024-04-28T13:07:28.019157+0000","last_clean":"2024-04-28T13:07:28.019157+0000","last_became_active":"2024-04-28T13:07:25.295243+0000","last_became_peered":"2024-04-28T13:07:25.295243+0000","last_unstale":"2024-04-28T13:07:28.019157+0000","last_undegraded":"2024-04-28T13:07:28.019157+0000","last_fullsized":"2024-04-28T13:07:28.019157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:49:52.826796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020137+0000","last_change":"2024-04-28T13:07:26.314594+0000","last_active":"2024-04-28T13:07:28.020137+0000","last_peered":"2024-04-28T13:07:28.020137+0000","last_clean":"2024-04-28T13:07:28.020137+0000","last_became_active":"2024-04-28T13:07:26.310077+0000","last_became_peered":"2024-04-28T13:07:26.310077+0000","last_unstale":"2024-04-28T13:07:28.020137+0000","last_undegraded":"2024-04-28T13:07:28.020137+0000","last_fullsized":"2024-04-28T13:07:28.020137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:17:42.011752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021124+0000","last_change":"2024-04-28T13:07:25.298854+0000","last_active":"2024-04-28T13:07:28.021124+0000","last_peered":"2024-04-28T13:07:28.021124+0000","last_clean":"2024-04-28T13:07:28.021124+0000","last_became_active":"2024-04-28T13:07:25.298100+0000","last_became_peered":"2024-04-28T13:07:25.298100+0000","last_unstale":"2024-04-28T13:07:28.021124+0000","last_undegraded":"2024-04-28T13:07:28.021124+0000","last_fullsized":"2024-04-28T13:07:28.021124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:50:40.986549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020963+0000","last_change":"2024-04-28T13:07:26.312944+0000","last_active":"2024-04-28T13:07:28.020963+0000","last_peered":"2024-04-28T13:07:28.020963+0000","last_clean":"2024-04-28T13:07:28.020963+0000","last_became_active":"2024-04-28T13:07:26.309861+0000","last_became_peered":"2024-04-28T13:07:26.309861+0000","last_unstale":"2024-04-28T13:07:28.020963+0000","last_undegraded":"2024-04-28T13:07:28.020963+0000","last_fullsized":"2024-04-28T13:07:28.020963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:06:35.011350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019402+0000","last_change":"2024-04-28T13:07:25.300448+0000","last_active":"2024-04-28T13:07:28.019402+0000","last_peered":"2024-04-28T13:07:28.019402+0000","last_clean":"2024-04-28T13:07:28.019402+0000","last_became_active":"2024-04-28T13:07:25.300181+0000","last_became_peered":"2024-04-28T13:07:25.300181+0000","last_unstale":"2024-04-28T13:07:28.019402+0000","last_undegraded":"2024-04-28T13:07:28.019402+0000","last_fullsized":"2024-04-28T13:07:28.019402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:34:02.814463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021674+0000","last_change":"2024-04-28T13:07:26.315390+0000","last_active":"2024-04-28T13:07:28.021674+0000","last_peered":"2024-04-28T13:07:28.021674+0000","last_clean":"2024-04-28T13:07:28.021674+0000","last_became_active":"2024-04-28T13:07:26.315077+0000","last_became_peered":"2024-04-28T13:07:26.315077+0000","last_unstale":"2024-04-28T13:07:28.021674+0000","last_undegraded":"2024-04-28T13:07:28.021674+0000","last_fullsized":"2024-04-28T13:07:28.021674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:05:21.187278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298630+0000","last_change":"2024-04-28T13:07:25.296275+0000","last_active":"2024-04-28T13:07:27.298630+0000","last_peered":"2024-04-28T13:07:27.298630+0000","last_clean":"2024-04-28T13:07:27.298630+0000","last_became_active":"2024-04-28T13:07:25.295930+0000","last_became_peered":"2024-04-28T13:07:25.295930+0000","last_unstale":"2024-04-28T13:07:27.298630+0000","last_undegraded":"2024-04-28T13:07:27.298630+0000","last_fullsized":"2024-04-28T13:07:27.298630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T20:04:55.906508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299309+0000","last_change":"2024-04-28T13:07:26.310964+0000","last_active":"2024-04-28T13:07:27.299309+0000","last_peered":"2024-04-28T13:07:27.299309+0000","last_clean":"2024-04-28T13:07:27.299309+0000","last_became_active":"2024-04-28T13:07:26.310666+0000","last_became_peered":"2024-04-28T13:07:26.310666+0000","last_unstale":"2024-04-28T13:07:27.299309+0000","last_undegraded":"2024-04-28T13:07:27.299309+0000","last_fullsized":"2024-04-28T13:07:27.299309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:06:35.011350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019509+0000","last_change":"2024-04-28T13:07:25.308033+0000","last_active":"2024-04-28T13:07:28.019509+0000","last_peered":"2024-04-28T13:07:28.019509+0000","last_clean":"2024-04-28T13:07:28.019509+0000","last_became_active":"2024-04-28T13:07:25.307709+0000","last_became_peered":"2024-04-28T13:07:25.307709+0000","last_unstale":"2024-04-28T13:07:28.019509+0000","last_undegraded":"2024-04-28T13:07:28.019509+0000","last_fullsized":"2024-04-28T13:07:28.019509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:45:55.171349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021170+0000","last_change":"2024-04-28T13:07:26.317026+0000","last_active":"2024-04-28T13:07:28.021170+0000","last_peered":"2024-04-28T13:07:28.021170+0000","last_clean":"2024-04-28T13:07:28.021170+0000","last_became_active":"2024-04-28T13:07:26.316637+0000","last_became_peered":"2024-04-28T13:07:26.316637+0000","last_unstale":"2024-04-28T13:07:28.021170+0000","last_undegraded":"2024-04-28T13:07:28.021170+0000","last_fullsized":"2024-04-28T13:07:28.021170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:10:44.035551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020210+0000","last_change":"2024-04-28T13:07:16.698740+0000","last_active":"2024-04-28T13:07:28.020210+0000","last_peered":"2024-04-28T13:07:28.020210+0000","last_clean":"2024-04-28T13:07:28.020210+0000","last_became_active":"2024-04-28T13:07:16.696364+0000","last_became_peered":"2024-04-28T13:07:16.696364+0000","last_unstale":"2024-04-28T13:07:28.020210+0000","last_undegraded":"2024-04-28T13:07:28.020210+0000","last_fullsized":"2024-04-28T13:07:28.020210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:14.770499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:14.770499+0000","last_clean_scrub_stamp":"2024-04-28T13:07:14.770499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:39:38.986133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299409+0000","last_change":"2024-04-28T13:07:25.301675+0000","last_active":"2024-04-28T13:07:27.299409+0000","last_peered":"2024-04-28T13:07:27.299409+0000","last_clean":"2024-04-28T13:07:27.299409+0000","last_became_active":"2024-04-28T13:07:25.301373+0000","last_became_peered":"2024-04-28T13:07:25.301373+0000","last_unstale":"2024-04-28T13:07:27.299409+0000","last_undegraded":"2024-04-28T13:07:27.299409+0000","last_fullsized":"2024-04-28T13:07:27.299409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:45:55.171349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019902+0000","last_change":"2024-04-28T13:07:26.309600+0000","last_active":"2024-04-28T13:07:28.019902+0000","last_peered":"2024-04-28T13:07:28.019902+0000","last_clean":"2024-04-28T13:07:28.019902+0000","last_became_active":"2024-04-28T13:07:26.309317+0000","last_became_peered":"2024-04-28T13:07:26.309317+0000","last_unstale":"2024-04-28T13:07:28.019902+0000","last_undegraded":"2024-04-28T13:07:28.019902+0000","last_fullsized":"2024-04-28T13:07:28.019902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T13:30:05.831084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020381+0000","last_change":"2024-04-28T13:07:25.305597+0000","last_active":"2024-04-28T13:07:28.020381+0000","last_peered":"2024-04-28T13:07:28.020381+0000","last_clean":"2024-04-28T13:07:28.020381+0000","last_became_active":"2024-04-28T13:07:25.305095+0000","last_became_peered":"2024-04-28T13:07:25.305095+0000","last_unstale":"2024-04-28T13:07:28.020381+0000","last_undegraded":"2024-04-28T13:07:28.020381+0000","last_fullsized":"2024-04-28T13:07:28.020381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:37:32.063208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.518924+0000","last_change":"2024-04-28T13:07:26.312371+0000","last_active":"2024-04-28T13:07:27.518924+0000","last_peered":"2024-04-28T13:07:27.518924+0000","last_clean":"2024-04-28T13:07:27.518924+0000","last_became_active":"2024-04-28T13:07:26.312094+0000","last_became_peered":"2024-04-28T13:07:26.312094+0000","last_unstale":"2024-04-28T13:07:27.518924+0000","last_undegraded":"2024-04-28T13:07:27.518924+0000","last_fullsized":"2024-04-28T13:07:27.518924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T20:29:58.561638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019272+0000","last_change":"2024-04-28T13:07:25.299270+0000","last_active":"2024-04-28T13:07:28.019272+0000","last_peered":"2024-04-28T13:07:28.019272+0000","last_clean":"2024-04-28T13:07:28.019272+0000","last_became_active":"2024-04-28T13:07:25.299003+0000","last_became_peered":"2024-04-28T13:07:25.299003+0000","last_unstale":"2024-04-28T13:07:28.019272+0000","last_undegraded":"2024-04-28T13:07:28.019272+0000","last_fullsized":"2024-04-28T13:07:28.019272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:15:37.155770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298443+0000","last_change":"2024-04-28T13:07:26.304077+0000","last_active":"2024-04-28T13:07:27.298443+0000","last_peered":"2024-04-28T13:07:27.298443+0000","last_clean":"2024-04-28T13:07:27.298443+0000","last_became_active":"2024-04-28T13:07:26.302114+0000","last_became_peered":"2024-04-28T13:07:26.302114+0000","last_unstale":"2024-04-28T13:07:27.298443+0000","last_undegraded":"2024-04-28T13:07:27.298443+0000","last_fullsized":"2024-04-28T13:07:27.298443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:28:05.357255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299704+0000","last_change":"2024-04-28T13:07:25.306063+0000","last_active":"2024-04-28T13:07:27.299704+0000","last_peered":"2024-04-28T13:07:27.299704+0000","last_clean":"2024-04-28T13:07:27.299704+0000","last_became_active":"2024-04-28T13:07:25.305789+0000","last_became_peered":"2024-04-28T13:07:25.305789+0000","last_unstale":"2024-04-28T13:07:27.299704+0000","last_undegraded":"2024-04-28T13:07:27.299704+0000","last_fullsized":"2024-04-28T13:07:27.299704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:18:36.741678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020557+0000","last_change":"2024-04-28T13:07:26.314298+0000","last_active":"2024-04-28T13:07:28.020557+0000","last_peered":"2024-04-28T13:07:28.020557+0000","last_clean":"2024-04-28T13:07:28.020557+0000","last_became_active":"2024-04-28T13:07:26.313337+0000","last_became_peered":"2024-04-28T13:07:26.313337+0000","last_unstale":"2024-04-28T13:07:28.020557+0000","last_undegraded":"2024-04-28T13:07:28.020557+0000","last_fullsized":"2024-04-28T13:07:28.020557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:57:55.521129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298469+0000","last_change":"2024-04-28T13:07:25.300122+0000","last_active":"2024-04-28T13:07:27.298469+0000","last_peered":"2024-04-28T13:07:27.298469+0000","last_clean":"2024-04-28T13:07:27.298469+0000","last_became_active":"2024-04-28T13:07:25.299837+0000","last_became_peered":"2024-04-28T13:07:25.299837+0000","last_unstale":"2024-04-28T13:07:27.298469+0000","last_undegraded":"2024-04-28T13:07:27.298469+0000","last_fullsized":"2024-04-28T13:07:27.298469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:34:02.814463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299554+0000","last_change":"2024-04-28T13:07:26.312457+0000","last_active":"2024-04-28T13:07:27.299554+0000","last_peered":"2024-04-28T13:07:27.299554+0000","last_clean":"2024-04-28T13:07:27.299554+0000","last_became_active":"2024-04-28T13:07:26.310729+0000","last_became_peered":"2024-04-28T13:07:26.310729+0000","last_unstale":"2024-04-28T13:07:27.299554+0000","last_undegraded":"2024-04-28T13:07:27.299554+0000","last_fullsized":"2024-04-28T13:07:27.299554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:39:10.176279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021328+0000","last_change":"2024-04-28T13:07:25.305837+0000","last_active":"2024-04-28T13:07:28.021328+0000","last_peered":"2024-04-28T13:07:28.021328+0000","last_clean":"2024-04-28T13:07:28.021328+0000","last_became_active":"2024-04-28T13:07:25.305581+0000","last_became_peered":"2024-04-28T13:07:25.305581+0000","last_unstale":"2024-04-28T13:07:28.021328+0000","last_undegraded":"2024-04-28T13:07:28.021328+0000","last_fullsized":"2024-04-28T13:07:28.021328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T20:04:55.906508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298902+0000","last_change":"2024-04-28T13:07:26.306415+0000","last_active":"2024-04-28T13:07:27.298902+0000","last_peered":"2024-04-28T13:07:27.298902+0000","last_clean":"2024-04-28T13:07:27.298902+0000","last_became_active":"2024-04-28T13:07:26.306144+0000","last_became_peered":"2024-04-28T13:07:26.306144+0000","last_unstale":"2024-04-28T13:07:27.298902+0000","last_undegraded":"2024-04-28T13:07:27.298902+0000","last_fullsized":"2024-04-28T13:07:27.298902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:17:21.385726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.292069+0000","last_change":"2024-04-28T13:07:25.303907+0000","last_active":"2024-04-28T13:07:28.292069+0000","last_peered":"2024-04-28T13:07:28.292069+0000","last_clean":"2024-04-28T13:07:28.292069+0000","last_became_active":"2024-04-28T13:07:25.303642+0000","last_became_peered":"2024-04-28T13:07:25.303642+0000","last_unstale":"2024-04-28T13:07:28.292069+0000","last_undegraded":"2024-04-28T13:07:28.292069+0000","last_fullsized":"2024-04-28T13:07:28.292069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:18:36.741678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019882+0000","last_change":"2024-04-28T13:07:26.302909+0000","last_active":"2024-04-28T13:07:28.019882+0000","last_peered":"2024-04-28T13:07:28.019882+0000","last_clean":"2024-04-28T13:07:28.019882+0000","last_became_active":"2024-04-28T13:07:26.302616+0000","last_became_peered":"2024-04-28T13:07:26.302616+0000","last_unstale":"2024-04-28T13:07:28.019882+0000","last_undegraded":"2024-04-28T13:07:28.019882+0000","last_fullsized":"2024-04-28T13:07:28.019882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:34:15.706993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021645+0000","last_change":"2024-04-28T13:07:25.303003+0000","last_active":"2024-04-28T13:07:28.021645+0000","last_peered":"2024-04-28T13:07:28.021645+0000","last_clean":"2024-04-28T13:07:28.021645+0000","last_became_active":"2024-04-28T13:07:25.302712+0000","last_became_peered":"2024-04-28T13:07:25.302712+0000","last_unstale":"2024-04-28T13:07:28.021645+0000","last_undegraded":"2024-04-28T13:07:28.021645+0000","last_fullsized":"2024-04-28T13:07:28.021645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:18:36.741678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519293+0000","last_change":"2024-04-28T13:07:26.315645+0000","last_active":"2024-04-28T13:07:27.519293+0000","last_peered":"2024-04-28T13:07:27.519293+0000","last_clean":"2024-04-28T13:07:27.519293+0000","last_became_active":"2024-04-28T13:07:26.315143+0000","last_became_peered":"2024-04-28T13:07:26.315143+0000","last_unstale":"2024-04-28T13:07:27.519293+0000","last_undegraded":"2024-04-28T13:07:27.519293+0000","last_fullsized":"2024-04-28T13:07:27.519293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:15:46.081328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019894+0000","last_change":"2024-04-28T13:07:25.305301+0000","last_active":"2024-04-28T13:07:28.019894+0000","last_peered":"2024-04-28T13:07:28.019894+0000","last_clean":"2024-04-28T13:07:28.019894+0000","last_became_active":"2024-04-28T13:07:25.304822+0000","last_became_peered":"2024-04-28T13:07:25.304822+0000","last_unstale":"2024-04-28T13:07:28.019894+0000","last_undegraded":"2024-04-28T13:07:28.019894+0000","last_fullsized":"2024-04-28T13:07:28.019894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:34:02.814463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020519+0000","last_change":"2024-04-28T13:07:26.303907+0000","last_active":"2024-04-28T13:07:28.020519+0000","last_peered":"2024-04-28T13:07:28.020519+0000","last_clean":"2024-04-28T13:07:28.020519+0000","last_became_active":"2024-04-28T13:07:26.302029+0000","last_became_peered":"2024-04-28T13:07:26.302029+0000","last_unstale":"2024-04-28T13:07:28.020519+0000","last_undegraded":"2024-04-28T13:07:28.020519+0000","last_fullsized":"2024-04-28T13:07:28.020519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:34:03.823865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298502+0000","last_change":"2024-04-28T13:07:25.302824+0000","last_active":"2024-04-28T13:07:27.298502+0000","last_peered":"2024-04-28T13:07:27.298502+0000","last_clean":"2024-04-28T13:07:27.298502+0000","last_became_active":"2024-04-28T13:07:25.302542+0000","last_became_peered":"2024-04-28T13:07:25.302542+0000","last_unstale":"2024-04-28T13:07:27.298502+0000","last_undegraded":"2024-04-28T13:07:27.298502+0000","last_fullsized":"2024-04-28T13:07:27.298502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:48:48.399055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019557+0000","last_change":"2024-04-28T13:07:26.302092+0000","last_active":"2024-04-28T13:07:28.019557+0000","last_peered":"2024-04-28T13:07:28.019557+0000","last_clean":"2024-04-28T13:07:28.019557+0000","last_became_active":"2024-04-28T13:07:26.301796+0000","last_became_peered":"2024-04-28T13:07:26.301796+0000","last_unstale":"2024-04-28T13:07:28.019557+0000","last_undegraded":"2024-04-28T13:07:28.019557+0000","last_fullsized":"2024-04-28T13:07:28.019557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:48:54.699408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298737+0000","last_change":"2024-04-28T13:07:25.297284+0000","last_active":"2024-04-28T13:07:27.298737+0000","last_peered":"2024-04-28T13:07:27.298737+0000","last_clean":"2024-04-28T13:07:27.298737+0000","last_became_active":"2024-04-28T13:07:25.296587+0000","last_became_peered":"2024-04-28T13:07:25.296587+0000","last_unstale":"2024-04-28T13:07:27.298737+0000","last_undegraded":"2024-04-28T13:07:27.298737+0000","last_fullsized":"2024-04-28T13:07:27.298737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:45:55.171349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019805+0000","last_change":"2024-04-28T13:07:26.312775+0000","last_active":"2024-04-28T13:07:28.019805+0000","last_peered":"2024-04-28T13:07:28.019805+0000","last_clean":"2024-04-28T13:07:28.019805+0000","last_became_active":"2024-04-28T13:07:26.312360+0000","last_became_peered":"2024-04-28T13:07:26.312360+0000","last_unstale":"2024-04-28T13:07:28.019805+0000","last_undegraded":"2024-04-28T13:07:28.019805+0000","last_fullsized":"2024-04-28T13:07:28.019805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T16:06:41.543332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020772+0000","last_change":"2024-04-28T13:07:25.305849+0000","last_active":"2024-04-28T13:07:28.020772+0000","last_peered":"2024-04-28T13:07:28.020772+0000","last_clean":"2024-04-28T13:07:28.020772+0000","last_became_active":"2024-04-28T13:07:25.305412+0000","last_became_peered":"2024-04-28T13:07:25.305412+0000","last_unstale":"2024-04-28T13:07:28.020772+0000","last_undegraded":"2024-04-28T13:07:28.020772+0000","last_fullsized":"2024-04-28T13:07:28.020772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:48:48.399055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019933+0000","last_change":"2024-04-28T13:07:26.310511+0000","last_active":"2024-04-28T13:07:28.019933+0000","last_peered":"2024-04-28T13:07:28.019933+0000","last_clean":"2024-04-28T13:07:28.019933+0000","last_became_active":"2024-04-28T13:07:26.310172+0000","last_became_peered":"2024-04-28T13:07:26.310172+0000","last_unstale":"2024-04-28T13:07:28.019933+0000","last_undegraded":"2024-04-28T13:07:28.019933+0000","last_fullsized":"2024-04-28T13:07:28.019933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:37:35.063109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299465+0000","last_change":"2024-04-28T13:07:26.310919+0000","last_active":"2024-04-28T13:07:27.299465+0000","last_peered":"2024-04-28T13:07:27.299465+0000","last_clean":"2024-04-28T13:07:27.299465+0000","last_became_active":"2024-04-28T13:07:26.310613+0000","last_became_peered":"2024-04-28T13:07:26.310613+0000","last_unstale":"2024-04-28T13:07:27.299465+0000","last_undegraded":"2024-04-28T13:07:27.299465+0000","last_fullsized":"2024-04-28T13:07:27.299465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T16:22:52.630763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020907+0000","last_change":"2024-04-28T13:07:25.307476+0000","last_active":"2024-04-28T13:07:28.020907+0000","last_peered":"2024-04-28T13:07:28.020907+0000","last_clean":"2024-04-28T13:07:28.020907+0000","last_became_active":"2024-04-28T13:07:25.307191+0000","last_became_peered":"2024-04-28T13:07:25.307191+0000","last_unstale":"2024-04-28T13:07:28.020907+0000","last_undegraded":"2024-04-28T13:07:28.020907+0000","last_fullsized":"2024-04-28T13:07:28.020907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:57:54.511728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299045+0000","last_change":"2024-04-28T13:07:26.310400+0000","last_active":"2024-04-28T13:07:27.299045+0000","last_peered":"2024-04-28T13:07:27.299045+0000","last_clean":"2024-04-28T13:07:27.299045+0000","last_became_active":"2024-04-28T13:07:26.310134+0000","last_became_peered":"2024-04-28T13:07:26.310134+0000","last_unstale":"2024-04-28T13:07:27.299045+0000","last_undegraded":"2024-04-28T13:07:27.299045+0000","last_fullsized":"2024-04-28T13:07:27.299045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T13:30:05.831084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021269+0000","last_change":"2024-04-28T13:07:25.307311+0000","last_active":"2024-04-28T13:07:28.021269+0000","last_peered":"2024-04-28T13:07:28.021269+0000","last_clean":"2024-04-28T13:07:28.021269+0000","last_became_active":"2024-04-28T13:07:25.307038+0000","last_became_peered":"2024-04-28T13:07:25.307038+0000","last_unstale":"2024-04-28T13:07:28.021269+0000","last_undegraded":"2024-04-28T13:07:28.021269+0000","last_fullsized":"2024-04-28T13:07:28.021269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:18:36.741678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519232+0000","last_change":"2024-04-28T13:07:26.311594+0000","last_active":"2024-04-28T13:07:27.519232+0000","last_peered":"2024-04-28T13:07:27.519232+0000","last_clean":"2024-04-28T13:07:27.519232+0000","last_became_active":"2024-04-28T13:07:26.311214+0000","last_became_peered":"2024-04-28T13:07:26.311214+0000","last_unstale":"2024-04-28T13:07:27.519232+0000","last_undegraded":"2024-04-28T13:07:27.519232+0000","last_fullsized":"2024-04-28T13:07:27.519232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:28:05.357255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019855+0000","last_change":"2024-04-28T13:07:25.301929+0000","last_active":"2024-04-28T13:07:28.019855+0000","last_peered":"2024-04-28T13:07:28.019855+0000","last_clean":"2024-04-28T13:07:28.019855+0000","last_became_active":"2024-04-28T13:07:25.301636+0000","last_became_peered":"2024-04-28T13:07:25.301636+0000","last_unstale":"2024-04-28T13:07:28.019855+0000","last_undegraded":"2024-04-28T13:07:28.019855+0000","last_fullsized":"2024-04-28T13:07:28.019855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:45:35.718557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019918+0000","last_change":"2024-04-28T13:07:26.311537+0000","last_active":"2024-04-28T13:07:28.019918+0000","last_peered":"2024-04-28T13:07:28.019918+0000","last_clean":"2024-04-28T13:07:28.019918+0000","last_became_active":"2024-04-28T13:07:26.310710+0000","last_became_peered":"2024-04-28T13:07:26.310710+0000","last_unstale":"2024-04-28T13:07:28.019918+0000","last_undegraded":"2024-04-28T13:07:28.019918+0000","last_fullsized":"2024-04-28T13:07:28.019918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:17:42.011752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519326+0000","last_change":"2024-04-28T13:07:25.302646+0000","last_active":"2024-04-28T13:07:27.519326+0000","last_peered":"2024-04-28T13:07:27.519326+0000","last_clean":"2024-04-28T13:07:27.519326+0000","last_became_active":"2024-04-28T13:07:25.302386+0000","last_became_peered":"2024-04-28T13:07:25.302386+0000","last_unstale":"2024-04-28T13:07:27.519326+0000","last_undegraded":"2024-04-28T13:07:27.519326+0000","last_fullsized":"2024-04-28T13:07:27.519326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:45:35.718557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-28T13:07:37.894 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-28T13:07:38.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.026+0000 7f493c358640 1 Processor -- start 2024-04-28T13:07:38.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.027+0000 7f493c358640 1 -- start start 2024-04-28T13:07:38.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.028+0000 7f493c358640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f49340723d0 0x7f493415d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:38.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.028+0000 7f493c358640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4934153710 con 0x7f4934153330 2024-04-28T13:07:38.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.028+0000 7f493c358640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49340b4a60 con 0x7f49340742c0 2024-04-28T13:07:38.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.028+0000 7f493c358640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f4934072990 con 0x7f49340723d0 2024-04-28T13:07:38.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.028+0000 7f493a8f5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f49340723d0 0x7f493415d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:38.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.028+0000 7f493a0f4640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f4934153330 0x7f4934073bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46930/0 (socket says 172.21.15.114:46930) 2024-04-28T13:07:38.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.028+0000 7f493a0f4640 1 -- 172.21.15.114:0/1257806400 learned_addr learned my addr 172.21.15.114:0/1257806400 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:38.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.028+0000 7f493a8f5640 1 -- 172.21.15.114:0/1257806400 >> v1:172.21.15.134:6789/0 conn(0x7f49340742c0 legacy=0x7f49340cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:38.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.028+0000 7f493a8f5640 1 -- 172.21.15.114:0/1257806400 >> v1:172.21.15.114:6789/0 conn(0x7f4934153330 legacy=0x7f4934073bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:38.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.028+0000 7f49390f2640 1 -- 172.21.15.114:0/1257806400 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 324276974 0 0) 0x7f4928001110 con 0x7f4934153330 2024-04-28T13:07:38.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.028+0000 7f493a8f5640 1 -- 172.21.15.114:0/1257806400 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4934072c70 con 0x7f49340723d0 2024-04-28T13:07:38.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.029+0000 7f493a8f5640 1 --2- 172.21.15.114:0/1257806400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49340723d0 0x7f493415d2e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f492c009d90 tx=0x7f492c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c06dc02dc92e955 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:38.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.029+0000 7f49390f2640 1 -- 172.21.15.114:0/1257806400 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492c007740 con 0x7f49340723d0 2024-04-28T13:07:38.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.029+0000 7f49390f2640 1 -- 172.21.15.114:0/1257806400 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f492c0078e0 con 0x7f49340723d0 2024-04-28T13:07:38.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.029+0000 7f49390f2640 1 -- 172.21.15.114:0/1257806400 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492c007cb0 con 0x7f49340723d0 2024-04-28T13:07:38.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.029+0000 7f493c358640 1 -- 172.21.15.114:0/1257806400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49340723d0 msgr2=0x7f493415d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:38.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.029+0000 7f493c358640 1 --2- 172.21.15.114:0/1257806400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49340723d0 0x7f493415d2e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f492c009d90 tx=0x7f492c02a6f0 comp rx=0 tx=0).stop 2024-04-28T13:07:38.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.029+0000 7f493c358640 1 -- 172.21.15.114:0/1257806400 shutdown_connections 2024-04-28T13:07:38.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.029+0000 7f493c358640 1 --2- 172.21.15.114:0/1257806400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49340723d0 0x7f493415d2e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:38.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.029+0000 7f493c358640 1 -- 172.21.15.114:0/1257806400 >> 172.21.15.114:0/1257806400 conn(0x7f493406c980 msgr2=0x7f49340b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:38.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.029+0000 7f493c358640 1 -- 172.21.15.114:0/1257806400 shutdown_connections 2024-04-28T13:07:38.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.029+0000 7f493c358640 1 -- 172.21.15.114:0/1257806400 wait complete. 2024-04-28T13:07:38.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.031+0000 7f493c358640 1 Processor -- start 2024-04-28T13:07:38.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.031+0000 7f493c358640 1 -- start start 2024-04-28T13:07:38.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.031+0000 7f493c358640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49340723d0 0x7f49341418e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:38.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.031+0000 7f493c358640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49340742c0 0x7f49341e5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:38.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.031+0000 7f493c358640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4934153330 0x7f49341e6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:38.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.031+0000 7f493c358640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4934073510 con 0x7f4934153330 2024-04-28T13:07:38.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.031+0000 7f493c358640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4934073230 con 0x7f49340723d0 2024-04-28T13:07:38.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.031+0000 7f493c358640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f49340cf500 con 0x7f49340742c0 2024-04-28T13:07:38.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.031+0000 7f493a8f5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4934153330 0x7f49341e6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:38.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.031+0000 7f493a8f5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4934153330 0x7f49341e6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48392/0 (socket says 172.21.15.114:48392) 2024-04-28T13:07:38.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.031+0000 7f493a8f5640 1 -- 172.21.15.114:0/757950562 learned_addr learned my addr 172.21.15.114:0/757950562 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:38.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.031+0000 7f493a0f4640 1 --2- 172.21.15.114:0/757950562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49340723d0 0x7f49341418e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:38.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.031+0000 7f49398f3640 1 --2- 172.21.15.114:0/757950562 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49340742c0 0x7f49341e5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:38.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.032+0000 7f493a8f5640 1 -- 172.21.15.114:0/757950562 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49340742c0 msgr2=0x7f49341e5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:38.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.032+0000 7f493a8f5640 1 --2- 172.21.15.114:0/757950562 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49340742c0 0x7f49341e5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:38.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.032+0000 7f493a8f5640 1 -- 172.21.15.114:0/757950562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49340723d0 msgr2=0x7f49341418e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:38.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.032+0000 7f493a8f5640 1 --2- 172.21.15.114:0/757950562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49340723d0 0x7f49341418e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:38.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.032+0000 7f493a8f5640 1 -- 172.21.15.114:0/757950562 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f493415d040 con 0x7f4934153330 2024-04-28T13:07:38.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.032+0000 7f493a8f5640 1 --2- 172.21.15.114:0/757950562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4934153330 0x7f49341e6550 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f492c009d90 tx=0x7f492c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:38.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.032+0000 7f4926ffd640 1 -- 172.21.15.114:0/757950562 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492c040070 con 0x7f4934153330 2024-04-28T13:07:38.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.032+0000 7f4926ffd640 1 -- 172.21.15.114:0/757950562 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f492c031c90 con 0x7f4934153330 2024-04-28T13:07:38.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.032+0000 7f493c358640 1 -- 172.21.15.114:0/757950562 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49341e7360 con 0x7f4934153330 2024-04-28T13:07:38.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.032+0000 7f4926ffd640 1 -- 172.21.15.114:0/757950562 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492c03c640 con 0x7f4934153330 2024-04-28T13:07:38.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.032+0000 7f493c358640 1 -- 172.21.15.114:0/757950562 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49341e7920 con 0x7f4934153330 2024-04-28T13:07:38.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.033+0000 7f493c358640 1 -- 172.21.15.114:0/757950562 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f493406a3d0 con 0x7f4934153330 2024-04-28T13:07:38.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.033+0000 7f4926ffd640 1 -- 172.21.15.114:0/757950562 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f492c039040 con 0x7f4934153330 2024-04-28T13:07:38.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.034+0000 7f4926ffd640 1 --2- 172.21.15.114:0/757950562 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f491806c8f0 0x7f491806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:38.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.034+0000 7f493a0f4640 1 --2- 172.21.15.114:0/757950562 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f491806c8f0 0x7f491806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:38.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.034+0000 7f4926ffd640 1 -- 172.21.15.114:0/757950562 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f492c0ad150 con 0x7f4934153330 2024-04-28T13:07:38.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.034+0000 7f493a0f4640 1 --2- 172.21.15.114:0/757950562 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f491806c8f0 0x7f491806edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4928000f60 tx=0x7f4928007d00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:38.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.038+0000 7f4926ffd640 1 -- 172.21.15.114:0/757950562 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f492c07b6d0 con 0x7f4934153330 2024-04-28T13:07:38.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.209+0000 7f493c358640 1 -- 172.21.15.114:0/757950562 --> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f49340740a0 con 0x7f491806c8f0 2024-04-28T13:07:38.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.215+0000 7f4926ffd640 1 -- 172.21.15.114:0/757950562 <== mgr.4104 v2:172.21.15.114:6832/2240257326 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251837 (secure 0 0 0) 0x7f49340740a0 con 0x7f491806c8f0 2024-04-28T13:07:38.219 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:38.220 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-04-28T13:07:38.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.218+0000 7f493c358640 1 -- 172.21.15.114:0/757950562 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f491806c8f0 msgr2=0x7f491806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:38.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.218+0000 7f493c358640 1 --2- 172.21.15.114:0/757950562 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f491806c8f0 0x7f491806edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4928000f60 tx=0x7f4928007d00 comp rx=0 tx=0).stop 2024-04-28T13:07:38.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.218+0000 7f493c358640 1 -- 172.21.15.114:0/757950562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4934153330 msgr2=0x7f49341e6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:38.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.218+0000 7f493c358640 1 --2- 172.21.15.114:0/757950562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4934153330 0x7f49341e6550 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f492c009d90 tx=0x7f492c004a40 comp rx=0 tx=0).stop 2024-04-28T13:07:38.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.218+0000 7f493c358640 1 -- 172.21.15.114:0/757950562 shutdown_connections 2024-04-28T13:07:38.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.218+0000 7f493c358640 1 --2- 172.21.15.114:0/757950562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4934153330 0x7f49341e6550 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:38.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.218+0000 7f493c358640 1 --2- 172.21.15.114:0/757950562 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49340742c0 0x7f49341e5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:38.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.218+0000 7f493c358640 1 --2- 172.21.15.114:0/757950562 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f491806c8f0 0x7f491806edb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:38.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.218+0000 7f493c358640 1 --2- 172.21.15.114:0/757950562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49340723d0 0x7f49341418e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:38.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.218+0000 7f493c358640 1 -- 172.21.15.114:0/757950562 >> 172.21.15.114:0/757950562 conn(0x7f493406c980 msgr2=0x7f49340b0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:38.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.218+0000 7f493c358640 1 -- 172.21.15.114:0/757950562 shutdown_connections 2024-04-28T13:07:38.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.218+0000 7f493c358640 1 -- 172.21.15.114:0/757950562 wait complete. 2024-04-28T13:07:38.228 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-04-28T13:07:36.709392+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219104,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755616,"statfs":{"total":773094113280,"available":772869750784,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002025"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021526+0000","last_change":"2024-04-28T13:07:26.313967+0000","last_active":"2024-04-28T13:07:28.021526+0000","last_peered":"2024-04-28T13:07:28.021526+0000","last_clean":"2024-04-28T13:07:28.021526+0000","last_became_active":"2024-04-28T13:07:26.309492+0000","last_became_peered":"2024-04-28T13:07:26.309492+0000","last_unstale":"2024-04-28T13:07:28.021526+0000","last_undegraded":"2024-04-28T13:07:28.021526+0000","last_fullsized":"2024-04-28T13:07:28.021526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:39:10.176279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298698+0000","last_change":"2024-04-28T13:07:26.309087+0000","last_active":"2024-04-28T13:07:27.298698+0000","last_peered":"2024-04-28T13:07:27.298698+0000","last_clean":"2024-04-28T13:07:27.298698+0000","last_became_active":"2024-04-28T13:07:26.308799+0000","last_became_peered":"2024-04-28T13:07:26.308799+0000","last_unstale":"2024-04-28T13:07:27.298698+0000","last_undegraded":"2024-04-28T13:07:27.298698+0000","last_fullsized":"2024-04-28T13:07:27.298698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:15:46.081328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519230+0000","last_change":"2024-04-28T13:07:26.310735+0000","last_active":"2024-04-28T13:07:27.519230+0000","last_peered":"2024-04-28T13:07:27.519230+0000","last_clean":"2024-04-28T13:07:27.519230+0000","last_became_active":"2024-04-28T13:07:26.310442+0000","last_became_peered":"2024-04-28T13:07:26.310442+0000","last_unstale":"2024-04-28T13:07:27.519230+0000","last_undegraded":"2024-04-28T13:07:27.519230+0000","last_fullsized":"2024-04-28T13:07:27.519230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:59:35.713480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299050+0000","last_change":"2024-04-28T13:07:26.316425+0000","last_active":"2024-04-28T13:07:27.299050+0000","last_peered":"2024-04-28T13:07:27.299050+0000","last_clean":"2024-04-28T13:07:27.299050+0000","last_became_active":"2024-04-28T13:07:26.316055+0000","last_became_peered":"2024-04-28T13:07:26.316055+0000","last_unstale":"2024-04-28T13:07:27.299050+0000","last_undegraded":"2024-04-28T13:07:27.299050+0000","last_fullsized":"2024-04-28T13:07:27.299050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:17:42.011752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020050+0000","last_change":"2024-04-28T13:07:26.315472+0000","last_active":"2024-04-28T13:07:28.020050+0000","last_peered":"2024-04-28T13:07:28.020050+0000","last_clean":"2024-04-28T13:07:28.020050+0000","last_became_active":"2024-04-28T13:07:26.315216+0000","last_became_peered":"2024-04-28T13:07:26.315216+0000","last_unstale":"2024-04-28T13:07:28.020050+0000","last_undegraded":"2024-04-28T13:07:28.020050+0000","last_fullsized":"2024-04-28T13:07:28.020050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T13:30:05.831084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298986+0000","last_change":"2024-04-28T13:07:26.313012+0000","last_active":"2024-04-28T13:07:27.298986+0000","last_peered":"2024-04-28T13:07:27.298986+0000","last_clean":"2024-04-28T13:07:27.298986+0000","last_became_active":"2024-04-28T13:07:26.312724+0000","last_became_peered":"2024-04-28T13:07:26.312724+0000","last_unstale":"2024-04-28T13:07:27.298986+0000","last_undegraded":"2024-04-28T13:07:27.298986+0000","last_fullsized":"2024-04-28T13:07:27.298986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:34:15.706993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019989+0000","last_change":"2024-04-28T13:07:26.314352+0000","last_active":"2024-04-28T13:07:28.019989+0000","last_peered":"2024-04-28T13:07:28.019989+0000","last_clean":"2024-04-28T13:07:28.019989+0000","last_became_active":"2024-04-28T13:07:26.314068+0000","last_became_peered":"2024-04-28T13:07:26.314068+0000","last_unstale":"2024-04-28T13:07:28.019989+0000","last_undegraded":"2024-04-28T13:07:28.019989+0000","last_fullsized":"2024-04-28T13:07:28.019989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:34:15.706993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019405+0000","last_change":"2024-04-28T13:07:26.308898+0000","last_active":"2024-04-28T13:07:28.019405+0000","last_peered":"2024-04-28T13:07:28.019405+0000","last_clean":"2024-04-28T13:07:28.019405+0000","last_became_active":"2024-04-28T13:07:26.308567+0000","last_became_peered":"2024-04-28T13:07:26.308567+0000","last_unstale":"2024-04-28T13:07:28.019405+0000","last_undegraded":"2024-04-28T13:07:28.019405+0000","last_fullsized":"2024-04-28T13:07:28.019405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:37:35.063109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021532+0000","last_change":"2024-04-28T13:07:26.313669+0000","last_active":"2024-04-28T13:07:28.021532+0000","last_peered":"2024-04-28T13:07:28.021532+0000","last_clean":"2024-04-28T13:07:28.021532+0000","last_became_active":"2024-04-28T13:07:26.307908+0000","last_became_peered":"2024-04-28T13:07:26.307908+0000","last_unstale":"2024-04-28T13:07:28.021532+0000","last_undegraded":"2024-04-28T13:07:28.021532+0000","last_fullsized":"2024-04-28T13:07:28.021532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:04:24.766267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021321+0000","last_change":"2024-04-28T13:07:26.307257+0000","last_active":"2024-04-28T13:07:28.021321+0000","last_peered":"2024-04-28T13:07:28.021321+0000","last_clean":"2024-04-28T13:07:28.021321+0000","last_became_active":"2024-04-28T13:07:26.306866+0000","last_became_peered":"2024-04-28T13:07:26.306866+0000","last_unstale":"2024-04-28T13:07:28.021321+0000","last_undegraded":"2024-04-28T13:07:28.021321+0000","last_fullsized":"2024-04-28T13:07:28.021321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T16:06:41.543332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020923+0000","last_change":"2024-04-28T13:07:26.309606+0000","last_active":"2024-04-28T13:07:28.020923+0000","last_peered":"2024-04-28T13:07:28.020923+0000","last_clean":"2024-04-28T13:07:28.020923+0000","last_became_active":"2024-04-28T13:07:26.309338+0000","last_became_peered":"2024-04-28T13:07:26.309338+0000","last_unstale":"2024-04-28T13:07:28.020923+0000","last_undegraded":"2024-04-28T13:07:28.020923+0000","last_fullsized":"2024-04-28T13:07:28.020923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:28:05.357255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020781+0000","last_change":"2024-04-28T13:07:26.308307+0000","last_active":"2024-04-28T13:07:28.020781+0000","last_peered":"2024-04-28T13:07:28.020781+0000","last_clean":"2024-04-28T13:07:28.020781+0000","last_became_active":"2024-04-28T13:07:26.307664+0000","last_became_peered":"2024-04-28T13:07:26.307664+0000","last_unstale":"2024-04-28T13:07:28.020781+0000","last_undegraded":"2024-04-28T13:07:28.020781+0000","last_fullsized":"2024-04-28T13:07:28.020781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:18:37.751080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019688+0000","last_change":"2024-04-28T13:07:26.311807+0000","last_active":"2024-04-28T13:07:28.019688+0000","last_peered":"2024-04-28T13:07:28.019688+0000","last_clean":"2024-04-28T13:07:28.019688+0000","last_became_active":"2024-04-28T13:07:26.310515+0000","last_became_peered":"2024-04-28T13:07:26.310515+0000","last_unstale":"2024-04-28T13:07:28.019688+0000","last_undegraded":"2024-04-28T13:07:28.019688+0000","last_fullsized":"2024-04-28T13:07:28.019688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:28:05.357255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519030+0000","last_change":"2024-04-28T13:07:26.315421+0000","last_active":"2024-04-28T13:07:27.519030+0000","last_peered":"2024-04-28T13:07:27.519030+0000","last_clean":"2024-04-28T13:07:27.519030+0000","last_became_active":"2024-04-28T13:07:26.315112+0000","last_became_peered":"2024-04-28T13:07:26.315112+0000","last_unstale":"2024-04-28T13:07:27.519030+0000","last_undegraded":"2024-04-28T13:07:27.519030+0000","last_fullsized":"2024-04-28T13:07:27.519030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:27:11.373413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298416+0000","last_change":"2024-04-28T13:07:26.297276+0000","last_active":"2024-04-28T13:07:27.298416+0000","last_peered":"2024-04-28T13:07:27.298416+0000","last_clean":"2024-04-28T13:07:27.298416+0000","last_became_active":"2024-04-28T13:07:26.297008+0000","last_became_peered":"2024-04-28T13:07:26.297008+0000","last_unstale":"2024-04-28T13:07:27.298416+0000","last_undegraded":"2024-04-28T13:07:27.298416+0000","last_fullsized":"2024-04-28T13:07:27.298416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:59:35.713480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298922+0000","last_change":"2024-04-28T13:07:26.312387+0000","last_active":"2024-04-28T13:07:27.298922+0000","last_peered":"2024-04-28T13:07:27.298922+0000","last_clean":"2024-04-28T13:07:27.298922+0000","last_became_active":"2024-04-28T13:07:26.312111+0000","last_became_peered":"2024-04-28T13:07:26.312111+0000","last_unstale":"2024-04-28T13:07:27.298922+0000","last_undegraded":"2024-04-28T13:07:27.298922+0000","last_fullsized":"2024-04-28T13:07:27.298922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:17:21.385726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299713+0000","last_change":"2024-04-28T13:07:26.306073+0000","last_active":"2024-04-28T13:07:27.299713+0000","last_peered":"2024-04-28T13:07:27.299713+0000","last_clean":"2024-04-28T13:07:27.299713+0000","last_became_active":"2024-04-28T13:07:26.305799+0000","last_became_peered":"2024-04-28T13:07:26.305799+0000","last_unstale":"2024-04-28T13:07:27.299713+0000","last_undegraded":"2024-04-28T13:07:27.299713+0000","last_fullsized":"2024-04-28T13:07:27.299713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:04:24.766267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019321+0000","last_change":"2024-04-28T13:07:26.308368+0000","last_active":"2024-04-28T13:07:28.019321+0000","last_peered":"2024-04-28T13:07:28.019321+0000","last_clean":"2024-04-28T13:07:28.019321+0000","last_became_active":"2024-04-28T13:07:26.308098+0000","last_became_peered":"2024-04-28T13:07:26.308098+0000","last_unstale":"2024-04-28T13:07:28.019321+0000","last_undegraded":"2024-04-28T13:07:28.019321+0000","last_fullsized":"2024-04-28T13:07:28.019321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:48:49.408457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021412+0000","last_change":"2024-04-28T13:07:26.307438+0000","last_active":"2024-04-28T13:07:28.021412+0000","last_peered":"2024-04-28T13:07:28.021412+0000","last_clean":"2024-04-28T13:07:28.021412+0000","last_became_active":"2024-04-28T13:07:26.306984+0000","last_became_peered":"2024-04-28T13:07:26.306984+0000","last_unstale":"2024-04-28T13:07:28.021412+0000","last_undegraded":"2024-04-28T13:07:28.021412+0000","last_fullsized":"2024-04-28T13:07:28.021412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T16:22:52.630763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020405+0000","last_change":"2024-04-28T13:07:26.309790+0000","last_active":"2024-04-28T13:07:28.020405+0000","last_peered":"2024-04-28T13:07:28.020405+0000","last_clean":"2024-04-28T13:07:28.020405+0000","last_became_active":"2024-04-28T13:07:26.309521+0000","last_became_peered":"2024-04-28T13:07:26.309521+0000","last_unstale":"2024-04-28T13:07:28.020405+0000","last_undegraded":"2024-04-28T13:07:28.020405+0000","last_fullsized":"2024-04-28T13:07:28.020405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:59:35.713480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519103+0000","last_change":"2024-04-28T13:07:26.318544+0000","last_active":"2024-04-28T13:07:27.519103+0000","last_peered":"2024-04-28T13:07:27.519103+0000","last_clean":"2024-04-28T13:07:27.519103+0000","last_became_active":"2024-04-28T13:07:26.318279+0000","last_became_peered":"2024-04-28T13:07:26.318279+0000","last_unstale":"2024-04-28T13:07:27.519103+0000","last_undegraded":"2024-04-28T13:07:27.519103+0000","last_fullsized":"2024-04-28T13:07:27.519103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:37:35.063109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299378+0000","last_change":"2024-04-28T13:07:26.309606+0000","last_active":"2024-04-28T13:07:27.299378+0000","last_peered":"2024-04-28T13:07:27.299378+0000","last_clean":"2024-04-28T13:07:27.299378+0000","last_became_active":"2024-04-28T13:07:26.309338+0000","last_became_peered":"2024-04-28T13:07:26.309338+0000","last_unstale":"2024-04-28T13:07:27.299378+0000","last_undegraded":"2024-04-28T13:07:27.299378+0000","last_fullsized":"2024-04-28T13:07:27.299378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:10:44.035551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019649+0000","last_change":"2024-04-28T13:07:26.307514+0000","last_active":"2024-04-28T13:07:28.019649+0000","last_peered":"2024-04-28T13:07:28.019649+0000","last_clean":"2024-04-28T13:07:28.019649+0000","last_became_active":"2024-04-28T13:07:26.307215+0000","last_became_peered":"2024-04-28T13:07:26.307215+0000","last_unstale":"2024-04-28T13:07:28.019649+0000","last_undegraded":"2024-04-28T13:07:28.019649+0000","last_fullsized":"2024-04-28T13:07:28.019649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:59:35.713480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298920+0000","last_change":"2024-04-28T13:07:26.303832+0000","last_active":"2024-04-28T13:07:27.298920+0000","last_peered":"2024-04-28T13:07:27.298920+0000","last_clean":"2024-04-28T13:07:27.298920+0000","last_became_active":"2024-04-28T13:07:26.303498+0000","last_became_peered":"2024-04-28T13:07:26.303498+0000","last_unstale":"2024-04-28T13:07:27.298920+0000","last_undegraded":"2024-04-28T13:07:27.298920+0000","last_fullsized":"2024-04-28T13:07:27.298920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:15:46.081328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019826+0000","last_change":"2024-04-28T13:07:26.306835+0000","last_active":"2024-04-28T13:07:28.019826+0000","last_peered":"2024-04-28T13:07:28.019826+0000","last_clean":"2024-04-28T13:07:28.019826+0000","last_became_active":"2024-04-28T13:07:26.306535+0000","last_became_peered":"2024-04-28T13:07:26.306535+0000","last_unstale":"2024-04-28T13:07:28.019826+0000","last_undegraded":"2024-04-28T13:07:28.019826+0000","last_fullsized":"2024-04-28T13:07:28.019826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:17:21.385726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021476+0000","last_change":"2024-04-28T13:07:26.316514+0000","last_active":"2024-04-28T13:07:28.021476+0000","last_peered":"2024-04-28T13:07:28.021476+0000","last_clean":"2024-04-28T13:07:28.021476+0000","last_became_active":"2024-04-28T13:07:26.316249+0000","last_became_peered":"2024-04-28T13:07:26.316249+0000","last_unstale":"2024-04-28T13:07:28.021476+0000","last_undegraded":"2024-04-28T13:07:28.021476+0000","last_fullsized":"2024-04-28T13:07:28.021476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:15:46.081328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298512+0000","last_change":"2024-04-28T13:07:26.297829+0000","last_active":"2024-04-28T13:07:27.298512+0000","last_peered":"2024-04-28T13:07:27.298512+0000","last_clean":"2024-04-28T13:07:27.298512+0000","last_became_active":"2024-04-28T13:07:26.297468+0000","last_became_peered":"2024-04-28T13:07:26.297468+0000","last_unstale":"2024-04-28T13:07:27.298512+0000","last_undegraded":"2024-04-28T13:07:27.298512+0000","last_fullsized":"2024-04-28T13:07:27.298512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T16:06:41.543332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019812+0000","last_change":"2024-04-28T13:07:26.313763+0000","last_active":"2024-04-28T13:07:28.019812+0000","last_peered":"2024-04-28T13:07:28.019812+0000","last_clean":"2024-04-28T13:07:28.019812+0000","last_became_active":"2024-04-28T13:07:26.313337+0000","last_became_peered":"2024-04-28T13:07:26.313337+0000","last_unstale":"2024-04-28T13:07:28.019812+0000","last_undegraded":"2024-04-28T13:07:28.019812+0000","last_fullsized":"2024-04-28T13:07:28.019812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:15:46.081328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519145+0000","last_change":"2024-04-28T13:07:26.317540+0000","last_active":"2024-04-28T13:07:27.519145+0000","last_peered":"2024-04-28T13:07:27.519145+0000","last_clean":"2024-04-28T13:07:27.519145+0000","last_became_active":"2024-04-28T13:07:26.316912+0000","last_became_peered":"2024-04-28T13:07:26.316912+0000","last_unstale":"2024-04-28T13:07:27.519145+0000","last_undegraded":"2024-04-28T13:07:27.519145+0000","last_fullsized":"2024-04-28T13:07:27.519145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:48:54.699408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299350+0000","last_change":"2024-04-28T13:07:26.311313+0000","last_active":"2024-04-28T13:07:27.299350+0000","last_peered":"2024-04-28T13:07:27.299350+0000","last_clean":"2024-04-28T13:07:27.299350+0000","last_became_active":"2024-04-28T13:07:26.310960+0000","last_became_peered":"2024-04-28T13:07:26.310960+0000","last_unstale":"2024-04-28T13:07:27.299350+0000","last_undegraded":"2024-04-28T13:07:27.299350+0000","last_fullsized":"2024-04-28T13:07:27.299350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:00:58.728022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019235+0000","last_change":"2024-04-28T13:07:26.306545+0000","last_active":"2024-04-28T13:07:28.019235+0000","last_peered":"2024-04-28T13:07:28.019235+0000","last_clean":"2024-04-28T13:07:28.019235+0000","last_became_active":"2024-04-28T13:07:26.306242+0000","last_became_peered":"2024-04-28T13:07:26.306242+0000","last_unstale":"2024-04-28T13:07:28.019235+0000","last_undegraded":"2024-04-28T13:07:28.019235+0000","last_fullsized":"2024-04-28T13:07:28.019235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T20:04:56.915910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019926+0000","last_change":"2024-04-28T13:07:26.314926+0000","last_active":"2024-04-28T13:07:28.019926+0000","last_peered":"2024-04-28T13:07:28.019926+0000","last_clean":"2024-04-28T13:07:28.019926+0000","last_became_active":"2024-04-28T13:07:26.314391+0000","last_became_peered":"2024-04-28T13:07:26.314391+0000","last_unstale":"2024-04-28T13:07:28.019926+0000","last_undegraded":"2024-04-28T13:07:28.019926+0000","last_fullsized":"2024-04-28T13:07:28.019926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:27:11.373413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020208+0000","last_change":"2024-04-28T13:07:26.303423+0000","last_active":"2024-04-28T13:07:28.020208+0000","last_peered":"2024-04-28T13:07:28.020208+0000","last_clean":"2024-04-28T13:07:28.020208+0000","last_became_active":"2024-04-28T13:07:26.302361+0000","last_became_peered":"2024-04-28T13:07:26.302361+0000","last_unstale":"2024-04-28T13:07:28.020208+0000","last_undegraded":"2024-04-28T13:07:28.020208+0000","last_fullsized":"2024-04-28T13:07:28.020208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:45:56.180751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019816+0000","last_change":"2024-04-28T13:07:25.306186+0000","last_active":"2024-04-28T13:07:28.019816+0000","last_peered":"2024-04-28T13:07:28.019816+0000","last_clean":"2024-04-28T13:07:28.019816+0000","last_became_active":"2024-04-28T13:07:25.305761+0000","last_became_peered":"2024-04-28T13:07:25.305761+0000","last_unstale":"2024-04-28T13:07:28.019816+0000","last_undegraded":"2024-04-28T13:07:28.019816+0000","last_fullsized":"2024-04-28T13:07:28.019816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:01:05.000996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519234+0000","last_change":"2024-04-28T13:07:26.317195+0000","last_active":"2024-04-28T13:07:27.519234+0000","last_peered":"2024-04-28T13:07:27.519234+0000","last_clean":"2024-04-28T13:07:27.519234+0000","last_became_active":"2024-04-28T13:07:26.316432+0000","last_became_peered":"2024-04-28T13:07:26.316432+0000","last_unstale":"2024-04-28T13:07:27.519234+0000","last_undegraded":"2024-04-28T13:07:27.519234+0000","last_fullsized":"2024-04-28T13:07:27.519234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T16:06:41.543332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020047+0000","last_change":"2024-04-28T13:07:25.303307+0000","last_active":"2024-04-28T13:07:28.020047+0000","last_peered":"2024-04-28T13:07:28.020047+0000","last_clean":"2024-04-28T13:07:28.020047+0000","last_became_active":"2024-04-28T13:07:25.302669+0000","last_became_peered":"2024-04-28T13:07:25.302669+0000","last_unstale":"2024-04-28T13:07:28.020047+0000","last_undegraded":"2024-04-28T13:07:28.020047+0000","last_fullsized":"2024-04-28T13:07:28.020047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:34:02.814463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019548+0000","last_change":"2024-04-28T13:07:25.305429+0000","last_active":"2024-04-28T13:07:28.019548+0000","last_peered":"2024-04-28T13:07:28.019548+0000","last_clean":"2024-04-28T13:07:28.019548+0000","last_became_active":"2024-04-28T13:07:25.305121+0000","last_became_peered":"2024-04-28T13:07:25.305121+0000","last_unstale":"2024-04-28T13:07:28.019548+0000","last_undegraded":"2024-04-28T13:07:28.019548+0000","last_fullsized":"2024-04-28T13:07:28.019548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:49:52.826796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019378+0000","last_change":"2024-04-28T13:07:26.312253+0000","last_active":"2024-04-28T13:07:28.019378+0000","last_peered":"2024-04-28T13:07:28.019378+0000","last_clean":"2024-04-28T13:07:28.019378+0000","last_became_active":"2024-04-28T13:07:26.310573+0000","last_became_peered":"2024-04-28T13:07:26.310573+0000","last_unstale":"2024-04-28T13:07:28.019378+0000","last_undegraded":"2024-04-28T13:07:28.019378+0000","last_fullsized":"2024-04-28T13:07:28.019378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:27:11.373413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299130+0000","last_change":"2024-04-28T13:07:25.301794+0000","last_active":"2024-04-28T13:07:27.299130+0000","last_peered":"2024-04-28T13:07:27.299130+0000","last_clean":"2024-04-28T13:07:27.299130+0000","last_became_active":"2024-04-28T13:07:25.301463+0000","last_became_peered":"2024-04-28T13:07:25.301463+0000","last_unstale":"2024-04-28T13:07:27.299130+0000","last_undegraded":"2024-04-28T13:07:27.299130+0000","last_fullsized":"2024-04-28T13:07:27.299130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:15:37.155770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298405+0000","last_change":"2024-04-28T13:07:26.296566+0000","last_active":"2024-04-28T13:07:27.298405+0000","last_peered":"2024-04-28T13:07:27.298405+0000","last_clean":"2024-04-28T13:07:27.298405+0000","last_became_active":"2024-04-28T13:07:26.296273+0000","last_became_peered":"2024-04-28T13:07:26.296273+0000","last_unstale":"2024-04-28T13:07:27.298405+0000","last_undegraded":"2024-04-28T13:07:27.298405+0000","last_fullsized":"2024-04-28T13:07:27.298405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:48:54.699408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021606+0000","last_change":"2024-04-28T13:07:25.308017+0000","last_active":"2024-04-28T13:07:28.021606+0000","last_peered":"2024-04-28T13:07:28.021606+0000","last_clean":"2024-04-28T13:07:28.021606+0000","last_became_active":"2024-04-28T13:07:25.307704+0000","last_became_peered":"2024-04-28T13:07:25.307704+0000","last_unstale":"2024-04-28T13:07:28.021606+0000","last_undegraded":"2024-04-28T13:07:28.021606+0000","last_fullsized":"2024-04-28T13:07:28.021606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:57:54.511728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299240+0000","last_change":"2024-04-28T13:07:26.305171+0000","last_active":"2024-04-28T13:07:27.299240+0000","last_peered":"2024-04-28T13:07:27.299240+0000","last_clean":"2024-04-28T13:07:27.299240+0000","last_became_active":"2024-04-28T13:07:26.304900+0000","last_became_peered":"2024-04-28T13:07:26.304900+0000","last_unstale":"2024-04-28T13:07:27.299240+0000","last_undegraded":"2024-04-28T13:07:27.299240+0000","last_fullsized":"2024-04-28T13:07:27.299240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:06:39.922627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299510+0000","last_change":"2024-04-28T13:07:25.307177+0000","last_active":"2024-04-28T13:07:27.299510+0000","last_peered":"2024-04-28T13:07:27.299510+0000","last_clean":"2024-04-28T13:07:27.299510+0000","last_became_active":"2024-04-28T13:07:25.306922+0000","last_became_peered":"2024-04-28T13:07:25.306922+0000","last_unstale":"2024-04-28T13:07:27.299510+0000","last_undegraded":"2024-04-28T13:07:27.299510+0000","last_fullsized":"2024-04-28T13:07:27.299510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:34:02.814463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519315+0000","last_change":"2024-04-28T13:07:26.308975+0000","last_active":"2024-04-28T13:07:27.519315+0000","last_peered":"2024-04-28T13:07:27.519315+0000","last_clean":"2024-04-28T13:07:27.519315+0000","last_became_active":"2024-04-28T13:07:26.308715+0000","last_became_peered":"2024-04-28T13:07:26.308715+0000","last_unstale":"2024-04-28T13:07:27.519315+0000","last_undegraded":"2024-04-28T13:07:27.519315+0000","last_fullsized":"2024-04-28T13:07:27.519315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:17:21.385726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298608+0000","last_change":"2024-04-28T13:07:25.307356+0000","last_active":"2024-04-28T13:07:27.298608+0000","last_peered":"2024-04-28T13:07:27.298608+0000","last_clean":"2024-04-28T13:07:27.298608+0000","last_became_active":"2024-04-28T13:07:25.307108+0000","last_became_peered":"2024-04-28T13:07:25.307108+0000","last_unstale":"2024-04-28T13:07:27.298608+0000","last_undegraded":"2024-04-28T13:07:27.298608+0000","last_fullsized":"2024-04-28T13:07:27.298608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:57:54.511728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020935+0000","last_change":"2024-04-28T13:07:26.306801+0000","last_active":"2024-04-28T13:07:28.020935+0000","last_peered":"2024-04-28T13:07:28.020935+0000","last_clean":"2024-04-28T13:07:28.020935+0000","last_became_active":"2024-04-28T13:07:26.306051+0000","last_became_peered":"2024-04-28T13:07:26.306051+0000","last_unstale":"2024-04-28T13:07:28.020935+0000","last_undegraded":"2024-04-28T13:07:28.020935+0000","last_fullsized":"2024-04-28T13:07:28.020935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T20:04:56.915910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020644+0000","last_change":"2024-04-28T13:07:25.304551+0000","last_active":"2024-04-28T13:07:28.020644+0000","last_peered":"2024-04-28T13:07:28.020644+0000","last_clean":"2024-04-28T13:07:28.020644+0000","last_became_active":"2024-04-28T13:07:25.304117+0000","last_became_peered":"2024-04-28T13:07:25.304117+0000","last_unstale":"2024-04-28T13:07:28.020644+0000","last_undegraded":"2024-04-28T13:07:28.020644+0000","last_fullsized":"2024-04-28T13:07:28.020644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:45:55.171349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021023+0000","last_change":"2024-04-28T13:07:26.301509+0000","last_active":"2024-04-28T13:07:28.021023+0000","last_peered":"2024-04-28T13:07:28.021023+0000","last_clean":"2024-04-28T13:07:28.021023+0000","last_became_active":"2024-04-28T13:07:26.301221+0000","last_became_peered":"2024-04-28T13:07:26.301221+0000","last_unstale":"2024-04-28T13:07:28.021023+0000","last_undegraded":"2024-04-28T13:07:28.021023+0000","last_fullsized":"2024-04-28T13:07:28.021023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:00:58.728022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519255+0000","last_change":"2024-04-28T13:07:25.297320+0000","last_active":"2024-04-28T13:07:27.519255+0000","last_peered":"2024-04-28T13:07:27.519255+0000","last_clean":"2024-04-28T13:07:27.519255+0000","last_became_active":"2024-04-28T13:07:25.297037+0000","last_became_peered":"2024-04-28T13:07:25.297037+0000","last_unstale":"2024-04-28T13:07:27.519255+0000","last_undegraded":"2024-04-28T13:07:27.519255+0000","last_fullsized":"2024-04-28T13:07:27.519255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:01:05.000996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519019+0000","last_change":"2024-04-28T13:07:26.317885+0000","last_active":"2024-04-28T13:07:27.519019+0000","last_peered":"2024-04-28T13:07:27.519019+0000","last_clean":"2024-04-28T13:07:27.519019+0000","last_became_active":"2024-04-28T13:07:26.317583+0000","last_became_peered":"2024-04-28T13:07:26.317583+0000","last_unstale":"2024-04-28T13:07:27.519019+0000","last_undegraded":"2024-04-28T13:07:27.519019+0000","last_fullsized":"2024-04-28T13:07:27.519019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:03:37.479826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299720+0000","last_change":"2024-04-28T13:07:25.305697+0000","last_active":"2024-04-28T13:07:27.299720+0000","last_peered":"2024-04-28T13:07:27.299720+0000","last_clean":"2024-04-28T13:07:27.299720+0000","last_became_active":"2024-04-28T13:07:25.304315+0000","last_became_peered":"2024-04-28T13:07:25.304315+0000","last_unstale":"2024-04-28T13:07:27.299720+0000","last_undegraded":"2024-04-28T13:07:27.299720+0000","last_fullsized":"2024-04-28T13:07:27.299720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:57:54.511728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020601+0000","last_change":"2024-04-28T13:07:26.314531+0000","last_active":"2024-04-28T13:07:28.020601+0000","last_peered":"2024-04-28T13:07:28.020601+0000","last_clean":"2024-04-28T13:07:28.020601+0000","last_became_active":"2024-04-28T13:07:26.314257+0000","last_became_peered":"2024-04-28T13:07:26.314257+0000","last_unstale":"2024-04-28T13:07:28.020601+0000","last_undegraded":"2024-04-28T13:07:28.020601+0000","last_fullsized":"2024-04-28T13:07:28.020601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:06:39.922627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020115+0000","last_change":"2024-04-28T13:07:25.295863+0000","last_active":"2024-04-28T13:07:28.020115+0000","last_peered":"2024-04-28T13:07:28.020115+0000","last_clean":"2024-04-28T13:07:28.020115+0000","last_became_active":"2024-04-28T13:07:25.295475+0000","last_became_peered":"2024-04-28T13:07:25.295475+0000","last_unstale":"2024-04-28T13:07:28.020115+0000","last_undegraded":"2024-04-28T13:07:28.020115+0000","last_fullsized":"2024-04-28T13:07:28.020115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:15:37.155770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020204+0000","last_change":"2024-04-28T13:07:26.314673+0000","last_active":"2024-04-28T13:07:28.020204+0000","last_peered":"2024-04-28T13:07:28.020204+0000","last_clean":"2024-04-28T13:07:28.020204+0000","last_became_active":"2024-04-28T13:07:26.314038+0000","last_became_peered":"2024-04-28T13:07:26.314038+0000","last_unstale":"2024-04-28T13:07:28.020204+0000","last_undegraded":"2024-04-28T13:07:28.020204+0000","last_fullsized":"2024-04-28T13:07:28.020204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:48:54.699408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019157+0000","last_change":"2024-04-28T13:07:25.295521+0000","last_active":"2024-04-28T13:07:28.019157+0000","last_peered":"2024-04-28T13:07:28.019157+0000","last_clean":"2024-04-28T13:07:28.019157+0000","last_became_active":"2024-04-28T13:07:25.295243+0000","last_became_peered":"2024-04-28T13:07:25.295243+0000","last_unstale":"2024-04-28T13:07:28.019157+0000","last_undegraded":"2024-04-28T13:07:28.019157+0000","last_fullsized":"2024-04-28T13:07:28.019157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:49:52.826796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020137+0000","last_change":"2024-04-28T13:07:26.314594+0000","last_active":"2024-04-28T13:07:28.020137+0000","last_peered":"2024-04-28T13:07:28.020137+0000","last_clean":"2024-04-28T13:07:28.020137+0000","last_became_active":"2024-04-28T13:07:26.310077+0000","last_became_peered":"2024-04-28T13:07:26.310077+0000","last_unstale":"2024-04-28T13:07:28.020137+0000","last_undegraded":"2024-04-28T13:07:28.020137+0000","last_fullsized":"2024-04-28T13:07:28.020137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:17:42.011752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021124+0000","last_change":"2024-04-28T13:07:25.298854+0000","last_active":"2024-04-28T13:07:28.021124+0000","last_peered":"2024-04-28T13:07:28.021124+0000","last_clean":"2024-04-28T13:07:28.021124+0000","last_became_active":"2024-04-28T13:07:25.298100+0000","last_became_peered":"2024-04-28T13:07:25.298100+0000","last_unstale":"2024-04-28T13:07:28.021124+0000","last_undegraded":"2024-04-28T13:07:28.021124+0000","last_fullsized":"2024-04-28T13:07:28.021124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:50:40.986549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020963+0000","last_change":"2024-04-28T13:07:26.312944+0000","last_active":"2024-04-28T13:07:28.020963+0000","last_peered":"2024-04-28T13:07:28.020963+0000","last_clean":"2024-04-28T13:07:28.020963+0000","last_became_active":"2024-04-28T13:07:26.309861+0000","last_became_peered":"2024-04-28T13:07:26.309861+0000","last_unstale":"2024-04-28T13:07:28.020963+0000","last_undegraded":"2024-04-28T13:07:28.020963+0000","last_fullsized":"2024-04-28T13:07:28.020963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:06:35.011350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019402+0000","last_change":"2024-04-28T13:07:25.300448+0000","last_active":"2024-04-28T13:07:28.019402+0000","last_peered":"2024-04-28T13:07:28.019402+0000","last_clean":"2024-04-28T13:07:28.019402+0000","last_became_active":"2024-04-28T13:07:25.300181+0000","last_became_peered":"2024-04-28T13:07:25.300181+0000","last_unstale":"2024-04-28T13:07:28.019402+0000","last_undegraded":"2024-04-28T13:07:28.019402+0000","last_fullsized":"2024-04-28T13:07:28.019402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:34:02.814463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021674+0000","last_change":"2024-04-28T13:07:26.315390+0000","last_active":"2024-04-28T13:07:28.021674+0000","last_peered":"2024-04-28T13:07:28.021674+0000","last_clean":"2024-04-28T13:07:28.021674+0000","last_became_active":"2024-04-28T13:07:26.315077+0000","last_became_peered":"2024-04-28T13:07:26.315077+0000","last_unstale":"2024-04-28T13:07:28.021674+0000","last_undegraded":"2024-04-28T13:07:28.021674+0000","last_fullsized":"2024-04-28T13:07:28.021674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:05:21.187278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298630+0000","last_change":"2024-04-28T13:07:25.296275+0000","last_active":"2024-04-28T13:07:27.298630+0000","last_peered":"2024-04-28T13:07:27.298630+0000","last_clean":"2024-04-28T13:07:27.298630+0000","last_became_active":"2024-04-28T13:07:25.295930+0000","last_became_peered":"2024-04-28T13:07:25.295930+0000","last_unstale":"2024-04-28T13:07:27.298630+0000","last_undegraded":"2024-04-28T13:07:27.298630+0000","last_fullsized":"2024-04-28T13:07:27.298630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T20:04:55.906508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299309+0000","last_change":"2024-04-28T13:07:26.310964+0000","last_active":"2024-04-28T13:07:27.299309+0000","last_peered":"2024-04-28T13:07:27.299309+0000","last_clean":"2024-04-28T13:07:27.299309+0000","last_became_active":"2024-04-28T13:07:26.310666+0000","last_became_peered":"2024-04-28T13:07:26.310666+0000","last_unstale":"2024-04-28T13:07:27.299309+0000","last_undegraded":"2024-04-28T13:07:27.299309+0000","last_fullsized":"2024-04-28T13:07:27.299309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:06:35.011350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019509+0000","last_change":"2024-04-28T13:07:25.308033+0000","last_active":"2024-04-28T13:07:28.019509+0000","last_peered":"2024-04-28T13:07:28.019509+0000","last_clean":"2024-04-28T13:07:28.019509+0000","last_became_active":"2024-04-28T13:07:25.307709+0000","last_became_peered":"2024-04-28T13:07:25.307709+0000","last_unstale":"2024-04-28T13:07:28.019509+0000","last_undegraded":"2024-04-28T13:07:28.019509+0000","last_fullsized":"2024-04-28T13:07:28.019509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:45:55.171349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021170+0000","last_change":"2024-04-28T13:07:26.317026+0000","last_active":"2024-04-28T13:07:28.021170+0000","last_peered":"2024-04-28T13:07:28.021170+0000","last_clean":"2024-04-28T13:07:28.021170+0000","last_became_active":"2024-04-28T13:07:26.316637+0000","last_became_peered":"2024-04-28T13:07:26.316637+0000","last_unstale":"2024-04-28T13:07:28.021170+0000","last_undegraded":"2024-04-28T13:07:28.021170+0000","last_fullsized":"2024-04-28T13:07:28.021170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:10:44.035551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020210+0000","last_change":"2024-04-28T13:07:16.698740+0000","last_active":"2024-04-28T13:07:28.020210+0000","last_peered":"2024-04-28T13:07:28.020210+0000","last_clean":"2024-04-28T13:07:28.020210+0000","last_became_active":"2024-04-28T13:07:16.696364+0000","last_became_peered":"2024-04-28T13:07:16.696364+0000","last_unstale":"2024-04-28T13:07:28.020210+0000","last_undegraded":"2024-04-28T13:07:28.020210+0000","last_fullsized":"2024-04-28T13:07:28.020210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:14.770499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:14.770499+0000","last_clean_scrub_stamp":"2024-04-28T13:07:14.770499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:39:38.986133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299409+0000","last_change":"2024-04-28T13:07:25.301675+0000","last_active":"2024-04-28T13:07:27.299409+0000","last_peered":"2024-04-28T13:07:27.299409+0000","last_clean":"2024-04-28T13:07:27.299409+0000","last_became_active":"2024-04-28T13:07:25.301373+0000","last_became_peered":"2024-04-28T13:07:25.301373+0000","last_unstale":"2024-04-28T13:07:27.299409+0000","last_undegraded":"2024-04-28T13:07:27.299409+0000","last_fullsized":"2024-04-28T13:07:27.299409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:45:55.171349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019902+0000","last_change":"2024-04-28T13:07:26.309600+0000","last_active":"2024-04-28T13:07:28.019902+0000","last_peered":"2024-04-28T13:07:28.019902+0000","last_clean":"2024-04-28T13:07:28.019902+0000","last_became_active":"2024-04-28T13:07:26.309317+0000","last_became_peered":"2024-04-28T13:07:26.309317+0000","last_unstale":"2024-04-28T13:07:28.019902+0000","last_undegraded":"2024-04-28T13:07:28.019902+0000","last_fullsized":"2024-04-28T13:07:28.019902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T13:30:05.831084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020381+0000","last_change":"2024-04-28T13:07:25.305597+0000","last_active":"2024-04-28T13:07:28.020381+0000","last_peered":"2024-04-28T13:07:28.020381+0000","last_clean":"2024-04-28T13:07:28.020381+0000","last_became_active":"2024-04-28T13:07:25.305095+0000","last_became_peered":"2024-04-28T13:07:25.305095+0000","last_unstale":"2024-04-28T13:07:28.020381+0000","last_undegraded":"2024-04-28T13:07:28.020381+0000","last_fullsized":"2024-04-28T13:07:28.020381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:37:32.063208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.518924+0000","last_change":"2024-04-28T13:07:26.312371+0000","last_active":"2024-04-28T13:07:27.518924+0000","last_peered":"2024-04-28T13:07:27.518924+0000","last_clean":"2024-04-28T13:07:27.518924+0000","last_became_active":"2024-04-28T13:07:26.312094+0000","last_became_peered":"2024-04-28T13:07:26.312094+0000","last_unstale":"2024-04-28T13:07:27.518924+0000","last_undegraded":"2024-04-28T13:07:27.518924+0000","last_fullsized":"2024-04-28T13:07:27.518924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T20:29:58.561638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019272+0000","last_change":"2024-04-28T13:07:25.299270+0000","last_active":"2024-04-28T13:07:28.019272+0000","last_peered":"2024-04-28T13:07:28.019272+0000","last_clean":"2024-04-28T13:07:28.019272+0000","last_became_active":"2024-04-28T13:07:25.299003+0000","last_became_peered":"2024-04-28T13:07:25.299003+0000","last_unstale":"2024-04-28T13:07:28.019272+0000","last_undegraded":"2024-04-28T13:07:28.019272+0000","last_fullsized":"2024-04-28T13:07:28.019272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:15:37.155770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298443+0000","last_change":"2024-04-28T13:07:26.304077+0000","last_active":"2024-04-28T13:07:27.298443+0000","last_peered":"2024-04-28T13:07:27.298443+0000","last_clean":"2024-04-28T13:07:27.298443+0000","last_became_active":"2024-04-28T13:07:26.302114+0000","last_became_peered":"2024-04-28T13:07:26.302114+0000","last_unstale":"2024-04-28T13:07:27.298443+0000","last_undegraded":"2024-04-28T13:07:27.298443+0000","last_fullsized":"2024-04-28T13:07:27.298443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:28:05.357255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299704+0000","last_change":"2024-04-28T13:07:25.306063+0000","last_active":"2024-04-28T13:07:27.299704+0000","last_peered":"2024-04-28T13:07:27.299704+0000","last_clean":"2024-04-28T13:07:27.299704+0000","last_became_active":"2024-04-28T13:07:25.305789+0000","last_became_peered":"2024-04-28T13:07:25.305789+0000","last_unstale":"2024-04-28T13:07:27.299704+0000","last_undegraded":"2024-04-28T13:07:27.299704+0000","last_fullsized":"2024-04-28T13:07:27.299704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:18:36.741678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020557+0000","last_change":"2024-04-28T13:07:26.314298+0000","last_active":"2024-04-28T13:07:28.020557+0000","last_peered":"2024-04-28T13:07:28.020557+0000","last_clean":"2024-04-28T13:07:28.020557+0000","last_became_active":"2024-04-28T13:07:26.313337+0000","last_became_peered":"2024-04-28T13:07:26.313337+0000","last_unstale":"2024-04-28T13:07:28.020557+0000","last_undegraded":"2024-04-28T13:07:28.020557+0000","last_fullsized":"2024-04-28T13:07:28.020557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:57:55.521129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298469+0000","last_change":"2024-04-28T13:07:25.300122+0000","last_active":"2024-04-28T13:07:27.298469+0000","last_peered":"2024-04-28T13:07:27.298469+0000","last_clean":"2024-04-28T13:07:27.298469+0000","last_became_active":"2024-04-28T13:07:25.299837+0000","last_became_peered":"2024-04-28T13:07:25.299837+0000","last_unstale":"2024-04-28T13:07:27.298469+0000","last_undegraded":"2024-04-28T13:07:27.298469+0000","last_fullsized":"2024-04-28T13:07:27.298469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:34:02.814463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299554+0000","last_change":"2024-04-28T13:07:26.312457+0000","last_active":"2024-04-28T13:07:27.299554+0000","last_peered":"2024-04-28T13:07:27.299554+0000","last_clean":"2024-04-28T13:07:27.299554+0000","last_became_active":"2024-04-28T13:07:26.310729+0000","last_became_peered":"2024-04-28T13:07:26.310729+0000","last_unstale":"2024-04-28T13:07:27.299554+0000","last_undegraded":"2024-04-28T13:07:27.299554+0000","last_fullsized":"2024-04-28T13:07:27.299554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:39:10.176279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021328+0000","last_change":"2024-04-28T13:07:25.305837+0000","last_active":"2024-04-28T13:07:28.021328+0000","last_peered":"2024-04-28T13:07:28.021328+0000","last_clean":"2024-04-28T13:07:28.021328+0000","last_became_active":"2024-04-28T13:07:25.305581+0000","last_became_peered":"2024-04-28T13:07:25.305581+0000","last_unstale":"2024-04-28T13:07:28.021328+0000","last_undegraded":"2024-04-28T13:07:28.021328+0000","last_fullsized":"2024-04-28T13:07:28.021328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T20:04:55.906508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298902+0000","last_change":"2024-04-28T13:07:26.306415+0000","last_active":"2024-04-28T13:07:27.298902+0000","last_peered":"2024-04-28T13:07:27.298902+0000","last_clean":"2024-04-28T13:07:27.298902+0000","last_became_active":"2024-04-28T13:07:26.306144+0000","last_became_peered":"2024-04-28T13:07:26.306144+0000","last_unstale":"2024-04-28T13:07:27.298902+0000","last_undegraded":"2024-04-28T13:07:27.298902+0000","last_fullsized":"2024-04-28T13:07:27.298902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:17:21.385726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.292069+0000","last_change":"2024-04-28T13:07:25.303907+0000","last_active":"2024-04-28T13:07:28.292069+0000","last_peered":"2024-04-28T13:07:28.292069+0000","last_clean":"2024-04-28T13:07:28.292069+0000","last_became_active":"2024-04-28T13:07:25.303642+0000","last_became_peered":"2024-04-28T13:07:25.303642+0000","last_unstale":"2024-04-28T13:07:28.292069+0000","last_undegraded":"2024-04-28T13:07:28.292069+0000","last_fullsized":"2024-04-28T13:07:28.292069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:18:36.741678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019882+0000","last_change":"2024-04-28T13:07:26.302909+0000","last_active":"2024-04-28T13:07:28.019882+0000","last_peered":"2024-04-28T13:07:28.019882+0000","last_clean":"2024-04-28T13:07:28.019882+0000","last_became_active":"2024-04-28T13:07:26.302616+0000","last_became_peered":"2024-04-28T13:07:26.302616+0000","last_unstale":"2024-04-28T13:07:28.019882+0000","last_undegraded":"2024-04-28T13:07:28.019882+0000","last_fullsized":"2024-04-28T13:07:28.019882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:34:15.706993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021645+0000","last_change":"2024-04-28T13:07:25.303003+0000","last_active":"2024-04-28T13:07:28.021645+0000","last_peered":"2024-04-28T13:07:28.021645+0000","last_clean":"2024-04-28T13:07:28.021645+0000","last_became_active":"2024-04-28T13:07:25.302712+0000","last_became_peered":"2024-04-28T13:07:25.302712+0000","last_unstale":"2024-04-28T13:07:28.021645+0000","last_undegraded":"2024-04-28T13:07:28.021645+0000","last_fullsized":"2024-04-28T13:07:28.021645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:18:36.741678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519293+0000","last_change":"2024-04-28T13:07:26.315645+0000","last_active":"2024-04-28T13:07:27.519293+0000","last_peered":"2024-04-28T13:07:27.519293+0000","last_clean":"2024-04-28T13:07:27.519293+0000","last_became_active":"2024-04-28T13:07:26.315143+0000","last_became_peered":"2024-04-28T13:07:26.315143+0000","last_unstale":"2024-04-28T13:07:27.519293+0000","last_undegraded":"2024-04-28T13:07:27.519293+0000","last_fullsized":"2024-04-28T13:07:27.519293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:15:46.081328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019894+0000","last_change":"2024-04-28T13:07:25.305301+0000","last_active":"2024-04-28T13:07:28.019894+0000","last_peered":"2024-04-28T13:07:28.019894+0000","last_clean":"2024-04-28T13:07:28.019894+0000","last_became_active":"2024-04-28T13:07:25.304822+0000","last_became_peered":"2024-04-28T13:07:25.304822+0000","last_unstale":"2024-04-28T13:07:28.019894+0000","last_undegraded":"2024-04-28T13:07:28.019894+0000","last_fullsized":"2024-04-28T13:07:28.019894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:34:02.814463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020519+0000","last_change":"2024-04-28T13:07:26.303907+0000","last_active":"2024-04-28T13:07:28.020519+0000","last_peered":"2024-04-28T13:07:28.020519+0000","last_clean":"2024-04-28T13:07:28.020519+0000","last_became_active":"2024-04-28T13:07:26.302029+0000","last_became_peered":"2024-04-28T13:07:26.302029+0000","last_unstale":"2024-04-28T13:07:28.020519+0000","last_undegraded":"2024-04-28T13:07:28.020519+0000","last_fullsized":"2024-04-28T13:07:28.020519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:34:03.823865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298502+0000","last_change":"2024-04-28T13:07:25.302824+0000","last_active":"2024-04-28T13:07:27.298502+0000","last_peered":"2024-04-28T13:07:27.298502+0000","last_clean":"2024-04-28T13:07:27.298502+0000","last_became_active":"2024-04-28T13:07:25.302542+0000","last_became_peered":"2024-04-28T13:07:25.302542+0000","last_unstale":"2024-04-28T13:07:27.298502+0000","last_undegraded":"2024-04-28T13:07:27.298502+0000","last_fullsized":"2024-04-28T13:07:27.298502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:48:48.399055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019557+0000","last_change":"2024-04-28T13:07:26.302092+0000","last_active":"2024-04-28T13:07:28.019557+0000","last_peered":"2024-04-28T13:07:28.019557+0000","last_clean":"2024-04-28T13:07:28.019557+0000","last_became_active":"2024-04-28T13:07:26.301796+0000","last_became_peered":"2024-04-28T13:07:26.301796+0000","last_unstale":"2024-04-28T13:07:28.019557+0000","last_undegraded":"2024-04-28T13:07:28.019557+0000","last_fullsized":"2024-04-28T13:07:28.019557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:48:54.699408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.298737+0000","last_change":"2024-04-28T13:07:25.297284+0000","last_active":"2024-04-28T13:07:27.298737+0000","last_peered":"2024-04-28T13:07:27.298737+0000","last_clean":"2024-04-28T13:07:27.298737+0000","last_became_active":"2024-04-28T13:07:25.296587+0000","last_became_peered":"2024-04-28T13:07:25.296587+0000","last_unstale":"2024-04-28T13:07:27.298737+0000","last_undegraded":"2024-04-28T13:07:27.298737+0000","last_fullsized":"2024-04-28T13:07:27.298737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:45:55.171349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019805+0000","last_change":"2024-04-28T13:07:26.312775+0000","last_active":"2024-04-28T13:07:28.019805+0000","last_peered":"2024-04-28T13:07:28.019805+0000","last_clean":"2024-04-28T13:07:28.019805+0000","last_became_active":"2024-04-28T13:07:26.312360+0000","last_became_peered":"2024-04-28T13:07:26.312360+0000","last_unstale":"2024-04-28T13:07:28.019805+0000","last_undegraded":"2024-04-28T13:07:28.019805+0000","last_fullsized":"2024-04-28T13:07:28.019805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T16:06:41.543332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020772+0000","last_change":"2024-04-28T13:07:25.305849+0000","last_active":"2024-04-28T13:07:28.020772+0000","last_peered":"2024-04-28T13:07:28.020772+0000","last_clean":"2024-04-28T13:07:28.020772+0000","last_became_active":"2024-04-28T13:07:25.305412+0000","last_became_peered":"2024-04-28T13:07:25.305412+0000","last_unstale":"2024-04-28T13:07:28.020772+0000","last_undegraded":"2024-04-28T13:07:28.020772+0000","last_fullsized":"2024-04-28T13:07:28.020772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:48:48.399055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019933+0000","last_change":"2024-04-28T13:07:26.310511+0000","last_active":"2024-04-28T13:07:28.019933+0000","last_peered":"2024-04-28T13:07:28.019933+0000","last_clean":"2024-04-28T13:07:28.019933+0000","last_became_active":"2024-04-28T13:07:26.310172+0000","last_became_peered":"2024-04-28T13:07:26.310172+0000","last_unstale":"2024-04-28T13:07:28.019933+0000","last_undegraded":"2024-04-28T13:07:28.019933+0000","last_fullsized":"2024-04-28T13:07:28.019933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:37:35.063109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299465+0000","last_change":"2024-04-28T13:07:26.310919+0000","last_active":"2024-04-28T13:07:27.299465+0000","last_peered":"2024-04-28T13:07:27.299465+0000","last_clean":"2024-04-28T13:07:27.299465+0000","last_became_active":"2024-04-28T13:07:26.310613+0000","last_became_peered":"2024-04-28T13:07:26.310613+0000","last_unstale":"2024-04-28T13:07:27.299465+0000","last_undegraded":"2024-04-28T13:07:27.299465+0000","last_fullsized":"2024-04-28T13:07:27.299465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T16:22:52.630763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.020907+0000","last_change":"2024-04-28T13:07:25.307476+0000","last_active":"2024-04-28T13:07:28.020907+0000","last_peered":"2024-04-28T13:07:28.020907+0000","last_clean":"2024-04-28T13:07:28.020907+0000","last_became_active":"2024-04-28T13:07:25.307191+0000","last_became_peered":"2024-04-28T13:07:25.307191+0000","last_unstale":"2024-04-28T13:07:28.020907+0000","last_undegraded":"2024-04-28T13:07:28.020907+0000","last_fullsized":"2024-04-28T13:07:28.020907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:57:54.511728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.299045+0000","last_change":"2024-04-28T13:07:26.310400+0000","last_active":"2024-04-28T13:07:27.299045+0000","last_peered":"2024-04-28T13:07:27.299045+0000","last_clean":"2024-04-28T13:07:27.299045+0000","last_became_active":"2024-04-28T13:07:26.310134+0000","last_became_peered":"2024-04-28T13:07:26.310134+0000","last_unstale":"2024-04-28T13:07:27.299045+0000","last_undegraded":"2024-04-28T13:07:27.299045+0000","last_fullsized":"2024-04-28T13:07:27.299045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T13:30:05.831084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.021269+0000","last_change":"2024-04-28T13:07:25.307311+0000","last_active":"2024-04-28T13:07:28.021269+0000","last_peered":"2024-04-28T13:07:28.021269+0000","last_clean":"2024-04-28T13:07:28.021269+0000","last_became_active":"2024-04-28T13:07:25.307038+0000","last_became_peered":"2024-04-28T13:07:25.307038+0000","last_unstale":"2024-04-28T13:07:28.021269+0000","last_undegraded":"2024-04-28T13:07:28.021269+0000","last_fullsized":"2024-04-28T13:07:28.021269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:18:36.741678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519232+0000","last_change":"2024-04-28T13:07:26.311594+0000","last_active":"2024-04-28T13:07:27.519232+0000","last_peered":"2024-04-28T13:07:27.519232+0000","last_clean":"2024-04-28T13:07:27.519232+0000","last_became_active":"2024-04-28T13:07:26.311214+0000","last_became_peered":"2024-04-28T13:07:26.311214+0000","last_unstale":"2024-04-28T13:07:27.519232+0000","last_undegraded":"2024-04-28T13:07:27.519232+0000","last_fullsized":"2024-04-28T13:07:27.519232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:28:05.357255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019855+0000","last_change":"2024-04-28T13:07:25.301929+0000","last_active":"2024-04-28T13:07:28.019855+0000","last_peered":"2024-04-28T13:07:28.019855+0000","last_clean":"2024-04-28T13:07:28.019855+0000","last_became_active":"2024-04-28T13:07:25.301636+0000","last_became_peered":"2024-04-28T13:07:25.301636+0000","last_unstale":"2024-04-28T13:07:28.019855+0000","last_undegraded":"2024-04-28T13:07:28.019855+0000","last_fullsized":"2024-04-28T13:07:28.019855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:45:35.718557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:28.019918+0000","last_change":"2024-04-28T13:07:26.311537+0000","last_active":"2024-04-28T13:07:28.019918+0000","last_peered":"2024-04-28T13:07:28.019918+0000","last_clean":"2024-04-28T13:07:28.019918+0000","last_became_active":"2024-04-28T13:07:26.310710+0000","last_became_peered":"2024-04-28T13:07:26.310710+0000","last_unstale":"2024-04-28T13:07:28.019918+0000","last_undegraded":"2024-04-28T13:07:28.019918+0000","last_fullsized":"2024-04-28T13:07:28.019918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:25.279682+0000","last_clean_scrub_stamp":"2024-04-28T13:07:25.279682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:17:42.011752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-28T13:07:27.519326+0000","last_change":"2024-04-28T13:07:25.302646+0000","last_active":"2024-04-28T13:07:27.519326+0000","last_peered":"2024-04-28T13:07:27.519326+0000","last_clean":"2024-04-28T13:07:27.519326+0000","last_became_active":"2024-04-28T13:07:25.302386+0000","last_became_peered":"2024-04-28T13:07:25.302386+0000","last_unstale":"2024-04-28T13:07:27.519326+0000","last_undegraded":"2024-04-28T13:07:27.519326+0000","last_fullsized":"2024-04-28T13:07:27.519326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:24.270280+0000","last_clean_scrub_stamp":"2024-04-28T13:07:24.270280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:45:35.718557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-28T13:07:38.232 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-28T13:07:38.232 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-28T13:07:38.232 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-28T13:07:38.232 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-28T13:07:38.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.365+0000 7f27bdda4640 1 Processor -- start 2024-04-28T13:07:38.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.365+0000 7f27bdda4640 1 -- start start 2024-04-28T13:07:38.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.366+0000 7f27bdda4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f27b80b73d0 0x7f27b80d27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:38.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.366+0000 7f27bdda4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27b8072830 con 0x7f27b80722a0 2024-04-28T13:07:38.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.366+0000 7f27bdda4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27b80d1d10 con 0x7f27b8070710 2024-04-28T13:07:38.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.366+0000 7f27bdda4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f27b8072b10 con 0x7f27b80b73d0 2024-04-28T13:07:38.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.366+0000 7f27b7fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f27b80722a0 0x7f27b80b5f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46944/0 (socket says 172.21.15.114:46944) 2024-04-28T13:07:38.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.366+0000 7f27b7fff640 1 -- 172.21.15.114:0/1152176170 learned_addr learned my addr 172.21.15.114:0/1152176170 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:38.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.366+0000 7f27b77fe640 1 --2- 172.21.15.114:0/1152176170 >> v2:172.21.15.134:3300/0 conn(0x7f27b80b73d0 0x7f27b80d27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:38.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.367+0000 7f27b67fc640 1 -- 172.21.15.114:0/1152176170 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1436108549 0 0) 0x7f27b8072830 con 0x7f27b80722a0 2024-04-28T13:07:38.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.367+0000 7f27b67fc640 1 -- 172.21.15.114:0/1152176170 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27a4003520 con 0x7f27b80722a0 2024-04-28T13:07:38.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.367+0000 7f27b67fc640 1 -- 172.21.15.114:0/1152176170 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 430416942 0 0) 0x7f27b80d1d10 con 0x7f27b8070710 2024-04-28T13:07:38.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.367+0000 7f27b67fc640 1 -- 172.21.15.114:0/1152176170 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27b8072830 con 0x7f27b8070710 2024-04-28T13:07:38.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.367+0000 7f27b67fc640 1 -- 172.21.15.114:0/1152176170 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3483178096 0 0) 0x7f27a4003520 con 0x7f27b80722a0 2024-04-28T13:07:38.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.367+0000 7f27b77fe640 1 -- 172.21.15.114:0/1152176170 >> v1:172.21.15.134:6789/0 conn(0x7f27b8070710 legacy=0x7f27b8071b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:38.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.367+0000 7f27b77fe640 1 -- 172.21.15.114:0/1152176170 >> v1:172.21.15.114:6789/0 conn(0x7f27b80722a0 legacy=0x7f27b80b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:38.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.367+0000 7f27b77fe640 1 -- 172.21.15.114:0/1152176170 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b80d1ff0 con 0x7f27b80b73d0 2024-04-28T13:07:38.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.368+0000 7f27b77fe640 1 --2- 172.21.15.114:0/1152176170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27b80b73d0 0x7f27b80d27f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f27a8009d90 tx=0x7f27a802a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31daa377cada5f20 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:38.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.368+0000 7f27b67fc640 1 -- 172.21.15.114:0/1152176170 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b0001670 con 0x7f27b80b73d0 2024-04-28T13:07:38.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.368+0000 7f27b67fc640 1 -- 172.21.15.114:0/1152176170 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a8007540 con 0x7f27b80b73d0 2024-04-28T13:07:38.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.368+0000 7f27b67fc640 1 -- 172.21.15.114:0/1152176170 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a80078f0 con 0x7f27b80b73d0 2024-04-28T13:07:38.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.368+0000 7f27bdda4640 1 -- 172.21.15.114:0/1152176170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27b80b73d0 msgr2=0x7f27b80d27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:38.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.368+0000 7f27bdda4640 1 --2- 172.21.15.114:0/1152176170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27b80b73d0 0x7f27b80d27f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f27a8009d90 tx=0x7f27a802a680 comp rx=0 tx=0).stop 2024-04-28T13:07:38.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.368+0000 7f27bdda4640 1 -- 172.21.15.114:0/1152176170 shutdown_connections 2024-04-28T13:07:38.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.368+0000 7f27bdda4640 1 --2- 172.21.15.114:0/1152176170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27b80b73d0 0x7f27b80d27f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:38.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.368+0000 7f27bdda4640 1 -- 172.21.15.114:0/1152176170 >> 172.21.15.114:0/1152176170 conn(0x7f27b80b4c60 msgr2=0x7f27b80b5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:38.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.368+0000 7f27bdda4640 1 -- 172.21.15.114:0/1152176170 shutdown_connections 2024-04-28T13:07:38.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.368+0000 7f27bdda4640 1 -- 172.21.15.114:0/1152176170 wait complete. 2024-04-28T13:07:38.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.369+0000 7f27bdda4640 1 Processor -- start 2024-04-28T13:07:38.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.370+0000 7f27bdda4640 1 -- start start 2024-04-28T13:07:38.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.370+0000 7f27bdda4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27b8070710 0x7f27b81f7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:38.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.370+0000 7f27bdda4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27b80722a0 0x7f27b81509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:38.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.370+0000 7f27bdda4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27b80b73d0 0x7f27b81f2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:38.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.370+0000 7f27bdda4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f27b80d2eb0 con 0x7f27b80722a0 2024-04-28T13:07:38.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.370+0000 7f27bdda4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f27b80d2d30 con 0x7f27b80b73d0 2024-04-28T13:07:38.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.370+0000 7f27bdda4640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f27b80b77b0 con 0x7f27b8070710 2024-04-28T13:07:38.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.370+0000 7f27b6ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27b80722a0 0x7f27b81509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:38.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.370+0000 7f27b6ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27b80722a0 0x7f27b81509c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48394/0 (socket says 172.21.15.114:48394) 2024-04-28T13:07:38.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.370+0000 7f27b6ffd640 1 -- 172.21.15.114:0/3488925303 learned_addr learned my addr 172.21.15.114:0/3488925303 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:38.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.371+0000 7f27b7fff640 1 --2- 172.21.15.114:0/3488925303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27b80b73d0 0x7f27b81f2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:38.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.371+0000 7f27b77fe640 1 --2- 172.21.15.114:0/3488925303 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27b8070710 0x7f27b81f7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:38.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.371+0000 7f27b6ffd640 1 -- 172.21.15.114:0/3488925303 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27b8070710 msgr2=0x7f27b81f7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:38.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.371+0000 7f27b6ffd640 1 --2- 172.21.15.114:0/3488925303 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27b8070710 0x7f27b81f7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:38.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.371+0000 7f27b6ffd640 1 -- 172.21.15.114:0/3488925303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27b80b73d0 msgr2=0x7f27b81f2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:38.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.371+0000 7f27b6ffd640 1 --2- 172.21.15.114:0/3488925303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27b80b73d0 0x7f27b81f2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:38.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.371+0000 7f27b6ffd640 1 -- 172.21.15.114:0/3488925303 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b81f7760 con 0x7f27b80722a0 2024-04-28T13:07:38.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.371+0000 7f27b6ffd640 1 --2- 172.21.15.114:0/3488925303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27b80722a0 0x7f27b81509c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f27a000c4c0 tx=0x7f27a000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:38.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.371+0000 7f27affff640 1 -- 172.21.15.114:0/3488925303 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a00052d0 con 0x7f27b80722a0 2024-04-28T13:07:38.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.371+0000 7f27affff640 1 -- 172.21.15.114:0/3488925303 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a0005470 con 0x7f27b80722a0 2024-04-28T13:07:38.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.371+0000 7f27bdda4640 1 -- 172.21.15.114:0/3488925303 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27b8150f00 con 0x7f27b80722a0 2024-04-28T13:07:38.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.371+0000 7f27affff640 1 -- 172.21.15.114:0/3488925303 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a0012870 con 0x7f27b80722a0 2024-04-28T13:07:38.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.371+0000 7f27bdda4640 1 -- 172.21.15.114:0/3488925303 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27b814fc00 con 0x7f27b80722a0 2024-04-28T13:07:38.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.372+0000 7f27bdda4640 1 -- 172.21.15.114:0/3488925303 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27b806a3d0 con 0x7f27b80722a0 2024-04-28T13:07:38.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.372+0000 7f27affff640 1 -- 172.21.15.114:0/3488925303 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f27a0012a10 con 0x7f27b80722a0 2024-04-28T13:07:38.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.373+0000 7f27affff640 1 --2- 172.21.15.114:0/3488925303 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f279806c8f0 0x7f279806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:38.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.373+0000 7f27b77fe640 1 --2- 172.21.15.114:0/3488925303 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f279806c8f0 0x7f279806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:38.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.373+0000 7f27affff640 1 -- 172.21.15.114:0/3488925303 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f27a008b7d0 con 0x7f27b80722a0 2024-04-28T13:07:38.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.373+0000 7f27b77fe640 1 --2- 172.21.15.114:0/3488925303 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f279806c8f0 0x7f279806edb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f27a8034000 tx=0x7f27a8033040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:38.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.377+0000 7f27affff640 1 -- 172.21.15.114:0/3488925303 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f27b81f7760 con 0x7f27b80722a0 2024-04-28T13:07:38.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.591+0000 7f27bdda4640 1 -- 172.21.15.114:0/3488925303 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f27b8071460 con 0x7f27b80722a0 2024-04-28T13:07:38.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.591+0000 7f27affff640 1 -- 172.21.15.114:0/3488925303 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f27a0059c00 con 0x7f27b80722a0 2024-04-28T13:07:38.591 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:38.591 INFO:teuthology.orchestra.run.smithi114.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-28T13:07:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.593+0000 7f27bdda4640 1 -- 172.21.15.114:0/3488925303 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f279806c8f0 msgr2=0x7f279806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.593+0000 7f27bdda4640 1 --2- 172.21.15.114:0/3488925303 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f279806c8f0 0x7f279806edb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f27a8034000 tx=0x7f27a8033040 comp rx=0 tx=0).stop 2024-04-28T13:07:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.593+0000 7f27bdda4640 1 -- 172.21.15.114:0/3488925303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27b80722a0 msgr2=0x7f27b81509c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.593+0000 7f27bdda4640 1 --2- 172.21.15.114:0/3488925303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27b80722a0 0x7f27b81509c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f27a000c4c0 tx=0x7f27a000c980 comp rx=0 tx=0).stop 2024-04-28T13:07:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.593+0000 7f27bdda4640 1 -- 172.21.15.114:0/3488925303 shutdown_connections 2024-04-28T13:07:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.593+0000 7f27bdda4640 1 --2- 172.21.15.114:0/3488925303 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f279806c8f0 0x7f279806edb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.593+0000 7f27bdda4640 1 --2- 172.21.15.114:0/3488925303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27b80b73d0 0x7f27b81f2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.593+0000 7f27bdda4640 1 --2- 172.21.15.114:0/3488925303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27b80722a0 0x7f27b81509c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.593+0000 7f27bdda4640 1 --2- 172.21.15.114:0/3488925303 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27b8070710 0x7f27b81f7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.593+0000 7f27bdda4640 1 -- 172.21.15.114:0/3488925303 >> 172.21.15.114:0/3488925303 conn(0x7f27b80b4c60 msgr2=0x7f27b815d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.593+0000 7f27bdda4640 1 -- 172.21.15.114:0/3488925303 shutdown_connections 2024-04-28T13:07:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.593+0000 7f27bdda4640 1 -- 172.21.15.114:0/3488925303 wait complete. 2024-04-28T13:07:38.603 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-28T13:07:38.603 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:07:38.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.700+0000 7fb2c0647640 1 Processor -- start 2024-04-28T13:07:38.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.700+0000 7fb2c0647640 1 -- start start 2024-04-28T13:07:38.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.701+0000 7fb2c0647640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb2b815f8a0 0x7fb2b8071160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:38.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.701+0000 7fb2c0647640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb2b815fc80 0x7fb2b8162e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:38.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.701+0000 7fb2c0647640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2b80c88e0 con 0x7fb2b8163340 2024-04-28T13:07:38.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.701+0000 7fb2c0647640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fb2b80c8f10 con 0x7fb2b815fc80 2024-04-28T13:07:38.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.701+0000 7fb2c0647640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb2b806d7a0 con 0x7fb2b815f8a0 2024-04-28T13:07:38.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.701+0000 7fb2bdbe2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb2b815fc80 0x7fb2b8162e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:38.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.701+0000 7fb2bebe4640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb2b8163340 0x7fb2b8160be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46948/0 (socket says 172.21.15.114:46948) 2024-04-28T13:07:38.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.701+0000 7fb2bebe4640 1 -- 172.21.15.114:0/3843131252 learned_addr learned my addr 172.21.15.114:0/3843131252 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:38.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.701+0000 7fb2be3e3640 1 --2- 172.21.15.114:0/3843131252 >> v2:172.21.15.134:3300/0 conn(0x7fb2b815f8a0 0x7fb2b8071160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:38.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.701+0000 7fb2bdbe2640 1 -- 172.21.15.114:0/3843131252 >> v2:172.21.15.134:3300/0 conn(0x7fb2b815f8a0 msgr2=0x7fb2b8071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:38.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.701+0000 7fb2bdbe2640 1 --2- 172.21.15.114:0/3843131252 >> v2:172.21.15.134:3300/0 conn(0x7fb2b815f8a0 0x7fb2b8071160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:38.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.701+0000 7fb2bdbe2640 1 -- 172.21.15.114:0/3843131252 >> v1:172.21.15.114:6789/0 conn(0x7fb2b8163340 legacy=0x7fb2b8160be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:38.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.701+0000 7fb2bdbe2640 1 -- 172.21.15.114:0/3843131252 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b806da80 con 0x7fb2b815fc80 2024-04-28T13:07:38.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.701+0000 7fb2bd3e1640 1 -- 172.21.15.114:0/3843131252 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3337617939 0 0) 0x7fb2b80c88e0 con 0x7fb2b8163340 2024-04-28T13:07:38.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.701+0000 7fb2be3e3640 1 --2- 172.21.15.114:0/3843131252 >> v2:172.21.15.134:3300/0 conn(0x7fb2b815f8a0 0x7fb2b8071160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:38.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.702+0000 7fb2bdbe2640 1 --2- 172.21.15.114:0/3843131252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b815fc80 0x7fb2b8162e00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb2b80b5cb0 tx=0x7fb2a802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88034923ff62e777 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:38.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.702+0000 7fb2bd3e1640 1 -- 172.21.15.114:0/3843131252 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8037070 con 0x7fb2b815fc80 2024-04-28T13:07:38.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.702+0000 7fb2bd3e1640 1 -- 172.21.15.114:0/3843131252 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a8032440 con 0x7fb2b815fc80 2024-04-28T13:07:38.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.702+0000 7fb2bd3e1640 1 -- 172.21.15.114:0/3843131252 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8032810 con 0x7fb2b815fc80 2024-04-28T13:07:38.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.702+0000 7fb2c0647640 1 -- 172.21.15.114:0/3843131252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b815fc80 msgr2=0x7fb2b8162e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:38.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.702+0000 7fb2c0647640 1 --2- 172.21.15.114:0/3843131252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b815fc80 0x7fb2b8162e00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb2b80b5cb0 tx=0x7fb2a802a1a0 comp rx=0 tx=0).stop 2024-04-28T13:07:38.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.703+0000 7fb2c0647640 1 -- 172.21.15.114:0/3843131252 shutdown_connections 2024-04-28T13:07:38.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.703+0000 7fb2c0647640 1 --2- 172.21.15.114:0/3843131252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b815fc80 0x7fb2b8162e00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:38.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.703+0000 7fb2c0647640 1 --2- 172.21.15.114:0/3843131252 >> v2:172.21.15.134:3300/0 conn(0x7fb2b815f8a0 0x7fb2b8071160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:38.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.703+0000 7fb2c0647640 1 -- 172.21.15.114:0/3843131252 >> 172.21.15.114:0/3843131252 conn(0x7fb2b8062d70 msgr2=0x7fb2b8063150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:38.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.703+0000 7fb2c0647640 1 -- 172.21.15.114:0/3843131252 shutdown_connections 2024-04-28T13:07:38.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.703+0000 7fb2c0647640 1 -- 172.21.15.114:0/3843131252 wait complete. 2024-04-28T13:07:38.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.704+0000 7fb2c0647640 1 Processor -- start 2024-04-28T13:07:38.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.704+0000 7fb2c0647640 1 -- start start 2024-04-28T13:07:38.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.704+0000 7fb2c0647640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb2b815f8a0 0x7fb2b80ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:38.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.704+0000 7fb2c0647640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b815fc80 0x7fb2b81eaff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:38.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.704+0000 7fb2c0647640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2b8163340 0x7fb2b81f4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:38.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.704+0000 7fb2c0647640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b81600c0 con 0x7fb2b815fc80 2024-04-28T13:07:38.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.704+0000 7fb2c0647640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b80d3930 con 0x7fb2b8163340 2024-04-28T13:07:38.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.704+0000 7fb2c0647640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb2b80ccd70 con 0x7fb2b815f8a0 2024-04-28T13:07:38.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.705+0000 7fb2bdbe2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b815fc80 0x7fb2b81eaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:38.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.705+0000 7fb2bdbe2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b815fc80 0x7fb2b81eaff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48420/0 (socket says 172.21.15.114:48420) 2024-04-28T13:07:38.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.705+0000 7fb2bdbe2640 1 -- 172.21.15.114:0/4043368438 learned_addr learned my addr 172.21.15.114:0/4043368438 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:38.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.705+0000 7fb2bdbe2640 1 -- 172.21.15.114:0/4043368438 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb2b815f8a0 msgr2=0x7fb2b80ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:38.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.705+0000 7fb2bdbe2640 1 --2- 172.21.15.114:0/4043368438 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb2b815f8a0 0x7fb2b80ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:38.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.705+0000 7fb2bdbe2640 1 -- 172.21.15.114:0/4043368438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2b8163340 msgr2=0x7fb2b81f4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:38.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.705+0000 7fb2bdbe2640 1 --2- 172.21.15.114:0/4043368438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2b8163340 0x7fb2b81f4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:38.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.705+0000 7fb2bdbe2640 1 -- 172.21.15.114:0/4043368438 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b80cd050 con 0x7fb2b815fc80 2024-04-28T13:07:38.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.705+0000 7fb2bdbe2640 1 --2- 172.21.15.114:0/4043368438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b815fc80 0x7fb2b81eaff0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8035040 tx=0x7fb2a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:38.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.705+0000 7fb2aeffd640 1 -- 172.21.15.114:0/4043368438 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8037050 con 0x7fb2b815fc80 2024-04-28T13:07:38.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.705+0000 7fb2aeffd640 1 -- 172.21.15.114:0/4043368438 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a8038040 con 0x7fb2b815fc80 2024-04-28T13:07:38.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.705+0000 7fb2c0647640 1 -- 172.21.15.114:0/4043368438 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2b80cd330 con 0x7fb2b815fc80 2024-04-28T13:07:38.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.705+0000 7fb2aeffd640 1 -- 172.21.15.114:0/4043368438 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8004470 con 0x7fb2b815fc80 2024-04-28T13:07:38.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.705+0000 7fb2c0647640 1 -- 172.21.15.114:0/4043368438 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2b80ca640 con 0x7fb2b815fc80 2024-04-28T13:07:38.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.706+0000 7fb2c0647640 1 -- 172.21.15.114:0/4043368438 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2b806a3d0 con 0x7fb2b815fc80 2024-04-28T13:07:38.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.707+0000 7fb2aeffd640 1 -- 172.21.15.114:0/4043368438 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb2a8030900 con 0x7fb2b815fc80 2024-04-28T13:07:38.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.707+0000 7fb2aeffd640 1 --2- 172.21.15.114:0/4043368438 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb29c06c8f0 0x7fb29c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:38.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.707+0000 7fb2be3e3640 1 --2- 172.21.15.114:0/4043368438 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb29c06c8f0 0x7fb29c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:38.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.707+0000 7fb2aeffd640 1 -- 172.21.15.114:0/4043368438 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb2a80ac790 con 0x7fb2b815fc80 2024-04-28T13:07:38.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.708+0000 7fb2be3e3640 1 --2- 172.21.15.114:0/4043368438 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb29c06c8f0 0x7fb29c06edb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4006fd0 tx=0x7fb2b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:38.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.712+0000 7fb2aeffd640 1 -- 172.21.15.114:0/4043368438 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb2a807aa90 con 0x7fb2b815fc80 2024-04-28T13:07:38.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.888+0000 7fb2c0647640 1 -- 172.21.15.114:0/4043368438 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb2b8163a50 con 0x7fb2b815fc80 2024-04-28T13:07:38.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.889+0000 7fb2aeffd640 1 -- 172.21.15.114:0/4043368438 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7fb2a807a390 con 0x7fb2b815fc80 2024-04-28T13:07:38.889 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:38.889 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:07:27.292537+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-28T13:07:23.706359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-28T13:07:24.596188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:07:38.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.891+0000 7fb2c0647640 1 -- 172.21.15.114:0/4043368438 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb29c06c8f0 msgr2=0x7fb29c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:38.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.891+0000 7fb2c0647640 1 --2- 172.21.15.114:0/4043368438 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb29c06c8f0 0x7fb29c06edb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4006fd0 tx=0x7fb2b4008040 comp rx=0 tx=0).stop 2024-04-28T13:07:38.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.891+0000 7fb2c0647640 1 -- 172.21.15.114:0/4043368438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b815fc80 msgr2=0x7fb2b81eaff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:38.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.891+0000 7fb2c0647640 1 --2- 172.21.15.114:0/4043368438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b815fc80 0x7fb2b81eaff0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8035040 tx=0x7fb2a80046c0 comp rx=0 tx=0).stop 2024-04-28T13:07:38.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.891+0000 7fb2c0647640 1 -- 172.21.15.114:0/4043368438 shutdown_connections 2024-04-28T13:07:38.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.891+0000 7fb2c0647640 1 --2- 172.21.15.114:0/4043368438 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb29c06c8f0 0x7fb29c06edb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:38.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.891+0000 7fb2c0647640 1 --2- 172.21.15.114:0/4043368438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2b8163340 0x7fb2b81f4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:38.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.891+0000 7fb2c0647640 1 --2- 172.21.15.114:0/4043368438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b815fc80 0x7fb2b81eaff0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:38.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.891+0000 7fb2c0647640 1 --2- 172.21.15.114:0/4043368438 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb2b815f8a0 0x7fb2b80ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:38.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.891+0000 7fb2c0647640 1 -- 172.21.15.114:0/4043368438 >> 172.21.15.114:0/4043368438 conn(0x7fb2b8062d70 msgr2=0x7fb2b815dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:38.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.891+0000 7fb2c0647640 1 -- 172.21.15.114:0/4043368438 shutdown_connections 2024-04-28T13:07:38.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:38.891+0000 7fb2c0647640 1 -- 172.21.15.114:0/4043368438 wait complete. 2024-04-28T13:07:38.902 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-28T13:07:14.721860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-28T13:07:23.706359+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-28T13:07:24.596188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-28T13:07:38.902 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-28T13:07:39.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.002+0000 7f3863e23640 1 Processor -- start 2024-04-28T13:07:39.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.002+0000 7f3863e23640 1 -- start start 2024-04-28T13:07:39.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.003+0000 7f3863e23640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f385c148dc0 0x7f385c0d0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:39.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.003+0000 7f3863e23640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f385c0d1270 0x7f385c0c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:39.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.003+0000 7f3863e23640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f385c0c8e70 con 0x7f385c0c8610 2024-04-28T13:07:39.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.003+0000 7f3863e23640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f385c0c9150 con 0x7f385c0d1270 2024-04-28T13:07:39.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.003+0000 7f3863e23640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f385c0c9430 con 0x7f385c148dc0 2024-04-28T13:07:39.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.003+0000 7f38613be640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f385c0d1270 0x7f385c0c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:39.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.003+0000 7f38623c0640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f385c0c8610 0x7f385c0cfb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46954/0 (socket says 172.21.15.114:46954) 2024-04-28T13:07:39.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.003+0000 7f38623c0640 1 -- 172.21.15.114:0/1020628170 learned_addr learned my addr 172.21.15.114:0/1020628170 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:39.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.003+0000 7f38613be640 1 -- 172.21.15.114:0/1020628170 >> v2:172.21.15.134:3300/0 conn(0x7f385c148dc0 msgr2=0x7f385c0d0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:39.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.003+0000 7f38613be640 1 --2- 172.21.15.114:0/1020628170 >> v2:172.21.15.134:3300/0 conn(0x7f385c148dc0 0x7f385c0d0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.003+0000 7f38613be640 1 -- 172.21.15.114:0/1020628170 >> v1:172.21.15.114:6789/0 conn(0x7f385c0c8610 legacy=0x7f385c0cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:39.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.003+0000 7f38613be640 1 -- 172.21.15.114:0/1020628170 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f385c0c9710 con 0x7f385c0d1270 2024-04-28T13:07:39.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.003+0000 7f3860bbd640 1 -- 172.21.15.114:0/1020628170 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2901758829 0 0) 0x7f385c0c8e70 con 0x7f385c0c8610 2024-04-28T13:07:39.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.004+0000 7f38613be640 1 --2- 172.21.15.114:0/1020628170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f385c0d1270 0x7f385c0c80d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f385c06d080 tx=0x7f384c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f2713ed207fc3c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:39.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.004+0000 7f3860bbd640 1 -- 172.21.15.114:0/1020628170 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384c037070 con 0x7f385c0d1270 2024-04-28T13:07:39.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.004+0000 7f3860bbd640 1 -- 172.21.15.114:0/1020628170 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f384c032440 con 0x7f385c0d1270 2024-04-28T13:07:39.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.004+0000 7f3860bbd640 1 -- 172.21.15.114:0/1020628170 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384c02ae60 con 0x7f385c0d1270 2024-04-28T13:07:39.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.004+0000 7f3863e23640 1 -- 172.21.15.114:0/1020628170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f385c0d1270 msgr2=0x7f385c0c80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:39.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.004+0000 7f3863e23640 1 --2- 172.21.15.114:0/1020628170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f385c0d1270 0x7f385c0c80d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f385c06d080 tx=0x7f384c02a110 comp rx=0 tx=0).stop 2024-04-28T13:07:39.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.004+0000 7f3863e23640 1 -- 172.21.15.114:0/1020628170 shutdown_connections 2024-04-28T13:07:39.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.004+0000 7f3863e23640 1 --2- 172.21.15.114:0/1020628170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f385c0d1270 0x7f385c0c80d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.004+0000 7f3863e23640 1 --2- 172.21.15.114:0/1020628170 >> v2:172.21.15.134:3300/0 conn(0x7f385c148dc0 0x7f385c0d0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.004+0000 7f3863e23640 1 -- 172.21.15.114:0/1020628170 >> 172.21.15.114:0/1020628170 conn(0x7f385c0706f0 msgr2=0x7f385c070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:39.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.005+0000 7f3863e23640 1 -- 172.21.15.114:0/1020628170 shutdown_connections 2024-04-28T13:07:39.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.005+0000 7f3863e23640 1 -- 172.21.15.114:0/1020628170 wait complete. 2024-04-28T13:07:39.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.006+0000 7f3863e23640 1 Processor -- start 2024-04-28T13:07:39.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.006+0000 7f3863e23640 1 -- start start 2024-04-28T13:07:39.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.006+0000 7f3863e23640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f385c0c8610 0x7f385c15eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:39.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.006+0000 7f3863e23640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f385c0d1270 0x7f385c15fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:39.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.006+0000 7f3863e23640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f385c148dc0 0x7f385c161d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:39.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.006+0000 7f3863e23640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f385c0c8be0 con 0x7f385c0d1270 2024-04-28T13:07:39.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.006+0000 7f3863e23640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f385c0c8a60 con 0x7f385c0c8610 2024-04-28T13:07:39.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.006+0000 7f3863e23640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f385c0ced80 con 0x7f385c148dc0 2024-04-28T13:07:39.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.006+0000 7f38613be640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f385c0d1270 0x7f385c15fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:39.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.006+0000 7f38613be640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f385c0d1270 0x7f385c15fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48448/0 (socket says 172.21.15.114:48448) 2024-04-28T13:07:39.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.006+0000 7f38613be640 1 -- 172.21.15.114:0/4224875964 learned_addr learned my addr 172.21.15.114:0/4224875964 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:39.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.007+0000 7f3861bbf640 1 --2- 172.21.15.114:0/4224875964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f385c0c8610 0x7f385c15eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:39.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.007+0000 7f38623c0640 1 --2- 172.21.15.114:0/4224875964 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f385c148dc0 0x7f385c161d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:39.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.007+0000 7f38613be640 1 -- 172.21.15.114:0/4224875964 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f385c148dc0 msgr2=0x7f385c161d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:39.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.007+0000 7f38613be640 1 --2- 172.21.15.114:0/4224875964 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f385c148dc0 0x7f385c161d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.007+0000 7f38613be640 1 -- 172.21.15.114:0/4224875964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f385c0c8610 msgr2=0x7f385c15eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:39.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.007+0000 7f38613be640 1 --2- 172.21.15.114:0/4224875964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f385c0c8610 0x7f385c15eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.007+0000 7f38613be640 1 -- 172.21.15.114:0/4224875964 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f385c1603d0 con 0x7f385c0d1270 2024-04-28T13:07:39.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.007+0000 7f38613be640 1 --2- 172.21.15.114:0/4224875964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f385c0d1270 0x7f385c15fa30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f384c009890 tx=0x7f384c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:39.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.007+0000 7f38527fc640 1 -- 172.21.15.114:0/4224875964 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384c041070 con 0x7f385c0d1270 2024-04-28T13:07:39.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.007+0000 7f38527fc640 1 -- 172.21.15.114:0/4224875964 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f384c03c950 con 0x7f385c0d1270 2024-04-28T13:07:39.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.007+0000 7f3863e23640 1 -- 172.21.15.114:0/4224875964 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f385c1606b0 con 0x7f385c0d1270 2024-04-28T13:07:39.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.007+0000 7f38527fc640 1 -- 172.21.15.114:0/4224875964 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384c037040 con 0x7f385c0d1270 2024-04-28T13:07:39.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.007+0000 7f3863e23640 1 -- 172.21.15.114:0/4224875964 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f385c160c70 con 0x7f385c0d1270 2024-04-28T13:07:39.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.008+0000 7f3863e23640 1 -- 172.21.15.114:0/4224875964 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f385c06a3d0 con 0x7f385c0d1270 2024-04-28T13:07:39.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.008+0000 7f38527fc640 1 -- 172.21.15.114:0/4224875964 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f384c044070 con 0x7f385c0d1270 2024-04-28T13:07:39.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.009+0000 7f38527fc640 1 --2- 172.21.15.114:0/4224875964 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f384006c8f0 0x7f384006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:39.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.009+0000 7f38527fc640 1 -- 172.21.15.114:0/4224875964 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f384c0ac940 con 0x7f385c0d1270 2024-04-28T13:07:39.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.009+0000 7f3861bbf640 1 --2- 172.21.15.114:0/4224875964 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f384006c8f0 0x7f384006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:39.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.009+0000 7f3861bbf640 1 --2- 172.21.15.114:0/4224875964 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f384006c8f0 0x7f384006edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f385c1f8c40 tx=0x7f3858008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:39.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.013+0000 7f38527fc640 1 -- 172.21.15.114:0/4224875964 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f384c07ae90 con 0x7f385c0d1270 2024-04-28T13:07:39.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.186+0000 7f3863e23640 1 -- 172.21.15.114:0/4224875964 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f385c0b5b70 con 0x7f385c0d1270 2024-04-28T13:07:39.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.186+0000 7f38527fc640 1 -- 172.21.15.114:0/4224875964 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f384c07a790 con 0x7f385c0d1270 2024-04-28T13:07:39.186 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-28T13:07:39.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.188+0000 7f3863e23640 1 -- 172.21.15.114:0/4224875964 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f384006c8f0 msgr2=0x7f384006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:39.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.188+0000 7f3863e23640 1 --2- 172.21.15.114:0/4224875964 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f384006c8f0 0x7f384006edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f385c1f8c40 tx=0x7f3858008040 comp rx=0 tx=0).stop 2024-04-28T13:07:39.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.188+0000 7f3863e23640 1 -- 172.21.15.114:0/4224875964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f385c0d1270 msgr2=0x7f385c15fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:39.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.188+0000 7f3863e23640 1 --2- 172.21.15.114:0/4224875964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f385c0d1270 0x7f385c15fa30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f384c009890 tx=0x7f384c0046c0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.188+0000 7f3863e23640 1 -- 172.21.15.114:0/4224875964 shutdown_connections 2024-04-28T13:07:39.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.188+0000 7f3863e23640 1 --2- 172.21.15.114:0/4224875964 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f385c148dc0 0x7f385c161d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.188+0000 7f3863e23640 1 --2- 172.21.15.114:0/4224875964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f385c0d1270 0x7f385c15fa30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.188+0000 7f3863e23640 1 --2- 172.21.15.114:0/4224875964 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f384006c8f0 0x7f384006edb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.188+0000 7f3863e23640 1 --2- 172.21.15.114:0/4224875964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f385c0c8610 0x7f385c15eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.188+0000 7f3863e23640 1 -- 172.21.15.114:0/4224875964 >> 172.21.15.114:0/4224875964 conn(0x7f385c0706f0 msgr2=0x7f385c0cf2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:39.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.188+0000 7f3863e23640 1 -- 172.21.15.114:0/4224875964 shutdown_connections 2024-04-28T13:07:39.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.188+0000 7f3863e23640 1 -- 172.21.15.114:0/4224875964 wait complete. 2024-04-28T13:07:39.199 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-28T13:07:39.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.300+0000 7f9f6bdc6640 1 Processor -- start 2024-04-28T13:07:39.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.300+0000 7f9f6bdc6640 1 -- start start 2024-04-28T13:07:39.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.300+0000 7f9f6bdc6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9f6415f4d0 0x7f9f6406dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:39.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.300+0000 7f9f6bdc6640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f640d0710 con 0x7f9f640d0270 2024-04-28T13:07:39.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.301+0000 7f9f6bdc6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f640d3550 con 0x7f9f640b6cb0 2024-04-28T13:07:39.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.301+0000 7f9f6bdc6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f9f640d3e80 con 0x7f9f6415f4d0 2024-04-28T13:07:39.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.301+0000 7f9f69361640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9f640d0270 0x7f9f640d4310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46966/0 (socket says 172.21.15.114:46966) 2024-04-28T13:07:39.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.301+0000 7f9f69361640 1 -- 172.21.15.114:0/171451833 learned_addr learned my addr 172.21.15.114:0/171451833 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:39.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.301+0000 7f9f6a363640 1 --2- 172.21.15.114:0/171451833 >> v2:172.21.15.134:3300/0 conn(0x7f9f6415f4d0 0x7f9f6406dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:39.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.301+0000 7f9f68b60640 1 -- 172.21.15.114:0/171451833 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3277198743 0 0) 0x7f9f640d0710 con 0x7f9f640d0270 2024-04-28T13:07:39.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.301+0000 7f9f68b60640 1 -- 172.21.15.114:0/171451833 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f50003520 con 0x7f9f640d0270 2024-04-28T13:07:39.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.301+0000 7f9f68b60640 1 -- 172.21.15.114:0/171451833 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3054898118 0 0) 0x7f9f640d3550 con 0x7f9f640b6cb0 2024-04-28T13:07:39.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.301+0000 7f9f68b60640 1 -- 172.21.15.114:0/171451833 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f640d0710 con 0x7f9f640b6cb0 2024-04-28T13:07:39.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.301+0000 7f9f68b60640 1 -- 172.21.15.114:0/171451833 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2232170111 0 0) 0x7f9f50003520 con 0x7f9f640d0270 2024-04-28T13:07:39.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.301+0000 7f9f68b60640 1 -- 172.21.15.114:0/171451833 >> v2:172.21.15.134:3300/0 conn(0x7f9f6415f4d0 msgr2=0x7f9f6406dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:39.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.301+0000 7f9f68b60640 1 --2- 172.21.15.114:0/171451833 >> v2:172.21.15.134:3300/0 conn(0x7f9f6415f4d0 0x7f9f6406dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.301+0000 7f9f68b60640 1 -- 172.21.15.114:0/171451833 >> v1:172.21.15.134:6789/0 conn(0x7f9f640b6cb0 legacy=0x7f9f640b7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:39.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.301+0000 7f9f68b60640 1 -- 172.21.15.114:0/171451833 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f640d3830 con 0x7f9f640d0270 2024-04-28T13:07:39.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.301+0000 7f9f68b60640 1 -- 172.21.15.114:0/171451833 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f9f54001690 con 0x7f9f640d0270 2024-04-28T13:07:39.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.301+0000 7f9f68b60640 1 -- 172.21.15.114:0/171451833 >> v1:172.21.15.114:6789/0 conn(0x7f9f640d0270 legacy=0x7f9f640d4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:39.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.301+0000 7f9f68b60640 1 --2- 172.21.15.114:0/171451833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f50003b90 0x7f9f50003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:39.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.301+0000 7f9f68b60640 1 --2- 172.21.15.114:0/171451833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f50004800 0x7f9f50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:39.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.301+0000 7f9f68b60640 1 --2- 172.21.15.114:0/171451833 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f500051c0 0x7f9f5000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:39.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.301+0000 7f9f68b60640 1 -- 172.21.15.114:0/171451833 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9f640d3e80 con 0x7f9f50004800 2024-04-28T13:07:39.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.301+0000 7f9f68b60640 1 -- 172.21.15.114:0/171451833 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5000bfe0 con 0x7f9f50003b90 2024-04-28T13:07:39.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.301+0000 7f9f68b60640 1 -- 172.21.15.114:0/171451833 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f9f5000c1e0 con 0x7f9f500051c0 2024-04-28T13:07:39.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.301+0000 7f9f69361640 1 --2- 172.21.15.114:0/171451833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f50004800 0x7f9f50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:39.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.301+0000 7f9f69b62640 1 --2- 172.21.15.114:0/171451833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f50003b90 0x7f9f50003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:39.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.301+0000 7f9f6a363640 1 --2- 172.21.15.114:0/171451833 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f500051c0 0x7f9f5000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:39.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.301+0000 7f9f69361640 1 -- 172.21.15.114:0/171451833 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f500051c0 msgr2=0x7f9f5000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:39.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.301+0000 7f9f69361640 1 --2- 172.21.15.114:0/171451833 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f500051c0 0x7f9f5000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.301+0000 7f9f69361640 1 -- 172.21.15.114:0/171451833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f50003b90 msgr2=0x7f9f50003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:39.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.301+0000 7f9f69361640 1 --2- 172.21.15.114:0/171451833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f50003b90 0x7f9f50003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.302+0000 7f9f69361640 1 -- 172.21.15.114:0/171451833 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f50003520 con 0x7f9f50004800 2024-04-28T13:07:39.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.302+0000 7f9f6a363640 1 -- 172.21.15.114:0/171451833 reap_dead start 2024-04-28T13:07:39.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.302+0000 7f9f69361640 1 --2- 172.21.15.114:0/171451833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f50004800 0x7f9f50004c80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9f54007fb0 tx=0x7f9f50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2674bdbcdc5bfe server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:39.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.302+0000 7f9f68b60640 1 -- 172.21.15.114:0/171451833 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f54007c00 con 0x7f9f50004800 2024-04-28T13:07:39.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.302+0000 7f9f68b60640 1 -- 172.21.15.114:0/171451833 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f54005ad0 con 0x7f9f50004800 2024-04-28T13:07:39.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.302+0000 7f9f68b60640 1 -- 172.21.15.114:0/171451833 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f54007070 con 0x7f9f50004800 2024-04-28T13:07:39.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.303+0000 7f9f6bdc6640 1 -- 172.21.15.114:0/171451833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f50004800 msgr2=0x7f9f50004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:39.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.303+0000 7f9f6bdc6640 1 --2- 172.21.15.114:0/171451833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f50004800 0x7f9f50004c80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9f54007fb0 tx=0x7f9f50005830 comp rx=0 tx=0).stop 2024-04-28T13:07:39.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.303+0000 7f9f6bdc6640 1 -- 172.21.15.114:0/171451833 shutdown_connections 2024-04-28T13:07:39.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.303+0000 7f9f6bdc6640 1 --2- 172.21.15.114:0/171451833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f50004800 0x7f9f50004c80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.303+0000 7f9f6bdc6640 1 -- 172.21.15.114:0/171451833 >> 172.21.15.114:0/171451833 conn(0x7f9f640633a0 msgr2=0x7f9f640d1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:39.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.303+0000 7f9f6bdc6640 1 -- 172.21.15.114:0/171451833 shutdown_connections 2024-04-28T13:07:39.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.303+0000 7f9f6bdc6640 1 -- 172.21.15.114:0/171451833 wait complete. 2024-04-28T13:07:39.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.304+0000 7f9f6bdc6640 1 Processor -- start 2024-04-28T13:07:39.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.304+0000 7f9f6bdc6640 1 -- start start 2024-04-28T13:07:39.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.305+0000 7f9f6bdc6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f50004800 0x7f9f640b92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:39.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.305+0000 7f9f6bdc6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f640b97e0 0x7f9f640d5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:39.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.305+0000 7f9f6bdc6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f640c9b20 0x7f9f640d5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:39.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.305+0000 7f9f6bdc6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6406dd40 con 0x7f9f50004800 2024-04-28T13:07:39.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.305+0000 7f9f6bdc6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9f640b48e0 con 0x7f9f640c9b20 2024-04-28T13:07:39.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.305+0000 7f9f6bdc6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f9f6406dec0 con 0x7f9f640b97e0 2024-04-28T13:07:39.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.305+0000 7f9f69b62640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f50004800 0x7f9f640b92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:39.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.305+0000 7f9f69b62640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f50004800 0x7f9f640b92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48472/0 (socket says 172.21.15.114:48472) 2024-04-28T13:07:39.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.305+0000 7f9f69b62640 1 -- 172.21.15.114:0/1582410735 learned_addr learned my addr 172.21.15.114:0/1582410735 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:39.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.305+0000 7f9f69b62640 1 -- 172.21.15.114:0/1582410735 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f640b97e0 msgr2=0x7f9f640d5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:39.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.305+0000 7f9f69b62640 1 --2- 172.21.15.114:0/1582410735 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f640b97e0 0x7f9f640d5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.305+0000 7f9f69b62640 1 -- 172.21.15.114:0/1582410735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f640c9b20 msgr2=0x7f9f640d5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:39.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.305+0000 7f9f69b62640 1 --2- 172.21.15.114:0/1582410735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f640c9b20 0x7f9f640d5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.305+0000 7f9f69b62640 1 -- 172.21.15.114:0/1582410735 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f640b9c80 con 0x7f9f50004800 2024-04-28T13:07:39.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.305+0000 7f9f69b62640 1 --2- 172.21.15.114:0/1582410735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f50004800 0x7f9f640b92a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9f6000f7a0 tx=0x7f9f6000fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:39.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.305+0000 7f9f5a7fc640 1 -- 172.21.15.114:0/1582410735 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6001a070 con 0x7f9f50004800 2024-04-28T13:07:39.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.305+0000 7f9f5a7fc640 1 -- 172.21.15.114:0/1582410735 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f6000fe50 con 0x7f9f50004800 2024-04-28T13:07:39.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.305+0000 7f9f6bdc6640 1 -- 172.21.15.114:0/1582410735 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f640c8d60 con 0x7f9f50004800 2024-04-28T13:07:39.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.305+0000 7f9f5a7fc640 1 -- 172.21.15.114:0/1582410735 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f60007050 con 0x7f9f50004800 2024-04-28T13:07:39.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.305+0000 7f9f6bdc6640 1 -- 172.21.15.114:0/1582410735 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f640c9320 con 0x7f9f50004800 2024-04-28T13:07:39.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.306+0000 7f9f6bdc6640 1 -- 172.21.15.114:0/1582410735 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f6406a3d0 con 0x7f9f50004800 2024-04-28T13:07:39.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.307+0000 7f9f5a7fc640 1 -- 172.21.15.114:0/1582410735 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9f6001d070 con 0x7f9f50004800 2024-04-28T13:07:39.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.307+0000 7f9f5a7fc640 1 --2- 172.21.15.114:0/1582410735 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9f4806c8f0 0x7f9f4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:39.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.307+0000 7f9f69361640 1 --2- 172.21.15.114:0/1582410735 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9f4806c8f0 0x7f9f4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:39.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.307+0000 7f9f5a7fc640 1 -- 172.21.15.114:0/1582410735 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9f6008b2e0 con 0x7f9f50004800 2024-04-28T13:07:39.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.307+0000 7f9f69361640 1 --2- 172.21.15.114:0/1582410735 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9f4806c8f0 0x7f9f4806edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9f54032000 tx=0x7f9f54007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:39.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.311+0000 7f9f5a7fc640 1 -- 172.21.15.114:0/1582410735 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9f600597a0 con 0x7f9f50004800 2024-04-28T13:07:39.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.490+0000 7f9f6bdc6640 1 -- 172.21.15.114:0/1582410735 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9f640d2a10 con 0x7f9f50004800 2024-04-28T13:07:39.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.490+0000 7f9f5a7fc640 1 -- 172.21.15.114:0/1582410735 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f9f600590a0 con 0x7f9f50004800 2024-04-28T13:07:39.490 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-04-28T13:07:39.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.492+0000 7f9f6bdc6640 1 -- 172.21.15.114:0/1582410735 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9f4806c8f0 msgr2=0x7f9f4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:39.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.492+0000 7f9f6bdc6640 1 --2- 172.21.15.114:0/1582410735 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9f4806c8f0 0x7f9f4806edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9f54032000 tx=0x7f9f54007000 comp rx=0 tx=0).stop 2024-04-28T13:07:39.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.492+0000 7f9f6bdc6640 1 -- 172.21.15.114:0/1582410735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f50004800 msgr2=0x7f9f640b92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:39.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.492+0000 7f9f6bdc6640 1 --2- 172.21.15.114:0/1582410735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f50004800 0x7f9f640b92a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9f6000f7a0 tx=0x7f9f6000fc60 comp rx=0 tx=0).stop 2024-04-28T13:07:39.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.492+0000 7f9f6bdc6640 1 -- 172.21.15.114:0/1582410735 shutdown_connections 2024-04-28T13:07:39.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.492+0000 7f9f6bdc6640 1 --2- 172.21.15.114:0/1582410735 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9f4806c8f0 0x7f9f4806edb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.492+0000 7f9f6bdc6640 1 --2- 172.21.15.114:0/1582410735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f640c9b20 0x7f9f640d5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.492+0000 7f9f6bdc6640 1 --2- 172.21.15.114:0/1582410735 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f640b97e0 0x7f9f640d5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.492+0000 7f9f6bdc6640 1 --2- 172.21.15.114:0/1582410735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f50004800 0x7f9f640b92a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.492+0000 7f9f6bdc6640 1 -- 172.21.15.114:0/1582410735 >> 172.21.15.114:0/1582410735 conn(0x7f9f640633a0 msgr2=0x7f9f6406d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:39.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.492+0000 7f9f6bdc6640 1 -- 172.21.15.114:0/1582410735 shutdown_connections 2024-04-28T13:07:39.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.492+0000 7f9f6bdc6640 1 -- 172.21.15.114:0/1582410735 wait complete. 2024-04-28T13:07:39.503 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-28T13:07:39.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.601+0000 7f3617559640 1 Processor -- start 2024-04-28T13:07:39.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.602+0000 7f3617559640 1 -- start start 2024-04-28T13:07:39.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.602+0000 7f3617559640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f361015d510 0x7f36100b5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:39.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.602+0000 7f3617559640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f36100d0c30 0x7f36100d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:39.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.602+0000 7f3617559640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36100d1070 con 0x7f36100d17a0 2024-04-28T13:07:39.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.602+0000 7f3617559640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f36100cecd0 con 0x7f36100d0c30 2024-04-28T13:07:39.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.602+0000 7f3617559640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f36100b24f0 con 0x7f361015d510 2024-04-28T13:07:39.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.602+0000 7f3614af4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f36100d0c30 0x7f36100d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.603+0000 7f3614af4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f36100d0c30 0x7f36100d1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48480/0 (socket says 172.21.15.114:48480) 2024-04-28T13:07:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.603+0000 7f3614af4640 1 -- 172.21.15.114:0/1679114402 learned_addr learned my addr 172.21.15.114:0/1679114402 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.603+0000 7f36152f5640 1 --2- 172.21.15.114:0/1679114402 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f361015d510 0x7f36100b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.603+0000 7f3614af4640 1 -- 172.21.15.114:0/1679114402 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f361015d510 msgr2=0x7f36100b5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.603+0000 7f3614af4640 1 --2- 172.21.15.114:0/1679114402 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f361015d510 0x7f36100b5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.603+0000 7f3614af4640 1 -- 172.21.15.114:0/1679114402 >> v1:172.21.15.134:6789/0 conn(0x7f36100d17a0 legacy=0x7f361009b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.603+0000 7f3614af4640 1 -- 172.21.15.114:0/1679114402 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36100b2790 con 0x7f36100d0c30 2024-04-28T13:07:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.603+0000 7f36152f5640 1 --2- 172.21.15.114:0/1679114402 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f361015d510 0x7f36100b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:07:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.603+0000 7f3614af4640 1 --2- 172.21.15.114:0/1679114402 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36100d0c30 0x7f36100d1260 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f360c009870 tx=0x7f360c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b6a6f5b43cde7b server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.604+0000 7f3607fff640 1 -- 172.21.15.114:0/1679114402 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360c037070 con 0x7f36100d0c30 2024-04-28T13:07:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.604+0000 7f3607fff640 1 -- 172.21.15.114:0/1679114402 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f360c032440 con 0x7f36100d0c30 2024-04-28T13:07:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.604+0000 7f3607fff640 1 -- 172.21.15.114:0/1679114402 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360c032810 con 0x7f36100d0c30 2024-04-28T13:07:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.604+0000 7f3617559640 1 -- 172.21.15.114:0/1679114402 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36100d0c30 msgr2=0x7f36100d1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:39.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.604+0000 7f3617559640 1 --2- 172.21.15.114:0/1679114402 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36100d0c30 0x7f36100d1260 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f360c009870 tx=0x7f360c02a180 comp rx=0 tx=0).stop 2024-04-28T13:07:39.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.604+0000 7f3617559640 1 -- 172.21.15.114:0/1679114402 shutdown_connections 2024-04-28T13:07:39.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.604+0000 7f3617559640 1 --2- 172.21.15.114:0/1679114402 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36100d0c30 0x7f36100d1260 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.604+0000 7f3617559640 1 --2- 172.21.15.114:0/1679114402 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f361015d510 0x7f36100b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.604+0000 7f3617559640 1 -- 172.21.15.114:0/1679114402 >> 172.21.15.114:0/1679114402 conn(0x7f36100b4b50 msgr2=0x7f36100b4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:39.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.604+0000 7f3617559640 1 -- 172.21.15.114:0/1679114402 shutdown_connections 2024-04-28T13:07:39.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.604+0000 7f3617559640 1 -- 172.21.15.114:0/1679114402 wait complete. 2024-04-28T13:07:39.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.605+0000 7f3617559640 1 Processor -- start 2024-04-28T13:07:39.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.605+0000 7f3617559640 1 -- start start 2024-04-28T13:07:39.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.606+0000 7f3617559640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36100d0c30 0x7f361006dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:39.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.606+0000 7f3617559640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36100d17a0 0x7f361015a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:39.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.606+0000 7f3617559640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f361015d510 0x7f361006e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:39.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.606+0000 7f3617559640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f36100713b0 con 0x7f36100d0c30 2024-04-28T13:07:39.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.606+0000 7f3617559640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f36100ce960 con 0x7f36100d17a0 2024-04-28T13:07:39.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.606+0000 7f3617559640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3610071530 con 0x7f361015d510 2024-04-28T13:07:39.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.606+0000 7f36152f5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36100d0c30 0x7f361006dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:39.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.606+0000 7f36152f5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36100d0c30 0x7f361006dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48494/0 (socket says 172.21.15.114:48494) 2024-04-28T13:07:39.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.606+0000 7f36152f5640 1 -- 172.21.15.114:0/3180793790 learned_addr learned my addr 172.21.15.114:0/3180793790 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:39.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.606+0000 7f3614af4640 1 --2- 172.21.15.114:0/3180793790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36100d17a0 0x7f361015a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:39.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.606+0000 7f3615af6640 1 --2- 172.21.15.114:0/3180793790 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f361015d510 0x7f361006e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:39.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.606+0000 7f36152f5640 1 -- 172.21.15.114:0/3180793790 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f361015d510 msgr2=0x7f361006e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:39.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.606+0000 7f36152f5640 1 --2- 172.21.15.114:0/3180793790 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f361015d510 0x7f361006e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.606+0000 7f36152f5640 1 -- 172.21.15.114:0/3180793790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36100d17a0 msgr2=0x7f361015a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:39.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.606+0000 7f36152f5640 1 --2- 172.21.15.114:0/3180793790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36100d17a0 0x7f361015a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.606+0000 7f36152f5640 1 -- 172.21.15.114:0/3180793790 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f361015ad40 con 0x7f36100d0c30 2024-04-28T13:07:39.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.606+0000 7f3614af4640 1 --2- 172.21.15.114:0/3180793790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36100d17a0 0x7f361015a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:07:39.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.607+0000 7f36152f5640 1 --2- 172.21.15.114:0/3180793790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36100d0c30 0x7f361006dfe0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f360000c7f0 tx=0x7f360000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:39.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.607+0000 7f3605ffb640 1 -- 172.21.15.114:0/3180793790 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600015070 con 0x7f36100d0c30 2024-04-28T13:07:39.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.607+0000 7f3605ffb640 1 -- 172.21.15.114:0/3180793790 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3600007a30 con 0x7f36100d0c30 2024-04-28T13:07:39.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.607+0000 7f3605ffb640 1 -- 172.21.15.114:0/3180793790 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600007e00 con 0x7f36100d0c30 2024-04-28T13:07:39.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.607+0000 7f3617559640 1 -- 172.21.15.114:0/3180793790 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36100c9020 con 0x7f36100d0c30 2024-04-28T13:07:39.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.607+0000 7f3617559640 1 -- 172.21.15.114:0/3180793790 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f361006d500 con 0x7f36100d0c30 2024-04-28T13:07:39.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.608+0000 7f3617559640 1 -- 172.21.15.114:0/3180793790 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f361006dc00 con 0x7f36100d0c30 2024-04-28T13:07:39.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.608+0000 7f3605ffb640 1 -- 172.21.15.114:0/3180793790 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3600018070 con 0x7f36100d0c30 2024-04-28T13:07:39.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.609+0000 7f3605ffb640 1 --2- 172.21.15.114:0/3180793790 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f35f406c8f0 0x7f35f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:39.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.609+0000 7f3614af4640 1 --2- 172.21.15.114:0/3180793790 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f35f406c8f0 0x7f35f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:39.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.609+0000 7f3605ffb640 1 -- 172.21.15.114:0/3180793790 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f360008ba80 con 0x7f36100d0c30 2024-04-28T13:07:39.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.609+0000 7f3614af4640 1 --2- 172.21.15.114:0/3180793790 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f35f406c8f0 0x7f35f406edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f360c034000 tx=0x7f360c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:39.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.613+0000 7f3605ffb640 1 -- 172.21.15.114:0/3180793790 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f361015ad40 con 0x7f36100d0c30 2024-04-28T13:07:39.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.790+0000 7f3617559640 1 -- 172.21.15.114:0/3180793790 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3610076120 con 0x7f36100d0c30 2024-04-28T13:07:39.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.791+0000 7f3605ffb640 1 -- 172.21.15.114:0/3180793790 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f3600059f40 con 0x7f36100d0c30 2024-04-28T13:07:39.790 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-04-28T13:07:39.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.792+0000 7f3617559640 1 -- 172.21.15.114:0/3180793790 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f35f406c8f0 msgr2=0x7f35f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:39.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.792+0000 7f3617559640 1 --2- 172.21.15.114:0/3180793790 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f35f406c8f0 0x7f35f406edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f360c034000 tx=0x7f360c02e000 comp rx=0 tx=0).stop 2024-04-28T13:07:39.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.793+0000 7f3617559640 1 -- 172.21.15.114:0/3180793790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36100d0c30 msgr2=0x7f361006dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:39.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.793+0000 7f3617559640 1 --2- 172.21.15.114:0/3180793790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36100d0c30 0x7f361006dfe0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f360000c7f0 tx=0x7f360000cbf0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.793+0000 7f3617559640 1 -- 172.21.15.114:0/3180793790 shutdown_connections 2024-04-28T13:07:39.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.793+0000 7f3617559640 1 --2- 172.21.15.114:0/3180793790 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f361015d510 0x7f361006e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.793+0000 7f3617559640 1 --2- 172.21.15.114:0/3180793790 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f35f406c8f0 0x7f35f406edb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.793+0000 7f3617559640 1 --2- 172.21.15.114:0/3180793790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36100d17a0 0x7f361015a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.793+0000 7f3617559640 1 --2- 172.21.15.114:0/3180793790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36100d0c30 0x7f361006dfe0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.793+0000 7f3617559640 1 -- 172.21.15.114:0/3180793790 >> 172.21.15.114:0/3180793790 conn(0x7f36100b4b50 msgr2=0x7f36100b4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:39.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.793+0000 7f3617559640 1 -- 172.21.15.114:0/3180793790 shutdown_connections 2024-04-28T13:07:39.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.793+0000 7f3617559640 1 -- 172.21.15.114:0/3180793790 wait complete. 2024-04-28T13:07:39.803 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-28T13:07:39.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.900+0000 7f3312b87640 1 Processor -- start 2024-04-28T13:07:39.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.900+0000 7f3312b87640 1 -- start start 2024-04-28T13:07:39.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.901+0000 7f3312b87640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f330c15f8a0 0x7f330c071160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:39.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.901+0000 7f3312b87640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f330c15fc80 0x7f330c162e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:39.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.901+0000 7f3312b87640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f330c163340 0x7f330c1637d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:39.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.901+0000 7f3312b87640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f330c0c8f10 con 0x7f330c15f8a0 2024-04-28T13:07:39.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.901+0000 7f3312b87640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f330c0c88e0 con 0x7f330c15fc80 2024-04-28T13:07:39.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.901+0000 7f3312b87640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f330c06d7a0 con 0x7f330c163340 2024-04-28T13:07:39.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.901+0000 7f3310923640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f330c15f8a0 0x7f330c071160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:39.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.901+0000 7f3310923640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f330c15f8a0 0x7f330c071160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48496/0 (socket says 172.21.15.114:48496) 2024-04-28T13:07:39.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.901+0000 7f3310923640 1 -- 172.21.15.114:0/3346725778 learned_addr learned my addr 172.21.15.114:0/3346725778 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:39.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.901+0000 7f3311124640 1 --2- 172.21.15.114:0/3346725778 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f330c163340 0x7f330c1637d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:39.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.901+0000 7f330bfff640 1 --2- 172.21.15.114:0/3346725778 >> v2:172.21.15.134:3300/0 conn(0x7f330c15fc80 0x7f330c162e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:39.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.901+0000 7f3310923640 1 -- 172.21.15.114:0/3346725778 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f330c163340 msgr2=0x7f330c1637d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:39.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.901+0000 7f3310923640 1 --2- 172.21.15.114:0/3346725778 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f330c163340 0x7f330c1637d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.901+0000 7f3310923640 1 -- 172.21.15.114:0/3346725778 >> v2:172.21.15.134:3300/0 conn(0x7f330c15fc80 msgr2=0x7f330c162e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:39.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.901+0000 7f3310923640 1 --2- 172.21.15.114:0/3346725778 >> v2:172.21.15.134:3300/0 conn(0x7f330c15fc80 0x7f330c162e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.901+0000 7f3310923640 1 -- 172.21.15.114:0/3346725778 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f330c06da80 con 0x7f330c15f8a0 2024-04-28T13:07:39.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.901+0000 7f330bfff640 1 --2- 172.21.15.114:0/3346725778 >> v2:172.21.15.134:3300/0 conn(0x7f330c15fc80 0x7f330c162e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:07:39.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.902+0000 7f3310923640 1 --2- 172.21.15.114:0/3346725778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f330c15f8a0 0x7f330c071160 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f330c0b9220 tx=0x7f330002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896ade4168a3a5e server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:39.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.902+0000 7f330b7fe640 1 -- 172.21.15.114:0/3346725778 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3300037070 con 0x7f330c15f8a0 2024-04-28T13:07:39.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.902+0000 7f330b7fe640 1 -- 172.21.15.114:0/3346725778 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3300032440 con 0x7f330c15f8a0 2024-04-28T13:07:39.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.902+0000 7f330b7fe640 1 -- 172.21.15.114:0/3346725778 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3300032810 con 0x7f330c15f8a0 2024-04-28T13:07:39.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.902+0000 7f3312b87640 1 -- 172.21.15.114:0/3346725778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f330c15f8a0 msgr2=0x7f330c071160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:39.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.902+0000 7f3312b87640 1 --2- 172.21.15.114:0/3346725778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f330c15f8a0 0x7f330c071160 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f330c0b9220 tx=0x7f330002a1e0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.902+0000 7f3312b87640 1 -- 172.21.15.114:0/3346725778 shutdown_connections 2024-04-28T13:07:39.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.902+0000 7f3312b87640 1 --2- 172.21.15.114:0/3346725778 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f330c163340 0x7f330c1637d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.902+0000 7f3312b87640 1 --2- 172.21.15.114:0/3346725778 >> v2:172.21.15.134:3300/0 conn(0x7f330c15fc80 0x7f330c162e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.902+0000 7f3312b87640 1 --2- 172.21.15.114:0/3346725778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f330c15f8a0 0x7f330c071160 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.902+0000 7f3312b87640 1 -- 172.21.15.114:0/3346725778 >> 172.21.15.114:0/3346725778 conn(0x7f330c062d70 msgr2=0x7f330c063150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:39.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.902+0000 7f3312b87640 1 -- 172.21.15.114:0/3346725778 shutdown_connections 2024-04-28T13:07:39.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.902+0000 7f3312b87640 1 -- 172.21.15.114:0/3346725778 wait complete. 2024-04-28T13:07:39.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.903+0000 7f3312b87640 1 Processor -- start 2024-04-28T13:07:39.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.904+0000 7f3312b87640 1 -- start start 2024-04-28T13:07:39.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.904+0000 7f3312b87640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f330c15f8a0 0x7f330c15e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:39.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.904+0000 7f3312b87640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f330c15fc80 0x7f330c0cf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:39.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.904+0000 7f3312b87640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f330c163340 0x7f330c0cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:39.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.904+0000 7f3312b87640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f330c1600c0 con 0x7f330c15fc80 2024-04-28T13:07:39.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.904+0000 7f3312b87640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f330c0d3930 con 0x7f330c15f8a0 2024-04-28T13:07:39.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.904+0000 7f3312b87640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f330c0ce2b0 con 0x7f330c163340 2024-04-28T13:07:39.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.904+0000 7f330bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f330c15fc80 0x7f330c0cf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:39.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.905+0000 7f330bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f330c15fc80 0x7f330c0cf3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48500/0 (socket says 172.21.15.114:48500) 2024-04-28T13:07:39.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.905+0000 7f330bfff640 1 -- 172.21.15.114:0/3210221753 learned_addr learned my addr 172.21.15.114:0/3210221753 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:39.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.905+0000 7f3310923640 1 --2- 172.21.15.114:0/3210221753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f330c15f8a0 0x7f330c15e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:39.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.905+0000 7f3311124640 1 --2- 172.21.15.114:0/3210221753 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f330c163340 0x7f330c0cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:39.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.905+0000 7f330bfff640 1 -- 172.21.15.114:0/3210221753 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f330c163340 msgr2=0x7f330c0cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:39.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.905+0000 7f330bfff640 1 --2- 172.21.15.114:0/3210221753 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f330c163340 0x7f330c0cf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.905+0000 7f330bfff640 1 -- 172.21.15.114:0/3210221753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f330c15f8a0 msgr2=0x7f330c15e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:39.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.905+0000 7f330bfff640 1 --2- 172.21.15.114:0/3210221753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f330c15f8a0 0x7f330c15e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:39.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.905+0000 7f330bfff640 1 -- 172.21.15.114:0/3210221753 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f330c0ce590 con 0x7f330c15fc80 2024-04-28T13:07:39.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.905+0000 7f3311124640 1 --2- 172.21.15.114:0/3210221753 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f330c163340 0x7f330c0cf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:39.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.905+0000 7f330bfff640 1 --2- 172.21.15.114:0/3210221753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f330c15fc80 0x7f330c0cf3a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f32f800c7f0 tx=0x7f32f800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:39.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.905+0000 7f33097fa640 1 -- 172.21.15.114:0/3210221753 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f8015070 con 0x7f330c15fc80 2024-04-28T13:07:39.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.905+0000 7f33097fa640 1 -- 172.21.15.114:0/3210221753 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f8007a30 con 0x7f330c15fc80 2024-04-28T13:07:39.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.905+0000 7f3312b87640 1 -- 172.21.15.114:0/3210221753 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f330c0ce870 con 0x7f330c15fc80 2024-04-28T13:07:39.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.905+0000 7f33097fa640 1 -- 172.21.15.114:0/3210221753 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f8007e00 con 0x7f330c15fc80 2024-04-28T13:07:39.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.905+0000 7f3312b87640 1 -- 172.21.15.114:0/3210221753 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f330c0cab80 con 0x7f330c15fc80 2024-04-28T13:07:39.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.906+0000 7f3312b87640 1 -- 172.21.15.114:0/3210221753 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f330c06a3d0 con 0x7f330c15fc80 2024-04-28T13:07:39.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.907+0000 7f33097fa640 1 -- 172.21.15.114:0/3210221753 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f32f8018070 con 0x7f330c15fc80 2024-04-28T13:07:39.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.907+0000 7f33097fa640 1 --2- 172.21.15.114:0/3210221753 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f32f006c8f0 0x7f32f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:39.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.907+0000 7f33097fa640 1 -- 172.21.15.114:0/3210221753 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f32f808b930 con 0x7f330c15fc80 2024-04-28T13:07:39.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.907+0000 7f3310923640 1 --2- 172.21.15.114:0/3210221753 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f32f006c8f0 0x7f32f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:39.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.907+0000 7f3310923640 1 --2- 172.21.15.114:0/3210221753 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f32f006c8f0 0x7f32f006edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3300034000 tx=0x7f330002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:39.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:39.911+0000 7f33097fa640 1 -- 172.21.15.114:0/3210221753 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f32f80597a0 con 0x7f330c15fc80 2024-04-28T13:07:40.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.122+0000 7f3312b87640 1 -- 172.21.15.114:0/3210221753 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f330c070f40 con 0x7f330c15fc80 2024-04-28T13:07:40.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.123+0000 7f33097fa640 1 -- 172.21.15.114:0/3210221753 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5181 (secure 0 0 0) 0x7f32f805daa0 con 0x7f330c15fc80 2024-04-28T13:07:40.123 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:40.123 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2660339514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2660339514},{"type":"v1","addr":"172.21.15.114:6837","nonce":2660339514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3536977085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3536977085},{"type":"v1","addr":"172.21.15.134:6833","nonce":3536977085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/869609014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":869609014},{"type":"v1","addr":"172.21.15.134:6835","nonce":869609014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-28T13:07:25.635297+0000","modified":"2024-04-28T13:07:27.635944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/888574435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":888574435},{"type":"v1","addr":"172.21.15.114:6836","nonce":888574435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-04-28T13:07:40.123 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 6 2024-04-28T13:07:40.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.125+0000 7f3312b87640 1 -- 172.21.15.114:0/3210221753 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f32f006c8f0 msgr2=0x7f32f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:40.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.125+0000 7f3312b87640 1 --2- 172.21.15.114:0/3210221753 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f32f006c8f0 0x7f32f006edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3300034000 tx=0x7f330002e000 comp rx=0 tx=0).stop 2024-04-28T13:07:40.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.125+0000 7f3312b87640 1 -- 172.21.15.114:0/3210221753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f330c15fc80 msgr2=0x7f330c0cf3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:40.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.125+0000 7f3312b87640 1 --2- 172.21.15.114:0/3210221753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f330c15fc80 0x7f330c0cf3a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f32f800c7f0 tx=0x7f32f800ccb0 comp rx=0 tx=0).stop 2024-04-28T13:07:40.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.125+0000 7f3312b87640 1 -- 172.21.15.114:0/3210221753 shutdown_connections 2024-04-28T13:07:40.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.125+0000 7f3312b87640 1 --2- 172.21.15.114:0/3210221753 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f330c163340 0x7f330c0cf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:40.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.125+0000 7f3312b87640 1 --2- 172.21.15.114:0/3210221753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f330c15fc80 0x7f330c0cf3a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:40.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.125+0000 7f3312b87640 1 --2- 172.21.15.114:0/3210221753 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f32f006c8f0 0x7f32f006edb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:40.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.125+0000 7f3312b87640 1 --2- 172.21.15.114:0/3210221753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f330c15f8a0 0x7f330c15e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:40.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.125+0000 7f3312b87640 1 -- 172.21.15.114:0/3210221753 >> 172.21.15.114:0/3210221753 conn(0x7f330c062d70 msgr2=0x7f330c15ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:40.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.125+0000 7f3312b87640 1 -- 172.21.15.114:0/3210221753 shutdown_connections 2024-04-28T13:07:40.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.125+0000 7f3312b87640 1 -- 172.21.15.114:0/3210221753 wait complete. 2024-04-28T13:07:40.135 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:07:40.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.232+0000 7f2010b71640 1 Processor -- start 2024-04-28T13:07:40.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.232+0000 7f2010b71640 1 -- start start 2024-04-28T13:07:40.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.233+0000 7f2010b71640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f200c15f410 0x7f200c0baaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:40.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.233+0000 7f2010b71640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f200c0b4380 0x7f200c0b8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:40.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.233+0000 7f2010b71640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f200c0d3650 con 0x7f200c0cff60 2024-04-28T13:07:40.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.233+0000 7f2010b71640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f200c0d3f10 con 0x7f200c15f410 2024-04-28T13:07:40.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.233+0000 7f2010b71640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f200c0b8840 con 0x7f200c0b4380 2024-04-28T13:07:40.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.233+0000 7f2009d9b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f200c0b4380 0x7f200c0b8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:40.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.233+0000 7f200a59c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f200c15f410 0x7f200c0baaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:40.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.233+0000 7f200a59c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f200c15f410 0x7f200c0baaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:50392/0 (socket says 172.21.15.114:50392) 2024-04-28T13:07:40.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.233+0000 7f200a59c640 1 -- 172.21.15.114:0/3876768877 learned_addr learned my addr 172.21.15.114:0/3876768877 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:40.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.233+0000 7f200ad9d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f200c0cff60 0x7f200c0d03f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:43460/0 (socket says 172.21.15.114:43460) 2024-04-28T13:07:40.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.233+0000 7f2009d9b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f200c0b4380 0x7f200c0b8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:58782/0 (socket says 172.21.15.114:58782) 2024-04-28T13:07:40.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.234+0000 7f200a59c640 1 -- 172.21.15.114:0/3876768877 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f200c0b4380 msgr2=0x7f200c0b8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:40.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.234+0000 7f200a59c640 1 --2- 172.21.15.114:0/3876768877 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f200c0b4380 0x7f200c0b8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:40.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.234+0000 7f200a59c640 1 -- 172.21.15.114:0/3876768877 >> v1:172.21.15.134:6789/0 conn(0x7f200c0cff60 legacy=0x7f200c0d03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:40.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.234+0000 7f200a59c640 1 -- 172.21.15.114:0/3876768877 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f200c15f7f0 con 0x7f200c15f410 2024-04-28T13:07:40.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.235+0000 7f200a59c640 1 --2- 172.21.15.114:0/3876768877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f200c15f410 0x7f200c0baaf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc009e50 tx=0x7f1ffc02a7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e93ee4ee9b7ada1 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:40.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.235+0000 7f200959a640 1 -- 172.21.15.114:0/3876768877 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc036070 con 0x7f200c15f410 2024-04-28T13:07:40.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.235+0000 7f200959a640 1 -- 172.21.15.114:0/3876768877 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ffc031600 con 0x7f200c15f410 2024-04-28T13:07:40.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.235+0000 7f200959a640 1 -- 172.21.15.114:0/3876768877 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc0319d0 con 0x7f200c15f410 2024-04-28T13:07:40.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.235+0000 7f2010b71640 1 -- 172.21.15.114:0/3876768877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f200c15f410 msgr2=0x7f200c0baaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:40.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.235+0000 7f2010b71640 1 --2- 172.21.15.114:0/3876768877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f200c15f410 0x7f200c0baaf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc009e50 tx=0x7f1ffc02a7a0 comp rx=0 tx=0).stop 2024-04-28T13:07:40.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.235+0000 7f2010b71640 1 -- 172.21.15.114:0/3876768877 shutdown_connections 2024-04-28T13:07:40.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.235+0000 7f2010b71640 1 --2- 172.21.15.114:0/3876768877 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f200c0b4380 0x7f200c0b8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:40.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.235+0000 7f2010b71640 1 --2- 172.21.15.114:0/3876768877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f200c15f410 0x7f200c0baaf0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:40.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.235+0000 7f2010b71640 1 -- 172.21.15.114:0/3876768877 >> 172.21.15.114:0/3876768877 conn(0x7f200c0633a0 msgr2=0x7f200c0d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:40.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.235+0000 7f2010b71640 1 -- 172.21.15.114:0/3876768877 shutdown_connections 2024-04-28T13:07:40.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.235+0000 7f2010b71640 1 -- 172.21.15.114:0/3876768877 wait complete. 2024-04-28T13:07:40.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.237+0000 7f2010b71640 1 Processor -- start 2024-04-28T13:07:40.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.237+0000 7f2010b71640 1 -- start start 2024-04-28T13:07:40.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.237+0000 7f2010b71640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f200c0b4380 0x7f200c159320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:40.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.237+0000 7f2010b71640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f200c0cff60 0x7f200c0ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:40.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.237+0000 7f2010b71640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f200c15f410 0x7f200c1615a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:40.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.237+0000 7f2010b71640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f200c0d3ba0 con 0x7f200c15f410 2024-04-28T13:07:40.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.237+0000 7f2010b71640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f200c0d2570 con 0x7f200c0cff60 2024-04-28T13:07:40.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.237+0000 7f2010b71640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f200c0bb180 con 0x7f200c0b4380 2024-04-28T13:07:40.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.238+0000 7f200ad9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f200c15f410 0x7f200c1615a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:40.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.238+0000 7f200ad9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f200c15f410 0x7f200c1615a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48506/0 (socket says 172.21.15.114:48506) 2024-04-28T13:07:40.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.238+0000 7f200ad9d640 1 -- 172.21.15.114:0/3919606306 learned_addr learned my addr 172.21.15.114:0/3919606306 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:40.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.238+0000 7f200a59c640 1 --2- 172.21.15.114:0/3919606306 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f200c0b4380 0x7f200c159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:40.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.238+0000 7f2009d9b640 1 --2- 172.21.15.114:0/3919606306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f200c0cff60 0x7f200c0ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:40.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.238+0000 7f200ad9d640 1 -- 172.21.15.114:0/3919606306 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f200c0b4380 msgr2=0x7f200c159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:40.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.238+0000 7f200ad9d640 1 --2- 172.21.15.114:0/3919606306 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f200c0b4380 0x7f200c159320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:40.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.238+0000 7f200ad9d640 1 -- 172.21.15.114:0/3919606306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f200c0cff60 msgr2=0x7f200c0ce5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:40.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.238+0000 7f200ad9d640 1 --2- 172.21.15.114:0/3919606306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f200c0cff60 0x7f200c0ce5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:40.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.238+0000 7f200ad9d640 1 -- 172.21.15.114:0/3919606306 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f200c159860 con 0x7f200c15f410 2024-04-28T13:07:40.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.238+0000 7f200ad9d640 1 --2- 172.21.15.114:0/3919606306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f200c15f410 0x7f200c1615a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f200400c3f0 tx=0x7f200400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:40.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.238+0000 7f1ffaffd640 1 -- 172.21.15.114:0/3919606306 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20040074e0 con 0x7f200c15f410 2024-04-28T13:07:40.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.238+0000 7f1ffaffd640 1 -- 172.21.15.114:0/3919606306 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2004007680 con 0x7f200c15f410 2024-04-28T13:07:40.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.238+0000 7f2010b71640 1 -- 172.21.15.114:0/3919606306 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f200c0cd550 con 0x7f200c15f410 2024-04-28T13:07:40.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.238+0000 7f1ffaffd640 1 -- 172.21.15.114:0/3919606306 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2004004a00 con 0x7f200c15f410 2024-04-28T13:07:40.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.238+0000 7f2010b71640 1 -- 172.21.15.114:0/3919606306 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f200c0cdb10 con 0x7f200c15f410 2024-04-28T13:07:40.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.239+0000 7f2010b71640 1 -- 172.21.15.114:0/3919606306 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f200c06a3d0 con 0x7f200c15f410 2024-04-28T13:07:40.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.240+0000 7f1ffaffd640 1 -- 172.21.15.114:0/3919606306 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f200401a020 con 0x7f200c15f410 2024-04-28T13:07:40.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.240+0000 7f1ffaffd640 1 --2- 172.21.15.114:0/3919606306 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1fec06c920 0x7f1fec06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:40.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.240+0000 7f200a59c640 1 --2- 172.21.15.114:0/3919606306 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1fec06c920 0x7f1fec06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:40.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.240+0000 7f1ffaffd640 1 -- 172.21.15.114:0/3919606306 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f200408b1a0 con 0x7f200c15f410 2024-04-28T13:07:40.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.240+0000 7f200a59c640 1 --2- 172.21.15.114:0/3919606306 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1fec06c920 0x7f1fec06ede0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc033000 tx=0x7f1ffc009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:40.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.244+0000 7f1ffaffd640 1 -- 172.21.15.114:0/3919606306 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2004058f80 con 0x7f200c15f410 2024-04-28T13:07:40.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.420+0000 7f2010b71640 1 -- 172.21.15.114:0/3919606306 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f200c0b7d80 con 0x7f200c15f410 2024-04-28T13:07:40.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.421+0000 7f1ffaffd640 1 -- 172.21.15.114:0/3919606306 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7f200405d280 con 0x7f200c15f410 2024-04-28T13:07:40.421 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:40.421 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:07:27.292537+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-28T13:07:23.706359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-28T13:07:24.596188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:07:40.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.423+0000 7f2010b71640 1 -- 172.21.15.114:0/3919606306 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1fec06c920 msgr2=0x7f1fec06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:40.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.423+0000 7f2010b71640 1 --2- 172.21.15.114:0/3919606306 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1fec06c920 0x7f1fec06ede0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc033000 tx=0x7f1ffc009000 comp rx=0 tx=0).stop 2024-04-28T13:07:40.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.423+0000 7f2010b71640 1 -- 172.21.15.114:0/3919606306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f200c15f410 msgr2=0x7f200c1615a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:40.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.423+0000 7f2010b71640 1 --2- 172.21.15.114:0/3919606306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f200c15f410 0x7f200c1615a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f200400c3f0 tx=0x7f200400c8b0 comp rx=0 tx=0).stop 2024-04-28T13:07:40.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.423+0000 7f2010b71640 1 -- 172.21.15.114:0/3919606306 shutdown_connections 2024-04-28T13:07:40.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.423+0000 7f2010b71640 1 --2- 172.21.15.114:0/3919606306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f200c15f410 0x7f200c1615a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:40.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.423+0000 7f2010b71640 1 --2- 172.21.15.114:0/3919606306 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1fec06c920 0x7f1fec06ede0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:40.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.423+0000 7f2010b71640 1 --2- 172.21.15.114:0/3919606306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f200c0cff60 0x7f200c0ce5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:40.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.423+0000 7f2010b71640 1 --2- 172.21.15.114:0/3919606306 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f200c0b4380 0x7f200c159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:40.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.423+0000 7f2010b71640 1 -- 172.21.15.114:0/3919606306 >> 172.21.15.114:0/3919606306 conn(0x7f200c0633a0 msgr2=0x7f200c0b6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:40.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.423+0000 7f2010b71640 1 -- 172.21.15.114:0/3919606306 shutdown_connections 2024-04-28T13:07:40.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.423+0000 7f2010b71640 1 -- 172.21.15.114:0/3919606306 wait complete. 2024-04-28T13:07:40.434 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-28T13:07:14.721860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-28T13:07:23.706359+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-28T13:07:24.596188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-28T13:07:40.435 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-28T13:07:40.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.534+0000 7fbb048fc640 1 Processor -- start 2024-04-28T13:07:40.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.534+0000 7fbb048fc640 1 -- start start 2024-04-28T13:07:40.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.535+0000 7fbb048fc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbb000732b0 0x7fbb0015ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:40.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.535+0000 7fbb048fc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb000d02b0 con 0x7fbb000b4850 2024-04-28T13:07:40.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.535+0000 7fbb048fc640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb000cedc0 con 0x7fbb00072e30 2024-04-28T13:07:40.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.535+0000 7fbb048fc640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fbb00073cc0 con 0x7fbb000732b0 2024-04-28T13:07:40.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.535+0000 7fbafe59c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbb000b4850 0x7fbb000b4c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44858/0 (socket says 172.21.15.114:44858) 2024-04-28T13:07:40.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.535+0000 7fbafe59c640 1 -- 172.21.15.114:0/1380446113 learned_addr learned my addr 172.21.15.114:0/1380446113 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:40.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.535+0000 7fbafed9d640 1 --2- 172.21.15.114:0/1380446113 >> v2:172.21.15.134:3300/0 conn(0x7fbb000732b0 0x7fbb0015ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:40.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.535+0000 7fbafd59a640 1 -- 172.21.15.114:0/1380446113 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1942669553 0 0) 0x7fbb000d02b0 con 0x7fbb000b4850 2024-04-28T13:07:40.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.535+0000 7fbafd59a640 1 -- 172.21.15.114:0/1380446113 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbae8003520 con 0x7fbb000b4850 2024-04-28T13:07:40.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.536+0000 7fbafed9d640 1 -- 172.21.15.114:0/1380446113 >> v1:172.21.15.134:6789/0 conn(0x7fbb00072e30 legacy=0x7fbb0015c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:40.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.536+0000 7fbafed9d640 1 -- 172.21.15.114:0/1380446113 >> v1:172.21.15.114:6789/0 conn(0x7fbb000b4850 legacy=0x7fbb000b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:40.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.536+0000 7fbafd59a640 1 -- 172.21.15.114:0/1380446113 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4057108433 0 0) 0x7fbae8003520 con 0x7fbb000b4850 2024-04-28T13:07:40.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.536+0000 7fbafed9d640 1 -- 172.21.15.114:0/1380446113 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb00073fa0 con 0x7fbb000732b0 2024-04-28T13:07:40.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.536+0000 7fbafed9d640 1 --2- 172.21.15.114:0/1380446113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb000732b0 0x7fbb0015ca80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbaf80097a0 tx=0x7fbaf802a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0fbcc3ae24daaba server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:40.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.536+0000 7fbafd59a640 1 -- 172.21.15.114:0/1380446113 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8037070 con 0x7fbb000732b0 2024-04-28T13:07:40.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.536+0000 7fbafd59a640 1 -- 172.21.15.114:0/1380446113 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaf802abc0 con 0x7fbb000732b0 2024-04-28T13:07:40.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.536+0000 7fbafd59a640 1 -- 172.21.15.114:0/1380446113 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf00019f0 con 0x7fbb000732b0 2024-04-28T13:07:40.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.537+0000 7fbb048fc640 1 -- 172.21.15.114:0/1380446113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb000732b0 msgr2=0x7fbb0015ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:40.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.537+0000 7fbb048fc640 1 --2- 172.21.15.114:0/1380446113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb000732b0 0x7fbb0015ca80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbaf80097a0 tx=0x7fbaf802a130 comp rx=0 tx=0).stop 2024-04-28T13:07:40.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.537+0000 7fbb048fc640 1 -- 172.21.15.114:0/1380446113 shutdown_connections 2024-04-28T13:07:40.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.537+0000 7fbb048fc640 1 --2- 172.21.15.114:0/1380446113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb000732b0 0x7fbb0015ca80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:40.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.537+0000 7fbb048fc640 1 -- 172.21.15.114:0/1380446113 >> 172.21.15.114:0/1380446113 conn(0x7fbb0006c980 msgr2=0x7fbb000b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:40.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.537+0000 7fbb048fc640 1 -- 172.21.15.114:0/1380446113 shutdown_connections 2024-04-28T13:07:40.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.537+0000 7fbb048fc640 1 -- 172.21.15.114:0/1380446113 wait complete. 2024-04-28T13:07:40.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.538+0000 7fbb048fc640 1 Processor -- start 2024-04-28T13:07:40.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.538+0000 7fbb048fc640 1 -- start start 2024-04-28T13:07:40.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.539+0000 7fbb048fc640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb00072e30 0x7fbb00153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:40.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.539+0000 7fbb048fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb000732b0 0x7fbb00143850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:40.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.539+0000 7fbb048fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb000b4850 0x7fbb001505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:40.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.539+0000 7fbb048fc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbb000736e0 con 0x7fbb000732b0 2024-04-28T13:07:40.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.539+0000 7fbb048fc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbb00074560 con 0x7fbb000b4850 2024-04-28T13:07:40.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.539+0000 7fbb048fc640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fbb0006e3e0 con 0x7fbb00072e30 2024-04-28T13:07:40.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.539+0000 7fbafdd9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb000732b0 0x7fbb00143850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:40.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.539+0000 7fbafdd9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb000732b0 0x7fbb00143850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41148/0 (socket says 172.21.15.114:41148) 2024-04-28T13:07:40.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.539+0000 7fbafdd9b640 1 -- 172.21.15.114:0/1020131198 learned_addr learned my addr 172.21.15.114:0/1020131198 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:40.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.539+0000 7fbafed9d640 1 --2- 172.21.15.114:0/1020131198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb000b4850 0x7fbb001505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:40.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.539+0000 7fbafe59c640 1 --2- 172.21.15.114:0/1020131198 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb00072e30 0x7fbb00153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:40.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.539+0000 7fbafdd9b640 1 -- 172.21.15.114:0/1020131198 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb00072e30 msgr2=0x7fbb00153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:40.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.539+0000 7fbafdd9b640 1 --2- 172.21.15.114:0/1020131198 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb00072e30 0x7fbb00153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:40.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.539+0000 7fbafdd9b640 1 -- 172.21.15.114:0/1020131198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb000b4850 msgr2=0x7fbb001505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:40.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.539+0000 7fbafdd9b640 1 --2- 172.21.15.114:0/1020131198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb000b4850 0x7fbb001505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:40.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.540+0000 7fbafdd9b640 1 -- 172.21.15.114:0/1020131198 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb00152660 con 0x7fbb000732b0 2024-04-28T13:07:40.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.540+0000 7fbafe59c640 1 --2- 172.21.15.114:0/1020131198 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb00072e30 0x7fbb00153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:07:40.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.540+0000 7fbafdd9b640 1 --2- 172.21.15.114:0/1020131198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb000732b0 0x7fbb00143850 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbaf400c340 tx=0x7fbaf400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:40.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.540+0000 7fbaeeffd640 1 -- 172.21.15.114:0/1020131198 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4017070 con 0x7fbb000732b0 2024-04-28T13:07:40.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.540+0000 7fbaeeffd640 1 -- 172.21.15.114:0/1020131198 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaf40052d0 con 0x7fbb000732b0 2024-04-28T13:07:40.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.540+0000 7fbb048fc640 1 -- 172.21.15.114:0/1020131198 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb001528e0 con 0x7fbb000732b0 2024-04-28T13:07:40.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.540+0000 7fbaeeffd640 1 -- 172.21.15.114:0/1020131198 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4003850 con 0x7fbb000732b0 2024-04-28T13:07:40.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.540+0000 7fbb048fc640 1 -- 172.21.15.114:0/1020131198 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb00152e80 con 0x7fbb000732b0 2024-04-28T13:07:40.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.541+0000 7fbb048fc640 1 -- 172.21.15.114:0/1020131198 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb0006a3d0 con 0x7fbb000732b0 2024-04-28T13:07:40.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.541+0000 7fbaeeffd640 1 -- 172.21.15.114:0/1020131198 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbaf401a070 con 0x7fbb000732b0 2024-04-28T13:07:40.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.542+0000 7fbaeeffd640 1 --2- 172.21.15.114:0/1020131198 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbae006c8f0 0x7fbae006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:40.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.542+0000 7fbaeeffd640 1 -- 172.21.15.114:0/1020131198 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbaf408aee0 con 0x7fbb000732b0 2024-04-28T13:07:40.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.542+0000 7fbafe59c640 1 --2- 172.21.15.114:0/1020131198 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbae006c8f0 0x7fbae006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:40.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.542+0000 7fbafe59c640 1 --2- 172.21.15.114:0/1020131198 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbae006c8f0 0x7fbae006edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbaf00012e0 tx=0x7fbaf0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:40.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.546+0000 7fbaeeffd640 1 -- 172.21.15.114:0/1020131198 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbb00152660 con 0x7fbb000732b0 2024-04-28T13:07:40.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.722+0000 7fbb048fc640 1 -- 172.21.15.114:0/1020131198 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbb0006f930 con 0x7fbb000732b0 2024-04-28T13:07:40.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.722+0000 7fbaeeffd640 1 -- 172.21.15.114:0/1020131198 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fbaf4059280 con 0x7fbb000732b0 2024-04-28T13:07:40.722 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-28T13:07:40.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.725+0000 7fbb048fc640 1 -- 172.21.15.114:0/1020131198 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbae006c8f0 msgr2=0x7fbae006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:40.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.725+0000 7fbb048fc640 1 --2- 172.21.15.114:0/1020131198 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbae006c8f0 0x7fbae006edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbaf00012e0 tx=0x7fbaf0009040 comp rx=0 tx=0).stop 2024-04-28T13:07:40.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.725+0000 7fbb048fc640 1 -- 172.21.15.114:0/1020131198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb000732b0 msgr2=0x7fbb00143850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:40.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.725+0000 7fbb048fc640 1 --2- 172.21.15.114:0/1020131198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb000732b0 0x7fbb00143850 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbaf400c340 tx=0x7fbaf400c800 comp rx=0 tx=0).stop 2024-04-28T13:07:40.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.725+0000 7fbb048fc640 1 -- 172.21.15.114:0/1020131198 shutdown_connections 2024-04-28T13:07:40.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.725+0000 7fbb048fc640 1 --2- 172.21.15.114:0/1020131198 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbae006c8f0 0x7fbae006edb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:40.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.725+0000 7fbb048fc640 1 --2- 172.21.15.114:0/1020131198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb000b4850 0x7fbb001505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:40.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.725+0000 7fbb048fc640 1 --2- 172.21.15.114:0/1020131198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb000732b0 0x7fbb00143850 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:40.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.725+0000 7fbb048fc640 1 --2- 172.21.15.114:0/1020131198 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb00072e30 0x7fbb00153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:40.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.725+0000 7fbb048fc640 1 -- 172.21.15.114:0/1020131198 >> 172.21.15.114:0/1020131198 conn(0x7fbb0006c980 msgr2=0x7fbb00072320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:40.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.725+0000 7fbb048fc640 1 -- 172.21.15.114:0/1020131198 shutdown_connections 2024-04-28T13:07:40.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.725+0000 7fbb048fc640 1 -- 172.21.15.114:0/1020131198 wait complete. 2024-04-28T13:07:40.735 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-28T13:07:40.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.835+0000 7f8c65122640 1 Processor -- start 2024-04-28T13:07:40.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.835+0000 7f8c65122640 1 -- start start 2024-04-28T13:07:40.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.836+0000 7f8c65122640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8c6006d460 0x7f8c6006d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:40.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.836+0000 7f8c65122640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c601635d0 con 0x7f8c60148670 2024-04-28T13:07:40.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.836+0000 7f8c65122640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c601638b0 con 0x7f8c60160410 2024-04-28T13:07:40.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.836+0000 7f8c65122640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f8c6006ddd0 con 0x7f8c6006d460 2024-04-28T13:07:40.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.836+0000 7f8c5f59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8c6006d460 0x7f8c6006d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:40.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.836+0000 7f8c5ed9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8c60148670 0x7f8c60162e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44868/0 (socket says 172.21.15.114:44868) 2024-04-28T13:07:40.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.836+0000 7f8c5ed9d640 1 -- 172.21.15.114:0/466630680 learned_addr learned my addr 172.21.15.114:0/466630680 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:40.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.836+0000 7f8c5f59e640 1 -- 172.21.15.114:0/466630680 >> v1:172.21.15.134:6789/0 conn(0x7f8c60160410 legacy=0x7f8c600722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:40.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.836+0000 7f8c5f59e640 1 -- 172.21.15.114:0/466630680 >> v1:172.21.15.114:6789/0 conn(0x7f8c60148670 legacy=0x7f8c60162e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:40.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.836+0000 7f8c5dd9b640 1 -- 172.21.15.114:0/466630680 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2341285292 0 0) 0x7f8c601635d0 con 0x7f8c60148670 2024-04-28T13:07:40.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.836+0000 7f8c5f59e640 1 -- 172.21.15.114:0/466630680 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c60163b90 con 0x7f8c6006d460 2024-04-28T13:07:40.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.837+0000 7f8c5f59e640 1 --2- 172.21.15.114:0/466630680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6006d460 0x7f8c6006d890 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8c58009d90 tx=0x7f8c5802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d815252bc825b0db server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:40.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.837+0000 7f8c5dd9b640 1 -- 172.21.15.114:0/466630680 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58007740 con 0x7f8c6006d460 2024-04-28T13:07:40.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.837+0000 7f8c5dd9b640 1 -- 172.21.15.114:0/466630680 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c580078e0 con 0x7f8c6006d460 2024-04-28T13:07:40.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.837+0000 7f8c5dd9b640 1 -- 172.21.15.114:0/466630680 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58007cb0 con 0x7f8c6006d460 2024-04-28T13:07:40.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.837+0000 7f8c65122640 1 -- 172.21.15.114:0/466630680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6006d460 msgr2=0x7f8c6006d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:40.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.837+0000 7f8c65122640 1 --2- 172.21.15.114:0/466630680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6006d460 0x7f8c6006d890 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8c58009d90 tx=0x7f8c5802a6a0 comp rx=0 tx=0).stop 2024-04-28T13:07:40.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.837+0000 7f8c65122640 1 -- 172.21.15.114:0/466630680 shutdown_connections 2024-04-28T13:07:40.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.837+0000 7f8c65122640 1 --2- 172.21.15.114:0/466630680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6006d460 0x7f8c6006d890 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:40.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.837+0000 7f8c65122640 1 -- 172.21.15.114:0/466630680 >> 172.21.15.114:0/466630680 conn(0x7f8c600b4bf0 msgr2=0x7f8c600b4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:40.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.837+0000 7f8c65122640 1 -- 172.21.15.114:0/466630680 shutdown_connections 2024-04-28T13:07:40.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.837+0000 7f8c65122640 1 -- 172.21.15.114:0/466630680 wait complete. 2024-04-28T13:07:40.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.839+0000 7f8c65122640 1 Processor -- start 2024-04-28T13:07:40.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.839+0000 7f8c65122640 1 -- start start 2024-04-28T13:07:40.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.839+0000 7f8c65122640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6006d460 0x7f8c60141490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:40.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.839+0000 7f8c65122640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c60148670 0x7f8c6015e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:40.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.839+0000 7f8c65122640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c60160410 0x7f8c601f4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:40.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.839+0000 7f8c65122640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8c600b5ef0 con 0x7f8c6006d460 2024-04-28T13:07:40.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.839+0000 7f8c65122640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8c600729d0 con 0x7f8c60148670 2024-04-28T13:07:40.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.839+0000 7f8c65122640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f8c600b6070 con 0x7f8c60160410 2024-04-28T13:07:40.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.840+0000 7f8c5ed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6006d460 0x7f8c60141490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:40.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.840+0000 7f8c5ed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6006d460 0x7f8c60141490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41170/0 (socket says 172.21.15.114:41170) 2024-04-28T13:07:40.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.840+0000 7f8c5ed9d640 1 -- 172.21.15.114:0/3236342787 learned_addr learned my addr 172.21.15.114:0/3236342787 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:40.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.840+0000 7f8c5f59e640 1 --2- 172.21.15.114:0/3236342787 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c60160410 0x7f8c601f4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:40.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.840+0000 7f8c5e59c640 1 --2- 172.21.15.114:0/3236342787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c60148670 0x7f8c6015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:40.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.840+0000 7f8c5ed9d640 1 -- 172.21.15.114:0/3236342787 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c60160410 msgr2=0x7f8c601f4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:40.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.840+0000 7f8c5ed9d640 1 --2- 172.21.15.114:0/3236342787 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c60160410 0x7f8c601f4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:40.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.840+0000 7f8c5ed9d640 1 -- 172.21.15.114:0/3236342787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c60148670 msgr2=0x7f8c6015e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:40.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.840+0000 7f8c5ed9d640 1 --2- 172.21.15.114:0/3236342787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c60148670 0x7f8c6015e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:40.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.840+0000 7f8c5ed9d640 1 -- 172.21.15.114:0/3236342787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c601f5820 con 0x7f8c6006d460 2024-04-28T13:07:40.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.840+0000 7f8c5ed9d640 1 --2- 172.21.15.114:0/3236342787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6006d460 0x7f8c60141490 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000c4d0 tx=0x7f8c5000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:40.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.840+0000 7f8c477fe640 1 -- 172.21.15.114:0/3236342787 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c50018070 con 0x7f8c6006d460 2024-04-28T13:07:40.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.840+0000 7f8c477fe640 1 -- 172.21.15.114:0/3236342787 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c50007500 con 0x7f8c6006d460 2024-04-28T13:07:40.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.840+0000 7f8c65122640 1 -- 172.21.15.114:0/3236342787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c601f5b00 con 0x7f8c6006d460 2024-04-28T13:07:40.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.840+0000 7f8c477fe640 1 -- 172.21.15.114:0/3236342787 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c50004a20 con 0x7f8c6006d460 2024-04-28T13:07:40.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.840+0000 7f8c65122640 1 -- 172.21.15.114:0/3236342787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c601f60c0 con 0x7f8c6006d460 2024-04-28T13:07:40.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.841+0000 7f8c65122640 1 -- 172.21.15.114:0/3236342787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c6006a3d0 con 0x7f8c6006d460 2024-04-28T13:07:40.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.842+0000 7f8c477fe640 1 -- 172.21.15.114:0/3236342787 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8c5001b070 con 0x7f8c6006d460 2024-04-28T13:07:40.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.842+0000 7f8c477fe640 1 --2- 172.21.15.114:0/3236342787 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f8c4c06c8f0 0x7f8c4c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:40.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.842+0000 7f8c477fe640 1 -- 172.21.15.114:0/3236342787 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8c5008ae90 con 0x7f8c6006d460 2024-04-28T13:07:40.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.842+0000 7f8c5e59c640 1 --2- 172.21.15.114:0/3236342787 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f8c4c06c8f0 0x7f8c4c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:40.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.843+0000 7f8c5e59c640 1 --2- 172.21.15.114:0/3236342787 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f8c4c06c8f0 0x7f8c4c06edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8c600d3e50 tx=0x7f8c54008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:40.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:40.846+0000 7f8c477fe640 1 -- 172.21.15.114:0/3236342787 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8c500592c0 con 0x7f8c6006d460 2024-04-28T13:07:41.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.023+0000 7f8c65122640 1 -- 172.21.15.114:0/3236342787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8c6006f1d0 con 0x7f8c6006d460 2024-04-28T13:07:41.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.024+0000 7f8c477fe640 1 -- 172.21.15.114:0/3236342787 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f8c50058bc0 con 0x7f8c6006d460 2024-04-28T13:07:41.024 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-04-28T13:07:41.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.026+0000 7f8c65122640 1 -- 172.21.15.114:0/3236342787 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f8c4c06c8f0 msgr2=0x7f8c4c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:41.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.026+0000 7f8c65122640 1 --2- 172.21.15.114:0/3236342787 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f8c4c06c8f0 0x7f8c4c06edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8c600d3e50 tx=0x7f8c54008040 comp rx=0 tx=0).stop 2024-04-28T13:07:41.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.026+0000 7f8c65122640 1 -- 172.21.15.114:0/3236342787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6006d460 msgr2=0x7f8c60141490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:41.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.026+0000 7f8c65122640 1 --2- 172.21.15.114:0/3236342787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6006d460 0x7f8c60141490 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000c4d0 tx=0x7f8c5000c990 comp rx=0 tx=0).stop 2024-04-28T13:07:41.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.026+0000 7f8c65122640 1 -- 172.21.15.114:0/3236342787 shutdown_connections 2024-04-28T13:07:41.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.026+0000 7f8c65122640 1 --2- 172.21.15.114:0/3236342787 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c60160410 0x7f8c601f4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.026+0000 7f8c65122640 1 --2- 172.21.15.114:0/3236342787 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f8c4c06c8f0 0x7f8c4c06edb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.026+0000 7f8c65122640 1 --2- 172.21.15.114:0/3236342787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c60148670 0x7f8c6015e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.026+0000 7f8c65122640 1 --2- 172.21.15.114:0/3236342787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6006d460 0x7f8c60141490 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.026+0000 7f8c65122640 1 -- 172.21.15.114:0/3236342787 >> 172.21.15.114:0/3236342787 conn(0x7f8c600b4bf0 msgr2=0x7f8c601608c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:41.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.026+0000 7f8c65122640 1 -- 172.21.15.114:0/3236342787 shutdown_connections 2024-04-28T13:07:41.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.026+0000 7f8c65122640 1 -- 172.21.15.114:0/3236342787 wait complete. 2024-04-28T13:07:41.036 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-28T13:07:41.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.136+0000 7f7d4b151640 1 Processor -- start 2024-04-28T13:07:41.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.137+0000 7f7d4b151640 1 -- start start 2024-04-28T13:07:41.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.137+0000 7f7d4b151640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d4415f430 0x7f7d440d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:41.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.137+0000 7f7d4b151640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7d440d5870 0x7f7d440d3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:41.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.137+0000 7f7d4b151640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d440d2a40 con 0x7f7d440d1fc0 2024-04-28T13:07:41.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.137+0000 7f7d4b151640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f7d4415f810 con 0x7f7d440d5870 2024-04-28T13:07:41.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.137+0000 7f7d4b151640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f7d440d36d0 con 0x7f7d4415f430 2024-04-28T13:07:41.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.138+0000 7f7d496ee640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7d440d5870 0x7f7d440d3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:41.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.138+0000 7f7d48eed640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d4415f430 0x7f7d440d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:41.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.138+0000 7f7d496ee640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7d440d5870 0x7f7d440d3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:43996/0 (socket says 172.21.15.114:43996) 2024-04-28T13:07:41.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.138+0000 7f7d496ee640 1 -- 172.21.15.114:0/3454417684 learned_addr learned my addr 172.21.15.114:0/3454417684 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:41.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.138+0000 7f7d43fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f7d440d1fc0 0x7f7d440d5160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:44358/0 (socket says 172.21.15.114:44358) 2024-04-28T13:07:41.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.138+0000 7f7d496ee640 1 -- 172.21.15.114:0/3454417684 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d4415f430 msgr2=0x7f7d440d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:41.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.138+0000 7f7d496ee640 1 --2- 172.21.15.114:0/3454417684 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d4415f430 0x7f7d440d1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.138+0000 7f7d496ee640 1 -- 172.21.15.114:0/3454417684 >> v1:172.21.15.134:6789/0 conn(0x7f7d440d1fc0 legacy=0x7f7d440d5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:41.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.138+0000 7f7d437fe640 1 -- 172.21.15.114:0/3454417684 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2446039482 0 0) 0x7f7d440d2a40 con 0x7f7d440d1fc0 2024-04-28T13:07:41.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.138+0000 7f7d496ee640 1 -- 172.21.15.114:0/3454417684 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d440d2480 con 0x7f7d440d5870 2024-04-28T13:07:41.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.138+0000 7f7d48eed640 1 --2- 172.21.15.114:0/3454417684 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d4415f430 0x7f7d440d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:07:41.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.139+0000 7f7d496ee640 1 --2- 172.21.15.114:0/3454417684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d440d5870 0x7f7d440d3b60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c009e50 tx=0x7f7d3c02a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=794a3283074d6786 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:41.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.139+0000 7f7d437fe640 1 -- 172.21.15.114:0/3454417684 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c036070 con 0x7f7d440d5870 2024-04-28T13:07:41.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.139+0000 7f7d437fe640 1 -- 172.21.15.114:0/3454417684 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d3c031600 con 0x7f7d440d5870 2024-04-28T13:07:41.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.139+0000 7f7d437fe640 1 -- 172.21.15.114:0/3454417684 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c0319d0 con 0x7f7d440d5870 2024-04-28T13:07:41.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.139+0000 7f7d4b151640 1 -- 172.21.15.114:0/3454417684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d440d5870 msgr2=0x7f7d440d3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:41.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.139+0000 7f7d4b151640 1 --2- 172.21.15.114:0/3454417684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d440d5870 0x7f7d440d3b60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c009e50 tx=0x7f7d3c02a710 comp rx=0 tx=0).stop 2024-04-28T13:07:41.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.139+0000 7f7d4b151640 1 -- 172.21.15.114:0/3454417684 shutdown_connections 2024-04-28T13:07:41.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.139+0000 7f7d4b151640 1 --2- 172.21.15.114:0/3454417684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d440d5870 0x7f7d440d3b60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.139+0000 7f7d4b151640 1 --2- 172.21.15.114:0/3454417684 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d4415f430 0x7f7d440d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.139+0000 7f7d4b151640 1 -- 172.21.15.114:0/3454417684 >> 172.21.15.114:0/3454417684 conn(0x7f7d440633a0 msgr2=0x7f7d4406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:41.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.139+0000 7f7d4b151640 1 -- 172.21.15.114:0/3454417684 shutdown_connections 2024-04-28T13:07:41.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.139+0000 7f7d4b151640 1 -- 172.21.15.114:0/3454417684 wait complete. 2024-04-28T13:07:41.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.140+0000 7f7d4b151640 1 Processor -- start 2024-04-28T13:07:41.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.140+0000 7f7d4b151640 1 -- start start 2024-04-28T13:07:41.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.141+0000 7f7d4b151640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d440d1fc0 0x7f7d440c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:41.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.141+0000 7f7d4b151640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d440d5870 0x7f7d441fc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:41.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.141+0000 7f7d4b151640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d4415f430 0x7f7d440cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:41.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.141+0000 7f7d4b151640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7d440baf40 con 0x7f7d440d5870 2024-04-28T13:07:41.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.141+0000 7f7d4b151640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7d440d3360 con 0x7f7d440d1fc0 2024-04-28T13:07:41.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.141+0000 7f7d4b151640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f7d440bb0c0 con 0x7f7d4415f430 2024-04-28T13:07:41.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.141+0000 7f7d43fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d440d5870 0x7f7d441fc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:41.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.141+0000 7f7d43fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d440d5870 0x7f7d441fc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41182/0 (socket says 172.21.15.114:41182) 2024-04-28T13:07:41.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.141+0000 7f7d43fff640 1 -- 172.21.15.114:0/1725249570 learned_addr learned my addr 172.21.15.114:0/1725249570 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:41.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.142+0000 7f7d48eed640 1 --2- 172.21.15.114:0/1725249570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d440d1fc0 0x7f7d440c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:41.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.142+0000 7f7d496ee640 1 --2- 172.21.15.114:0/1725249570 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d4415f430 0x7f7d440cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:41.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.142+0000 7f7d43fff640 1 -- 172.21.15.114:0/1725249570 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d4415f430 msgr2=0x7f7d440cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:41.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.142+0000 7f7d43fff640 1 --2- 172.21.15.114:0/1725249570 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d4415f430 0x7f7d440cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.142+0000 7f7d43fff640 1 -- 172.21.15.114:0/1725249570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d440d1fc0 msgr2=0x7f7d440c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:41.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.142+0000 7f7d43fff640 1 --2- 172.21.15.114:0/1725249570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d440d1fc0 0x7f7d440c9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.142+0000 7f7d43fff640 1 -- 172.21.15.114:0/1725249570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d4415d1b0 con 0x7f7d440d5870 2024-04-28T13:07:41.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.142+0000 7f7d496ee640 1 --2- 172.21.15.114:0/1725249570 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d4415f430 0x7f7d440cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:41.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.142+0000 7f7d43fff640 1 --2- 172.21.15.114:0/1725249570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d440d5870 0x7f7d441fc140 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7d3800c4d0 tx=0x7f7d3800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:41.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.142+0000 7f7d417fa640 1 -- 172.21.15.114:0/1725249570 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d38018070 con 0x7f7d440d5870 2024-04-28T13:07:41.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.142+0000 7f7d417fa640 1 -- 172.21.15.114:0/1725249570 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d38007500 con 0x7f7d440d5870 2024-04-28T13:07:41.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.142+0000 7f7d417fa640 1 -- 172.21.15.114:0/1725249570 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d38004a20 con 0x7f7d440d5870 2024-04-28T13:07:41.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.142+0000 7f7d4b151640 1 -- 172.21.15.114:0/1725249570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d440ce430 con 0x7f7d440d5870 2024-04-28T13:07:41.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.142+0000 7f7d4b151640 1 -- 172.21.15.114:0/1725249570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d440ce9f0 con 0x7f7d440d5870 2024-04-28T13:07:41.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.143+0000 7f7d4b151640 1 -- 172.21.15.114:0/1725249570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d44075c40 con 0x7f7d440d5870 2024-04-28T13:07:41.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.143+0000 7f7d417fa640 1 -- 172.21.15.114:0/1725249570 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7d3801b070 con 0x7f7d440d5870 2024-04-28T13:07:41.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.144+0000 7f7d417fa640 1 --2- 172.21.15.114:0/1725249570 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7d3006c8f0 0x7f7d3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:41.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.144+0000 7f7d417fa640 1 -- 172.21.15.114:0/1725249570 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7d3808ad10 con 0x7f7d440d5870 2024-04-28T13:07:41.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.144+0000 7f7d48eed640 1 --2- 172.21.15.114:0/1725249570 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7d3006c8f0 0x7f7d3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:41.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.144+0000 7f7d48eed640 1 --2- 172.21.15.114:0/1725249570 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7d3006c8f0 0x7f7d3006edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7d34009560 tx=0x7f7d34009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:41.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.148+0000 7f7d417fa640 1 -- 172.21.15.114:0/1725249570 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7d38058b80 con 0x7f7d440d5870 2024-04-28T13:07:41.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.325+0000 7f7d4b151640 1 -- 172.21.15.114:0/1725249570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7d440cec30 con 0x7f7d440d5870 2024-04-28T13:07:41.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.325+0000 7f7d417fa640 1 -- 172.21.15.114:0/1725249570 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f7d3805ce80 con 0x7f7d440d5870 2024-04-28T13:07:41.325 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-04-28T13:07:41.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.327+0000 7f7d4b151640 1 -- 172.21.15.114:0/1725249570 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7d3006c8f0 msgr2=0x7f7d3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:41.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.327+0000 7f7d4b151640 1 --2- 172.21.15.114:0/1725249570 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7d3006c8f0 0x7f7d3006edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7d34009560 tx=0x7f7d34009190 comp rx=0 tx=0).stop 2024-04-28T13:07:41.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.327+0000 7f7d4b151640 1 -- 172.21.15.114:0/1725249570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d440d5870 msgr2=0x7f7d441fc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:41.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.327+0000 7f7d4b151640 1 --2- 172.21.15.114:0/1725249570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d440d5870 0x7f7d441fc140 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7d3800c4d0 tx=0x7f7d3800c990 comp rx=0 tx=0).stop 2024-04-28T13:07:41.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.327+0000 7f7d4b151640 1 -- 172.21.15.114:0/1725249570 shutdown_connections 2024-04-28T13:07:41.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.327+0000 7f7d4b151640 1 --2- 172.21.15.114:0/1725249570 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d4415f430 0x7f7d440cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.327+0000 7f7d4b151640 1 --2- 172.21.15.114:0/1725249570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d440d5870 0x7f7d441fc140 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.327+0000 7f7d4b151640 1 --2- 172.21.15.114:0/1725249570 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7d3006c8f0 0x7f7d3006edb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.327+0000 7f7d4b151640 1 --2- 172.21.15.114:0/1725249570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d440d1fc0 0x7f7d440c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.327+0000 7f7d4b151640 1 -- 172.21.15.114:0/1725249570 >> 172.21.15.114:0/1725249570 conn(0x7f7d440633a0 msgr2=0x7f7d440d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:41.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.327+0000 7f7d4b151640 1 -- 172.21.15.114:0/1725249570 shutdown_connections 2024-04-28T13:07:41.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.327+0000 7f7d4b151640 1 -- 172.21.15.114:0/1725249570 wait complete. 2024-04-28T13:07:41.338 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-28T13:07:41.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.434+0000 7fa4243e4640 1 Processor -- start 2024-04-28T13:07:41.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.434+0000 7fa4243e4640 1 -- start start 2024-04-28T13:07:41.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.435+0000 7fa4243e4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa41c148770 0x7fa41c15fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:41.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.435+0000 7fa4243e4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa41c163070 0x7fa41c070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:41.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.435+0000 7fa4243e4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa41c148b50 con 0x7fa41c1634d0 2024-04-28T13:07:41.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.435+0000 7fa4243e4640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fa41c164010 con 0x7fa41c163070 2024-04-28T13:07:41.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.435+0000 7fa4243e4640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fa41c06de10 con 0x7fa41c148770 2024-04-28T13:07:41.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.436+0000 7fa42197f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa41c163070 0x7fa41c070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:41.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.436+0000 7fa422981640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa41c1634d0 0x7fa41c06e2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44870/0 (socket says 172.21.15.114:44870) 2024-04-28T13:07:41.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.436+0000 7fa422981640 1 -- 172.21.15.114:0/916445183 learned_addr learned my addr 172.21.15.114:0/916445183 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:41.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.436+0000 7fa422180640 1 --2- 172.21.15.114:0/916445183 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa41c148770 0x7fa41c15fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:41.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.436+0000 7fa42197f640 1 -- 172.21.15.114:0/916445183 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa41c148770 msgr2=0x7fa41c15fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:41.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.436+0000 7fa42197f640 1 --2- 172.21.15.114:0/916445183 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa41c148770 0x7fa41c15fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.436+0000 7fa42197f640 1 -- 172.21.15.114:0/916445183 >> v1:172.21.15.114:6789/0 conn(0x7fa41c1634d0 legacy=0x7fa41c06e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:41.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.436+0000 7fa42197f640 1 -- 172.21.15.114:0/916445183 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa41c163a50 con 0x7fa41c163070 2024-04-28T13:07:41.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.436+0000 7fa42117e640 1 -- 172.21.15.114:0/916445183 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2691902693 0 0) 0x7fa41c148b50 con 0x7fa41c1634d0 2024-04-28T13:07:41.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.436+0000 7fa422180640 1 --2- 172.21.15.114:0/916445183 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa41c148770 0x7fa41c15fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:41.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.437+0000 7fa42197f640 1 --2- 172.21.15.114:0/916445183 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa41c163070 0x7fa41c070710 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa40c0097a0 tx=0x7fa40c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f363baea639ea62 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:41.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.437+0000 7fa42117e640 1 -- 172.21.15.114:0/916445183 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40c037070 con 0x7fa41c163070 2024-04-28T13:07:41.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.437+0000 7fa42117e640 1 -- 172.21.15.114:0/916445183 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa40c02ae50 con 0x7fa41c163070 2024-04-28T13:07:41.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.437+0000 7fa42117e640 1 -- 172.21.15.114:0/916445183 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40c032660 con 0x7fa41c163070 2024-04-28T13:07:41.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.437+0000 7fa4243e4640 1 -- 172.21.15.114:0/916445183 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa41c163070 msgr2=0x7fa41c070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:41.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.437+0000 7fa4243e4640 1 --2- 172.21.15.114:0/916445183 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa41c163070 0x7fa41c070710 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa40c0097a0 tx=0x7fa40c02a100 comp rx=0 tx=0).stop 2024-04-28T13:07:41.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.437+0000 7fa4243e4640 1 -- 172.21.15.114:0/916445183 shutdown_connections 2024-04-28T13:07:41.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.437+0000 7fa4243e4640 1 --2- 172.21.15.114:0/916445183 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa41c163070 0x7fa41c070710 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.437+0000 7fa4243e4640 1 --2- 172.21.15.114:0/916445183 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa41c148770 0x7fa41c15fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.437+0000 7fa4243e4640 1 -- 172.21.15.114:0/916445183 >> 172.21.15.114:0/916445183 conn(0x7fa41c0b4c60 msgr2=0x7fa41c0b5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:41.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.437+0000 7fa4243e4640 1 -- 172.21.15.114:0/916445183 shutdown_connections 2024-04-28T13:07:41.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.437+0000 7fa4243e4640 1 -- 172.21.15.114:0/916445183 wait complete. 2024-04-28T13:07:41.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.438+0000 7fa4243e4640 1 Processor -- start 2024-04-28T13:07:41.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.438+0000 7fa4243e4640 1 -- start start 2024-04-28T13:07:41.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.439+0000 7fa4243e4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa41c148770 0x7fa41c13c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:41.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.439+0000 7fa4243e4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa41c163070 0x7fa41c142da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:41.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.439+0000 7fa4243e4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa41c1634d0 0x7fa41c1432e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:41.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.439+0000 7fa4243e4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa41c15fff0 con 0x7fa41c163070 2024-04-28T13:07:41.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.439+0000 7fa4243e4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa41c06daa0 con 0x7fa41c1634d0 2024-04-28T13:07:41.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.439+0000 7fa4243e4640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fa41c148f50 con 0x7fa41c148770 2024-04-28T13:07:41.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.439+0000 7fa42197f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa41c163070 0x7fa41c142da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:41.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.439+0000 7fa42197f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa41c163070 0x7fa41c142da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41198/0 (socket says 172.21.15.114:41198) 2024-04-28T13:07:41.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.439+0000 7fa42197f640 1 -- 172.21.15.114:0/4191742055 learned_addr learned my addr 172.21.15.114:0/4191742055 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:41.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.439+0000 7fa422981640 1 --2- 172.21.15.114:0/4191742055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa41c1634d0 0x7fa41c1432e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:41.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.439+0000 7fa422180640 1 --2- 172.21.15.114:0/4191742055 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa41c148770 0x7fa41c13c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:41.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.439+0000 7fa42197f640 1 -- 172.21.15.114:0/4191742055 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa41c148770 msgr2=0x7fa41c13c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:41.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.439+0000 7fa42197f640 1 --2- 172.21.15.114:0/4191742055 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa41c148770 0x7fa41c13c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.439+0000 7fa42197f640 1 -- 172.21.15.114:0/4191742055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa41c1634d0 msgr2=0x7fa41c1432e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:41.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.439+0000 7fa42197f640 1 --2- 172.21.15.114:0/4191742055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa41c1634d0 0x7fa41c1432e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.440+0000 7fa42197f640 1 -- 172.21.15.114:0/4191742055 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa41c140d80 con 0x7fa41c163070 2024-04-28T13:07:41.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.440+0000 7fa422981640 1 --2- 172.21.15.114:0/4191742055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa41c1634d0 0x7fa41c1432e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:41.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.440+0000 7fa422180640 1 --2- 172.21.15.114:0/4191742055 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa41c148770 0x7fa41c13c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:41.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.440+0000 7fa42197f640 1 --2- 172.21.15.114:0/4191742055 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa41c163070 0x7fa41c142da0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa40c0097a0 tx=0x7fa40c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:41.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.440+0000 7fa412ffd640 1 -- 172.21.15.114:0/4191742055 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40c037040 con 0x7fa41c163070 2024-04-28T13:07:41.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.440+0000 7fa412ffd640 1 -- 172.21.15.114:0/4191742055 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa40c004030 con 0x7fa41c163070 2024-04-28T13:07:41.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.440+0000 7fa4243e4640 1 -- 172.21.15.114:0/4191742055 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa41c161d70 con 0x7fa41c163070 2024-04-28T13:07:41.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.440+0000 7fa412ffd640 1 -- 172.21.15.114:0/4191742055 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40c004420 con 0x7fa41c163070 2024-04-28T13:07:41.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.440+0000 7fa4243e4640 1 -- 172.21.15.114:0/4191742055 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa41c162330 con 0x7fa41c163070 2024-04-28T13:07:41.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.441+0000 7fa4243e4640 1 -- 172.21.15.114:0/4191742055 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa41c06a3d0 con 0x7fa41c163070 2024-04-28T13:07:41.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.441+0000 7fa412ffd640 1 -- 172.21.15.114:0/4191742055 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa40c003610 con 0x7fa41c163070 2024-04-28T13:07:41.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.441+0000 7fa412ffd640 1 --2- 172.21.15.114:0/4191742055 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa40006c8f0 0x7fa40006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:41.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.442+0000 7fa422180640 1 --2- 172.21.15.114:0/4191742055 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa40006c8f0 0x7fa40006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:41.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.442+0000 7fa412ffd640 1 -- 172.21.15.114:0/4191742055 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa40c0ac7a0 con 0x7fa41c163070 2024-04-28T13:07:41.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.442+0000 7fa422180640 1 --2- 172.21.15.114:0/4191742055 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa40006c8f0 0x7fa40006edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa418006fd0 tx=0x7fa418008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:41.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.446+0000 7fa412ffd640 1 -- 172.21.15.114:0/4191742055 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa40c04c070 con 0x7fa41c163070 2024-04-28T13:07:41.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.655+0000 7fa4243e4640 1 -- 172.21.15.114:0/4191742055 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa41c071460 con 0x7fa41c163070 2024-04-28T13:07:41.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.655+0000 7fa412ffd640 1 -- 172.21.15.114:0/4191742055 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5181 (secure 0 0 0) 0x7fa40c07ac60 con 0x7fa41c163070 2024-04-28T13:07:41.655 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:41.655 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2660339514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2660339514},{"type":"v1","addr":"172.21.15.114:6837","nonce":2660339514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3536977085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3536977085},{"type":"v1","addr":"172.21.15.134:6833","nonce":3536977085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/869609014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":869609014},{"type":"v1","addr":"172.21.15.134:6835","nonce":869609014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-28T13:07:25.635297+0000","modified":"2024-04-28T13:07:27.635944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/888574435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":888574435},{"type":"v1","addr":"172.21.15.114:6836","nonce":888574435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-04-28T13:07:41.655 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 6 2024-04-28T13:07:41.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.657+0000 7fa4243e4640 1 -- 172.21.15.114:0/4191742055 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa40006c8f0 msgr2=0x7fa40006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:41.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.657+0000 7fa4243e4640 1 --2- 172.21.15.114:0/4191742055 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa40006c8f0 0x7fa40006edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa418006fd0 tx=0x7fa418008040 comp rx=0 tx=0).stop 2024-04-28T13:07:41.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.657+0000 7fa4243e4640 1 -- 172.21.15.114:0/4191742055 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa41c163070 msgr2=0x7fa41c142da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:41.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.657+0000 7fa4243e4640 1 --2- 172.21.15.114:0/4191742055 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa41c163070 0x7fa41c142da0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa40c0097a0 tx=0x7fa40c0046c0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.657+0000 7fa4243e4640 1 -- 172.21.15.114:0/4191742055 shutdown_connections 2024-04-28T13:07:41.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.657+0000 7fa4243e4640 1 --2- 172.21.15.114:0/4191742055 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa40006c8f0 0x7fa40006edb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.657+0000 7fa4243e4640 1 --2- 172.21.15.114:0/4191742055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa41c1634d0 0x7fa41c1432e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.657+0000 7fa4243e4640 1 --2- 172.21.15.114:0/4191742055 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa41c163070 0x7fa41c142da0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.657+0000 7fa4243e4640 1 --2- 172.21.15.114:0/4191742055 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa41c148770 0x7fa41c13c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.657+0000 7fa4243e4640 1 -- 172.21.15.114:0/4191742055 >> 172.21.15.114:0/4191742055 conn(0x7fa41c0b4c60 msgr2=0x7fa41c0b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:41.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.657+0000 7fa4243e4640 1 -- 172.21.15.114:0/4191742055 shutdown_connections 2024-04-28T13:07:41.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.657+0000 7fa4243e4640 1 -- 172.21.15.114:0/4191742055 wait complete. 2024-04-28T13:07:41.667 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:07:41.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.764+0000 7f108cd96640 1 Processor -- start 2024-04-28T13:07:41.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.764+0000 7f108cd96640 1 -- start start 2024-04-28T13:07:41.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.765+0000 7f108cd96640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10880cdde0 0x7f108815fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:41.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.765+0000 7f108cd96640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1088160420 con 0x7f1088160000 2024-04-28T13:07:41.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.765+0000 7f108cd96640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10880d2be0 con 0x7f10880cda00 2024-04-28T13:07:41.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.765+0000 7f108cd96640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1088160980 con 0x7f10880cdde0 2024-04-28T13:07:41.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.765+0000 7f1086d9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1088160000 0x7f1088155fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44874/0 (socket says 172.21.15.114:44874) 2024-04-28T13:07:41.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.765+0000 7f1086d9d640 1 -- 172.21.15.114:0/2670735945 learned_addr learned my addr 172.21.15.114:0/2670735945 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:41.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.765+0000 7f1085d9b640 1 --2- 172.21.15.114:0/2670735945 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10880cdde0 0x7f108815fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:41.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.766+0000 7f108559a640 1 -- 172.21.15.114:0/2670735945 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4272027544 0 0) 0x7f1080001110 con 0x7f1088160000 2024-04-28T13:07:41.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.766+0000 7f108559a640 1 -- 172.21.15.114:0/2670735945 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1070003520 con 0x7f1088160000 2024-04-28T13:07:41.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.766+0000 7f108559a640 1 -- 172.21.15.114:0/2670735945 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3001811152 0 0) 0x7f10880d2be0 con 0x7f10880cda00 2024-04-28T13:07:41.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.766+0000 7f108559a640 1 -- 172.21.15.114:0/2670735945 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1080001110 con 0x7f10880cda00 2024-04-28T13:07:41.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.766+0000 7f108559a640 1 -- 172.21.15.114:0/2670735945 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2213696478 0 0) 0x7f1070003520 con 0x7f1088160000 2024-04-28T13:07:41.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.766+0000 7f108559a640 1 -- 172.21.15.114:0/2670735945 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10880cdde0 msgr2=0x7f108815fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:41.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.766+0000 7f108559a640 1 --2- 172.21.15.114:0/2670735945 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10880cdde0 0x7f108815fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.766+0000 7f108559a640 1 -- 172.21.15.114:0/2670735945 >> v1:172.21.15.134:6789/0 conn(0x7f10880cda00 legacy=0x7f10880d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:41.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.766+0000 7f108559a640 1 -- 172.21.15.114:0/2670735945 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10881606a0 con 0x7f1088160000 2024-04-28T13:07:41.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.766+0000 7f108559a640 1 -- 172.21.15.114:0/2670735945 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f1080001840 con 0x7f1088160000 2024-04-28T13:07:41.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.766+0000 7f1085d9b640 1 --2- 172.21.15.114:0/2670735945 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10880cdde0 0x7f108815fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:07:41.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.766+0000 7f108559a640 1 -- 172.21.15.114:0/2670735945 >> v1:172.21.15.114:6789/0 conn(0x7f1088160000 legacy=0x7f1088155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:41.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.766+0000 7f108559a640 1 --2- 172.21.15.114:0/2670735945 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10880cdde0 0x7f1070003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:41.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.766+0000 7f108559a640 1 --2- 172.21.15.114:0/2670735945 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10700040b0 0x7f1070004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:41.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.766+0000 7f108559a640 1 --2- 172.21.15.114:0/2670735945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1070004d40 0x7f10700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:41.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.766+0000 7f108559a640 1 -- 172.21.15.114:0/2670735945 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1088160980 con 0x7f10700040b0 2024-04-28T13:07:41.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.766+0000 7f108559a640 1 -- 172.21.15.114:0/2670735945 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f107000ba70 con 0x7f1070004d40 2024-04-28T13:07:41.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.766+0000 7f108559a640 1 -- 172.21.15.114:0/2670735945 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f107000bc70 con 0x7f10880cdde0 2024-04-28T13:07:41.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.766+0000 7f1085d9b640 1 --2- 172.21.15.114:0/2670735945 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10700040b0 0x7f1070004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:41.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.766+0000 7f1086d9d640 1 --2- 172.21.15.114:0/2670735945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1070004d40 0x7f10700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:41.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.766+0000 7f108659c640 1 --2- 172.21.15.114:0/2670735945 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10880cdde0 0x7f1070003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:41.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.766+0000 7f1085d9b640 1 -- 172.21.15.114:0/2670735945 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10880cdde0 msgr2=0x7f1070003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:41.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.766+0000 7f1085d9b640 1 --2- 172.21.15.114:0/2670735945 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10880cdde0 0x7f1070003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.766+0000 7f1085d9b640 1 -- 172.21.15.114:0/2670735945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1070004d40 msgr2=0x7f10700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:41.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.766+0000 7f1085d9b640 1 --2- 172.21.15.114:0/2670735945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1070004d40 0x7f10700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.766+0000 7f1085d9b640 1 -- 172.21.15.114:0/2670735945 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1070003520 con 0x7f10700040b0 2024-04-28T13:07:41.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.766+0000 7f1086d9d640 1 --2- 172.21.15.114:0/2670735945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1070004d40 0x7f10700051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:41.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.766+0000 7f108659c640 1 --2- 172.21.15.114:0/2670735945 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10880cdde0 0x7f1070003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:41.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.767+0000 7f1085d9b640 1 --2- 172.21.15.114:0/2670735945 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10700040b0 0x7f1070004800 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f107c009c70 tx=0x7f1070005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a68d866810b2ca18 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:41.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.767+0000 7f108559a640 1 -- 172.21.15.114:0/2670735945 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c036070 con 0x7f10700040b0 2024-04-28T13:07:41.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.767+0000 7f108559a640 1 -- 172.21.15.114:0/2670735945 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f107c031400 con 0x7f10700040b0 2024-04-28T13:07:41.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.767+0000 7f108559a640 1 -- 172.21.15.114:0/2670735945 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c009840 con 0x7f10700040b0 2024-04-28T13:07:41.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.768+0000 7f108cd96640 1 -- 172.21.15.114:0/2670735945 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10700040b0 msgr2=0x7f1070004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:41.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.768+0000 7f108cd96640 1 --2- 172.21.15.114:0/2670735945 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10700040b0 0x7f1070004800 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f107c009c70 tx=0x7f1070005830 comp rx=0 tx=0).stop 2024-04-28T13:07:41.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.768+0000 7f1086d9d640 1 -- 172.21.15.114:0/2670735945 reap_dead start 2024-04-28T13:07:41.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.768+0000 7f108cd96640 1 -- 172.21.15.114:0/2670735945 shutdown_connections 2024-04-28T13:07:41.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.768+0000 7f108cd96640 1 -- 172.21.15.114:0/2670735945 >> 172.21.15.114:0/2670735945 conn(0x7f10880706f0 msgr2=0x7f1088070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:41.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.768+0000 7f108cd96640 1 -- 172.21.15.114:0/2670735945 shutdown_connections 2024-04-28T13:07:41.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.768+0000 7f108cd96640 1 -- 172.21.15.114:0/2670735945 wait complete. 2024-04-28T13:07:41.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.769+0000 7f108cd96640 1 Processor -- start 2024-04-28T13:07:41.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.769+0000 7f108cd96640 1 -- start start 2024-04-28T13:07:41.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.770+0000 7f108cd96640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10700040b0 0x7f10880c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:41.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.770+0000 7f108cd96640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1088157500 0x7f10880cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:41.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.770+0000 7f108cd96640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1088157960 0x7f10880cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:41.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.770+0000 7f108cd96640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f10880cfd70 con 0x7f1088157500 2024-04-28T13:07:41.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.770+0000 7f108cd96640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f10880cfa90 con 0x7f1088157960 2024-04-28T13:07:41.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.770+0000 7f108cd96640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f10880d0980 con 0x7f10700040b0 2024-04-28T13:07:41.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.770+0000 7f1085d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1088157500 0x7f10880cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:41.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.770+0000 7f1085d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1088157500 0x7f10880cc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41224/0 (socket says 172.21.15.114:41224) 2024-04-28T13:07:41.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.770+0000 7f1085d9b640 1 -- 172.21.15.114:0/1521214918 learned_addr learned my addr 172.21.15.114:0/1521214918 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:41.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.770+0000 7f108659c640 1 --2- 172.21.15.114:0/1521214918 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10700040b0 0x7f10880c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:41.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.770+0000 7f1086d9d640 1 --2- 172.21.15.114:0/1521214918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1088157960 0x7f10880cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:41.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.770+0000 7f1085d9b640 1 -- 172.21.15.114:0/1521214918 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10700040b0 msgr2=0x7f10880c76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:41.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.770+0000 7f1085d9b640 1 --2- 172.21.15.114:0/1521214918 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10700040b0 0x7f10880c76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.770+0000 7f1085d9b640 1 -- 172.21.15.114:0/1521214918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1088157960 msgr2=0x7f10880cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:41.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.770+0000 7f1085d9b640 1 --2- 172.21.15.114:0/1521214918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1088157960 0x7f10880cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.770+0000 7f1085d9b640 1 -- 172.21.15.114:0/1521214918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10880b0c20 con 0x7f1088157500 2024-04-28T13:07:41.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.770+0000 7f1086d9d640 1 --2- 172.21.15.114:0/1521214918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1088157960 0x7f10880cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:07:41.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.770+0000 7f1085d9b640 1 --2- 172.21.15.114:0/1521214918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1088157500 0x7f10880cc220 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f107c02ad30 tx=0x7f107c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:41.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.770+0000 7f1076ffd640 1 -- 172.21.15.114:0/1521214918 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c040070 con 0x7f1088157500 2024-04-28T13:07:41.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.770+0000 7f1076ffd640 1 -- 172.21.15.114:0/1521214918 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f107c0093e0 con 0x7f1088157500 2024-04-28T13:07:41.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.770+0000 7f108cd96640 1 -- 172.21.15.114:0/1521214918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10880b0e90 con 0x7f1088157500 2024-04-28T13:07:41.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.770+0000 7f1076ffd640 1 -- 172.21.15.114:0/1521214918 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c036040 con 0x7f1088157500 2024-04-28T13:07:41.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.770+0000 7f108cd96640 1 -- 172.21.15.114:0/1521214918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10880b1450 con 0x7f1088157500 2024-04-28T13:07:41.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.771+0000 7f108cd96640 1 -- 172.21.15.114:0/1521214918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f108806a3d0 con 0x7f1088157500 2024-04-28T13:07:41.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.772+0000 7f1076ffd640 1 -- 172.21.15.114:0/1521214918 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f107c043070 con 0x7f1088157500 2024-04-28T13:07:41.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.772+0000 7f1076ffd640 1 --2- 172.21.15.114:0/1521214918 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f106806c920 0x7f106806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:41.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.772+0000 7f1076ffd640 1 -- 172.21.15.114:0/1521214918 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f107c0ac0d0 con 0x7f1088157500 2024-04-28T13:07:41.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.772+0000 7f108659c640 1 --2- 172.21.15.114:0/1521214918 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f106806c920 0x7f106806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:41.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.772+0000 7f108659c640 1 --2- 172.21.15.114:0/1521214918 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f106806c920 0x7f106806ede0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f10780051f0 tx=0x7f1078009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:41.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.776+0000 7f1076ffd640 1 -- 172.21.15.114:0/1521214918 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f107c031e20 con 0x7f1088157500 2024-04-28T13:07:41.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.953+0000 7f108cd96640 1 -- 172.21.15.114:0/1521214918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f10880b1830 con 0x7f1088157500 2024-04-28T13:07:41.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.954+0000 7f1076ffd640 1 -- 172.21.15.114:0/1521214918 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7f107c079eb0 con 0x7f1088157500 2024-04-28T13:07:41.954 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:41.954 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:07:27.292537+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-28T13:07:23.706359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-28T13:07:24.596188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:07:41.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.956+0000 7f108cd96640 1 -- 172.21.15.114:0/1521214918 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f106806c920 msgr2=0x7f106806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:41.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.956+0000 7f108cd96640 1 --2- 172.21.15.114:0/1521214918 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f106806c920 0x7f106806ede0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f10780051f0 tx=0x7f1078009040 comp rx=0 tx=0).stop 2024-04-28T13:07:41.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.956+0000 7f108cd96640 1 -- 172.21.15.114:0/1521214918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1088157500 msgr2=0x7f10880cc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:41.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.956+0000 7f108cd96640 1 --2- 172.21.15.114:0/1521214918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1088157500 0x7f10880cc220 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f107c02ad30 tx=0x7f107c004730 comp rx=0 tx=0).stop 2024-04-28T13:07:41.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.956+0000 7f108cd96640 1 -- 172.21.15.114:0/1521214918 shutdown_connections 2024-04-28T13:07:41.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.956+0000 7f108cd96640 1 --2- 172.21.15.114:0/1521214918 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f106806c920 0x7f106806ede0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.956+0000 7f108cd96640 1 --2- 172.21.15.114:0/1521214918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1088157960 0x7f10880cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.956+0000 7f108cd96640 1 --2- 172.21.15.114:0/1521214918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1088157500 0x7f10880cc220 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.956+0000 7f108cd96640 1 --2- 172.21.15.114:0/1521214918 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10700040b0 0x7f10880c76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:41.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.956+0000 7f108cd96640 1 -- 172.21.15.114:0/1521214918 >> 172.21.15.114:0/1521214918 conn(0x7f10880706f0 msgr2=0x7f10880b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:41.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.956+0000 7f108cd96640 1 -- 172.21.15.114:0/1521214918 shutdown_connections 2024-04-28T13:07:41.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:41.956+0000 7f108cd96640 1 -- 172.21.15.114:0/1521214918 wait complete. 2024-04-28T13:07:41.967 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-28T13:07:42.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.063+0000 7fb21da6d640 1 Processor -- start 2024-04-28T13:07:42.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.063+0000 7fb21da6d640 1 -- start start 2024-04-28T13:07:42.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.064+0000 7fb21da6d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb218148cd0 0x7fb2180b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:42.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.064+0000 7fb21da6d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb21806dd80 0x7fb21815ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:42.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.064+0000 7fb21da6d640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb21806ec20 con 0x7fb2180b51a0 2024-04-28T13:07:42.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.064+0000 7fb21da6d640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fb2181490b0 con 0x7fb218148cd0 2024-04-28T13:07:42.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.064+0000 7fb21da6d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb21815fb10 con 0x7fb21806dd80 2024-04-28T13:07:42.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.064+0000 7fb2177fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb218148cd0 0x7fb2180b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:42.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.064+0000 7fb216ffd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb2180b51a0 0x7fb21806d670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44880/0 (socket says 172.21.15.114:44880) 2024-04-28T13:07:42.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.064+0000 7fb216ffd640 1 -- 172.21.15.114:0/46973000 learned_addr learned my addr 172.21.15.114:0/46973000 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:42.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.064+0000 7fb217fff640 1 --2- 172.21.15.114:0/46973000 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb21806dd80 0x7fb21815ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:42.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.064+0000 7fb2177fe640 1 -- 172.21.15.114:0/46973000 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb21806dd80 msgr2=0x7fb21815ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:42.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.064+0000 7fb2177fe640 1 --2- 172.21.15.114:0/46973000 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb21806dd80 0x7fb21815ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.064+0000 7fb2177fe640 1 -- 172.21.15.114:0/46973000 >> v1:172.21.15.114:6789/0 conn(0x7fb2180b51a0 legacy=0x7fb21806d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:42.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.065+0000 7fb2177fe640 1 -- 172.21.15.114:0/46973000 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb21806e380 con 0x7fb218148cd0 2024-04-28T13:07:42.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.064+0000 7fb2167fc640 1 -- 172.21.15.114:0/46973000 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 351292790 0 0) 0x7fb21806ec20 con 0x7fb2180b51a0 2024-04-28T13:07:42.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.065+0000 7fb217fff640 1 --2- 172.21.15.114:0/46973000 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb21806dd80 0x7fb21815ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:42.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.065+0000 7fb2177fe640 1 --2- 172.21.15.114:0/46973000 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb218148cd0 0x7fb2180b4c60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb2080097a0 tx=0x7fb20802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c357f79e7b29571 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:42.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.065+0000 7fb2167fc640 1 -- 172.21.15.114:0/46973000 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb208037070 con 0x7fb218148cd0 2024-04-28T13:07:42.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.065+0000 7fb2167fc640 1 -- 172.21.15.114:0/46973000 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb20802ae50 con 0x7fb218148cd0 2024-04-28T13:07:42.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.065+0000 7fb2167fc640 1 -- 172.21.15.114:0/46973000 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb208032660 con 0x7fb218148cd0 2024-04-28T13:07:42.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.066+0000 7fb21da6d640 1 -- 172.21.15.114:0/46973000 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb218148cd0 msgr2=0x7fb2180b4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:42.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.066+0000 7fb21da6d640 1 --2- 172.21.15.114:0/46973000 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb218148cd0 0x7fb2180b4c60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb2080097a0 tx=0x7fb20802a100 comp rx=0 tx=0).stop 2024-04-28T13:07:42.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.066+0000 7fb21da6d640 1 -- 172.21.15.114:0/46973000 shutdown_connections 2024-04-28T13:07:42.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.066+0000 7fb21da6d640 1 --2- 172.21.15.114:0/46973000 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb21806dd80 0x7fb21815ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.066+0000 7fb21da6d640 1 --2- 172.21.15.114:0/46973000 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb218148cd0 0x7fb2180b4c60 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.066+0000 7fb21da6d640 1 -- 172.21.15.114:0/46973000 >> 172.21.15.114:0/46973000 conn(0x7fb218062d70 msgr2=0x7fb218063150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:42.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.066+0000 7fb21da6d640 1 -- 172.21.15.114:0/46973000 shutdown_connections 2024-04-28T13:07:42.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.066+0000 7fb21da6d640 1 -- 172.21.15.114:0/46973000 wait complete. 2024-04-28T13:07:42.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.067+0000 7fb21da6d640 1 Processor -- start 2024-04-28T13:07:42.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.067+0000 7fb21da6d640 1 -- start start 2024-04-28T13:07:42.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.068+0000 7fb21da6d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb21806dd80 0x7fb218155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:42.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.068+0000 7fb21da6d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb2180b51a0 0x7fb218143040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:42.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.068+0000 7fb21da6d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb218148cd0 0x7fb2180d2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:42.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.068+0000 7fb21da6d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb2181604e0 con 0x7fb218148cd0 2024-04-28T13:07:42.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.068+0000 7fb21da6d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb21806e940 con 0x7fb21806dd80 2024-04-28T13:07:42.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.068+0000 7fb21da6d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb218160660 con 0x7fb2180b51a0 2024-04-28T13:07:42.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.068+0000 7fb217fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb218148cd0 0x7fb2180d2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:42.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.068+0000 7fb217fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb218148cd0 0x7fb2180d2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41250/0 (socket says 172.21.15.114:41250) 2024-04-28T13:07:42.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.068+0000 7fb217fff640 1 -- 172.21.15.114:0/2241676521 learned_addr learned my addr 172.21.15.114:0/2241676521 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:42.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.068+0000 7fb217fff640 1 -- 172.21.15.114:0/2241676521 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb2180b51a0 msgr2=0x7fb218143040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:42.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.068+0000 7fb217fff640 1 --2- 172.21.15.114:0/2241676521 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb2180b51a0 0x7fb218143040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.068+0000 7fb217fff640 1 -- 172.21.15.114:0/2241676521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb21806dd80 msgr2=0x7fb218155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:42.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.068+0000 7fb217fff640 1 --2- 172.21.15.114:0/2241676521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb21806dd80 0x7fb218155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.068+0000 7fb217fff640 1 -- 172.21.15.114:0/2241676521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb218155680 con 0x7fb218148cd0 2024-04-28T13:07:42.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.068+0000 7fb217fff640 1 --2- 172.21.15.114:0/2241676521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb218148cd0 0x7fb2180d2610 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb210009fa0 tx=0x7fb21000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:42.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.068+0000 7fb1fffff640 1 -- 172.21.15.114:0/2241676521 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21001a070 con 0x7fb218148cd0 2024-04-28T13:07:42.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.068+0000 7fb1fffff640 1 -- 172.21.15.114:0/2241676521 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb210003bb0 con 0x7fb218148cd0 2024-04-28T13:07:42.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.068+0000 7fb21da6d640 1 -- 172.21.15.114:0/2241676521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb218151e60 con 0x7fb218148cd0 2024-04-28T13:07:42.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.069+0000 7fb1fffff640 1 -- 172.21.15.114:0/2241676521 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb210004030 con 0x7fb218148cd0 2024-04-28T13:07:42.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.069+0000 7fb21da6d640 1 -- 172.21.15.114:0/2241676521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb218152420 con 0x7fb218148cd0 2024-04-28T13:07:42.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.070+0000 7fb21da6d640 1 -- 172.21.15.114:0/2241676521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb21806a3d0 con 0x7fb218148cd0 2024-04-28T13:07:42.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.070+0000 7fb1fffff640 1 -- 172.21.15.114:0/2241676521 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb21001d070 con 0x7fb218148cd0 2024-04-28T13:07:42.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.070+0000 7fb1fffff640 1 --2- 172.21.15.114:0/2241676521 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb20406c8f0 0x7fb20406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:42.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.070+0000 7fb2177fe640 1 --2- 172.21.15.114:0/2241676521 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb20406c8f0 0x7fb20406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:42.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.070+0000 7fb1fffff640 1 -- 172.21.15.114:0/2241676521 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb21008be90 con 0x7fb218148cd0 2024-04-28T13:07:42.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.071+0000 7fb2177fe640 1 --2- 172.21.15.114:0/2241676521 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb20406c8f0 0x7fb20406edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb208034000 tx=0x7fb20802c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:42.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.075+0000 7fb1fffff640 1 -- 172.21.15.114:0/2241676521 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb210010070 con 0x7fb218148cd0 2024-04-28T13:07:42.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.285+0000 7fb21da6d640 1 -- 172.21.15.114:0/2241676521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb2180cc3f0 con 0x7fb218148cd0 2024-04-28T13:07:42.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.285+0000 7fb1fffff640 1 -- 172.21.15.114:0/2241676521 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5181 (secure 0 0 0) 0x7fb21005a2c0 con 0x7fb218148cd0 2024-04-28T13:07:42.285 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:42.285 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2660339514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2660339514},{"type":"v1","addr":"172.21.15.114:6837","nonce":2660339514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3536977085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3536977085},{"type":"v1","addr":"172.21.15.134:6833","nonce":3536977085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/869609014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":869609014},{"type":"v1","addr":"172.21.15.134:6835","nonce":869609014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-28T13:07:25.635297+0000","modified":"2024-04-28T13:07:27.635944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/888574435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":888574435},{"type":"v1","addr":"172.21.15.114:6836","nonce":888574435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-04-28T13:07:42.285 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 6 2024-04-28T13:07:42.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.287+0000 7fb21da6d640 1 -- 172.21.15.114:0/2241676521 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb20406c8f0 msgr2=0x7fb20406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:42.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.287+0000 7fb21da6d640 1 --2- 172.21.15.114:0/2241676521 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb20406c8f0 0x7fb20406edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb208034000 tx=0x7fb20802c000 comp rx=0 tx=0).stop 2024-04-28T13:07:42.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.287+0000 7fb21da6d640 1 -- 172.21.15.114:0/2241676521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb218148cd0 msgr2=0x7fb2180d2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:42.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.287+0000 7fb21da6d640 1 --2- 172.21.15.114:0/2241676521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb218148cd0 0x7fb2180d2610 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb210009fa0 tx=0x7fb21000d560 comp rx=0 tx=0).stop 2024-04-28T13:07:42.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.287+0000 7fb21da6d640 1 -- 172.21.15.114:0/2241676521 shutdown_connections 2024-04-28T13:07:42.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.287+0000 7fb21da6d640 1 --2- 172.21.15.114:0/2241676521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb218148cd0 0x7fb2180d2610 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.287+0000 7fb21da6d640 1 --2- 172.21.15.114:0/2241676521 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb2180b51a0 0x7fb218143040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.287+0000 7fb21da6d640 1 --2- 172.21.15.114:0/2241676521 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb20406c8f0 0x7fb20406edb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.287+0000 7fb21da6d640 1 --2- 172.21.15.114:0/2241676521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb21806dd80 0x7fb218155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.287+0000 7fb21da6d640 1 -- 172.21.15.114:0/2241676521 >> 172.21.15.114:0/2241676521 conn(0x7fb218062d70 msgr2=0x7fb218146200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:42.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.288+0000 7fb21da6d640 1 -- 172.21.15.114:0/2241676521 shutdown_connections 2024-04-28T13:07:42.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.288+0000 7fb21da6d640 1 -- 172.21.15.114:0/2241676521 wait complete. 2024-04-28T13:07:42.701 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-28T13:07:25.635297+0000', 'modified': '2024-04-28T13:07:27.635944+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4284}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4284': {'gid': 4284, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.114:6836/888574435', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6834', 'nonce': 888574435}, {'type': 'v1', 'addr': '172.21.15.114:6836', 'nonce': 888574435}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4284, 'qdb_cluster': [4284]} 2024-04-28T13:07:42.701 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-28T13:07:42.701 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-28T13:07:42.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.804+0000 7f4f49bda640 1 Processor -- start 2024-04-28T13:07:42.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.804+0000 7f4f49bda640 1 -- start start 2024-04-28T13:07:42.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.805+0000 7f4f49bda640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4f440d1cc0 0x7f4f4409b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:42.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.805+0000 7f4f49bda640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f4409bf20 0x7f4f44070290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:42.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.805+0000 7f4f49bda640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f440cf7d0 con 0x7f4f440d18e0 2024-04-28T13:07:42.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.805+0000 7f4f49bda640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f4f440d2130 con 0x7f4f440d1cc0 2024-04-28T13:07:42.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.805+0000 7f4f49bda640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f4f440ce460 con 0x7f4f4409bf20 2024-04-28T13:07:42.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.805+0000 7f4f3affd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4f440d1cc0 0x7f4f4409b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:42.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.805+0000 7f4f3affd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4f440d1cc0 0x7f4f4409b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41252/0 (socket says 172.21.15.114:41252) 2024-04-28T13:07:42.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.805+0000 7f4f3affd640 1 -- 172.21.15.114:0/1380371685 learned_addr learned my addr 172.21.15.114:0/1380371685 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:42.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.806+0000 7f4f43fff640 1 --2- 172.21.15.114:0/1380371685 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f4409bf20 0x7f4f44070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:42.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.806+0000 7f4f3affd640 1 -- 172.21.15.114:0/1380371685 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f4409bf20 msgr2=0x7f4f44070290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:42.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.806+0000 7f4f3affd640 1 --2- 172.21.15.114:0/1380371685 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f4409bf20 0x7f4f44070290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.806+0000 7f4f3affd640 1 -- 172.21.15.114:0/1380371685 >> v1:172.21.15.134:6789/0 conn(0x7f4f440d18e0 legacy=0x7f4f440cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:42.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.806+0000 7f4f3affd640 1 -- 172.21.15.114:0/1380371685 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f440ce730 con 0x7f4f440d1cc0 2024-04-28T13:07:42.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.806+0000 7f4f3affd640 1 --2- 172.21.15.114:0/1380371685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f440d1cc0 0x7f4f4409b9e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c009870 tx=0x7f4f2c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8049aa63c77e7a65 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:42.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.806+0000 7f4f42ffd640 1 -- 172.21.15.114:0/1380371685 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c037070 con 0x7f4f440d1cc0 2024-04-28T13:07:42.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.806+0000 7f4f42ffd640 1 -- 172.21.15.114:0/1380371685 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f2c032440 con 0x7f4f440d1cc0 2024-04-28T13:07:42.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.806+0000 7f4f42ffd640 1 -- 172.21.15.114:0/1380371685 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c032810 con 0x7f4f440d1cc0 2024-04-28T13:07:42.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.807+0000 7f4f49bda640 1 -- 172.21.15.114:0/1380371685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f440d1cc0 msgr2=0x7f4f4409b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:42.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.807+0000 7f4f49bda640 1 --2- 172.21.15.114:0/1380371685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f440d1cc0 0x7f4f4409b9e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c009870 tx=0x7f4f2c02a180 comp rx=0 tx=0).stop 2024-04-28T13:07:42.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.807+0000 7f4f49bda640 1 -- 172.21.15.114:0/1380371685 shutdown_connections 2024-04-28T13:07:42.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.807+0000 7f4f49bda640 1 --2- 172.21.15.114:0/1380371685 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f4409bf20 0x7f4f44070290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.807+0000 7f4f49bda640 1 --2- 172.21.15.114:0/1380371685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f440d1cc0 0x7f4f4409b9e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.807+0000 7f4f49bda640 1 -- 172.21.15.114:0/1380371685 >> 172.21.15.114:0/1380371685 conn(0x7f4f440b4a50 msgr2=0x7f4f440b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:42.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.807+0000 7f4f49bda640 1 -- 172.21.15.114:0/1380371685 shutdown_connections 2024-04-28T13:07:42.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.807+0000 7f4f49bda640 1 -- 172.21.15.114:0/1380371685 wait complete. 2024-04-28T13:07:42.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.808+0000 7f4f49bda640 1 Processor -- start 2024-04-28T13:07:42.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.808+0000 7f4f49bda640 1 -- start start 2024-04-28T13:07:42.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.809+0000 7f4f49bda640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f4409bf20 0x7f4f441f5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:42.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.809+0000 7f4f49bda640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f440d18e0 0x7f4f441f92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:42.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.809+0000 7f4f49bda640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f440d1cc0 0x7f4f4415fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:42.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.809+0000 7f4f49bda640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4f440cefd0 con 0x7f4f4409bf20 2024-04-28T13:07:42.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.809+0000 7f4f49bda640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4f440cecf0 con 0x7f4f440d18e0 2024-04-28T13:07:42.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.809+0000 7f4f49bda640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f4f440707d0 con 0x7f4f440d1cc0 2024-04-28T13:07:42.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.809+0000 7f4f437fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f4409bf20 0x7f4f441f5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:42.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.809+0000 7f4f437fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f4409bf20 0x7f4f441f5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41262/0 (socket says 172.21.15.114:41262) 2024-04-28T13:07:42.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.809+0000 7f4f437fe640 1 -- 172.21.15.114:0/2608873530 learned_addr learned my addr 172.21.15.114:0/2608873530 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:42.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.809+0000 7f4f43fff640 1 --2- 172.21.15.114:0/2608873530 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f440d1cc0 0x7f4f4415fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:42.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.809+0000 7f4f3affd640 1 --2- 172.21.15.114:0/2608873530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f440d18e0 0x7f4f441f92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:42.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.809+0000 7f4f437fe640 1 -- 172.21.15.114:0/2608873530 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f440d1cc0 msgr2=0x7f4f4415fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:42.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.809+0000 7f4f437fe640 1 --2- 172.21.15.114:0/2608873530 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f440d1cc0 0x7f4f4415fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.809+0000 7f4f437fe640 1 -- 172.21.15.114:0/2608873530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f440d18e0 msgr2=0x7f4f441f92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:42.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.809+0000 7f4f437fe640 1 --2- 172.21.15.114:0/2608873530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f440d18e0 0x7f4f441f92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.809+0000 7f4f437fe640 1 -- 172.21.15.114:0/2608873530 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f441f9830 con 0x7f4f4409bf20 2024-04-28T13:07:42.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.809+0000 7f4f43fff640 1 --2- 172.21.15.114:0/2608873530 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f440d1cc0 0x7f4f4415fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:42.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.809+0000 7f4f3affd640 1 --2- 172.21.15.114:0/2608873530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f440d18e0 0x7f4f441f92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:42.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.810+0000 7f4f437fe640 1 --2- 172.21.15.114:0/2608873530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f4409bf20 0x7f4f441f5ee0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400c460 tx=0x7f4f3400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:42.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.810+0000 7f4f40ff9640 1 -- 172.21.15.114:0/2608873530 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f34016020 con 0x7f4f4409bf20 2024-04-28T13:07:42.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.810+0000 7f4f40ff9640 1 -- 172.21.15.114:0/2608873530 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f34012870 con 0x7f4f4409bf20 2024-04-28T13:07:42.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.810+0000 7f4f49bda640 1 -- 172.21.15.114:0/2608873530 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f4415e120 con 0x7f4f4409bf20 2024-04-28T13:07:42.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.810+0000 7f4f40ff9640 1 -- 172.21.15.114:0/2608873530 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f34012c60 con 0x7f4f4409bf20 2024-04-28T13:07:42.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.810+0000 7f4f49bda640 1 -- 172.21.15.114:0/2608873530 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f441f5400 con 0x7f4f4409bf20 2024-04-28T13:07:42.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.811+0000 7f4f40ff9640 1 -- 172.21.15.114:0/2608873530 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4f34019020 con 0x7f4f4409bf20 2024-04-28T13:07:42.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.812+0000 7f4f40ff9640 1 --2- 172.21.15.114:0/2608873530 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f4f2406c8f0 0x7f4f2406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:42.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.812+0000 7f4f3affd640 1 --2- 172.21.15.114:0/2608873530 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f4f2406c8f0 0x7f4f2406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:42.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.812+0000 7f4f40ff9640 1 -- 172.21.15.114:0/2608873530 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4f3408b9c0 con 0x7f4f4409bf20 2024-04-28T13:07:42.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.812+0000 7f4f3affd640 1 --2- 172.21.15.114:0/2608873530 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f4f2406c8f0 0x7f4f2406edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c034000 tx=0x7f4f2c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:42.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.813+0000 7f4f4c9c9740 1 Processor -- start 2024-04-28T13:07:42.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.813+0000 7f4f4c9c9740 1 -- start start 2024-04-28T13:07:42.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.813+0000 7f4f4c9c9740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5582e5a30440 0x5582e5a30820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:42.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.813+0000 7f4f4c9c9740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5582e5a4dce0 0x5582e5a4e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:42.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.813+0000 7f4f4c9c9740 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5582e5a06120 0x5582e5a4c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:42.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.813+0000 7f4f4c9c9740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5582e596a740 con 0x5582e5a4dce0 2024-04-28T13:07:42.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.813+0000 7f4f4c9c9740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5582e59063a0 con 0x5582e5a30440 2024-04-28T13:07:42.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.813+0000 7f4f4c9c9740 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x5582e5966700 con 0x5582e5a06120 2024-04-28T13:07:42.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.814+0000 7f4f3affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5582e5a4dce0 0x5582e5a4e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:42.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.814+0000 7f4f3affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5582e5a4dce0 0x5582e5a4e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41276/0 (socket says 172.21.15.114:41276) 2024-04-28T13:07:42.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.814+0000 7f4f3affd640 1 -- 172.21.15.114:0/4118523517 learned_addr learned my addr 172.21.15.114:0/4118523517 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:42.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.814+0000 7f4f43fff640 1 --2- 172.21.15.114:0/4118523517 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5582e5a06120 0x5582e5a4c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.814+0000 7f4f437fe640 1 --2- 172.21.15.114:0/4118523517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5582e5a30440 0x5582e5a30820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.814+0000 7f4f3affd640 1 -- 172.21.15.114:0/4118523517 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5582e5a06120 msgr2=0x5582e5a4c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.814+0000 7f4f3affd640 1 --2- 172.21.15.114:0/4118523517 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5582e5a06120 0x5582e5a4c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.814+0000 7f4f3affd640 1 -- 172.21.15.114:0/4118523517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5582e5a30440 msgr2=0x5582e5a30820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.814+0000 7f4f3affd640 1 --2- 172.21.15.114:0/4118523517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5582e5a30440 0x5582e5a30820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.814+0000 7f4f3affd640 1 -- 172.21.15.114:0/4118523517 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582e5922750 con 0x5582e5a4dce0 2024-04-28T13:07:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.814+0000 7f4f3affd640 1 --2- 172.21.15.114:0/4118523517 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5582e5a4dce0 0x5582e5a4e230 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c02a1c0 tx=0x7f4f2c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1329d277f0ca93ff server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.814+0000 7f4f397fa640 1 -- 172.21.15.114:0/4118523517 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c04d070 con 0x5582e5a4dce0 2024-04-28T13:07:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.814+0000 7f4f397fa640 1 -- 172.21.15.114:0/4118523517 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f2c048470 con 0x5582e5a4dce0 2024-04-28T13:07:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.814+0000 7f4f397fa640 1 -- 172.21.15.114:0/4118523517 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c037040 con 0x5582e5a4dce0 2024-04-28T13:07:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.815+0000 7f4f4c9c9740 1 -- 172.21.15.114:0/4118523517 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5582e5a4dce0 msgr2=0x5582e5a4e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.815+0000 7f4f4c9c9740 1 --2- 172.21.15.114:0/4118523517 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5582e5a4dce0 0x5582e5a4e230 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c02a1c0 tx=0x7f4f2c02c000 comp rx=0 tx=0).stop 2024-04-28T13:07:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.815+0000 7f4f4c9c9740 1 -- 172.21.15.114:0/4118523517 shutdown_connections 2024-04-28T13:07:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.815+0000 7f4f4c9c9740 1 --2- 172.21.15.114:0/4118523517 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5582e5a06120 0x5582e5a4c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.815+0000 7f4f4c9c9740 1 --2- 172.21.15.114:0/4118523517 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5582e5a4dce0 0x5582e5a4e230 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.815+0000 7f4f4c9c9740 1 --2- 172.21.15.114:0/4118523517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5582e5a30440 0x5582e5a30820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.815+0000 7f4f4c9c9740 1 -- 172.21.15.114:0/4118523517 >> 172.21.15.114:0/4118523517 conn(0x5582e5a02a50 msgr2=0x5582e5a4b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.815+0000 7f4f4c9c9740 1 -- 172.21.15.114:0/4118523517 shutdown_connections 2024-04-28T13:07:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.815+0000 7f4f4c9c9740 1 -- 172.21.15.114:0/4118523517 wait complete. 2024-04-28T13:07:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.815+0000 7f4f4c9c9740 1 -- start start 2024-04-28T13:07:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.816+0000 7f4f4c9c9740 1 Processor -- start 2024-04-28T13:07:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.816+0000 7f4f4c9c9740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5582e5a30440 0x5582e5a32630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.816+0000 7f4f4c9c9740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5582e5a4dce0 0x5582e5a4c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.816+0000 7f4f4c9c9740 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5582e5a50bf0 0x5582e5a32f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.816+0000 7f4f4c9c9740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5582e5a06ec0 con 0x5582e5a30440 2024-04-28T13:07:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.816+0000 7f4f4c9c9740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5582e58f1fe0 con 0x5582e5a4dce0 2024-04-28T13:07:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.816+0000 7f4f4c9c9740 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x5582e5a00980 con 0x5582e5a50bf0 2024-04-28T13:07:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.816+0000 7f4f4c9c9740 10 client.0 _ll_register_callbacks cb 0x5582e5908150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-28T13:07:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.816+0000 7f4f437fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5582e5a30440 0x5582e5a32630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.816+0000 7f4f437fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5582e5a30440 0x5582e5a32630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41282/0 (socket says 172.21.15.114:41282) 2024-04-28T13:07:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.816+0000 7f4f437fe640 1 -- 172.21.15.114:0/3691412432 learned_addr learned my addr 172.21.15.114:0/3691412432 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.816+0000 7f4f43fff640 1 --2- 172.21.15.114:0/3691412432 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5582e5a50bf0 0x5582e5a32f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.817+0000 7f4f3affd640 1 --2- 172.21.15.114:0/3691412432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5582e5a4dce0 0x5582e5a4c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.817+0000 7f4f437fe640 1 -- 172.21.15.114:0/3691412432 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5582e5a50bf0 msgr2=0x5582e5a32f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.817+0000 7f4f437fe640 1 --2- 172.21.15.114:0/3691412432 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5582e5a50bf0 0x5582e5a32f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.817+0000 7f4f437fe640 1 -- 172.21.15.114:0/3691412432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5582e5a4dce0 msgr2=0x5582e5a4c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.817+0000 7f4f437fe640 1 --2- 172.21.15.114:0/3691412432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5582e5a4dce0 0x5582e5a4c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.817+0000 7f4f437fe640 1 -- 172.21.15.114:0/3691412432 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582e567c2d0 con 0x5582e5a30440 2024-04-28T13:07:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.817+0000 7f4f3affd640 1 --2- 172.21.15.114:0/3691412432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5582e5a4dce0 0x5582e5a4c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:07:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.817+0000 7f4f437fe640 1 --2- 172.21.15.114:0/3691412432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5582e5a30440 0x5582e5a32630 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4f34061d00 tx=0x7f4f34059e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abdefa84c8a8f549 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.817+0000 7f4f227fc640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-04-28T13:07:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.817+0000 7f4f227fc640 1 -- 172.21.15.114:0/3691412432 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f34088060 con 0x5582e5a30440 2024-04-28T13:07:42.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.817+0000 7f4f227fc640 1 -- 172.21.15.114:0/3691412432 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4f34003800 con 0x5582e5a30440 2024-04-28T13:07:42.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.817+0000 7f4f4c9c9740 1 -- 172.21.15.114:0/3691412432 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f2c048470 con 0x5582e5a30440 2024-04-28T13:07:42.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.817+0000 7f4f227fc640 1 -- 172.21.15.114:0/3691412432 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f4f34055cc0 con 0x5582e5a30440 2024-04-28T13:07:42.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.817+0000 7f4f4c9c9740 10 client.4707 fetch_fsmap learned FSMap version 6 2024-04-28T13:07:42.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.817+0000 7f4f4c9c9740 1 -- 172.21.15.114:0/3691412432 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x5582e57466b0 con 0x5582e5a30440 2024-04-28T13:07:42.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.817+0000 7f4f227fc640 1 -- 172.21.15.114:0/3691412432 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f2c048470 con 0x5582e5a30440 2024-04-28T13:07:42.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.817+0000 7f4f227fc640 1 -- 172.21.15.114:0/3691412432 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 6) ==== 3494+0+0 (secure 0 0 0) 0x7f4f3405eb90 con 0x5582e5a30440 2024-04-28T13:07:42.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.817+0000 7f4f4c9c9740 10 client.4707 fetch_fsmap finished waiting for FSMap version 6 2024-04-28T13:07:42.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.817+0000 7f4f4c9c9740 10 client.4707 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-28T13:07:42.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.817+0000 7f4f4c9c9740 20 client.4707 populate_metadata read hostname 'smithi114' 2024-04-28T13:07:42.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.817+0000 7f4f4c9c9740 1 --2- 172.21.15.114:0/3691412432 >> [v2:172.21.15.114:6834/888574435,v1:172.21.15.114:6836/888574435] conn(0x5582e5a5eee0 0x5582e5a5f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:42.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.817+0000 7f4f4c9c9740 4 client.4707 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-28T13:07:42.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.817+0000 7f4f4c9c9740 1 -- 172.21.15.114:0/3691412432 --> [v2:172.21.15.114:6834/888574435,v1:172.21.15.114:6836/888574435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582e5978350 con 0x5582e5a5eee0 2024-04-28T13:07:42.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.817+0000 7f4f3affd640 1 --2- 172.21.15.114:0/3691412432 >> [v2:172.21.15.114:6834/888574435,v1:172.21.15.114:6836/888574435] conn(0x5582e5a5eee0 0x5582e5a5f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:42.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.818+0000 7f4f227fc640 10 client.4707 ms_handle_connect on v2:172.21.15.114:6834/888574435 2024-04-28T13:07:42.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.818+0000 7f4f3affd640 1 --2- 172.21.15.114:0/3691412432 >> [v2:172.21.15.114:6834/888574435,v1:172.21.15.114:6836/888574435] conn(0x5582e5a5eee0 0x5582e5a5f2c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fc36eb2302649e server_cookie=3efa8350e59d2c50 in_seq=0 out_seq=0 2024-04-28T13:07:42.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.818+0000 7f4f227fc640 1 -- 172.21.15.114:0/3691412432 <== mds.0 v2:172.21.15.114:6834/888574435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5582e5978350 con 0x5582e5a5eee0 2024-04-28T13:07:42.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.818+0000 7f4f227fc640 10 client.4707 handle_command_reply: tid=0 2024-04-28T13:07:42.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.818+0000 7f4f4c9c9740 1 client.4707 shutdown 2024-04-28T13:07:42.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.818+0000 7f4f4c9c9740 1 -- 172.21.15.114:0/3691412432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5582e5a30440 msgr2=0x5582e5a32630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:42.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.818+0000 7f4f4c9c9740 1 --2- 172.21.15.114:0/3691412432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5582e5a30440 0x5582e5a32630 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4f34061d00 tx=0x7f4f34059e90 comp rx=0 tx=0).stop 2024-04-28T13:07:42.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.818+0000 7f4f4c9c9740 1 -- 172.21.15.114:0/3691412432 shutdown_connections 2024-04-28T13:07:42.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.818+0000 7f4f4c9c9740 1 --2- 172.21.15.114:0/3691412432 >> [v2:172.21.15.114:6834/888574435,v1:172.21.15.114:6836/888574435] conn(0x5582e5a5eee0 0x5582e5a5f2c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.818+0000 7f4f4c9c9740 1 --2- 172.21.15.114:0/3691412432 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5582e5a50bf0 0x5582e5a32f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.818+0000 7f4f4c9c9740 1 --2- 172.21.15.114:0/3691412432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5582e5a4dce0 0x5582e5a4c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.818+0000 7f4f227fc640 0 client.4707 ms_handle_reset on v2:172.21.15.114:6834/888574435 2024-04-28T13:07:42.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.818+0000 7f4f4c9c9740 1 --2- 172.21.15.114:0/3691412432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5582e5a30440 0x5582e5a32630 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.818+0000 7f4f4c9c9740 1 -- 172.21.15.114:0/3691412432 >> 172.21.15.114:0/3691412432 conn(0x5582e5a06120 msgr2=0x5582e5a4e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:42.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.819+0000 7f4f4c9c9740 1 -- 172.21.15.114:0/3691412432 shutdown_connections 2024-04-28T13:07:42.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.819+0000 7f4f4c9c9740 1 -- 172.21.15.114:0/3691412432 wait complete. 2024-04-28T13:07:42.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.819+0000 7f4f4c9c9740 20 client.4707 trim_cache size 0 max 16384 2024-04-28T13:07:42.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.836+0000 7f4f4c9c9740 1 Processor -- start 2024-04-28T13:07:42.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.836+0000 7f4f4c9c9740 1 -- start start 2024-04-28T13:07:42.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.837+0000 7f4f4c9c9740 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5582e5a30440 0x5582e59fc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:42.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.837+0000 7f4f4c9c9740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5582e5a4dce0 0x5582e5a4b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:42.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.837+0000 7f4f4c9c9740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5582e5a50bf0 0x5582e5abc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:42.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.837+0000 7f4f4c9c9740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4415f4b0 con 0x5582e5a4dce0 2024-04-28T13:07:42.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.837+0000 7f4f4c9c9740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4415e810 con 0x5582e5a50bf0 2024-04-28T13:07:42.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.837+0000 7f4f4c9c9740 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f4f4415ee60 con 0x5582e5a30440 2024-04-28T13:07:42.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.837+0000 7f4f3affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5582e5a4dce0 0x5582e5a4b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:42.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.837+0000 7f4f3affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5582e5a4dce0 0x5582e5a4b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41292/0 (socket says 172.21.15.114:41292) 2024-04-28T13:07:42.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.837+0000 7f4f3affd640 1 -- 172.21.15.114:0/3751383205 learned_addr learned my addr 172.21.15.114:0/3751383205 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:42.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.837+0000 7f4f3affd640 1 -- 172.21.15.114:0/3751383205 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5582e5a30440 msgr2=0x5582e59fc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:42.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.837+0000 7f4f3affd640 1 --2- 172.21.15.114:0/3751383205 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5582e5a30440 0x5582e59fc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.837+0000 7f4f3affd640 1 -- 172.21.15.114:0/3751383205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5582e5a50bf0 msgr2=0x5582e5abc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:42.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.837+0000 7f4f3affd640 1 --2- 172.21.15.114:0/3751383205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5582e5a50bf0 0x5582e5abc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.837+0000 7f4f3affd640 1 -- 172.21.15.114:0/3751383205 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582e5a01f10 con 0x5582e5a4dce0 2024-04-28T13:07:42.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.837+0000 7f4f3affd640 1 --2- 172.21.15.114:0/3751383205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5582e5a4dce0 0x5582e5a4b4c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c02a770 tx=0x7f4f2c03b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc3ba31d6ddd7e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:42.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.838+0000 7f4f38ff9640 1 -- 172.21.15.114:0/3751383205 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c04d040 con 0x5582e5a4dce0 2024-04-28T13:07:42.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.838+0000 7f4f38ff9640 1 -- 172.21.15.114:0/3751383205 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f2c04f040 con 0x5582e5a4dce0 2024-04-28T13:07:42.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.838+0000 7f4f38ff9640 1 -- 172.21.15.114:0/3751383205 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c037040 con 0x5582e5a4dce0 2024-04-28T13:07:42.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.838+0000 7f4f4c9c9740 1 -- 172.21.15.114:0/3751383205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5582e5a4dce0 msgr2=0x5582e5a4b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:42.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.838+0000 7f4f4c9c9740 1 --2- 172.21.15.114:0/3751383205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5582e5a4dce0 0x5582e5a4b4c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c02a770 tx=0x7f4f2c03b000 comp rx=0 tx=0).stop 2024-04-28T13:07:42.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.838+0000 7f4f4c9c9740 1 -- 172.21.15.114:0/3751383205 shutdown_connections 2024-04-28T13:07:42.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.838+0000 7f4f4c9c9740 1 --2- 172.21.15.114:0/3751383205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5582e5a50bf0 0x5582e5abc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.838+0000 7f4f4c9c9740 1 --2- 172.21.15.114:0/3751383205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5582e5a4dce0 0x5582e5a4b4c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.838+0000 7f4f4c9c9740 1 --2- 172.21.15.114:0/3751383205 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5582e5a30440 0x5582e59fc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.838+0000 7f4f4c9c9740 1 -- 172.21.15.114:0/3751383205 >> 172.21.15.114:0/3751383205 conn(0x5582e5a06120 msgr2=0x5582e5a06500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:42.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.838+0000 7f4f4c9c9740 1 -- 172.21.15.114:0/3751383205 shutdown_connections 2024-04-28T13:07:42.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.838+0000 7f4f4c9c9740 1 -- 172.21.15.114:0/3751383205 wait complete. 2024-04-28T13:07:42.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.839+0000 7f4f4c9c9740 1 -- start start 2024-04-28T13:07:42.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.839+0000 7f4f4c9c9740 1 Processor -- start 2024-04-28T13:07:42.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.840+0000 7f4f4c9c9740 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5582e5a30440 0x5582e5a51bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:42.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.840+0000 7f4f4c9c9740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5582e5a4dce0 0x5582e5a4e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:42.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.840+0000 7f4f4c9c9740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5582e5a50bf0 0x5582e5a4eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:42.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.840+0000 7f4f4c9c9740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5582e5a33450 con 0x5582e5a4dce0 2024-04-28T13:07:42.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.840+0000 7f4f4c9c9740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5582e5a31e90 con 0x5582e5a50bf0 2024-04-28T13:07:42.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.840+0000 7f4f4c9c9740 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x5582e5a1b810 con 0x5582e5a30440 2024-04-28T13:07:42.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.840+0000 7f4f4c9c9740 10 client.0 _ll_register_callbacks cb 0x7f4f340594a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-28T13:07:42.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.840+0000 7f4f3affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5582e5a4dce0 0x5582e5a4e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:42.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.840+0000 7f4f3affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5582e5a4dce0 0x5582e5a4e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41302/0 (socket says 172.21.15.114:41302) 2024-04-28T13:07:42.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.840+0000 7f4f3affd640 1 -- 172.21.15.114:0/4250735239 learned_addr learned my addr 172.21.15.114:0/4250735239 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:42.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.840+0000 7f4f3affd640 1 -- 172.21.15.114:0/4250735239 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5582e5a30440 msgr2=0x5582e5a51bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:42.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.840+0000 7f4f3affd640 1 --2- 172.21.15.114:0/4250735239 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5582e5a30440 0x5582e5a51bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.840+0000 7f4f3affd640 1 -- 172.21.15.114:0/4250735239 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5582e5a50bf0 msgr2=0x5582e5a4eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:42.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.840+0000 7f4f3affd640 1 --2- 172.21.15.114:0/4250735239 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5582e5a50bf0 0x5582e5a4eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.840+0000 7f4f3affd640 1 -- 172.21.15.114:0/4250735239 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582e5a520f0 con 0x5582e5a4dce0 2024-04-28T13:07:42.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.840+0000 7f4f3affd640 1 --2- 172.21.15.114:0/4250735239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5582e5a4dce0 0x5582e5a4e190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c000c00 tx=0x7f4f2c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d0f8454d7341f08 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:42.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.840+0000 7f4f227fc640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-04-28T13:07:42.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.840+0000 7f4f227fc640 1 -- 172.21.15.114:0/4250735239 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c05a060 con 0x5582e5a4dce0 2024-04-28T13:07:42.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.840+0000 7f4f4c9c9740 1 -- 172.21.15.114:0/4250735239 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f2c04f040 con 0x5582e5a4dce0 2024-04-28T13:07:42.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.840+0000 7f4f227fc640 1 -- 172.21.15.114:0/4250735239 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4f2c048a00 con 0x5582e5a4dce0 2024-04-28T13:07:42.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.840+0000 7f4f227fc640 1 -- 172.21.15.114:0/4250735239 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f4f2c060050 con 0x5582e5a4dce0 2024-04-28T13:07:42.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.840+0000 7f4f4c9c9740 10 client.4713 fetch_fsmap learned FSMap version 6 2024-04-28T13:07:42.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.840+0000 7f4f4c9c9740 1 -- 172.21.15.114:0/4250735239 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x5582e5abafd0 con 0x5582e5a4dce0 2024-04-28T13:07:42.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.840+0000 7f4f227fc640 1 -- 172.21.15.114:0/4250735239 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f2c04f040 con 0x5582e5a4dce0 2024-04-28T13:07:42.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.841+0000 7f4f227fc640 1 -- 172.21.15.114:0/4250735239 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 6) ==== 3494+0+0 (secure 0 0 0) 0x7f4f2c063020 con 0x5582e5a4dce0 2024-04-28T13:07:42.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.841+0000 7f4f4c9c9740 10 client.4713 fetch_fsmap finished waiting for FSMap version 6 2024-04-28T13:07:42.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.841+0000 7f4f4c9c9740 10 client.4713 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-28T13:07:42.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.841+0000 7f4f4c9c9740 20 client.4713 populate_metadata read hostname 'smithi114' 2024-04-28T13:07:42.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.841+0000 7f4f4c9c9740 1 --2- 172.21.15.114:0/4250735239 >> [v2:172.21.15.114:6834/888574435,v1:172.21.15.114:6836/888574435] conn(0x5582e5aba2e0 0x5582e5aba6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:42.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.841+0000 7f4f4c9c9740 4 client.4713 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-28T13:07:42.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.841+0000 7f4f4c9c9740 1 -- 172.21.15.114:0/4250735239 --> [v2:172.21.15.114:6834/888574435,v1:172.21.15.114:6836/888574435] -- command(tid 0: {"prefix": "status"}) -- 0x5582e59721c0 con 0x5582e5aba2e0 2024-04-28T13:07:42.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.841+0000 7f4f437fe640 1 --2- 172.21.15.114:0/4250735239 >> [v2:172.21.15.114:6834/888574435,v1:172.21.15.114:6836/888574435] conn(0x5582e5aba2e0 0x5582e5aba6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:42.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.841+0000 7f4f227fc640 10 client.4713 ms_handle_connect on v2:172.21.15.114:6834/888574435 2024-04-28T13:07:42.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.841+0000 7f4f437fe640 1 --2- 172.21.15.114:0/4250735239 >> [v2:172.21.15.114:6834/888574435,v1:172.21.15.114:6836/888574435] conn(0x5582e5aba2e0 0x5582e5aba6c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89c7707862368534 server_cookie=9b55d9935529ca04 in_seq=0 out_seq=0 2024-04-28T13:07:42.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.841+0000 7f4f227fc640 1 -- 172.21.15.114:0/4250735239 <== mds.0 v2:172.21.15.114:6834/888574435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x5582e59721c0 con 0x5582e5aba2e0 2024-04-28T13:07:42.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.841+0000 7f4f227fc640 10 client.4713 handle_command_reply: tid=0 2024-04-28T13:07:42.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.841+0000 7f4f4c9c9740 1 client.4713 shutdown 2024-04-28T13:07:42.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.841+0000 7f4f4c9c9740 1 -- 172.21.15.114:0/4250735239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5582e5a4dce0 msgr2=0x5582e5a4e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:42.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.841+0000 7f4f4c9c9740 1 --2- 172.21.15.114:0/4250735239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5582e5a4dce0 0x5582e5a4e190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c000c00 tx=0x7f4f2c004730 comp rx=0 tx=0).stop 2024-04-28T13:07:42.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.841+0000 7f4f4c9c9740 1 -- 172.21.15.114:0/4250735239 shutdown_connections 2024-04-28T13:07:42.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.841+0000 7f4f4c9c9740 1 --2- 172.21.15.114:0/4250735239 >> [v2:172.21.15.114:6834/888574435,v1:172.21.15.114:6836/888574435] conn(0x5582e5aba2e0 0x5582e5aba6c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.841+0000 7f4f4c9c9740 1 --2- 172.21.15.114:0/4250735239 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5582e5a50bf0 0x5582e5a4eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.841+0000 7f4f4c9c9740 1 --2- 172.21.15.114:0/4250735239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5582e5a4dce0 0x5582e5a4e190 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.841+0000 7f4f227fc640 0 client.4713 ms_handle_reset on v2:172.21.15.114:6834/888574435 2024-04-28T13:07:42.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.841+0000 7f4f4c9c9740 1 --2- 172.21.15.114:0/4250735239 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5582e5a30440 0x5582e5a51bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.841+0000 7f4f4c9c9740 1 -- 172.21.15.114:0/4250735239 >> 172.21.15.114:0/4250735239 conn(0x5582e5a06120 msgr2=0x5582e5a32010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:42.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.841+0000 7f4f4c9c9740 1 -- 172.21.15.114:0/4250735239 shutdown_connections 2024-04-28T13:07:42.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.841+0000 7f4f4c9c9740 1 -- 172.21.15.114:0/4250735239 wait complete. 2024-04-28T13:07:42.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.842+0000 7f4f4c9c9740 20 client.4713 trim_cache size 0 max 16384 2024-04-28T13:07:42.847 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-04-28T13:07:42.847 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "0961cca0-69c8-4b26-b89a-621e12152fc4", 2024-04-28T13:07:42.847 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2024-04-28T13:07:42.848 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4284, 2024-04-28T13:07:42.848 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2024-04-28T13:07:42.848 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2024-04-28T13:07:42.848 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2024-04-28T13:07:42.848 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 16.556069986000001, 2024-04-28T13:07:42.848 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 6, 2024-04-28T13:07:42.848 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 21, 2024-04-28T13:07:42.848 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 21, 2024-04-28T13:07:42.848 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 23.586357025000002 2024-04-28T13:07:42.848 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-04-28T13:07:42.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.842+0000 7f4f49bda640 1 -- 172.21.15.114:0/2608873530 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f4f2406c8f0 msgr2=0x7f4f2406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:42.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.842+0000 7f4f49bda640 1 --2- 172.21.15.114:0/2608873530 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f4f2406c8f0 0x7f4f2406edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c034000 tx=0x7f4f2c02e000 comp rx=0 tx=0).stop 2024-04-28T13:07:42.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.842+0000 7f4f49bda640 1 -- 172.21.15.114:0/2608873530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f4409bf20 msgr2=0x7f4f441f5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:42.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.842+0000 7f4f49bda640 1 --2- 172.21.15.114:0/2608873530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f4409bf20 0x7f4f441f5ee0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400c460 tx=0x7f4f3400c920 comp rx=0 tx=0).stop 2024-04-28T13:07:42.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.842+0000 7f4f49bda640 1 -- 172.21.15.114:0/2608873530 shutdown_connections 2024-04-28T13:07:42.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.842+0000 7f4f49bda640 1 --2- 172.21.15.114:0/2608873530 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f440d1cc0 0x7f4f4415fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.842+0000 7f4f49bda640 1 --2- 172.21.15.114:0/2608873530 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f4f2406c8f0 0x7f4f2406edb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.842+0000 7f4f49bda640 1 --2- 172.21.15.114:0/2608873530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f440d18e0 0x7f4f441f92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.842+0000 7f4f49bda640 1 --2- 172.21.15.114:0/2608873530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f4409bf20 0x7f4f441f5ee0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:42.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.842+0000 7f4f49bda640 1 -- 172.21.15.114:0/2608873530 >> 172.21.15.114:0/2608873530 conn(0x7f4f440b4a50 msgr2=0x7f4f440d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:42.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.842+0000 7f4f49bda640 1 -- 172.21.15.114:0/2608873530 shutdown_connections 2024-04-28T13:07:42.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:42.842+0000 7f4f49bda640 1 -- 172.21.15.114:0/2608873530 wait complete. 2024-04-28T13:07:42.852 INFO:teuthology.run_tasks:Running task sequential... 2024-04-28T13:07:42.863 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-28T13:07:42.863 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-28T13:07:42.863 INFO:teuthology.task.print:Enabling mgr modules 2024-04-28T13:07:42.863 INFO:teuthology.run_tasks:Running task kclient... 2024-04-28T13:07:42.889 INFO:tasks.kclient:Mounting kernel clients... 2024-04-28T13:07:42.889 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-28T13:07:42.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:42.890 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-04-28T13:07:42.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:42.905 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2024-04-28T13:07:42.971 INFO:teuthology.orchestra.run.smithi114.stderr:Cannot find device "ceph-brx" 2024-04-28T13:07:42.972 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-28T13:07:42.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:42.973 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-04-28T13:07:43.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:43.028 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2024-04-28T13:07:43.092 INFO:teuthology.orchestra.run.smithi114.stderr:Cannot find device "ceph-brx" 2024-04-28T13:07:43.093 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-28T13:07:43.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:43.094 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-04-28T13:07:43.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:43.112 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link delete ceph-brx 2024-04-28T13:07:43.182 INFO:teuthology.orchestra.run.smithi134.stderr:Cannot find device "ceph-brx" 2024-04-28T13:07:43.184 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-28T13:07:43.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:43.185 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-04-28T13:07:43.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:43.242 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link delete ceph-brx 2024-04-28T13:07:43.308 INFO:teuthology.orchestra.run.smithi134.stderr:Cannot find device "ceph-brx" 2024-04-28T13:07:43.310 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-28T13:07:43.310 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-04-28T13:07:43.310 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-28T13:07:43.310 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-28T13:07:43.311 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-28T13:07:43.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.408+0000 7f53791c6640 1 Processor -- start 2024-04-28T13:07:43.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.408+0000 7f53791c6640 1 -- start start 2024-04-28T13:07:43.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.408+0000 7f53791c6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f537415f7a0 0x7f537406d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:43.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.408+0000 7f53791c6640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53740af6b0 con 0x7f537406d8a0 2024-04-28T13:07:43.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.408+0000 7f53791c6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f537406f150 con 0x7f5374159990 2024-04-28T13:07:43.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.408+0000 7f53791c6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f537406dcd0 con 0x7f537415f7a0 2024-04-28T13:07:43.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.409+0000 7f537359e640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f537406d8a0 0x7f53740afb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44894/0 (socket says 172.21.15.114:44894) 2024-04-28T13:07:43.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.409+0000 7f537359e640 1 -- 172.21.15.114:0/4229592527 learned_addr learned my addr 172.21.15.114:0/4229592527 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:43.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.409+0000 7f537259c640 1 --2- 172.21.15.114:0/4229592527 >> v2:172.21.15.134:3300/0 conn(0x7f537415f7a0 0x7f537406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:43.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.409+0000 7f5371d9b640 1 -- 172.21.15.114:0/4229592527 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4009892605 0 0) 0x7f536c001490 con 0x7f537406d8a0 2024-04-28T13:07:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.409+0000 7f5371d9b640 1 -- 172.21.15.114:0/4229592527 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f535c003520 con 0x7f537406d8a0 2024-04-28T13:07:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.409+0000 7f5371d9b640 1 -- 172.21.15.114:0/4229592527 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3008044494 0 0) 0x7f535c003520 con 0x7f537406d8a0 2024-04-28T13:07:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.409+0000 7f5371d9b640 1 -- 172.21.15.114:0/4229592527 >> v2:172.21.15.134:3300/0 conn(0x7f537415f7a0 msgr2=0x7f537406d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.409+0000 7f5371d9b640 1 --2- 172.21.15.114:0/4229592527 >> v2:172.21.15.134:3300/0 conn(0x7f537415f7a0 0x7f537406d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.409+0000 7f5371d9b640 1 -- 172.21.15.114:0/4229592527 >> v1:172.21.15.134:6789/0 conn(0x7f5374159990 legacy=0x7f537406e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.409+0000 7f5371d9b640 1 -- 172.21.15.114:0/4229592527 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f537406f430 con 0x7f537406d8a0 2024-04-28T13:07:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.409+0000 7f5371d9b640 1 -- 172.21.15.114:0/4229592527 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f536c001bc0 con 0x7f537406d8a0 2024-04-28T13:07:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.409+0000 7f5371d9b640 1 -- 172.21.15.114:0/4229592527 >> v1:172.21.15.114:6789/0 conn(0x7f537406d8a0 legacy=0x7f53740afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.409+0000 7f5371d9b640 1 --2- 172.21.15.114:0/4229592527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f535c0039b0 0x7f535c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.409+0000 7f5371d9b640 1 --2- 172.21.15.114:0/4229592527 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f535c0043b0 0x7f535c004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.409+0000 7f5371d9b640 1 --2- 172.21.15.114:0/4229592527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f535c005080 0x7f535c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.409+0000 7f5371d9b640 1 -- 172.21.15.114:0/4229592527 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f537406dcd0 con 0x7f535c005080 2024-04-28T13:07:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.409+0000 7f5371d9b640 1 -- 172.21.15.114:0/4229592527 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f535c00bfe0 con 0x7f535c0039b0 2024-04-28T13:07:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.409+0000 7f5371d9b640 1 -- 172.21.15.114:0/4229592527 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f535c00c1e0 con 0x7f535c0043b0 2024-04-28T13:07:43.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.409+0000 7f537359e640 1 --2- 172.21.15.114:0/4229592527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f535c005080 0x7f535c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:43.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.409+0000 7f5372d9d640 1 --2- 172.21.15.114:0/4229592527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f535c0039b0 0x7f535c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:43.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.409+0000 7f537259c640 1 --2- 172.21.15.114:0/4229592527 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f535c0043b0 0x7f535c004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:43.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.409+0000 7f537359e640 1 -- 172.21.15.114:0/4229592527 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f535c0043b0 msgr2=0x7f535c004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:43.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.409+0000 7f537359e640 1 --2- 172.21.15.114:0/4229592527 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f535c0043b0 0x7f535c004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:43.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.409+0000 7f537359e640 1 -- 172.21.15.114:0/4229592527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f535c0039b0 msgr2=0x7f535c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:43.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.409+0000 7f537359e640 1 --2- 172.21.15.114:0/4229592527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f535c0039b0 0x7f535c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:43.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.409+0000 7f537359e640 1 -- 172.21.15.114:0/4229592527 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f535c003520 con 0x7f535c005080 2024-04-28T13:07:43.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.410+0000 7f537359e640 1 -- 172.21.15.114:0/4229592527 reap_dead start 2024-04-28T13:07:43.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.410+0000 7f537359e640 1 --2- 172.21.15.114:0/4229592527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f535c005080 0x7f535c00b9c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f536c00aa70 tx=0x7f535c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa0949df07b979b server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:43.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.410+0000 7f5371d9b640 1 -- 172.21.15.114:0/4229592527 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536c00a690 con 0x7f535c005080 2024-04-28T13:07:43.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.410+0000 7f5371d9b640 1 -- 172.21.15.114:0/4229592527 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f536c02f070 con 0x7f535c005080 2024-04-28T13:07:43.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.410+0000 7f5371d9b640 1 -- 172.21.15.114:0/4229592527 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536c034470 con 0x7f535c005080 2024-04-28T13:07:43.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.411+0000 7f53791c6640 1 -- 172.21.15.114:0/4229592527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f535c005080 msgr2=0x7f535c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:43.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.411+0000 7f53791c6640 1 --2- 172.21.15.114:0/4229592527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f535c005080 0x7f535c00b9c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f536c00aa70 tx=0x7f535c005830 comp rx=0 tx=0).stop 2024-04-28T13:07:43.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.411+0000 7f53791c6640 1 -- 172.21.15.114:0/4229592527 shutdown_connections 2024-04-28T13:07:43.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.411+0000 7f53791c6640 1 --2- 172.21.15.114:0/4229592527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f535c005080 0x7f535c00b9c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:43.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.411+0000 7f53791c6640 1 -- 172.21.15.114:0/4229592527 >> 172.21.15.114:0/4229592527 conn(0x7f5374072a60 msgr2=0x7f5374072e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:43.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.411+0000 7f53791c6640 1 -- 172.21.15.114:0/4229592527 shutdown_connections 2024-04-28T13:07:43.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.411+0000 7f53791c6640 1 -- 172.21.15.114:0/4229592527 wait complete. 2024-04-28T13:07:43.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.412+0000 7f53791c6640 1 Processor -- start 2024-04-28T13:07:43.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.412+0000 7f53791c6640 1 -- start start 2024-04-28T13:07:43.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.413+0000 7f53791c6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f535c005080 0x7f53740d0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:43.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.413+0000 7f53791c6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f537415a9c0 0x7f5374154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:43.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.413+0000 7f53791c6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5374159d70 0x7f537415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:43.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.413+0000 7f53791c6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f537406d360 con 0x7f5374159d70 2024-04-28T13:07:43.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.413+0000 7f53791c6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f537406f9f0 con 0x7f537415a9c0 2024-04-28T13:07:43.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.413+0000 7f53791c6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f537406d4e0 con 0x7f535c005080 2024-04-28T13:07:43.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.413+0000 7f537359e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5374159d70 0x7f537415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:43.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.413+0000 7f537359e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5374159d70 0x7f537415a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41318/0 (socket says 172.21.15.114:41318) 2024-04-28T13:07:43.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.413+0000 7f537359e640 1 -- 172.21.15.114:0/1730616778 learned_addr learned my addr 172.21.15.114:0/1730616778 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:43.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.413+0000 7f5372d9d640 1 --2- 172.21.15.114:0/1730616778 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f535c005080 0x7f53740d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:43.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.413+0000 7f537259c640 1 --2- 172.21.15.114:0/1730616778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f537415a9c0 0x7f5374154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:43.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.413+0000 7f537359e640 1 -- 172.21.15.114:0/1730616778 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f535c005080 msgr2=0x7f53740d0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:43.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.413+0000 7f537359e640 1 --2- 172.21.15.114:0/1730616778 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f535c005080 0x7f53740d0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:43.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.413+0000 7f537359e640 1 -- 172.21.15.114:0/1730616778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f537415a9c0 msgr2=0x7f5374154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:43.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.413+0000 7f537359e640 1 --2- 172.21.15.114:0/1730616778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f537415a9c0 0x7f5374154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:43.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.413+0000 7f537359e640 1 -- 172.21.15.114:0/1730616778 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f537415b130 con 0x7f5374159d70 2024-04-28T13:07:43.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.413+0000 7f5372d9d640 1 --2- 172.21.15.114:0/1730616778 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f535c005080 0x7f53740d0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:43.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.413+0000 7f537259c640 1 --2- 172.21.15.114:0/1730616778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f537415a9c0 0x7f5374154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:43.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.413+0000 7f537359e640 1 --2- 172.21.15.114:0/1730616778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5374159d70 0x7f537415a1f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f536c0012e0 tx=0x7f536c001f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:43.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.414+0000 7f535b7fe640 1 -- 172.21.15.114:0/1730616778 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536c00a690 con 0x7f5374159d70 2024-04-28T13:07:43.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.414+0000 7f535b7fe640 1 -- 172.21.15.114:0/1730616778 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f536c001490 con 0x7f5374159d70 2024-04-28T13:07:43.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.414+0000 7f53791c6640 1 -- 172.21.15.114:0/1730616778 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f537415b410 con 0x7f5374159d70 2024-04-28T13:07:43.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.414+0000 7f535b7fe640 1 -- 172.21.15.114:0/1730616778 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536c034470 con 0x7f5374159d70 2024-04-28T13:07:43.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.414+0000 7f53791c6640 1 -- 172.21.15.114:0/1730616778 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53740b4dc0 con 0x7f5374159d70 2024-04-28T13:07:43.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.415+0000 7f53791c6640 1 -- 172.21.15.114:0/1730616778 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f537406a3d0 con 0x7f5374159d70 2024-04-28T13:07:43.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.415+0000 7f535b7fe640 1 -- 172.21.15.114:0/1730616778 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f536c034610 con 0x7f5374159d70 2024-04-28T13:07:43.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.415+0000 7f535b7fe640 1 --2- 172.21.15.114:0/1730616778 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f536006c8f0 0x7f536006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:43.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.416+0000 7f535b7fe640 1 -- 172.21.15.114:0/1730616778 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f536c0abc80 con 0x7f5374159d70 2024-04-28T13:07:43.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.416+0000 7f5372d9d640 1 --2- 172.21.15.114:0/1730616778 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f536006c8f0 0x7f536006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:43.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.416+0000 7f5372d9d640 1 --2- 172.21.15.114:0/1730616778 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f536006c8f0 0x7f536006edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5368003640 tx=0x7f5368009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:43.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.420+0000 7f535b7fe640 1 -- 172.21.15.114:0/1730616778 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f53740af6b0 con 0x7f5374159d70 2024-04-28T13:07:43.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.631+0000 7f53791c6640 1 -- 172.21.15.114:0/1730616778 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5374160df0 con 0x7f5374159d70 2024-04-28T13:07:43.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.632+0000 7f535b7fe640 1 -- 172.21.15.114:0/1730616778 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f536c07a0b0 con 0x7f5374159d70 2024-04-28T13:07:43.632 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-28T13:07:43.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.634+0000 7f53791c6640 1 -- 172.21.15.114:0/1730616778 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f536006c8f0 msgr2=0x7f536006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:43.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.634+0000 7f53791c6640 1 --2- 172.21.15.114:0/1730616778 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f536006c8f0 0x7f536006edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5368003640 tx=0x7f5368009040 comp rx=0 tx=0).stop 2024-04-28T13:07:43.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.634+0000 7f53791c6640 1 -- 172.21.15.114:0/1730616778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5374159d70 msgr2=0x7f537415a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:43.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.634+0000 7f53791c6640 1 --2- 172.21.15.114:0/1730616778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5374159d70 0x7f537415a1f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f536c0012e0 tx=0x7f536c001f90 comp rx=0 tx=0).stop 2024-04-28T13:07:43.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.634+0000 7f53791c6640 1 -- 172.21.15.114:0/1730616778 shutdown_connections 2024-04-28T13:07:43.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.634+0000 7f53791c6640 1 --2- 172.21.15.114:0/1730616778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5374159d70 0x7f537415a1f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:43.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.634+0000 7f53791c6640 1 --2- 172.21.15.114:0/1730616778 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f536006c8f0 0x7f536006edb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:43.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.634+0000 7f53791c6640 1 --2- 172.21.15.114:0/1730616778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f537415a9c0 0x7f5374154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:43.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.634+0000 7f53791c6640 1 --2- 172.21.15.114:0/1730616778 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f535c005080 0x7f53740d0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:43.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.634+0000 7f53791c6640 1 -- 172.21.15.114:0/1730616778 >> 172.21.15.114:0/1730616778 conn(0x7f5374072a60 msgr2=0x7f5374161010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:43.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.634+0000 7f53791c6640 1 -- 172.21.15.114:0/1730616778 shutdown_connections 2024-04-28T13:07:43.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43.634+0000 7f53791c6640 1 -- 172.21.15.114:0/1730616778 wait complete. 2024-04-28T13:07:43.645 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-28T13:07:43.645 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-28T13:07:43.645 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-04-28T13:07:43.645 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-28T13:07:43.645 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-28T13:07:43.645 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-28T13:07:43.645 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-28T13:07:43.645 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-28T13:07:43.646 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-28T13:07:43.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:43.646 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-04-28T13:07:43.660 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-28T13:07:43.661 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-28T13:07:43.661 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-04-28T13:07:43.661 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:43.661 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-04-28T13:07:43.661 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:43.661 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-28T13:07:43.661 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:07:43.661 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-04-28T13:07:43.661 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-28T13:07:43.661 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:07:43.661 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-04-28T13:07:43.661 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-28T13:07:43.661 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:07:43.662 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-28T13:07:43.662 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:07:43.662 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-28T13:07:43.662 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42749sec preferred_lft 42749sec 2024-04-28T13:07:43.662 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::cd74:6bbf:5a:b4fa/64 scope link noprefixroute 2024-04-28T13:07:43.662 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:43.662 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-28T13:07:43.662 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-28T13:07:43.663 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-04-28T13:07:43.663 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add name ceph-brx type bridge 2024-04-28T13:07:43.663 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr flush dev ceph-brx 2024-04-28T13:07:43.663 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set ceph-brx up 2024-04-28T13:07:43.663 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-28T13:07:43.663 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-04-28T13:07:43.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-28T13:07:43.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:43.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:43.838 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-28T13:07:43.861 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-04-28T13:07:43.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:43.863 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-04-28T13:07:43.928 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-04-28T13:07:43.928 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-28T13:07:43.928 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-28T13:07:43.928 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-28T13:07:43.928 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-28T13:07:43.928 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-28T13:07:43.928 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-04-28T13:07:43.928 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-28T13:07:43.929 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-28T13:07:43.929 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-28T13:07:43.929 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-04-28T13:07:44.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-28T13:07:44.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:44.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:44.183 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-04-28T13:07:44.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:44.198 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list-id 2024-04-28T13:07:44.254 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-28T13:07:44.254 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-04-28T13:07:44.254 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-28T13:07:44.254 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-28T13:07:44.254 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-04-28T13:07:44.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-28T13:07:44.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:44.371 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-28T13:07:44.372 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-28T13:07:44.372 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-04-28T13:07:44.372 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-28T13:07:44.372 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-28T13:07:44.372 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-28T13:07:44.372 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-28T13:07:44.372 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-28T13:07:44.372 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-04-28T13:07:44.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-28T13:07:44.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:44.509 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-28T13:07:44.509 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-04-28T13:07:44.509 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-04-28T13:07:44.509 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set dev brx.0 master ceph-brx 2024-04-28T13:07:44.510 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-04-28T13:07:44.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-28T13:07:44.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:44.586 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-28T13:07:44.586 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-28T13:07:44.600 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-28T13:07:44.601 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-28T13:07:44.601 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-28T13:07:44.655 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-28T13:07:44.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:44.656 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-28T13:07:44.743 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-28T13:07:44.743 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-28T13:07:44.743 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-04-28T13:07:44.846 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-28T13:07:44.846 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-28T13:07:44.846 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-04-28T13:07:44.846 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.134:3300,172.21.15.134:3301" 2024-04-28T13:07:44.846 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-28T13:07:44.851 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-28T13:07:44.851 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-28T13:07:44.851 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-04-28T13:07:44.851 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.134:3300,172.21.15.134:3301" 2024-04-28T13:07:44.851 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-28T13:07:44.851 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.134:6789,172.21.15.134:6790" 2024-04-28T13:07:44.851 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.134:6789,172.21.15.134:6790:/ 2024-04-28T13:07:44.852 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=0961cca0-69c8-4b26-b89a-621e12152fc4" will pass to kernel 2024-04-28T13:07:44.852 INFO:teuthology.orchestra.run.smithi114.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-28T13:07:44.853 INFO:teuthology.orchestra.run.smithi114.stdout: You just mounted a file system that supports labels which does not 2024-04-28T13:07:44.853 INFO:teuthology.orchestra.run.smithi114.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-28T13:07:44.853 INFO:teuthology.orchestra.run.smithi114.stdout: applications will generate AVC messages and not be allowed access to 2024-04-28T13:07:44.853 INFO:teuthology.orchestra.run.smithi114.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-28T13:07:44.854 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-28T13:07:44.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:44.855 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-28T13:07:44.878 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-28T13:07:44.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-28T13:07:44.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:44.978 INFO:teuthology.orchestra.run.smithi114.stdout:client4484 2024-04-28T13:07:44.978 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:07:44.978 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-28T13:07:44.993 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-28T13:07:45.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-28T13:07:45.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:45.101 INFO:teuthology.orchestra.run.smithi114.stdout:client4484 2024-04-28T13:07:45.101 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-28T13:07:45.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-28T13:07:45.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:45.160 INFO:teuthology.orchestra.run.smithi114.stdout:client4484 2024-04-28T13:07:45.160 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/0961cca0-69c8-4b26-b89a-621e12152fc4.client4484/status') 2024-04-28T13:07:45.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-28T13:07:45.220 INFO:teuthology.orchestra.run.smithi114.stdout:instance: client.4484 (3)172.21.15.114:0/785284736 2024-04-28T13:07:45.220 INFO:teuthology.orchestra.run.smithi114.stdout:blocklisted: false 2024-04-28T13:07:45.220 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records in 2024-04-28T13:07:45.220 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records out 2024-04-28T13:07:45.220 INFO:teuthology.orchestra.run.smithi114.stderr:70 bytes copied, 2.1754e-05 s, 3.2 MB/s 2024-04-28T13:07:45.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:45.227 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-04-28T13:07:45.227 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-28T13:07:45.228 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-28T13:07:45.228 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-28T13:07:45.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.326+0000 7f1f267f9640 1 Processor -- start 2024-04-28T13:07:45.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.326+0000 7f1f267f9640 1 -- start start 2024-04-28T13:07:45.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.327+0000 7f1f267f9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1f200d0670 0x7f1f200baaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:45.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.327+0000 7f1f267f9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f200b4380 0x7f1f200b8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:45.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.327+0000 7f1f267f9640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f200d3650 con 0x7f1f2015f410 2024-04-28T13:07:45.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.327+0000 7f1f267f9640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f1f200d3f10 con 0x7f1f200d0670 2024-04-28T13:07:45.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.327+0000 7f1f267f9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1f200b8840 con 0x7f1f200b4380 2024-04-28T13:07:45.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.328+0000 7f1f1f7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1f200d0670 0x7f1f200baaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:45.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.328+0000 7f1f24d96640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f200b4380 0x7f1f200b8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:45.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.328+0000 7f1f1ffff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f1f2015f410 0x7f1f200cff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:44396/0 (socket says 172.21.15.114:44396) 2024-04-28T13:07:45.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.328+0000 7f1f1ffff640 1 -- 172.21.15.114:0/1924923907 learned_addr learned my addr 172.21.15.114:0/1924923907 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:45.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.328+0000 7f1f1effd640 1 -- 172.21.15.114:0/1924923907 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 622640442 0 0) 0x7f1f200d3650 con 0x7f1f2015f410 2024-04-28T13:07:45.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.328+0000 7f1f1effd640 1 -- 172.21.15.114:0/1924923907 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f08003520 con 0x7f1f2015f410 2024-04-28T13:07:45.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.328+0000 7f1f24d96640 1 -- 172.21.15.114:0/1924923907 >> v2:172.21.15.134:3300/0 conn(0x7f1f200d0670 msgr2=0x7f1f200baaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:45.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.328+0000 7f1f24d96640 1 --2- 172.21.15.114:0/1924923907 >> v2:172.21.15.134:3300/0 conn(0x7f1f200d0670 0x7f1f200baaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:45.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.328+0000 7f1f24d96640 1 -- 172.21.15.114:0/1924923907 >> v1:172.21.15.134:6789/0 conn(0x7f1f2015f410 legacy=0x7f1f200cff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:45.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.328+0000 7f1f24d96640 1 -- 172.21.15.114:0/1924923907 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f2015f7f0 con 0x7f1f200b4380 2024-04-28T13:07:45.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.329+0000 7f1f24d96640 1 --2- 172.21.15.114:0/1924923907 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f200b4380 0x7f1f200b8300 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1f18009d90 tx=0x7f1f1802a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4605b09ea70777bd server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:45.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.329+0000 7f1f1effd640 1 -- 172.21.15.114:0/1924923907 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f18007740 con 0x7f1f200b4380 2024-04-28T13:07:45.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.329+0000 7f1f1effd640 1 -- 172.21.15.114:0/1924923907 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f180078e0 con 0x7f1f200b4380 2024-04-28T13:07:45.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.329+0000 7f1f1effd640 1 -- 172.21.15.114:0/1924923907 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f18007c90 con 0x7f1f200b4380 2024-04-28T13:07:45.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.329+0000 7f1f267f9640 1 -- 172.21.15.114:0/1924923907 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f200b4380 msgr2=0x7f1f200b8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:45.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.329+0000 7f1f267f9640 1 --2- 172.21.15.114:0/1924923907 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f200b4380 0x7f1f200b8300 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1f18009d90 tx=0x7f1f1802a6f0 comp rx=0 tx=0).stop 2024-04-28T13:07:45.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.330+0000 7f1f267f9640 1 -- 172.21.15.114:0/1924923907 shutdown_connections 2024-04-28T13:07:45.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.330+0000 7f1f267f9640 1 --2- 172.21.15.114:0/1924923907 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f200b4380 0x7f1f200b8300 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:45.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.330+0000 7f1f267f9640 1 --2- 172.21.15.114:0/1924923907 >> v2:172.21.15.134:3300/0 conn(0x7f1f200d0670 0x7f1f200baaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:45.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.330+0000 7f1f267f9640 1 -- 172.21.15.114:0/1924923907 >> 172.21.15.114:0/1924923907 conn(0x7f1f200633a0 msgr2=0x7f1f200d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:45.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.330+0000 7f1f267f9640 1 -- 172.21.15.114:0/1924923907 shutdown_connections 2024-04-28T13:07:45.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.330+0000 7f1f267f9640 1 -- 172.21.15.114:0/1924923907 wait complete. 2024-04-28T13:07:45.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.331+0000 7f1f267f9640 1 Processor -- start 2024-04-28T13:07:45.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.331+0000 7f1f267f9640 1 -- start start 2024-04-28T13:07:45.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.332+0000 7f1f267f9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f200b4380 0x7f1f200b8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:45.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.332+0000 7f1f267f9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f200d0670 0x7f1f20152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:45.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.332+0000 7f1f267f9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f2015f410 0x7f1f20152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:45.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.332+0000 7f1f267f9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1f200d3ba0 con 0x7f1f200d0670 2024-04-28T13:07:45.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.332+0000 7f1f267f9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1f200d2570 con 0x7f1f200b4380 2024-04-28T13:07:45.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.332+0000 7f1f267f9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1f200bb180 con 0x7f1f2015f410 2024-04-28T13:07:45.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.332+0000 7f1f1f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f200d0670 0x7f1f20152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:45.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.332+0000 7f1f1f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f200d0670 0x7f1f20152240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41330/0 (socket says 172.21.15.114:41330) 2024-04-28T13:07:45.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.332+0000 7f1f1f7fe640 1 -- 172.21.15.114:0/1321942288 learned_addr learned my addr 172.21.15.114:0/1321942288 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:45.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.332+0000 7f1f1ffff640 1 --2- 172.21.15.114:0/1321942288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f200b4380 0x7f1f200b8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:45.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.332+0000 7f1f24d96640 1 --2- 172.21.15.114:0/1321942288 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f2015f410 0x7f1f20152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:45.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.332+0000 7f1f1f7fe640 1 -- 172.21.15.114:0/1321942288 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f2015f410 msgr2=0x7f1f20152780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:45.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.332+0000 7f1f1f7fe640 1 --2- 172.21.15.114:0/1321942288 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f2015f410 0x7f1f20152780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:45.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.332+0000 7f1f1f7fe640 1 -- 172.21.15.114:0/1321942288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f200b4380 msgr2=0x7f1f200b8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:45.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.332+0000 7f1f1f7fe640 1 --2- 172.21.15.114:0/1321942288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f200b4380 0x7f1f200b8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:45.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.332+0000 7f1f1f7fe640 1 -- 172.21.15.114:0/1321942288 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f201610e0 con 0x7f1f200d0670 2024-04-28T13:07:45.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.332+0000 7f1f1ffff640 1 --2- 172.21.15.114:0/1321942288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f200b4380 0x7f1f200b8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:07:45.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.332+0000 7f1f1f7fe640 1 --2- 172.21.15.114:0/1321942288 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f200d0670 0x7f1f20152240 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1f1400e9b0 tx=0x7f1f1400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:45.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.332+0000 7f1f1cff9640 1 -- 172.21.15.114:0/1321942288 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f14017070 con 0x7f1f200d0670 2024-04-28T13:07:45.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.332+0000 7f1f1cff9640 1 -- 172.21.15.114:0/1321942288 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f1400c9a0 con 0x7f1f200d0670 2024-04-28T13:07:45.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.332+0000 7f1f267f9640 1 -- 172.21.15.114:0/1321942288 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f201613c0 con 0x7f1f200d0670 2024-04-28T13:07:45.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.332+0000 7f1f1cff9640 1 -- 172.21.15.114:0/1321942288 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1400cd90 con 0x7f1f200d0670 2024-04-28T13:07:45.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.333+0000 7f1f267f9640 1 -- 172.21.15.114:0/1321942288 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f20161c60 con 0x7f1f200d0670 2024-04-28T13:07:45.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.334+0000 7f1f267f9640 1 -- 172.21.15.114:0/1321942288 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f20161590 con 0x7f1f200d0670 2024-04-28T13:07:45.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.334+0000 7f1f1cff9640 1 -- 172.21.15.114:0/1321942288 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1f1401a070 con 0x7f1f200d0670 2024-04-28T13:07:45.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.334+0000 7f1f1cff9640 1 --2- 172.21.15.114:0/1321942288 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1f0c06c8f0 0x7f1f0c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:45.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.334+0000 7f1f1cff9640 1 -- 172.21.15.114:0/1321942288 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1f1408be90 con 0x7f1f200d0670 2024-04-28T13:07:45.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.335+0000 7f1f1ffff640 1 --2- 172.21.15.114:0/1321942288 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1f0c06c8f0 0x7f1f0c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:45.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.335+0000 7f1f1ffff640 1 --2- 172.21.15.114:0/1321942288 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1f0c06c8f0 0x7f1f0c06edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1f10005880 tx=0x7f1f10009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:45.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.339+0000 7f1f1cff9640 1 -- 172.21.15.114:0/1321942288 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1f1405a350 con 0x7f1f200d0670 2024-04-28T13:07:45.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.553+0000 7f1f267f9640 1 -- 172.21.15.114:0/1321942288 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1f2006a3d0 con 0x7f1f200d0670 2024-04-28T13:07:45.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.553+0000 7f1f1cff9640 1 -- 172.21.15.114:0/1321942288 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f1f14059c50 con 0x7f1f200d0670 2024-04-28T13:07:45.553 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-28T13:07:45.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.555+0000 7f1f267f9640 1 -- 172.21.15.114:0/1321942288 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1f0c06c8f0 msgr2=0x7f1f0c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:45.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.555+0000 7f1f267f9640 1 --2- 172.21.15.114:0/1321942288 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1f0c06c8f0 0x7f1f0c06edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1f10005880 tx=0x7f1f10009040 comp rx=0 tx=0).stop 2024-04-28T13:07:45.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.555+0000 7f1f267f9640 1 -- 172.21.15.114:0/1321942288 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f200d0670 msgr2=0x7f1f20152240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:45.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.555+0000 7f1f267f9640 1 --2- 172.21.15.114:0/1321942288 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f200d0670 0x7f1f20152240 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1f1400e9b0 tx=0x7f1f1400ee70 comp rx=0 tx=0).stop 2024-04-28T13:07:45.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.555+0000 7f1f267f9640 1 -- 172.21.15.114:0/1321942288 shutdown_connections 2024-04-28T13:07:45.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.555+0000 7f1f267f9640 1 --2- 172.21.15.114:0/1321942288 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f2015f410 0x7f1f20152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:45.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.555+0000 7f1f267f9640 1 --2- 172.21.15.114:0/1321942288 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f200d0670 0x7f1f20152240 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:45.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.555+0000 7f1f267f9640 1 --2- 172.21.15.114:0/1321942288 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1f0c06c8f0 0x7f1f0c06edb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:45.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.555+0000 7f1f267f9640 1 --2- 172.21.15.114:0/1321942288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f200b4380 0x7f1f200b8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:45.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.555+0000 7f1f267f9640 1 -- 172.21.15.114:0/1321942288 >> 172.21.15.114:0/1321942288 conn(0x7f1f200633a0 msgr2=0x7f1f200b7100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:45.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.555+0000 7f1f267f9640 1 -- 172.21.15.114:0/1321942288 shutdown_connections 2024-04-28T13:07:45.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45.555+0000 7f1f267f9640 1 -- 172.21.15.114:0/1321942288 wait complete. 2024-04-28T13:07:45.565 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-28T13:07:45.565 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-28T13:07:45.566 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-04-28T13:07:45.566 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-28T13:07:45.566 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-28T13:07:45.566 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-28T13:07:45.566 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-28T13:07:45.566 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-28T13:07:45.566 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-28T13:07:45.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:45.566 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-04-28T13:07:45.582 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-28T13:07:45.582 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-28T13:07:45.582 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-04-28T13:07:45.582 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:45.582 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-04-28T13:07:45.582 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:45.582 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-28T13:07:45.582 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:07:45.582 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-04-28T13:07:45.582 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-28T13:07:45.583 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:07:45.583 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-04-28T13:07:45.583 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-28T13:07:45.583 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:07:45.583 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-28T13:07:45.583 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:07:45.583 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-28T13:07:45.583 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42747sec preferred_lft 42747sec 2024-04-28T13:07:45.583 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::cd74:6bbf:5a:b4fa/64 scope link noprefixroute 2024-04-28T13:07:45.583 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:45.583 INFO:teuthology.orchestra.run.smithi114.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-28T13:07:45.583 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether d2:4c:d3:d0:70:bf brd ff:ff:ff:ff:ff:ff 2024-04-28T13:07:45.583 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-28T13:07:45.583 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:45.583 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::e4ef:19ff:fecc:cecc/64 scope link 2024-04-28T13:07:45.583 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:45.584 INFO:teuthology.orchestra.run.smithi114.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-28T13:07:45.584 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether d2:4c:d3:d0:70:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-28T13:07:45.584 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::d04c:d3ff:fed0:70bf/64 scope link tentative 2024-04-28T13:07:45.584 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:45.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:45.584 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-28T13:07:45.645 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-04-28T13:07:45.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:45.647 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-04-28T13:07:45.702 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-04-28T13:07:45.703 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-28T13:07:45.703 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-28T13:07:45.703 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-28T13:07:45.703 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-28T13:07:45.703 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-28T13:07:45.703 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-04-28T13:07:45.703 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-28T13:07:45.703 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-28T13:07:45.703 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-28T13:07:45.704 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-04-28T13:07:45.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-28T13:07:45.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:45.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:45.826 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-04-28T13:07:45.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-28T13:07:45.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:45.841 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list-id 2024-04-28T13:07:45.896 INFO:teuthology.orchestra.run.smithi114.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-28T13:07:45.896 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-28T13:07:45.896 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-04-28T13:07:45.896 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-28T13:07:45.897 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-28T13:07:45.897 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-04-28T13:07:45.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-28T13:07:46.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:46.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:46.011 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-28T13:07:46.033 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-28T13:07:46.033 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-28T13:07:46.033 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-04-28T13:07:46.033 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:46.034 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-04-28T13:07:46.034 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:46.034 INFO:teuthology.orchestra.run.smithi114.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-28T13:07:46.034 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 26:8b:af:3d:14:5c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-28T13:07:46.034 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-28T13:07:46.034 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:46.034 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::248b:afff:fe3d:145c/64 scope link tentative 2024-04-28T13:07:46.034 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:46.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:46.035 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-28T13:07:46.099 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-28T13:07:46.099 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-28T13:07:46.099 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-04-28T13:07:46.099 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:46.099 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-04-28T13:07:46.099 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:46.099 INFO:teuthology.orchestra.run.smithi114.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-28T13:07:46.099 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 26:8b:af:3d:14:5c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-28T13:07:46.100 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-28T13:07:46.100 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:46.100 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::248b:afff:fe3d:145c/64 scope link tentative 2024-04-28T13:07:46.100 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:46.101 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-28T13:07:46.101 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-28T13:07:46.101 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-04-28T13:07:46.101 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-28T13:07:46.101 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-28T13:07:46.101 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-28T13:07:46.101 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-28T13:07:46.102 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-28T13:07:46.102 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-04-28T13:07:46.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-28T13:07:46.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:46.248 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-28T13:07:46.248 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-04-28T13:07:46.248 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.1 up 2024-04-28T13:07:46.248 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set dev brx.1 master ceph-brx 2024-04-28T13:07:46.248 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-04-28T13:07:46.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-28T13:07:46.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:46.322 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-28T13:07:46.322 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-28T13:07:46.336 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-28T13:07:46.336 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-28T13:07:46.336 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-28T13:07:46.391 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-28T13:07:46.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:46.391 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-28T13:07:46.472 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-28T13:07:46.472 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-28T13:07:46.473 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-04-28T13:07:46.481 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-28T13:07:46.481 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-28T13:07:46.481 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-04-28T13:07:46.481 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.134:3300,172.21.15.134:3301" 2024-04-28T13:07:46.481 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-28T13:07:46.492 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-28T13:07:46.492 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-28T13:07:46.492 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-04-28T13:07:46.492 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.134:3300,172.21.15.134:3301" 2024-04-28T13:07:46.492 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-28T13:07:46.492 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.134:6789,172.21.15.134:6790" 2024-04-28T13:07:46.492 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.134:6789,172.21.15.134:6790:/ 2024-04-28T13:07:46.492 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=0961cca0-69c8-4b26-b89a-621e12152fc4" will pass to kernel 2024-04-28T13:07:46.493 INFO:teuthology.orchestra.run.smithi114.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-04-28T13:07:46.493 INFO:teuthology.orchestra.run.smithi114.stdout: You just mounted a file system that supports labels which does not 2024-04-28T13:07:46.493 INFO:teuthology.orchestra.run.smithi114.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-28T13:07:46.493 INFO:teuthology.orchestra.run.smithi114.stdout: applications will generate AVC messages and not be allowed access to 2024-04-28T13:07:46.493 INFO:teuthology.orchestra.run.smithi114.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-28T13:07:46.495 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-28T13:07:46.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:46.495 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-28T13:07:46.559 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-28T13:07:46.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-28T13:07:46.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:46.654 INFO:teuthology.orchestra.run.smithi114.stdout:client4725 2024-04-28T13:07:46.654 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:07:46.654 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-28T13:07:46.669 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-28T13:07:46.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-28T13:07:46.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:46.764 INFO:teuthology.orchestra.run.smithi114.stdout:client4725 2024-04-28T13:07:46.764 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-28T13:07:46.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-28T13:07:46.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:46.819 INFO:teuthology.orchestra.run.smithi114.stdout:client4725 2024-04-28T13:07:46.819 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/0961cca0-69c8-4b26-b89a-621e12152fc4.client4725/status') 2024-04-28T13:07:46.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-28T13:07:46.875 INFO:teuthology.orchestra.run.smithi114.stdout:instance: client.4725 (3)192.168.0.2:0/544705270 2024-04-28T13:07:46.875 INFO:teuthology.orchestra.run.smithi114.stdout:blocklisted: false 2024-04-28T13:07:46.876 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records in 2024-04-28T13:07:46.876 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records out 2024-04-28T13:07:46.876 INFO:teuthology.orchestra.run.smithi114.stderr:68 bytes copied, 2.2286e-05 s, 3.1 MB/s 2024-04-28T13:07:46.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:46.882 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-04-28T13:07:46.882 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-28T13:07:46.883 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-28T13:07:46.883 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-28T13:07:46.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.979+0000 7f9d13fc1640 1 Processor -- start 2024-04-28T13:07:46.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.979+0000 7f9d13fc1640 1 -- start start 2024-04-28T13:07:46.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.979+0000 7f9d13fc1640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9d0c0cda00 0x7f9d0c0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:46.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.980+0000 7f9d13fc1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9d0c0d07b0 0x7f9d0c15fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:46.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.980+0000 7f9d13fc1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d0c0cdde0 0x7f9d0c160000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:46.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.980+0000 7f9d13fc1640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f9d0c0d2be0 con 0x7f9d0c0cda00 2024-04-28T13:07:46.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.980+0000 7f9d13fc1640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f9d0c160980 con 0x7f9d0c0d07b0 2024-04-28T13:07:46.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.980+0000 7f9d13fc1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f9d0c1606a0 con 0x7f9d0c0cdde0 2024-04-28T13:07:46.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.980+0000 7f9d11d5d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9d0c0cda00 0x7f9d0c0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:46.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.980+0000 7f9d11d5d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9d0c0cda00 0x7f9d0c0d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41338/0 (socket says 172.21.15.114:41338) 2024-04-28T13:07:46.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.980+0000 7f9d11d5d640 1 -- 172.21.15.114:0/385570276 learned_addr learned my addr 172.21.15.114:0/385570276 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:46.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.980+0000 7f9d11d5d640 1 -- 172.21.15.114:0/385570276 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d0c0cdde0 msgr2=0x7f9d0c160000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:46.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.980+0000 7f9d11d5d640 1 --2- 172.21.15.114:0/385570276 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d0c0cdde0 0x7f9d0c160000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:46.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.980+0000 7f9d1155c640 1 --2- 172.21.15.114:0/385570276 >> v2:172.21.15.134:3300/0 conn(0x7f9d0c0d07b0 0x7f9d0c15fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:46.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.980+0000 7f9d11d5d640 1 -- 172.21.15.114:0/385570276 >> v2:172.21.15.134:3300/0 conn(0x7f9d0c0d07b0 msgr2=0x7f9d0c15fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:46.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.980+0000 7f9d11d5d640 1 --2- 172.21.15.114:0/385570276 >> v2:172.21.15.134:3300/0 conn(0x7f9d0c0d07b0 0x7f9d0c15fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:46.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.980+0000 7f9d11d5d640 1 -- 172.21.15.114:0/385570276 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d0c0cf7b0 con 0x7f9d0c0cda00 2024-04-28T13:07:46.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.980+0000 7f9d1155c640 1 --2- 172.21.15.114:0/385570276 >> v2:172.21.15.134:3300/0 conn(0x7f9d0c0d07b0 0x7f9d0c15fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:07:46.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.981+0000 7f9d11d5d640 1 --2- 172.21.15.114:0/385570276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d0c0cda00 0x7f9d0c0d0270 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c0c6c10 tx=0x7f9d0802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4332bd16636e35e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:46.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.981+0000 7f9d10d5b640 1 -- 172.21.15.114:0/385570276 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d08036070 con 0x7f9d0c0cda00 2024-04-28T13:07:46.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.981+0000 7f9d10d5b640 1 -- 172.21.15.114:0/385570276 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d08031600 con 0x7f9d0c0cda00 2024-04-28T13:07:46.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.981+0000 7f9d10d5b640 1 -- 172.21.15.114:0/385570276 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d080319d0 con 0x7f9d0c0cda00 2024-04-28T13:07:46.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.981+0000 7f9d13fc1640 1 -- 172.21.15.114:0/385570276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d0c0cda00 msgr2=0x7f9d0c0d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:46.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.981+0000 7f9d13fc1640 1 --2- 172.21.15.114:0/385570276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d0c0cda00 0x7f9d0c0d0270 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c0c6c10 tx=0x7f9d0802a6a0 comp rx=0 tx=0).stop 2024-04-28T13:07:46.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.981+0000 7f9d13fc1640 1 -- 172.21.15.114:0/385570276 shutdown_connections 2024-04-28T13:07:46.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.981+0000 7f9d13fc1640 1 --2- 172.21.15.114:0/385570276 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d0c0cdde0 0x7f9d0c160000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:46.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.981+0000 7f9d13fc1640 1 --2- 172.21.15.114:0/385570276 >> v2:172.21.15.134:3300/0 conn(0x7f9d0c0d07b0 0x7f9d0c15fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:46.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.981+0000 7f9d13fc1640 1 --2- 172.21.15.114:0/385570276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d0c0cda00 0x7f9d0c0d0270 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:46.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.981+0000 7f9d13fc1640 1 -- 172.21.15.114:0/385570276 >> 172.21.15.114:0/385570276 conn(0x7f9d0c0706f0 msgr2=0x7f9d0c070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:46.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.981+0000 7f9d13fc1640 1 -- 172.21.15.114:0/385570276 shutdown_connections 2024-04-28T13:07:46.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.981+0000 7f9d13fc1640 1 -- 172.21.15.114:0/385570276 wait complete. 2024-04-28T13:07:46.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.983+0000 7f9d13fc1640 1 Processor -- start 2024-04-28T13:07:46.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.983+0000 7f9d13fc1640 1 -- start start 2024-04-28T13:07:46.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.983+0000 7f9d13fc1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d0c0cda00 0x7f9d0c0b7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:46.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.983+0000 7f9d13fc1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d0c0cdde0 0x7f9d0c149640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:46.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.983+0000 7f9d13fc1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d0c0d07b0 0x7f9d0c0d30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:46.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.983+0000 7f9d13fc1640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0c155fc0 con 0x7f9d0c0cdde0 2024-04-28T13:07:46.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.983+0000 7f9d13fc1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0c0cfd70 con 0x7f9d0c0cda00 2024-04-28T13:07:46.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.983+0000 7f9d13fc1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f9d0c156140 con 0x7f9d0c0d07b0 2024-04-28T13:07:46.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.983+0000 7f9d1155c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d0c0cdde0 0x7f9d0c149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:46.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.983+0000 7f9d1155c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d0c0cdde0 0x7f9d0c149640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41340/0 (socket says 172.21.15.114:41340) 2024-04-28T13:07:46.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.983+0000 7f9d1155c640 1 -- 172.21.15.114:0/1518771611 learned_addr learned my addr 172.21.15.114:0/1518771611 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:46.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.983+0000 7f9d11d5d640 1 --2- 172.21.15.114:0/1518771611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d0c0cda00 0x7f9d0c0b7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:46.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.984+0000 7f9d1255e640 1 --2- 172.21.15.114:0/1518771611 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d0c0d07b0 0x7f9d0c0d30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:46.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.984+0000 7f9d1155c640 1 -- 172.21.15.114:0/1518771611 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d0c0d07b0 msgr2=0x7f9d0c0d30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:46.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.984+0000 7f9d1155c640 1 --2- 172.21.15.114:0/1518771611 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d0c0d07b0 0x7f9d0c0d30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:46.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.984+0000 7f9d1155c640 1 -- 172.21.15.114:0/1518771611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d0c0cda00 msgr2=0x7f9d0c0b7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:46.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.984+0000 7f9d1155c640 1 --2- 172.21.15.114:0/1518771611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d0c0cda00 0x7f9d0c0b7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:46.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.984+0000 7f9d1155c640 1 -- 172.21.15.114:0/1518771611 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d0c0b6a50 con 0x7f9d0c0cdde0 2024-04-28T13:07:46.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.984+0000 7f9d1255e640 1 --2- 172.21.15.114:0/1518771611 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d0c0d07b0 0x7f9d0c0d30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:07:46.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.984+0000 7f9d11d5d640 1 --2- 172.21.15.114:0/1518771611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d0c0cda00 0x7f9d0c0b7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:46.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.984+0000 7f9d1155c640 1 --2- 172.21.15.114:0/1518771611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d0c0cdde0 0x7f9d0c149640 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc00c7f0 tx=0x7f9cfc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:46.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.984+0000 7f9d027fc640 1 -- 172.21.15.114:0/1518771611 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc015070 con 0x7f9d0c0cdde0 2024-04-28T13:07:46.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.984+0000 7f9d027fc640 1 -- 172.21.15.114:0/1518771611 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cfc0077c0 con 0x7f9d0c0cdde0 2024-04-28T13:07:46.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.984+0000 7f9d027fc640 1 -- 172.21.15.114:0/1518771611 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc007bb0 con 0x7f9d0c0cdde0 2024-04-28T13:07:46.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.984+0000 7f9d13fc1640 1 -- 172.21.15.114:0/1518771611 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d0c0b6d30 con 0x7f9d0c0cdde0 2024-04-28T13:07:46.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.984+0000 7f9d13fc1640 1 -- 172.21.15.114:0/1518771611 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d0c0b72f0 con 0x7f9d0c0cdde0 2024-04-28T13:07:46.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.985+0000 7f9d13fc1640 1 -- 172.21.15.114:0/1518771611 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d0c06a3d0 con 0x7f9d0c0cdde0 2024-04-28T13:07:46.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.985+0000 7f9d027fc640 1 -- 172.21.15.114:0/1518771611 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9cfc018070 con 0x7f9d0c0cdde0 2024-04-28T13:07:46.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.986+0000 7f9d027fc640 1 --2- 172.21.15.114:0/1518771611 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9cf006c8f0 0x7f9cf006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:46.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.986+0000 7f9d11d5d640 1 --2- 172.21.15.114:0/1518771611 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9cf006c8f0 0x7f9cf006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:46.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.986+0000 7f9d027fc640 1 -- 172.21.15.114:0/1518771611 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9cfc08b840 con 0x7f9d0c0cdde0 2024-04-28T13:07:46.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.986+0000 7f9d11d5d640 1 --2- 172.21.15.114:0/1518771611 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9cf006c8f0 0x7f9cf006edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9d08033000 tx=0x7f9d08009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:46.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:46.990+0000 7f9d027fc640 1 -- 172.21.15.114:0/1518771611 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9cfc059d00 con 0x7f9d0c0cdde0 2024-04-28T13:07:47.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:47.200+0000 7f9d13fc1640 1 -- 172.21.15.114:0/1518771611 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9d0c154280 con 0x7f9d0c0cdde0 2024-04-28T13:07:47.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:47.201+0000 7f9d027fc640 1 -- 172.21.15.114:0/1518771611 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f9cfc059600 con 0x7f9d0c0cdde0 2024-04-28T13:07:47.201 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-28T13:07:47.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:47.203+0000 7f9d13fc1640 1 -- 172.21.15.114:0/1518771611 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9cf006c8f0 msgr2=0x7f9cf006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:47.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:47.203+0000 7f9d13fc1640 1 --2- 172.21.15.114:0/1518771611 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9cf006c8f0 0x7f9cf006edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9d08033000 tx=0x7f9d08009000 comp rx=0 tx=0).stop 2024-04-28T13:07:47.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:47.203+0000 7f9d13fc1640 1 -- 172.21.15.114:0/1518771611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d0c0cdde0 msgr2=0x7f9d0c149640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:47.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:47.203+0000 7f9d13fc1640 1 --2- 172.21.15.114:0/1518771611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d0c0cdde0 0x7f9d0c149640 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc00c7f0 tx=0x7f9cfc00ccb0 comp rx=0 tx=0).stop 2024-04-28T13:07:47.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:47.203+0000 7f9d13fc1640 1 -- 172.21.15.114:0/1518771611 shutdown_connections 2024-04-28T13:07:47.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:47.203+0000 7f9d13fc1640 1 --2- 172.21.15.114:0/1518771611 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d0c0d07b0 0x7f9d0c0d30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:47.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:47.203+0000 7f9d13fc1640 1 --2- 172.21.15.114:0/1518771611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d0c0cdde0 0x7f9d0c149640 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:47.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:47.203+0000 7f9d13fc1640 1 --2- 172.21.15.114:0/1518771611 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9cf006c8f0 0x7f9cf006edb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:47.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:47.203+0000 7f9d13fc1640 1 --2- 172.21.15.114:0/1518771611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d0c0cda00 0x7f9d0c0b7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:47.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:47.203+0000 7f9d13fc1640 1 -- 172.21.15.114:0/1518771611 >> 172.21.15.114:0/1518771611 conn(0x7f9d0c0706f0 msgr2=0x7f9d0c155580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:47.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:47.203+0000 7f9d13fc1640 1 -- 172.21.15.114:0/1518771611 shutdown_connections 2024-04-28T13:07:47.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:47.203+0000 7f9d13fc1640 1 -- 172.21.15.114:0/1518771611 wait complete. 2024-04-28T13:07:47.213 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-28T13:07:47.213 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-28T13:07:47.213 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2024-04-28T13:07:47.213 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-28T13:07:47.213 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-28T13:07:47.213 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-28T13:07:47.213 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-28T13:07:47.213 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-28T13:07:47.213 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-28T13:07:47.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:47.214 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2024-04-28T13:07:47.232 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-28T13:07:47.232 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-28T13:07:47.232 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-04-28T13:07:47.233 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:47.233 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-04-28T13:07:47.233 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:47.233 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-28T13:07:47.233 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:07:47.233 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2024-04-28T13:07:47.233 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-28T13:07:47.233 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:07:47.233 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2024-04-28T13:07:47.233 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-28T13:07:47.233 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:07:47.233 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-28T13:07:47.233 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:07:47.233 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-28T13:07:47.234 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42742sec preferred_lft 42742sec 2024-04-28T13:07:47.234 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::26cd:4a7a:1eab:e9e4/64 scope link noprefixroute 2024-04-28T13:07:47.234 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:47.234 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-28T13:07:47.234 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-28T13:07:47.234 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-04-28T13:07:47.234 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add name ceph-brx type bridge 2024-04-28T13:07:47.234 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip addr flush dev ceph-brx 2024-04-28T13:07:47.235 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set ceph-brx up 2024-04-28T13:07:47.235 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-28T13:07:47.235 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-04-28T13:07:47.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-28T13:07:47.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:47.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:47.427 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-28T13:07:47.451 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-04-28T13:07:47.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:47.452 DEBUG:teuthology.orchestra.run.smithi134:> route 2024-04-28T13:07:47.521 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2024-04-28T13:07:47.521 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-28T13:07:47.521 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-28T13:07:47.521 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-28T13:07:47.521 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-28T13:07:47.521 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-28T13:07:47.521 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-04-28T13:07:47.521 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-28T13:07:47.521 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-28T13:07:47.522 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-28T13:07:47.522 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-04-28T13:07:47.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-28T13:07:47.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:47.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:47.793 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-04-28T13:07:47.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:47.807 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list-id 2024-04-28T13:07:47.863 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-28T13:07:47.863 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-04-28T13:07:47.863 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-28T13:07:47.863 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-28T13:07:47.863 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-04-28T13:07:47.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-28T13:07:47.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:47.980 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-28T13:07:47.980 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-28T13:07:47.980 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-04-28T13:07:47.980 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-28T13:07:47.980 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-28T13:07:47.981 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-28T13:07:47.981 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-28T13:07:47.981 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-28T13:07:47.981 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-04-28T13:07:48.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-28T13:07:48.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:48.109 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-28T13:07:48.109 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-04-28T13:07:48.109 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2024-04-28T13:07:48.109 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set dev brx.0 master ceph-brx 2024-04-28T13:07:48.109 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-04-28T13:07:48.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-28T13:07:48.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:48.184 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-28T13:07:48.185 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-28T13:07:48.200 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-28T13:07:48.200 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-28T13:07:48.200 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-28T13:07:48.254 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-28T13:07:48.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:48.254 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-28T13:07:48.343 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-28T13:07:48.343 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-28T13:07:48.343 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-04-28T13:07:48.454 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-28T13:07:48.454 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-28T13:07:48.454 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-04-28T13:07:48.454 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.134:3300,172.21.15.134:3301" 2024-04-28T13:07:48.454 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-28T13:07:48.459 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-28T13:07:48.459 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-28T13:07:48.459 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-04-28T13:07:48.459 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.134:3300,172.21.15.134:3301" 2024-04-28T13:07:48.460 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-28T13:07:48.460 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.134:6789,172.21.15.134:6790" 2024-04-28T13:07:48.460 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.134:6789,172.21.15.134:6790:/ 2024-04-28T13:07:48.460 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=0961cca0-69c8-4b26-b89a-621e12152fc4" will pass to kernel 2024-04-28T13:07:48.460 INFO:teuthology.orchestra.run.smithi134.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-28T13:07:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: You just mounted a file system that supports labels which does not 2024-04-28T13:07:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-28T13:07:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: applications will generate AVC messages and not be allowed access to 2024-04-28T13:07:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-28T13:07:48.462 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-28T13:07:48.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:48.463 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-28T13:07:48.486 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-28T13:07:48.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-28T13:07:48.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:48.580 INFO:teuthology.orchestra.run.smithi134.stdout:client4734 2024-04-28T13:07:48.581 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:07:48.581 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-28T13:07:48.596 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-28T13:07:48.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-28T13:07:48.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:48.691 INFO:teuthology.orchestra.run.smithi134.stdout:client4734 2024-04-28T13:07:48.691 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-28T13:07:48.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-28T13:07:48.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:48.746 INFO:teuthology.orchestra.run.smithi134.stdout:client4734 2024-04-28T13:07:48.746 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/0961cca0-69c8-4b26-b89a-621e12152fc4.client4734/status') 2024-04-28T13:07:48.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-28T13:07:48.803 INFO:teuthology.orchestra.run.smithi134.stdout:instance: client.4734 (3)172.21.15.134:0/3238416320 2024-04-28T13:07:48.803 INFO:teuthology.orchestra.run.smithi134.stdout:blocklisted: false 2024-04-28T13:07:48.804 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records in 2024-04-28T13:07:48.804 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records out 2024-04-28T13:07:48.804 INFO:teuthology.orchestra.run.smithi134.stderr:71 bytes copied, 2.5221e-05 s, 2.8 MB/s 2024-04-28T13:07:48.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:48.811 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-04-28T13:07:48.811 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-28T13:07:48.811 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-28T13:07:48.811 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-28T13:07:48.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.921+0000 7f6dce6da640 1 Processor -- start 2024-04-28T13:07:48.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.921+0000 7f6dce6da640 1 -- start start 2024-04-28T13:07:48.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.921+0000 7f6dce6da640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6dc815eb10 0x7f6dc80ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:48.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.921+0000 7f6dce6da640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dc8146fe0 con 0x7f6dc80cd890 2024-04-28T13:07:48.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.921+0000 7f6dce6da640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dc8073440 con 0x7f6dc8146c00 2024-04-28T13:07:48.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.921+0000 7f6dce6da640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f6dc80cf390 con 0x7f6dc815eb10 2024-04-28T13:07:48.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.922+0000 7f6dc77fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6dc815eb10 0x7f6dc80ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:48.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.922+0000 7f6dccc77640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6dc80cd890 0x7f6dc80cdca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44902/0 (socket says 172.21.15.114:44902) 2024-04-28T13:07:48.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.922+0000 7f6dccc77640 1 -- 172.21.15.114:0/3221485061 learned_addr learned my addr 172.21.15.114:0/3221485061 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:48.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.922+0000 7f6dc77fe640 1 -- 172.21.15.114:0/3221485061 >> v1:172.21.15.134:6789/0 conn(0x7f6dc8146c00 legacy=0x7f6dc815e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:48.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.922+0000 7f6dc77fe640 1 -- 172.21.15.114:0/3221485061 >> v1:172.21.15.114:6789/0 conn(0x7f6dc80cd890 legacy=0x7f6dc80cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:48.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.922+0000 7f6dc77fe640 1 -- 172.21.15.114:0/3221485061 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc80cf670 con 0x7f6dc815eb10 2024-04-28T13:07:48.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.922+0000 7f6dc6ffd640 1 -- 172.21.15.114:0/3221485061 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2254964966 0 0) 0x7f6dc0001490 con 0x7f6dc80cd890 2024-04-28T13:07:48.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.923+0000 7f6dc77fe640 1 --2- 172.21.15.114:0/3221485061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dc815eb10 0x7f6dc80ced60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6db80097a0 tx=0x7f6db802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d59beacf083d386f server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:48.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.923+0000 7f6dc6ffd640 1 -- 172.21.15.114:0/3221485061 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db8037070 con 0x7f6dc815eb10 2024-04-28T13:07:48.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.923+0000 7f6dc6ffd640 1 -- 172.21.15.114:0/3221485061 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6db8032440 con 0x7f6dc815eb10 2024-04-28T13:07:48.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.923+0000 7f6dc6ffd640 1 -- 172.21.15.114:0/3221485061 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db8032810 con 0x7f6dc815eb10 2024-04-28T13:07:48.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.923+0000 7f6dce6da640 1 -- 172.21.15.114:0/3221485061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dc815eb10 msgr2=0x7f6dc80ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:48.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.923+0000 7f6dce6da640 1 --2- 172.21.15.114:0/3221485061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dc815eb10 0x7f6dc80ced60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6db80097a0 tx=0x7f6db802a1e0 comp rx=0 tx=0).stop 2024-04-28T13:07:48.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.923+0000 7f6dce6da640 1 -- 172.21.15.114:0/3221485061 shutdown_connections 2024-04-28T13:07:48.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.923+0000 7f6dce6da640 1 --2- 172.21.15.114:0/3221485061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dc815eb10 0x7f6dc80ced60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:48.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.923+0000 7f6dce6da640 1 -- 172.21.15.114:0/3221485061 >> 172.21.15.114:0/3221485061 conn(0x7f6dc806c980 msgr2=0x7f6dc80b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:48.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.923+0000 7f6dce6da640 1 -- 172.21.15.114:0/3221485061 shutdown_connections 2024-04-28T13:07:48.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.923+0000 7f6dce6da640 1 -- 172.21.15.114:0/3221485061 wait complete. 2024-04-28T13:07:48.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.925+0000 7f6dce6da640 1 Processor -- start 2024-04-28T13:07:48.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.925+0000 7f6dce6da640 1 -- start start 2024-04-28T13:07:48.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.925+0000 7f6dce6da640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dc80cd890 0x7f6dc81f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:48.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.925+0000 7f6dce6da640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6dc8146c00 0x7f6dc80d0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:48.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.925+0000 7f6dce6da640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dc815eb10 0x7f6dc813c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:48.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.925+0000 7f6dce6da640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc8073920 con 0x7f6dc815eb10 2024-04-28T13:07:48.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.925+0000 7f6dce6da640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc80cfc30 con 0x7f6dc80cd890 2024-04-28T13:07:48.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.925+0000 7f6dce6da640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f6dc8073aa0 con 0x7f6dc8146c00 2024-04-28T13:07:48.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.926+0000 7f6dccc77640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dc815eb10 0x7f6dc813c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:48.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.926+0000 7f6dccc77640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dc815eb10 0x7f6dc813c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41360/0 (socket says 172.21.15.114:41360) 2024-04-28T13:07:48.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.926+0000 7f6dccc77640 1 -- 172.21.15.114:0/3983157229 learned_addr learned my addr 172.21.15.114:0/3983157229 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:48.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.926+0000 7f6dc7fff640 1 --2- 172.21.15.114:0/3983157229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dc80cd890 0x7f6dc81f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:48.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.926+0000 7f6dc77fe640 1 --2- 172.21.15.114:0/3983157229 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6dc8146c00 0x7f6dc80d0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:48.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.926+0000 7f6dccc77640 1 -- 172.21.15.114:0/3983157229 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6dc8146c00 msgr2=0x7f6dc80d0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:48.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.926+0000 7f6dccc77640 1 --2- 172.21.15.114:0/3983157229 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6dc8146c00 0x7f6dc80d0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:48.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.926+0000 7f6dccc77640 1 -- 172.21.15.114:0/3983157229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dc80cd890 msgr2=0x7f6dc81f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:48.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.926+0000 7f6dccc77640 1 --2- 172.21.15.114:0/3983157229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dc80cd890 0x7f6dc81f64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:48.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.926+0000 7f6dccc77640 1 -- 172.21.15.114:0/3983157229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc81f6d20 con 0x7f6dc815eb10 2024-04-28T13:07:48.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.926+0000 7f6dccc77640 1 --2- 172.21.15.114:0/3983157229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dc815eb10 0x7f6dc813c470 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6dc000cac0 tx=0x7f6dc000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:48.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.926+0000 7f6dc4ff9640 1 -- 172.21.15.114:0/3983157229 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc000ac30 con 0x7f6dc815eb10 2024-04-28T13:07:48.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.926+0000 7f6dc4ff9640 1 -- 172.21.15.114:0/3983157229 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc000add0 con 0x7f6dc815eb10 2024-04-28T13:07:48.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.926+0000 7f6dce6da640 1 -- 172.21.15.114:0/3983157229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc81f7000 con 0x7f6dc815eb10 2024-04-28T13:07:48.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.926+0000 7f6dc4ff9640 1 -- 172.21.15.114:0/3983157229 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0012640 con 0x7f6dc815eb10 2024-04-28T13:07:48.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.926+0000 7f6dce6da640 1 -- 172.21.15.114:0/3983157229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc81f72e0 con 0x7f6dc815eb10 2024-04-28T13:07:48.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.927+0000 7f6dce6da640 1 -- 172.21.15.114:0/3983157229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dc806a3d0 con 0x7f6dc815eb10 2024-04-28T13:07:48.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.928+0000 7f6dc4ff9640 1 -- 172.21.15.114:0/3983157229 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6dc00127e0 con 0x7f6dc815eb10 2024-04-28T13:07:48.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.928+0000 7f6dc4ff9640 1 --2- 172.21.15.114:0/3983157229 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6da806c8f0 0x7f6da806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:48.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.928+0000 7f6dc4ff9640 1 -- 172.21.15.114:0/3983157229 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6dc008c200 con 0x7f6dc815eb10 2024-04-28T13:07:48.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.928+0000 7f6dc7fff640 1 --2- 172.21.15.114:0/3983157229 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6da806c8f0 0x7f6da806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:48.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.929+0000 7f6dc7fff640 1 --2- 172.21.15.114:0/3983157229 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6da806c8f0 0x7f6da806edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6db0004ea0 tx=0x7f6db0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:48.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:48.933+0000 7f6dc4ff9640 1 -- 172.21.15.114:0/3983157229 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6dc8146fe0 con 0x7f6dc815eb10 2024-04-28T13:07:49.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:49.142+0000 7f6dce6da640 1 -- 172.21.15.114:0/3983157229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6dc80cdfb0 con 0x7f6dc815eb10 2024-04-28T13:07:49.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:49.143+0000 7f6dc4ff9640 1 -- 172.21.15.114:0/3983157229 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f6dc005a630 con 0x7f6dc815eb10 2024-04-28T13:07:49.143 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-28T13:07:49.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:49.145+0000 7f6dce6da640 1 -- 172.21.15.114:0/3983157229 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6da806c8f0 msgr2=0x7f6da806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:49.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:49.145+0000 7f6dce6da640 1 --2- 172.21.15.114:0/3983157229 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6da806c8f0 0x7f6da806edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6db0004ea0 tx=0x7f6db0009040 comp rx=0 tx=0).stop 2024-04-28T13:07:49.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:49.145+0000 7f6dce6da640 1 -- 172.21.15.114:0/3983157229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dc815eb10 msgr2=0x7f6dc813c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:49.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:49.145+0000 7f6dce6da640 1 --2- 172.21.15.114:0/3983157229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dc815eb10 0x7f6dc813c470 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6dc000cac0 tx=0x7f6dc000cf80 comp rx=0 tx=0).stop 2024-04-28T13:07:49.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:49.145+0000 7f6dce6da640 1 -- 172.21.15.114:0/3983157229 shutdown_connections 2024-04-28T13:07:49.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:49.145+0000 7f6dce6da640 1 --2- 172.21.15.114:0/3983157229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dc815eb10 0x7f6dc813c470 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:49.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:49.145+0000 7f6dce6da640 1 --2- 172.21.15.114:0/3983157229 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6dc8146c00 0x7f6dc80d0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:49.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:49.145+0000 7f6dce6da640 1 --2- 172.21.15.114:0/3983157229 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6da806c8f0 0x7f6da806edb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:49.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:49.145+0000 7f6dce6da640 1 --2- 172.21.15.114:0/3983157229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dc80cd890 0x7f6dc81f64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:49.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:49.145+0000 7f6dce6da640 1 -- 172.21.15.114:0/3983157229 >> 172.21.15.114:0/3983157229 conn(0x7f6dc806c980 msgr2=0x7f6dc80b5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:49.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:49.145+0000 7f6dce6da640 1 -- 172.21.15.114:0/3983157229 shutdown_connections 2024-04-28T13:07:49.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:49.145+0000 7f6dce6da640 1 -- 172.21.15.114:0/3983157229 wait complete. 2024-04-28T13:07:49.155 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-28T13:07:49.155 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-28T13:07:49.156 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2024-04-28T13:07:49.156 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-28T13:07:49.156 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-28T13:07:49.156 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-28T13:07:49.156 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-28T13:07:49.156 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-28T13:07:49.156 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-28T13:07:49.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:49.156 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2024-04-28T13:07:49.172 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-28T13:07:49.172 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-28T13:07:49.172 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-04-28T13:07:49.172 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:49.172 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-04-28T13:07:49.172 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:49.172 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-28T13:07:49.173 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:07:49.173 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2024-04-28T13:07:49.173 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-28T13:07:49.173 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:07:49.173 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2024-04-28T13:07:49.173 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-28T13:07:49.173 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:07:49.173 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-28T13:07:49.173 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:07:49.173 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-28T13:07:49.173 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42740sec preferred_lft 42740sec 2024-04-28T13:07:49.173 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::26cd:4a7a:1eab:e9e4/64 scope link noprefixroute 2024-04-28T13:07:49.173 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:49.173 INFO:teuthology.orchestra.run.smithi134.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-28T13:07:49.173 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 56:6a:3a:53:27:30 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:07:49.173 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-28T13:07:49.174 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:49.174 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ccad:f6ff:feeb:4c86/64 scope link 2024-04-28T13:07:49.174 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:49.174 INFO:teuthology.orchestra.run.smithi134.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-28T13:07:49.174 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 56:6a:3a:53:27:30 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-28T13:07:49.174 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::546a:3aff:fe53:2730/64 scope link tentative 2024-04-28T13:07:49.174 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:49.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:49.174 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-28T13:07:49.235 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-04-28T13:07:49.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:49.237 DEBUG:teuthology.orchestra.run.smithi134:> route 2024-04-28T13:07:49.292 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2024-04-28T13:07:49.293 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-28T13:07:49.293 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-28T13:07:49.293 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-28T13:07:49.293 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-28T13:07:49.293 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-28T13:07:49.293 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-04-28T13:07:49.293 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-28T13:07:49.293 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-28T13:07:49.293 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-28T13:07:49.294 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-04-28T13:07:49.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-28T13:07:49.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:49.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:49.417 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-04-28T13:07:49.431 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-28T13:07:49.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:49.432 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list-id 2024-04-28T13:07:49.486 INFO:teuthology.orchestra.run.smithi134.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-28T13:07:49.487 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-28T13:07:49.487 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-04-28T13:07:49.487 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-28T13:07:49.487 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-28T13:07:49.487 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-04-28T13:07:49.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-28T13:07:49.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:49.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:49.602 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-28T13:07:49.625 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-28T13:07:49.625 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-28T13:07:49.625 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-04-28T13:07:49.625 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:49.626 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-04-28T13:07:49.626 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:49.626 INFO:teuthology.orchestra.run.smithi134.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-28T13:07:49.626 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 76:c0:80:d1:05:bf brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-28T13:07:49.626 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-28T13:07:49.626 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:49.626 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::74c0:80ff:fed1:5bf/64 scope link tentative 2024-04-28T13:07:49.626 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:49.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:49.627 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-28T13:07:49.690 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-28T13:07:49.690 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-28T13:07:49.690 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-04-28T13:07:49.690 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:49.690 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-04-28T13:07:49.690 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:49.690 INFO:teuthology.orchestra.run.smithi134.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-28T13:07:49.690 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 76:c0:80:d1:05:bf brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-28T13:07:49.690 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-28T13:07:49.690 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:49.690 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::74c0:80ff:fed1:5bf/64 scope link 2024-04-28T13:07:49.691 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:07:49.691 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-28T13:07:49.692 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-28T13:07:49.692 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-04-28T13:07:49.692 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-28T13:07:49.692 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-28T13:07:49.692 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-28T13:07:49.692 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-28T13:07:49.692 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-28T13:07:49.692 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-04-28T13:07:49.749 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:07:49.751 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:07:49.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-28T13:07:49.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:49.839 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-28T13:07:49.839 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-04-28T13:07:49.839 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.1 up 2024-04-28T13:07:49.839 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set dev brx.1 master ceph-brx 2024-04-28T13:07:49.839 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-04-28T13:07:49.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-28T13:07:49.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:49.954 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-28T13:07:49.954 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-28T13:07:49.968 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-28T13:07:49.968 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-28T13:07:49.968 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-28T13:07:50.022 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-28T13:07:50.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:50.023 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-28T13:07:50.104 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-28T13:07:50.104 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-28T13:07:50.104 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-04-28T13:07:50.112 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-28T13:07:50.112 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-28T13:07:50.113 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-04-28T13:07:50.113 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.134:3300,172.21.15.134:3301" 2024-04-28T13:07:50.113 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-28T13:07:50.118 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-28T13:07:50.118 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-28T13:07:50.118 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-04-28T13:07:50.118 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.134:3300,172.21.15.134:3301" 2024-04-28T13:07:50.118 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-28T13:07:50.118 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.134:6789,172.21.15.134:6790" 2024-04-28T13:07:50.118 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.134:6789,172.21.15.134:6790:/ 2024-04-28T13:07:50.118 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=0961cca0-69c8-4b26-b89a-621e12152fc4" will pass to kernel 2024-04-28T13:07:50.121 INFO:teuthology.orchestra.run.smithi134.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-04-28T13:07:50.121 INFO:teuthology.orchestra.run.smithi134.stdout: You just mounted a file system that supports labels which does not 2024-04-28T13:07:50.121 INFO:teuthology.orchestra.run.smithi134.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-28T13:07:50.121 INFO:teuthology.orchestra.run.smithi134.stdout: applications will generate AVC messages and not be allowed access to 2024-04-28T13:07:50.122 INFO:teuthology.orchestra.run.smithi134.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-28T13:07:50.122 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-28T13:07:50.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:50.122 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-28T13:07:50.185 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-28T13:07:50.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-28T13:07:50.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:50.280 INFO:teuthology.orchestra.run.smithi134.stdout:client4496 2024-04-28T13:07:50.280 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:07:50.281 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-28T13:07:50.296 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-28T13:07:50.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-28T13:07:50.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:50.391 INFO:teuthology.orchestra.run.smithi134.stdout:client4496 2024-04-28T13:07:50.391 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-28T13:07:50.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-28T13:07:50.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:50.447 INFO:teuthology.orchestra.run.smithi134.stdout:client4496 2024-04-28T13:07:50.447 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/0961cca0-69c8-4b26-b89a-621e12152fc4.client4496/status') 2024-04-28T13:07:50.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-28T13:07:50.503 INFO:teuthology.orchestra.run.smithi134.stdout:instance: client.4496 (3)192.168.0.2:0/3518050670 2024-04-28T13:07:50.504 INFO:teuthology.orchestra.run.smithi134.stdout:blocklisted: false 2024-04-28T13:07:50.504 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records in 2024-04-28T13:07:50.504 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records out 2024-04-28T13:07:50.504 INFO:teuthology.orchestra.run.smithi134.stderr:69 bytes copied, 3.979e-05 s, 1.7 MB/s 2024-04-28T13:07:50.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:07:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:07:50.511 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-28T13:07:50.526 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:07:50.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.635+0000 7f83680f9640 1 Processor -- start 2024-04-28T13:07:50.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.635+0000 7f83680f9640 1 -- start start 2024-04-28T13:07:50.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.636+0000 7f83680f9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83601601d0 0x7f8360155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:50.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.636+0000 7f83680f9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83600d2be0 con 0x7f83600cda00 2024-04-28T13:07:50.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.636+0000 7f83680f9640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8360160980 con 0x7f83600cdde0 2024-04-28T13:07:50.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.636+0000 7f83680f9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f83601606a0 con 0x7f83601601d0 2024-04-28T13:07:50.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.636+0000 7f8365e95640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f83600cda00 0x7f83600d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49954/0 (socket says 172.21.15.114:49954) 2024-04-28T13:07:50.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.636+0000 7f8365e95640 1 -- 172.21.15.114:0/2622923037 learned_addr learned my addr 172.21.15.114:0/2622923037 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:50.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.636+0000 7f8366696640 1 --2- 172.21.15.114:0/2622923037 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83601601d0 0x7f8360155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:50.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.636+0000 7f8364e93640 1 -- 172.21.15.114:0/2622923037 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4089589464 0 0) 0x7f83600d2be0 con 0x7f83600cda00 2024-04-28T13:07:50.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.636+0000 7f8364e93640 1 -- 172.21.15.114:0/2622923037 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f834c003520 con 0x7f83600cda00 2024-04-28T13:07:50.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.636+0000 7f8364e93640 1 -- 172.21.15.114:0/2622923037 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 887987331 0 0) 0x7f8360160980 con 0x7f83600cdde0 2024-04-28T13:07:50.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.636+0000 7f8364e93640 1 -- 172.21.15.114:0/2622923037 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83600d2be0 con 0x7f83600cdde0 2024-04-28T13:07:50.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.636+0000 7f8366696640 1 -- 172.21.15.114:0/2622923037 >> v1:172.21.15.134:6789/0 conn(0x7f83600cdde0 legacy=0x7f836015fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:50.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.636+0000 7f8366696640 1 -- 172.21.15.114:0/2622923037 >> v1:172.21.15.114:6789/0 conn(0x7f83600cda00 legacy=0x7f83600d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:50.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.636+0000 7f8364e93640 1 -- 172.21.15.114:0/2622923037 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 227329629 0 0) 0x7f834c003520 con 0x7f83600cda00 2024-04-28T13:07:50.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.636+0000 7f8366696640 1 -- 172.21.15.114:0/2622923037 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83600cf7b0 con 0x7f83601601d0 2024-04-28T13:07:50.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.637+0000 7f8366696640 1 --2- 172.21.15.114:0/2622923037 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83601601d0 0x7f8360155fc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8358009dc0 tx=0x7f835802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36d9f762e499e72e server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:50.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.637+0000 7f8364e93640 1 -- 172.21.15.114:0/2622923037 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835c001670 con 0x7f83601601d0 2024-04-28T13:07:50.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.637+0000 7f8364e93640 1 -- 172.21.15.114:0/2622923037 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8358007540 con 0x7f83601601d0 2024-04-28T13:07:50.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.637+0000 7f8364e93640 1 -- 172.21.15.114:0/2622923037 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83580078f0 con 0x7f83601601d0 2024-04-28T13:07:50.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.638+0000 7f83680f9640 1 -- 172.21.15.114:0/2622923037 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83601601d0 msgr2=0x7f8360155fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:50.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.638+0000 7f83680f9640 1 --2- 172.21.15.114:0/2622923037 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83601601d0 0x7f8360155fc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8358009dc0 tx=0x7f835802a660 comp rx=0 tx=0).stop 2024-04-28T13:07:50.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.638+0000 7f83680f9640 1 -- 172.21.15.114:0/2622923037 shutdown_connections 2024-04-28T13:07:50.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.638+0000 7f83680f9640 1 --2- 172.21.15.114:0/2622923037 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83601601d0 0x7f8360155fc0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:50.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.638+0000 7f83680f9640 1 -- 172.21.15.114:0/2622923037 >> 172.21.15.114:0/2622923037 conn(0x7f83600706f0 msgr2=0x7f8360070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:50.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.638+0000 7f83680f9640 1 -- 172.21.15.114:0/2622923037 shutdown_connections 2024-04-28T13:07:50.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.638+0000 7f83680f9640 1 -- 172.21.15.114:0/2622923037 wait complete. 2024-04-28T13:07:50.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.639+0000 7f83680f9640 1 Processor -- start 2024-04-28T13:07:50.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.639+0000 7f83680f9640 1 -- start start 2024-04-28T13:07:50.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.640+0000 7f83680f9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83600cda00 0x7f83600c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:50.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.640+0000 7f83680f9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83600cdde0 0x7f83601590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:50.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.640+0000 7f83680f9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83601601d0 0x7f8360159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:50.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.640+0000 7f83680f9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f83600d0980 con 0x7f83600cda00 2024-04-28T13:07:50.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.640+0000 7f83680f9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f83600cfd70 con 0x7f83601601d0 2024-04-28T13:07:50.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.640+0000 7f83680f9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f8360156500 con 0x7f83600cdde0 2024-04-28T13:07:50.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.640+0000 7f8365e95640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83600cda00 0x7f83600c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:50.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.640+0000 7f8365e95640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83600cda00 0x7f83600c8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43216/0 (socket says 172.21.15.114:43216) 2024-04-28T13:07:50.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.640+0000 7f8365e95640 1 -- 172.21.15.114:0/3050108568 learned_addr learned my addr 172.21.15.114:0/3050108568 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:50.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.640+0000 7f8366696640 1 --2- 172.21.15.114:0/3050108568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83601601d0 0x7f8360159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:50.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.640+0000 7f8365694640 1 --2- 172.21.15.114:0/3050108568 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83600cdde0 0x7f83601590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:50.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.640+0000 7f8365e95640 1 -- 172.21.15.114:0/3050108568 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83600cdde0 msgr2=0x7f83601590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:50.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.640+0000 7f8365e95640 1 --2- 172.21.15.114:0/3050108568 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83600cdde0 0x7f83601590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:50.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.640+0000 7f8365e95640 1 -- 172.21.15.114:0/3050108568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83601601d0 msgr2=0x7f8360159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:50.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.640+0000 7f8365e95640 1 --2- 172.21.15.114:0/3050108568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83601601d0 0x7f8360159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:50.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.640+0000 7f8365e95640 1 -- 172.21.15.114:0/3050108568 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8360157780 con 0x7f83600cda00 2024-04-28T13:07:50.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.640+0000 7f8366696640 1 --2- 172.21.15.114:0/3050108568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83601601d0 0x7f8360159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:50.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.640+0000 7f8365694640 1 --2- 172.21.15.114:0/3050108568 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83600cdde0 0x7f83601590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:50.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.641+0000 7f8365e95640 1 --2- 172.21.15.114:0/3050108568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83600cda00 0x7f83600c8fc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f835c00c5a0 tx=0x7f835c00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:50.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.641+0000 7f83567fc640 1 -- 172.21.15.114:0/3050108568 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835c017070 con 0x7f83600cda00 2024-04-28T13:07:50.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.641+0000 7f83567fc640 1 -- 172.21.15.114:0/3050108568 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f835c005ce0 con 0x7f83600cda00 2024-04-28T13:07:50.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.641+0000 7f83680f9640 1 -- 172.21.15.114:0/3050108568 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8360157a60 con 0x7f83600cda00 2024-04-28T13:07:50.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.641+0000 7f83567fc640 1 -- 172.21.15.114:0/3050108568 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835c0072b0 con 0x7f83600cda00 2024-04-28T13:07:50.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.641+0000 7f83680f9640 1 -- 172.21.15.114:0/3050108568 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8360158020 con 0x7f83600cda00 2024-04-28T13:07:50.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.642+0000 7f83680f9640 1 -- 172.21.15.114:0/3050108568 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f836006a3d0 con 0x7f83600cda00 2024-04-28T13:07:50.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.642+0000 7f83567fc640 1 -- 172.21.15.114:0/3050108568 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f835c01a070 con 0x7f83600cda00 2024-04-28T13:07:50.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.642+0000 7f83567fc640 1 --2- 172.21.15.114:0/3050108568 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f834406c920 0x7f834406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:50.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.643+0000 7f83567fc640 1 -- 172.21.15.114:0/3050108568 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f835c08b0e0 con 0x7f83600cda00 2024-04-28T13:07:50.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.643+0000 7f8365694640 1 --2- 172.21.15.114:0/3050108568 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f834406c920 0x7f834406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:50.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.643+0000 7f8365694640 1 --2- 172.21.15.114:0/3050108568 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f834406c920 0x7f834406ede0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f83500011e0 tx=0x7f8350009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:50.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.647+0000 7f83567fc640 1 -- 172.21.15.114:0/3050108568 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f835c059490 con 0x7f83600cda00 2024-04-28T13:07:50.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.825+0000 7f83680f9640 1 -- 172.21.15.114:0/3050108568 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8360069640 con 0x7f83600cda00 2024-04-28T13:07:50.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.826+0000 7f83567fc640 1 -- 172.21.15.114:0/3050108568 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7f835c058d90 con 0x7f83600cda00 2024-04-28T13:07:50.827 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:50.827 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:07:27.292537+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-28T13:07:23.706359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-28T13:07:24.596188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:07:50.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.828+0000 7f83680f9640 1 -- 172.21.15.114:0/3050108568 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f834406c920 msgr2=0x7f834406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:50.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.828+0000 7f83680f9640 1 --2- 172.21.15.114:0/3050108568 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f834406c920 0x7f834406ede0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f83500011e0 tx=0x7f8350009040 comp rx=0 tx=0).stop 2024-04-28T13:07:50.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.828+0000 7f83680f9640 1 -- 172.21.15.114:0/3050108568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83600cda00 msgr2=0x7f83600c8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:50.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.828+0000 7f83680f9640 1 --2- 172.21.15.114:0/3050108568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83600cda00 0x7f83600c8fc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f835c00c5a0 tx=0x7f835c00ca60 comp rx=0 tx=0).stop 2024-04-28T13:07:50.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.828+0000 7f83680f9640 1 -- 172.21.15.114:0/3050108568 shutdown_connections 2024-04-28T13:07:50.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.828+0000 7f83680f9640 1 --2- 172.21.15.114:0/3050108568 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f834406c920 0x7f834406ede0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:50.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.828+0000 7f83680f9640 1 --2- 172.21.15.114:0/3050108568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83601601d0 0x7f8360159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:50.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.828+0000 7f83680f9640 1 --2- 172.21.15.114:0/3050108568 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83600cdde0 0x7f83601590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:50.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.828+0000 7f83680f9640 1 --2- 172.21.15.114:0/3050108568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83600cda00 0x7f83600c8fc0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:50.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.828+0000 7f83680f9640 1 -- 172.21.15.114:0/3050108568 >> 172.21.15.114:0/3050108568 conn(0x7f83600706f0 msgr2=0x7f836006d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:50.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.828+0000 7f83680f9640 1 -- 172.21.15.114:0/3050108568 shutdown_connections 2024-04-28T13:07:50.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.828+0000 7f83680f9640 1 -- 172.21.15.114:0/3050108568 wait complete. 2024-04-28T13:07:50.840 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-28T13:07:14.721860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-28T13:07:23.706359+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-28T13:07:24.596188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-28T13:07:50.840 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-28T13:07:50.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.940+0000 7f80036bd640 1 Processor -- start 2024-04-28T13:07:50.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.940+0000 7f80036bd640 1 -- start start 2024-04-28T13:07:50.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.941+0000 7f80036bd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7ffc0d5870 0x7f7ffc16a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:50.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.941+0000 7f80036bd640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ffc0d2a40 con 0x7f7ffc0baf40 2024-04-28T13:07:50.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.941+0000 7f80036bd640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ffc0d2480 con 0x7f7ffc15f430 2024-04-28T13:07:50.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.941+0000 7f80036bd640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f7ffc15f810 con 0x7f7ffc0d5870 2024-04-28T13:07:50.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.941+0000 7f8000c58640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f7ffc0baf40 0x7f7ffc0d5160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49960/0 (socket says 172.21.15.114:49960) 2024-04-28T13:07:50.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.941+0000 7f8000c58640 1 -- 172.21.15.114:0/1741430740 learned_addr learned my addr 172.21.15.114:0/1741430740 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:50.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.941+0000 7f8001c5a640 1 --2- 172.21.15.114:0/1741430740 >> v2:172.21.15.134:3300/0 conn(0x7f7ffc0d5870 0x7f7ffc16a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:50.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.941+0000 7f7ff3fff640 1 -- 172.21.15.114:0/1741430740 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2943046227 0 0) 0x7f7ffc0d2a40 con 0x7f7ffc0baf40 2024-04-28T13:07:50.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.941+0000 7f7ff3fff640 1 -- 172.21.15.114:0/1741430740 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fe8003520 con 0x7f7ffc0baf40 2024-04-28T13:07:50.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.941+0000 7f7ff3fff640 1 -- 172.21.15.114:0/1741430740 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1044234902 0 0) 0x7f7ffc0d2480 con 0x7f7ffc15f430 2024-04-28T13:07:50.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.941+0000 7f7ff3fff640 1 -- 172.21.15.114:0/1741430740 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ffc0d2a40 con 0x7f7ffc15f430 2024-04-28T13:07:50.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.941+0000 7f8001c5a640 1 -- 172.21.15.114:0/1741430740 >> v1:172.21.15.134:6789/0 conn(0x7f7ffc15f430 legacy=0x7f7ffc0d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:50.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.941+0000 7f8001c5a640 1 -- 172.21.15.114:0/1741430740 >> v1:172.21.15.114:6789/0 conn(0x7f7ffc0baf40 legacy=0x7f7ffc0d5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:50.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.941+0000 7f8001c5a640 1 -- 172.21.15.114:0/1741430740 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ffc0d2760 con 0x7f7ffc0d5870 2024-04-28T13:07:50.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.942+0000 7f8001c5a640 1 --2- 172.21.15.114:0/1741430740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ffc0d5870 0x7f7ffc16a020 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4009d90 tx=0x7f7ff402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=818649be288fdb53 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:50.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.942+0000 7f7ff3fff640 1 -- 172.21.15.114:0/1741430740 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4007740 con 0x7f7ffc0d5870 2024-04-28T13:07:50.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.942+0000 7f7ff3fff640 1 -- 172.21.15.114:0/1741430740 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ff40078e0 con 0x7f7ffc0d5870 2024-04-28T13:07:50.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.942+0000 7f7ff3fff640 1 -- 172.21.15.114:0/1741430740 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4007c90 con 0x7f7ffc0d5870 2024-04-28T13:07:50.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.943+0000 7f80036bd640 1 -- 172.21.15.114:0/1741430740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ffc0d5870 msgr2=0x7f7ffc16a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:50.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.943+0000 7f80036bd640 1 --2- 172.21.15.114:0/1741430740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ffc0d5870 0x7f7ffc16a020 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4009d90 tx=0x7f7ff402a6f0 comp rx=0 tx=0).stop 2024-04-28T13:07:50.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.943+0000 7f80036bd640 1 -- 172.21.15.114:0/1741430740 shutdown_connections 2024-04-28T13:07:50.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.943+0000 7f80036bd640 1 --2- 172.21.15.114:0/1741430740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ffc0d5870 0x7f7ffc16a020 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:50.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.943+0000 7f80036bd640 1 -- 172.21.15.114:0/1741430740 >> 172.21.15.114:0/1741430740 conn(0x7f7ffc0633a0 msgr2=0x7f7ffc06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:50.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.943+0000 7f80036bd640 1 -- 172.21.15.114:0/1741430740 shutdown_connections 2024-04-28T13:07:50.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.943+0000 7f80036bd640 1 -- 172.21.15.114:0/1741430740 wait complete. 2024-04-28T13:07:50.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.944+0000 7f80036bd640 1 Processor -- start 2024-04-28T13:07:50.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.944+0000 7f80036bd640 1 -- start start 2024-04-28T13:07:50.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.945+0000 7f80036bd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ffc0baf40 0x7f7ffc14d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:50.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.945+0000 7f80036bd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ffc0d5870 0x7f7ffc0b6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:50.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.945+0000 7f80036bd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ffc15f430 0x7f7ffc0b7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:50.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.945+0000 7f80036bd640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7ffc0d2190 con 0x7f7ffc0baf40 2024-04-28T13:07:50.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.945+0000 7f80036bd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7ffc0d36d0 con 0x7f7ffc0d5870 2024-04-28T13:07:50.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.945+0000 7f80036bd640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f7ffc0d4b70 con 0x7f7ffc15f430 2024-04-28T13:07:50.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.945+0000 7f8001459640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ffc0baf40 0x7f7ffc14d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:50.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.945+0000 7f8001459640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ffc0baf40 0x7f7ffc14d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43222/0 (socket says 172.21.15.114:43222) 2024-04-28T13:07:50.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.945+0000 7f8001459640 1 -- 172.21.15.114:0/1861491433 learned_addr learned my addr 172.21.15.114:0/1861491433 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:50.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.945+0000 7f8001c5a640 1 --2- 172.21.15.114:0/1861491433 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ffc15f430 0x7f7ffc0b7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:50.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.945+0000 7f8000c58640 1 --2- 172.21.15.114:0/1861491433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ffc0d5870 0x7f7ffc0b6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:50.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.945+0000 7f8001459640 1 -- 172.21.15.114:0/1861491433 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ffc15f430 msgr2=0x7f7ffc0b7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:50.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.945+0000 7f8001459640 1 --2- 172.21.15.114:0/1861491433 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ffc15f430 0x7f7ffc0b7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:50.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.945+0000 7f8001459640 1 -- 172.21.15.114:0/1861491433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ffc0d5870 msgr2=0x7f7ffc0b6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:50.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.945+0000 7f8001459640 1 --2- 172.21.15.114:0/1861491433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ffc0d5870 0x7f7ffc0b6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:50.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.945+0000 7f8001459640 1 -- 172.21.15.114:0/1861491433 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ffc0c8da0 con 0x7f7ffc0baf40 2024-04-28T13:07:50.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.945+0000 7f8001459640 1 --2- 172.21.15.114:0/1861491433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ffc0baf40 0x7f7ffc14d550 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7ff800c430 tx=0x7f7ff800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:50.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.945+0000 7f7ff1ffb640 1 -- 172.21.15.114:0/1861491433 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8017070 con 0x7f7ffc0baf40 2024-04-28T13:07:50.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.946+0000 7f7ff1ffb640 1 -- 172.21.15.114:0/1861491433 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ff80052f0 con 0x7f7ffc0baf40 2024-04-28T13:07:50.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.946+0000 7f7ff1ffb640 1 -- 172.21.15.114:0/1861491433 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8003830 con 0x7f7ffc0baf40 2024-04-28T13:07:50.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.946+0000 7f80036bd640 1 -- 172.21.15.114:0/1861491433 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ffc0c9080 con 0x7f7ffc0baf40 2024-04-28T13:07:50.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.946+0000 7f80036bd640 1 -- 172.21.15.114:0/1861491433 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ffc14da90 con 0x7f7ffc0baf40 2024-04-28T13:07:50.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.947+0000 7f80036bd640 1 -- 172.21.15.114:0/1861491433 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ffc0c8b30 con 0x7f7ffc0baf40 2024-04-28T13:07:50.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.947+0000 7f7ff1ffb640 1 -- 172.21.15.114:0/1861491433 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7ff801a070 con 0x7f7ffc0baf40 2024-04-28T13:07:50.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.947+0000 7f7ff1ffb640 1 --2- 172.21.15.114:0/1861491433 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7fe006c8f0 0x7f7fe006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:50.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.948+0000 7f8000c58640 1 --2- 172.21.15.114:0/1861491433 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7fe006c8f0 0x7f7fe006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:50.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.948+0000 7f7ff1ffb640 1 -- 172.21.15.114:0/1861491433 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7ff808ae90 con 0x7f7ffc0baf40 2024-04-28T13:07:50.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.948+0000 7f8000c58640 1 --2- 172.21.15.114:0/1861491433 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7fe006c8f0 0x7f7fe006edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc0ca0d0 tx=0x7f7fec007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:50.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:50.952+0000 7f7ff1ffb640 1 -- 172.21.15.114:0/1861491433 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7ff8058c70 con 0x7f7ffc0baf40 2024-04-28T13:07:51.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.125+0000 7f80036bd640 1 -- 172.21.15.114:0/1861491433 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7ffc075c40 con 0x7f7ffc0baf40 2024-04-28T13:07:51.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.125+0000 7f7ff1ffb640 1 -- 172.21.15.114:0/1861491433 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f7ff805cf70 con 0x7f7ffc0baf40 2024-04-28T13:07:51.126 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-28T13:07:51.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.127+0000 7f80036bd640 1 -- 172.21.15.114:0/1861491433 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7fe006c8f0 msgr2=0x7f7fe006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:51.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.127+0000 7f80036bd640 1 --2- 172.21.15.114:0/1861491433 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7fe006c8f0 0x7f7fe006edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc0ca0d0 tx=0x7f7fec007d30 comp rx=0 tx=0).stop 2024-04-28T13:07:51.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.127+0000 7f80036bd640 1 -- 172.21.15.114:0/1861491433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ffc0baf40 msgr2=0x7f7ffc14d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:51.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.127+0000 7f80036bd640 1 --2- 172.21.15.114:0/1861491433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ffc0baf40 0x7f7ffc14d550 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7ff800c430 tx=0x7f7ff800c8f0 comp rx=0 tx=0).stop 2024-04-28T13:07:51.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.127+0000 7f80036bd640 1 -- 172.21.15.114:0/1861491433 shutdown_connections 2024-04-28T13:07:51.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.127+0000 7f80036bd640 1 --2- 172.21.15.114:0/1861491433 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ffc15f430 0x7f7ffc0b7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:51.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.127+0000 7f80036bd640 1 --2- 172.21.15.114:0/1861491433 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7fe006c8f0 0x7f7fe006edb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:51.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.127+0000 7f80036bd640 1 --2- 172.21.15.114:0/1861491433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ffc0d5870 0x7f7ffc0b6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:51.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.127+0000 7f80036bd640 1 --2- 172.21.15.114:0/1861491433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ffc0baf40 0x7f7ffc14d550 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:51.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.127+0000 7f80036bd640 1 -- 172.21.15.114:0/1861491433 >> 172.21.15.114:0/1861491433 conn(0x7f7ffc0633a0 msgr2=0x7f7ffc0d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:51.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.128+0000 7f80036bd640 1 -- 172.21.15.114:0/1861491433 shutdown_connections 2024-04-28T13:07:51.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.128+0000 7f80036bd640 1 -- 172.21.15.114:0/1861491433 wait complete. 2024-04-28T13:07:51.139 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-28T13:07:51.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.238+0000 7f4721787640 1 Processor -- start 2024-04-28T13:07:51.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.238+0000 7f4721787640 1 -- start start 2024-04-28T13:07:51.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.238+0000 7f4721787640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f471c15f430 0x7f471c0d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:51.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.238+0000 7f4721787640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f471c0d5870 0x7f471c0d3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:51.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.238+0000 7f4721787640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f471c0d2a40 con 0x7f471c0d1fc0 2024-04-28T13:07:51.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.238+0000 7f4721787640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f471c15f810 con 0x7f471c15f430 2024-04-28T13:07:51.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.238+0000 7f4721787640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f471c0d36d0 con 0x7f471c0d5870 2024-04-28T13:07:51.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.239+0000 7f471affd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f471c15f430 0x7f471c0d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:51.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.239+0000 7f471affd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f471c15f430 0x7f471c0d1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43238/0 (socket says 172.21.15.114:43238) 2024-04-28T13:07:51.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.239+0000 7f4713fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f471c0d1fc0 0x7f471c0d5160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49976/0 (socket says 172.21.15.114:49976) 2024-04-28T13:07:51.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.239+0000 7f471affd640 1 -- 172.21.15.114:0/4083859425 learned_addr learned my addr 172.21.15.114:0/4083859425 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:51.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.239+0000 7f471affd640 1 -- 172.21.15.114:0/4083859425 >> v2:172.21.15.134:3300/0 conn(0x7f471c0d5870 msgr2=0x7f471c0d3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:51.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.239+0000 7f471affd640 1 --2- 172.21.15.114:0/4083859425 >> v2:172.21.15.134:3300/0 conn(0x7f471c0d5870 0x7f471c0d3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:51.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.239+0000 7f471affd640 1 -- 172.21.15.114:0/4083859425 >> v1:172.21.15.114:6789/0 conn(0x7f471c0d1fc0 legacy=0x7f471c0d5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:51.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.239+0000 7f471a7fc640 1 -- 172.21.15.114:0/4083859425 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 493683703 0 0) 0x7f471c0d2a40 con 0x7f471c0d1fc0 2024-04-28T13:07:51.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.239+0000 7f471affd640 1 -- 172.21.15.114:0/4083859425 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f471c0d2480 con 0x7f471c15f430 2024-04-28T13:07:51.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.240+0000 7f471affd640 1 --2- 172.21.15.114:0/4083859425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f471c15f430 0x7f471c0d1a80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f471c0cf7b0 tx=0x7f470c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f4cb93c6ef93b66 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:51.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.240+0000 7f471a7fc640 1 -- 172.21.15.114:0/4083859425 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c037070 con 0x7f471c15f430 2024-04-28T13:07:51.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.240+0000 7f471a7fc640 1 -- 172.21.15.114:0/4083859425 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f470c032440 con 0x7f471c15f430 2024-04-28T13:07:51.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.240+0000 7f471a7fc640 1 -- 172.21.15.114:0/4083859425 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c032810 con 0x7f471c15f430 2024-04-28T13:07:51.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.240+0000 7f4721787640 1 -- 172.21.15.114:0/4083859425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f471c15f430 msgr2=0x7f471c0d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:51.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.240+0000 7f4721787640 1 --2- 172.21.15.114:0/4083859425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f471c15f430 0x7f471c0d1a80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f471c0cf7b0 tx=0x7f470c02a270 comp rx=0 tx=0).stop 2024-04-28T13:07:51.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.240+0000 7f4721787640 1 -- 172.21.15.114:0/4083859425 shutdown_connections 2024-04-28T13:07:51.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.240+0000 7f4721787640 1 --2- 172.21.15.114:0/4083859425 >> v2:172.21.15.134:3300/0 conn(0x7f471c0d5870 0x7f471c0d3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:51.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.240+0000 7f4721787640 1 --2- 172.21.15.114:0/4083859425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f471c15f430 0x7f471c0d1a80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:51.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.240+0000 7f4721787640 1 -- 172.21.15.114:0/4083859425 >> 172.21.15.114:0/4083859425 conn(0x7f471c0633a0 msgr2=0x7f471c06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:51.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.240+0000 7f4721787640 1 -- 172.21.15.114:0/4083859425 shutdown_connections 2024-04-28T13:07:51.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.240+0000 7f4721787640 1 -- 172.21.15.114:0/4083859425 wait complete. 2024-04-28T13:07:51.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.241+0000 7f4721787640 1 Processor -- start 2024-04-28T13:07:51.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.241+0000 7f4721787640 1 -- start start 2024-04-28T13:07:51.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.242+0000 7f4721787640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f471c0d1fc0 0x7f471c15a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:51.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.242+0000 7f4721787640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f471c0d5870 0x7f471c14c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:51.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.242+0000 7f4721787640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f471c15f430 0x7f471c0c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:51.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.242+0000 7f4721787640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f471c0baf40 con 0x7f471c0d5870 2024-04-28T13:07:51.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.242+0000 7f4721787640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f471c0d3360 con 0x7f471c0d1fc0 2024-04-28T13:07:51.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.242+0000 7f4721787640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f471c0bb0c0 con 0x7f471c15f430 2024-04-28T13:07:51.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.242+0000 7f4713fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f471c0d5870 0x7f471c14c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:51.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.242+0000 7f4713fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f471c0d5870 0x7f471c14c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43246/0 (socket says 172.21.15.114:43246) 2024-04-28T13:07:51.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.242+0000 7f4713fff640 1 -- 172.21.15.114:0/150957186 learned_addr learned my addr 172.21.15.114:0/150957186 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:51.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.242+0000 7f471b7fe640 1 --2- 172.21.15.114:0/150957186 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f471c15f430 0x7f471c0c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:51.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.242+0000 7f471affd640 1 --2- 172.21.15.114:0/150957186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f471c0d1fc0 0x7f471c15a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:51.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.242+0000 7f4713fff640 1 -- 172.21.15.114:0/150957186 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f471c15f430 msgr2=0x7f471c0c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:51.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.242+0000 7f4713fff640 1 --2- 172.21.15.114:0/150957186 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f471c15f430 0x7f471c0c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:51.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.242+0000 7f4713fff640 1 -- 172.21.15.114:0/150957186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f471c0d1fc0 msgr2=0x7f471c15a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:51.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.243+0000 7f4713fff640 1 --2- 172.21.15.114:0/150957186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f471c0d1fc0 0x7f471c15a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:51.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.243+0000 7f4713fff640 1 -- 172.21.15.114:0/150957186 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f471c0ce450 con 0x7f471c0d5870 2024-04-28T13:07:51.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.243+0000 7f471b7fe640 1 --2- 172.21.15.114:0/150957186 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f471c15f430 0x7f471c0c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:07:51.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.243+0000 7f4713fff640 1 --2- 172.21.15.114:0/150957186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f471c0d5870 0x7f471c14c520 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f470400c4d0 tx=0x7f470400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:51.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.243+0000 7f47137fe640 1 -- 172.21.15.114:0/150957186 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4704018070 con 0x7f471c0d5870 2024-04-28T13:07:51.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.243+0000 7f47137fe640 1 -- 172.21.15.114:0/150957186 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4704007500 con 0x7f471c0d5870 2024-04-28T13:07:51.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.243+0000 7f4721787640 1 -- 172.21.15.114:0/150957186 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f471c14ca60 con 0x7f471c0d5870 2024-04-28T13:07:51.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.243+0000 7f47137fe640 1 -- 172.21.15.114:0/150957186 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4704004a20 con 0x7f471c0d5870 2024-04-28T13:07:51.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.243+0000 7f4721787640 1 -- 172.21.15.114:0/150957186 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f471c0ce9d0 con 0x7f471c0d5870 2024-04-28T13:07:51.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.244+0000 7f4721787640 1 -- 172.21.15.114:0/150957186 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f471c075c40 con 0x7f471c0d5870 2024-04-28T13:07:51.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.244+0000 7f47137fe640 1 -- 172.21.15.114:0/150957186 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f470401b070 con 0x7f471c0d5870 2024-04-28T13:07:51.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.245+0000 7f47137fe640 1 --2- 172.21.15.114:0/150957186 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f46fc06c920 0x7f46fc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:51.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.245+0000 7f471affd640 1 --2- 172.21.15.114:0/150957186 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f46fc06c920 0x7f46fc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:51.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.245+0000 7f47137fe640 1 -- 172.21.15.114:0/150957186 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f470408ae50 con 0x7f471c0d5870 2024-04-28T13:07:51.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.245+0000 7f471affd640 1 --2- 172.21.15.114:0/150957186 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f46fc06c920 0x7f46fc06ede0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f470c034000 tx=0x7f470c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:51.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.249+0000 7f47137fe640 1 -- 172.21.15.114:0/150957186 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4704059270 con 0x7f471c0d5870 2024-04-28T13:07:51.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.426+0000 7f4721787640 1 -- 172.21.15.114:0/150957186 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f471c06a3d0 con 0x7f471c0d5870 2024-04-28T13:07:51.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.426+0000 7f47137fe640 1 -- 172.21.15.114:0/150957186 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f4704058b70 con 0x7f471c0d5870 2024-04-28T13:07:51.427 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-04-28T13:07:51.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.428+0000 7f4721787640 1 -- 172.21.15.114:0/150957186 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f46fc06c920 msgr2=0x7f46fc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:51.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.428+0000 7f4721787640 1 --2- 172.21.15.114:0/150957186 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f46fc06c920 0x7f46fc06ede0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f470c034000 tx=0x7f470c02e000 comp rx=0 tx=0).stop 2024-04-28T13:07:51.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.428+0000 7f4721787640 1 -- 172.21.15.114:0/150957186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f471c0d5870 msgr2=0x7f471c14c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:51.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.428+0000 7f4721787640 1 --2- 172.21.15.114:0/150957186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f471c0d5870 0x7f471c14c520 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f470400c4d0 tx=0x7f470400c990 comp rx=0 tx=0).stop 2024-04-28T13:07:51.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.428+0000 7f4721787640 1 -- 172.21.15.114:0/150957186 shutdown_connections 2024-04-28T13:07:51.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.428+0000 7f4721787640 1 --2- 172.21.15.114:0/150957186 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f471c15f430 0x7f471c0c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:51.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.428+0000 7f4721787640 1 --2- 172.21.15.114:0/150957186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f471c0d5870 0x7f471c14c520 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:51.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.428+0000 7f4721787640 1 --2- 172.21.15.114:0/150957186 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f46fc06c920 0x7f46fc06ede0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:51.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.428+0000 7f4721787640 1 --2- 172.21.15.114:0/150957186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f471c0d1fc0 0x7f471c15a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:51.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.428+0000 7f4721787640 1 -- 172.21.15.114:0/150957186 >> 172.21.15.114:0/150957186 conn(0x7f471c0633a0 msgr2=0x7f471c0b8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:51.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.428+0000 7f4721787640 1 -- 172.21.15.114:0/150957186 shutdown_connections 2024-04-28T13:07:51.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.428+0000 7f4721787640 1 -- 172.21.15.114:0/150957186 wait complete. 2024-04-28T13:07:51.440 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-28T13:07:51.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.538+0000 7f14c53e7640 1 Processor -- start 2024-04-28T13:07:51.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.538+0000 7f14c53e7640 1 -- start start 2024-04-28T13:07:51.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.539+0000 7f14c53e7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f14c00b6cb0 0x7f14c006dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:51.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.539+0000 7f14c53e7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14c00d0710 con 0x7f14c015f4d0 2024-04-28T13:07:51.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.539+0000 7f14c53e7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14c00d3550 con 0x7f14c00d0270 2024-04-28T13:07:51.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.539+0000 7f14c53e7640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f14c00d3e80 con 0x7f14c00b6cb0 2024-04-28T13:07:51.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.539+0000 7f14bf7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f14c015f4d0 0x7f14c00d4310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49986/0 (socket says 172.21.15.114:49986) 2024-04-28T13:07:51.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.539+0000 7f14bf7fe640 1 -- 172.21.15.114:0/1773339537 learned_addr learned my addr 172.21.15.114:0/1773339537 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:51.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.539+0000 7f14beffd640 1 --2- 172.21.15.114:0/1773339537 >> v2:172.21.15.134:3300/0 conn(0x7f14c00b6cb0 0x7f14c006dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:51.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.539+0000 7f14bdffb640 1 -- 172.21.15.114:0/1773339537 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3264215588 0 0) 0x7f14c00d0710 con 0x7f14c015f4d0 2024-04-28T13:07:51.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.539+0000 7f14bdffb640 1 -- 172.21.15.114:0/1773339537 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14a8003520 con 0x7f14c015f4d0 2024-04-28T13:07:51.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.539+0000 7f14bdffb640 1 -- 172.21.15.114:0/1773339537 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3491134689 0 0) 0x7f14a8003520 con 0x7f14c015f4d0 2024-04-28T13:07:51.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.539+0000 7f14bdffb640 1 -- 172.21.15.114:0/1773339537 >> v2:172.21.15.134:3300/0 conn(0x7f14c00b6cb0 msgr2=0x7f14c006dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:51.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.539+0000 7f14bdffb640 1 --2- 172.21.15.114:0/1773339537 >> v2:172.21.15.134:3300/0 conn(0x7f14c00b6cb0 0x7f14c006dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:51.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.539+0000 7f14bdffb640 1 -- 172.21.15.114:0/1773339537 >> v1:172.21.15.134:6789/0 conn(0x7f14c00d0270 legacy=0x7f14c00b7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:51.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.540+0000 7f14bdffb640 1 -- 172.21.15.114:0/1773339537 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14c00d3830 con 0x7f14c015f4d0 2024-04-28T13:07:51.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.540+0000 7f14bdffb640 1 -- 172.21.15.114:0/1773339537 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f14b8001670 con 0x7f14c015f4d0 2024-04-28T13:07:51.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.540+0000 7f14bdffb640 1 -- 172.21.15.114:0/1773339537 >> v1:172.21.15.114:6789/0 conn(0x7f14c015f4d0 legacy=0x7f14c00d4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:51.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.540+0000 7f14bdffb640 1 --2- 172.21.15.114:0/1773339537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14a80039b0 0x7f14a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:51.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.540+0000 7f14bdffb640 1 --2- 172.21.15.114:0/1773339537 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14a8004800 0x7f14a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:51.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.540+0000 7f14bdffb640 1 --2- 172.21.15.114:0/1773339537 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14a80051c0 0x7f14a800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:51.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.540+0000 7f14bdffb640 1 -- 172.21.15.114:0/1773339537 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f14c00d3e80 con 0x7f14a80051c0 2024-04-28T13:07:51.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.540+0000 7f14bdffb640 1 -- 172.21.15.114:0/1773339537 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f14a800c070 con 0x7f14a80039b0 2024-04-28T13:07:51.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.540+0000 7f14bdffb640 1 -- 172.21.15.114:0/1773339537 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f14a800c270 con 0x7f14a8004800 2024-04-28T13:07:51.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.540+0000 7f14bf7fe640 1 --2- 172.21.15.114:0/1773339537 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14a80051c0 0x7f14a800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:51.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.540+0000 7f14beffd640 1 --2- 172.21.15.114:0/1773339537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14a80039b0 0x7f14a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:51.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.540+0000 7f14be7fc640 1 --2- 172.21.15.114:0/1773339537 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14a8004800 0x7f14a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:51.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.540+0000 7f14bf7fe640 1 -- 172.21.15.114:0/1773339537 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14a8004800 msgr2=0x7f14a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:51.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.540+0000 7f14bf7fe640 1 --2- 172.21.15.114:0/1773339537 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14a8004800 0x7f14a8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:51.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.540+0000 7f14bf7fe640 1 -- 172.21.15.114:0/1773339537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14a80039b0 msgr2=0x7f14a8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:51.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.540+0000 7f14bf7fe640 1 --2- 172.21.15.114:0/1773339537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14a80039b0 0x7f14a8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:51.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.540+0000 7f14bf7fe640 1 -- 172.21.15.114:0/1773339537 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14a8003520 con 0x7f14a80051c0 2024-04-28T13:07:51.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.541+0000 7f14bf7fe640 1 -- 172.21.15.114:0/1773339537 reap_dead start 2024-04-28T13:07:51.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.541+0000 7f14bf7fe640 1 --2- 172.21.15.114:0/1773339537 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14a80051c0 0x7f14a800b9c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f14b800c240 tx=0x7f14a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b92e209622053a25 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:51.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.541+0000 7f14bdffb640 1 -- 172.21.15.114:0/1773339537 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b8007cf0 con 0x7f14a80051c0 2024-04-28T13:07:51.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.541+0000 7f14bdffb640 1 -- 172.21.15.114:0/1773339537 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14b80058d0 con 0x7f14a80051c0 2024-04-28T13:07:51.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.541+0000 7f14bdffb640 1 -- 172.21.15.114:0/1773339537 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b8005ce0 con 0x7f14a80051c0 2024-04-28T13:07:51.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.541+0000 7f14c53e7640 1 -- 172.21.15.114:0/1773339537 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14a80051c0 msgr2=0x7f14a800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:51.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.541+0000 7f14c53e7640 1 --2- 172.21.15.114:0/1773339537 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14a80051c0 0x7f14a800b9c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f14b800c240 tx=0x7f14a8005830 comp rx=0 tx=0).stop 2024-04-28T13:07:51.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.541+0000 7f14c53e7640 1 -- 172.21.15.114:0/1773339537 shutdown_connections 2024-04-28T13:07:51.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.541+0000 7f14c53e7640 1 --2- 172.21.15.114:0/1773339537 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14a80051c0 0x7f14a800b9c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:51.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.541+0000 7f14c53e7640 1 -- 172.21.15.114:0/1773339537 >> 172.21.15.114:0/1773339537 conn(0x7f14c00633a0 msgr2=0x7f14c00d1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:51.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.542+0000 7f14c53e7640 1 -- 172.21.15.114:0/1773339537 shutdown_connections 2024-04-28T13:07:51.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.542+0000 7f14c53e7640 1 -- 172.21.15.114:0/1773339537 wait complete. 2024-04-28T13:07:51.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.543+0000 7f14c53e7640 1 Processor -- start 2024-04-28T13:07:51.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.543+0000 7f14c53e7640 1 -- start start 2024-04-28T13:07:51.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.544+0000 7f14c53e7640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14a80051c0 0x7f14c00b9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:51.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.544+0000 7f14c53e7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14c014a7d0 0x7f14c014ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:51.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.544+0000 7f14c53e7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14c01f4ce0 0x7f14c01f5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:51.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.544+0000 7f14c53e7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f14c006dd40 con 0x7f14c01f4ce0 2024-04-28T13:07:51.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.544+0000 7f14c53e7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f14c00b48e0 con 0x7f14c014a7d0 2024-04-28T13:07:51.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.544+0000 7f14c53e7640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f14c006dec0 con 0x7f14a80051c0 2024-04-28T13:07:51.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.544+0000 7f14bf7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14c01f4ce0 0x7f14c01f5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:51.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.544+0000 7f14bf7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14c01f4ce0 0x7f14c01f5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43264/0 (socket says 172.21.15.114:43264) 2024-04-28T13:07:51.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.544+0000 7f14bf7fe640 1 -- 172.21.15.114:0/1942221808 learned_addr learned my addr 172.21.15.114:0/1942221808 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:51.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.544+0000 7f14bf7fe640 1 -- 172.21.15.114:0/1942221808 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14a80051c0 msgr2=0x7f14c00b9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:51.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.544+0000 7f14beffd640 1 --2- 172.21.15.114:0/1942221808 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14a80051c0 0x7f14c00b9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:51.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.544+0000 7f14be7fc640 1 --2- 172.21.15.114:0/1942221808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14c014a7d0 0x7f14c014ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:51.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.544+0000 7f14bf7fe640 1 --2- 172.21.15.114:0/1942221808 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14a80051c0 0x7f14c00b9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:51.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.544+0000 7f14bf7fe640 1 -- 172.21.15.114:0/1942221808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14c014a7d0 msgr2=0x7f14c014ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:51.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.544+0000 7f14bf7fe640 1 --2- 172.21.15.114:0/1942221808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14c014a7d0 0x7f14c014ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:51.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.544+0000 7f14bf7fe640 1 -- 172.21.15.114:0/1942221808 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14c014b170 con 0x7f14c01f4ce0 2024-04-28T13:07:51.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.544+0000 7f14bf7fe640 1 --2- 172.21.15.114:0/1942221808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14c01f4ce0 0x7f14c01f5160 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f14b800c360 tx=0x7f14c00b81f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:51.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.544+0000 7f14a77fe640 1 -- 172.21.15.114:0/1942221808 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b8038040 con 0x7f14c01f4ce0 2024-04-28T13:07:51.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.544+0000 7f14a77fe640 1 -- 172.21.15.114:0/1942221808 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14b80047e0 con 0x7f14c01f4ce0 2024-04-28T13:07:51.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.544+0000 7f14c53e7640 1 -- 172.21.15.114:0/1942221808 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14c00ba0f0 con 0x7f14c01f4ce0 2024-04-28T13:07:51.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.544+0000 7f14a77fe640 1 -- 172.21.15.114:0/1942221808 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b8007cf0 con 0x7f14c01f4ce0 2024-04-28T13:07:51.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.544+0000 7f14c53e7640 1 -- 172.21.15.114:0/1942221808 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14c015fd10 con 0x7f14c01f4ce0 2024-04-28T13:07:51.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.545+0000 7f14c53e7640 1 -- 172.21.15.114:0/1942221808 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14c006a3d0 con 0x7f14c01f4ce0 2024-04-28T13:07:51.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.546+0000 7f14a77fe640 1 -- 172.21.15.114:0/1942221808 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f14b8043020 con 0x7f14c01f4ce0 2024-04-28T13:07:51.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.546+0000 7f14a77fe640 1 --2- 172.21.15.114:0/1942221808 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f14ac06c920 0x7f14ac06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:51.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.546+0000 7f14a77fe640 1 -- 172.21.15.114:0/1942221808 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f14b80aae40 con 0x7f14c01f4ce0 2024-04-28T13:07:51.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.546+0000 7f14beffd640 1 --2- 172.21.15.114:0/1942221808 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f14ac06c920 0x7f14ac06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:51.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.546+0000 7f14beffd640 1 --2- 172.21.15.114:0/1942221808 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f14ac06c920 0x7f14ac06ede0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f14b0007330 tx=0x7f14b000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:51.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.550+0000 7f14a77fe640 1 -- 172.21.15.114:0/1942221808 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f14b804a020 con 0x7f14c01f4ce0 2024-04-28T13:07:51.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.726+0000 7f14c53e7640 1 -- 172.21.15.114:0/1942221808 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f14c00cc300 con 0x7f14c01f4ce0 2024-04-28T13:07:51.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.727+0000 7f14a77fe640 1 -- 172.21.15.114:0/1942221808 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f14b80791e0 con 0x7f14c01f4ce0 2024-04-28T13:07:51.727 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-04-28T13:07:51.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.729+0000 7f14c53e7640 1 -- 172.21.15.114:0/1942221808 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f14ac06c920 msgr2=0x7f14ac06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:51.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.729+0000 7f14c53e7640 1 --2- 172.21.15.114:0/1942221808 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f14ac06c920 0x7f14ac06ede0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f14b0007330 tx=0x7f14b000b040 comp rx=0 tx=0).stop 2024-04-28T13:07:51.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.729+0000 7f14c53e7640 1 -- 172.21.15.114:0/1942221808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14c01f4ce0 msgr2=0x7f14c01f5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:51.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.729+0000 7f14c53e7640 1 --2- 172.21.15.114:0/1942221808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14c01f4ce0 0x7f14c01f5160 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f14b800c360 tx=0x7f14c00b81f0 comp rx=0 tx=0).stop 2024-04-28T13:07:51.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.729+0000 7f14c53e7640 1 -- 172.21.15.114:0/1942221808 shutdown_connections 2024-04-28T13:07:51.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.729+0000 7f14c53e7640 1 --2- 172.21.15.114:0/1942221808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14c01f4ce0 0x7f14c01f5160 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:51.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.729+0000 7f14c53e7640 1 --2- 172.21.15.114:0/1942221808 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f14ac06c920 0x7f14ac06ede0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:51.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.729+0000 7f14c53e7640 1 --2- 172.21.15.114:0/1942221808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14c014a7d0 0x7f14c014ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:51.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.729+0000 7f14c53e7640 1 --2- 172.21.15.114:0/1942221808 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14a80051c0 0x7f14c00b9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:51.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.729+0000 7f14c53e7640 1 -- 172.21.15.114:0/1942221808 >> 172.21.15.114:0/1942221808 conn(0x7f14c00633a0 msgr2=0x7f14c00b5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:51.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.729+0000 7f14c53e7640 1 -- 172.21.15.114:0/1942221808 shutdown_connections 2024-04-28T13:07:51.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.729+0000 7f14c53e7640 1 -- 172.21.15.114:0/1942221808 wait complete. 2024-04-28T13:07:51.741 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:07:51.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.838+0000 7f2166daf640 1 Processor -- start 2024-04-28T13:07:51.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.838+0000 7f2166daf640 1 -- start start 2024-04-28T13:07:51.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.839+0000 7f2166daf640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f216015f8a0 0x7f2160071160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:51.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.839+0000 7f2166daf640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2160163c20 con 0x7f216015fc80 2024-04-28T13:07:51.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.839+0000 7f2166daf640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21600c88e0 con 0x7f2160161bf0 2024-04-28T13:07:51.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.839+0000 7f2166daf640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f21600c8f10 con 0x7f216015f8a0 2024-04-28T13:07:51.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.839+0000 7f215ffff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f216015fc80 0x7f2160162e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49990/0 (socket says 172.21.15.114:49990) 2024-04-28T13:07:51.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.839+0000 7f215ffff640 1 -- 172.21.15.114:0/251908408 learned_addr learned my addr 172.21.15.114:0/251908408 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:51.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.839+0000 7f215f7fe640 1 -- 172.21.15.114:0/251908408 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2534912061 0 0) 0x7f2160163c20 con 0x7f216015fc80 2024-04-28T13:07:51.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.839+0000 7f215f7fe640 1 -- 172.21.15.114:0/251908408 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2150003520 con 0x7f216015fc80 2024-04-28T13:07:51.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.839+0000 7f2164b4b640 1 --2- 172.21.15.114:0/251908408 >> v2:172.21.15.134:3300/0 conn(0x7f216015f8a0 0x7f2160071160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:51.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.839+0000 7f215f7fe640 1 -- 172.21.15.114:0/251908408 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1577513040 0 0) 0x7f2150003520 con 0x7f216015fc80 2024-04-28T13:07:51.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.839+0000 7f215f7fe640 1 -- 172.21.15.114:0/251908408 >> v2:172.21.15.134:3300/0 conn(0x7f216015f8a0 msgr2=0x7f2160071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:51.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.839+0000 7f215f7fe640 1 --2- 172.21.15.114:0/251908408 >> v2:172.21.15.134:3300/0 conn(0x7f216015f8a0 0x7f2160071160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:51.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.839+0000 7f215f7fe640 1 -- 172.21.15.114:0/251908408 >> v1:172.21.15.134:6789/0 conn(0x7f2160161bf0 legacy=0x7f2160163510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:51.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.839+0000 7f215f7fe640 1 -- 172.21.15.114:0/251908408 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f216006d7a0 con 0x7f216015fc80 2024-04-28T13:07:51.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.839+0000 7f215f7fe640 1 -- 172.21.15.114:0/251908408 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f214c001670 con 0x7f216015fc80 2024-04-28T13:07:51.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.839+0000 7f215f7fe640 1 -- 172.21.15.114:0/251908408 >> v1:172.21.15.114:6789/0 conn(0x7f216015fc80 legacy=0x7f2160162e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:51.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.839+0000 7f215f7fe640 1 --2- 172.21.15.114:0/251908408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21500039b0 0x7f2150003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:51.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.839+0000 7f215f7fe640 1 --2- 172.21.15.114:0/251908408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2150004800 0x7f2150004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:51.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.840+0000 7f215f7fe640 1 --2- 172.21.15.114:0/251908408 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21500051c0 0x7f215000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:51.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.840+0000 7f215f7fe640 1 -- 172.21.15.114:0/251908408 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f21600c8f10 con 0x7f21500039b0 2024-04-28T13:07:51.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.840+0000 7f215f7fe640 1 -- 172.21.15.114:0/251908408 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f215000c060 con 0x7f2150004800 2024-04-28T13:07:51.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.840+0000 7f215f7fe640 1 -- 172.21.15.114:0/251908408 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f215000c260 con 0x7f21500051c0 2024-04-28T13:07:51.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.840+0000 7f2164b4b640 1 --2- 172.21.15.114:0/251908408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21500039b0 0x7f2150003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:51.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.840+0000 7f215ffff640 1 --2- 172.21.15.114:0/251908408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2150004800 0x7f2150004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:51.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.840+0000 7f216534c640 1 --2- 172.21.15.114:0/251908408 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21500051c0 0x7f215000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:51.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.840+0000 7f2164b4b640 1 -- 172.21.15.114:0/251908408 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21500051c0 msgr2=0x7f215000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:51.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.840+0000 7f2164b4b640 1 --2- 172.21.15.114:0/251908408 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21500051c0 0x7f215000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:51.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.840+0000 7f2164b4b640 1 -- 172.21.15.114:0/251908408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2150004800 msgr2=0x7f2150004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:51.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.840+0000 7f2164b4b640 1 --2- 172.21.15.114:0/251908408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2150004800 0x7f2150004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:51.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.840+0000 7f2164b4b640 1 -- 172.21.15.114:0/251908408 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2150003520 con 0x7f21500039b0 2024-04-28T13:07:51.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.840+0000 7f216534c640 1 --2- 172.21.15.114:0/251908408 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21500051c0 0x7f215000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:51.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.840+0000 7f216534c640 1 -- 172.21.15.114:0/251908408 reap_dead start 2024-04-28T13:07:51.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.841+0000 7f2164b4b640 1 --2- 172.21.15.114:0/251908408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21500039b0 0x7f2150003dd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2154009ac0 tx=0x7f2150005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b755e6b3f3e59547 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:51.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.841+0000 7f215f7fe640 1 -- 172.21.15.114:0/251908408 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2154036070 con 0x7f21500039b0 2024-04-28T13:07:51.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.841+0000 7f215f7fe640 1 -- 172.21.15.114:0/251908408 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2154031400 con 0x7f21500039b0 2024-04-28T13:07:51.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.841+0000 7f215f7fe640 1 -- 172.21.15.114:0/251908408 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2154009690 con 0x7f21500039b0 2024-04-28T13:07:51.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.841+0000 7f2166daf640 1 -- 172.21.15.114:0/251908408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21500039b0 msgr2=0x7f2150003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:51.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.841+0000 7f2166daf640 1 --2- 172.21.15.114:0/251908408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21500039b0 0x7f2150003dd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2154009ac0 tx=0x7f2150005830 comp rx=0 tx=0).stop 2024-04-28T13:07:51.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.841+0000 7f2166daf640 1 -- 172.21.15.114:0/251908408 shutdown_connections 2024-04-28T13:07:51.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.841+0000 7f2166daf640 1 --2- 172.21.15.114:0/251908408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21500039b0 0x7f2150003dd0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:51.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.841+0000 7f2166daf640 1 -- 172.21.15.114:0/251908408 >> 172.21.15.114:0/251908408 conn(0x7f2160062d70 msgr2=0x7f2160063150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:51.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.841+0000 7f2166daf640 1 -- 172.21.15.114:0/251908408 shutdown_connections 2024-04-28T13:07:51.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.841+0000 7f2166daf640 1 -- 172.21.15.114:0/251908408 wait complete. 2024-04-28T13:07:51.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.842+0000 7f2166daf640 1 Processor -- start 2024-04-28T13:07:51.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.842+0000 7f2166daf640 1 -- start start 2024-04-28T13:07:51.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.843+0000 7f2166daf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21500039b0 0x7f21600b6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:51.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.843+0000 7f2166daf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f216014deb0 0x7f21600cd660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:51.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.843+0000 7f2166daf640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2160162070 0x7f21601624f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:51.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.843+0000 7f2166daf640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f21600d3930 con 0x7f21500039b0 2024-04-28T13:07:51.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.843+0000 7f2166daf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f21600c8ba0 con 0x7f216014deb0 2024-04-28T13:07:51.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.843+0000 7f2166daf640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f21601600c0 con 0x7f2160162070 2024-04-28T13:07:51.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.843+0000 7f2164b4b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21500039b0 0x7f21600b6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:51.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.843+0000 7f2164b4b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21500039b0 0x7f21600b6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43276/0 (socket says 172.21.15.114:43276) 2024-04-28T13:07:51.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.843+0000 7f2164b4b640 1 -- 172.21.15.114:0/890033552 learned_addr learned my addr 172.21.15.114:0/890033552 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:51.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.844+0000 7f216534c640 1 --2- 172.21.15.114:0/890033552 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2160162070 0x7f21601624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:51.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.844+0000 7f2164b4b640 1 -- 172.21.15.114:0/890033552 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2160162070 msgr2=0x7f21601624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:51.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.844+0000 7f215ffff640 1 --2- 172.21.15.114:0/890033552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f216014deb0 0x7f21600cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:51.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.844+0000 7f2164b4b640 1 --2- 172.21.15.114:0/890033552 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2160162070 0x7f21601624f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:51.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.844+0000 7f2164b4b640 1 -- 172.21.15.114:0/890033552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f216014deb0 msgr2=0x7f21600cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:51.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.844+0000 7f2164b4b640 1 --2- 172.21.15.114:0/890033552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f216014deb0 0x7f21600cd660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:51.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.844+0000 7f2164b4b640 1 -- 172.21.15.114:0/890033552 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f216014e760 con 0x7f21500039b0 2024-04-28T13:07:51.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.844+0000 7f2164b4b640 1 --2- 172.21.15.114:0/890033552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21500039b0 0x7f21600b6ec0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2154009be0 tx=0x7f2154004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:51.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.844+0000 7f215d7fa640 1 -- 172.21.15.114:0/890033552 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215403f020 con 0x7f21500039b0 2024-04-28T13:07:51.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.844+0000 7f215d7fa640 1 -- 172.21.15.114:0/890033552 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2154037040 con 0x7f21500039b0 2024-04-28T13:07:51.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.844+0000 7f2166daf640 1 -- 172.21.15.114:0/890033552 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f216014ea40 con 0x7f21500039b0 2024-04-28T13:07:51.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.844+0000 7f215d7fa640 1 -- 172.21.15.114:0/890033552 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2154036070 con 0x7f21500039b0 2024-04-28T13:07:51.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.844+0000 7f2166daf640 1 -- 172.21.15.114:0/890033552 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f216014f000 con 0x7f21500039b0 2024-04-28T13:07:51.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.845+0000 7f2166daf640 1 -- 172.21.15.114:0/890033552 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f216006a3d0 con 0x7f21500039b0 2024-04-28T13:07:51.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.846+0000 7f215d7fa640 1 -- 172.21.15.114:0/890033552 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2154042020 con 0x7f21500039b0 2024-04-28T13:07:51.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.846+0000 7f215d7fa640 1 --2- 172.21.15.114:0/890033552 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f214406c920 0x7f214406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:51.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.846+0000 7f215d7fa640 1 -- 172.21.15.114:0/890033552 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f21540abb30 con 0x7f21500039b0 2024-04-28T13:07:51.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.846+0000 7f215ffff640 1 --2- 172.21.15.114:0/890033552 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f214406c920 0x7f214406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:51.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.847+0000 7f215ffff640 1 --2- 172.21.15.114:0/890033552 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f214406c920 0x7f214406ede0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f216014f5c0 tx=0x7f214c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:51.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:51.851+0000 7f215d7fa640 1 -- 172.21.15.114:0/890033552 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2154049030 con 0x7f21500039b0 2024-04-28T13:07:52.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.026+0000 7f2166daf640 1 -- 172.21.15.114:0/890033552 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2160070f40 con 0x7f21500039b0 2024-04-28T13:07:52.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.028+0000 7f215d7fa640 1 -- 172.21.15.114:0/890033552 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7f2154079f60 con 0x7f21500039b0 2024-04-28T13:07:52.028 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:52.029 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:07:27.292537+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-28T13:07:23.706359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-28T13:07:24.596188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:07:52.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.030+0000 7f2166daf640 1 -- 172.21.15.114:0/890033552 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f214406c920 msgr2=0x7f214406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:52.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.030+0000 7f2166daf640 1 --2- 172.21.15.114:0/890033552 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f214406c920 0x7f214406ede0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f216014f5c0 tx=0x7f214c009040 comp rx=0 tx=0).stop 2024-04-28T13:07:52.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.030+0000 7f2166daf640 1 -- 172.21.15.114:0/890033552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21500039b0 msgr2=0x7f21600b6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:52.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.030+0000 7f2166daf640 1 --2- 172.21.15.114:0/890033552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21500039b0 0x7f21600b6ec0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2154009be0 tx=0x7f2154004730 comp rx=0 tx=0).stop 2024-04-28T13:07:52.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.030+0000 7f2166daf640 1 -- 172.21.15.114:0/890033552 shutdown_connections 2024-04-28T13:07:52.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.030+0000 7f2166daf640 1 --2- 172.21.15.114:0/890033552 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2160162070 0x7f21601624f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.030+0000 7f2166daf640 1 --2- 172.21.15.114:0/890033552 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f214406c920 0x7f214406ede0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.030+0000 7f2166daf640 1 --2- 172.21.15.114:0/890033552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f216014deb0 0x7f21600cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.030+0000 7f2166daf640 1 --2- 172.21.15.114:0/890033552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21500039b0 0x7f21600b6ec0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.030+0000 7f2166daf640 1 -- 172.21.15.114:0/890033552 >> 172.21.15.114:0/890033552 conn(0x7f2160062d70 msgr2=0x7f21600b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:52.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.030+0000 7f2166daf640 1 -- 172.21.15.114:0/890033552 shutdown_connections 2024-04-28T13:07:52.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.030+0000 7f2166daf640 1 -- 172.21.15.114:0/890033552 wait complete. 2024-04-28T13:07:52.041 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-28T13:07:14.721860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-28T13:07:23.706359+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-28T13:07:24.596188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-28T13:07:52.042 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-28T13:07:52.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.141+0000 7fb0313af640 1 Processor -- start 2024-04-28T13:07:52.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.141+0000 7fb0313af640 1 -- start start 2024-04-28T13:07:52.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.141+0000 7fb0313af640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb02c0baf40 0x7fb02c0d5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:52.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.141+0000 7fb0313af640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb02c0d56a0 0x7fb02c0d3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:52.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.141+0000 7fb0313af640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb02c0d2a40 con 0x7fb02c15f430 2024-04-28T13:07:52.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.141+0000 7fb0313af640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fb02c15f810 con 0x7fb02c0d56a0 2024-04-28T13:07:52.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.141+0000 7fb0313af640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb02c0d36d0 con 0x7fb02c0baf40 2024-04-28T13:07:52.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.142+0000 7fb02b7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb02c0d56a0 0x7fb02c0d3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:52.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.142+0000 7fb02affd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb02c15f430 0x7fb02c0d1a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49992/0 (socket says 172.21.15.114:49992) 2024-04-28T13:07:52.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.142+0000 7fb02affd640 1 -- 172.21.15.114:0/3158559884 learned_addr learned my addr 172.21.15.114:0/3158559884 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:52.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.142+0000 7fb02a7fc640 1 --2- 172.21.15.114:0/3158559884 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb02c0baf40 0x7fb02c0d5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:52.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.142+0000 7fb02b7fe640 1 -- 172.21.15.114:0/3158559884 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb02c0baf40 msgr2=0x7fb02c0d5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:52.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.142+0000 7fb02b7fe640 1 --2- 172.21.15.114:0/3158559884 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb02c0baf40 0x7fb02c0d5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.142+0000 7fb02b7fe640 1 -- 172.21.15.114:0/3158559884 >> v1:172.21.15.114:6789/0 conn(0x7fb02c15f430 legacy=0x7fb02c0d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:52.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.142+0000 7fb02b7fe640 1 -- 172.21.15.114:0/3158559884 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb02c0d2480 con 0x7fb02c0d56a0 2024-04-28T13:07:52.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.142+0000 7fb029ffb640 1 -- 172.21.15.114:0/3158559884 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1738180446 0 0) 0x7fb02c0d2a40 con 0x7fb02c15f430 2024-04-28T13:07:52.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.143+0000 7fb02b7fe640 1 --2- 172.21.15.114:0/3158559884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb02c0d56a0 0x7fb02c0d3b60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb024009d90 tx=0x7fb02402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1641caf61a35c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:52.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.143+0000 7fb029ffb640 1 -- 172.21.15.114:0/3158559884 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb024007740 con 0x7fb02c0d56a0 2024-04-28T13:07:52.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.143+0000 7fb029ffb640 1 -- 172.21.15.114:0/3158559884 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0240078e0 con 0x7fb02c0d56a0 2024-04-28T13:07:52.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.143+0000 7fb029ffb640 1 -- 172.21.15.114:0/3158559884 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb024007cb0 con 0x7fb02c0d56a0 2024-04-28T13:07:52.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.143+0000 7fb0313af640 1 -- 172.21.15.114:0/3158559884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb02c0d56a0 msgr2=0x7fb02c0d3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:52.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.143+0000 7fb0313af640 1 --2- 172.21.15.114:0/3158559884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb02c0d56a0 0x7fb02c0d3b60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb024009d90 tx=0x7fb02402a660 comp rx=0 tx=0).stop 2024-04-28T13:07:52.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.143+0000 7fb0313af640 1 -- 172.21.15.114:0/3158559884 shutdown_connections 2024-04-28T13:07:52.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.143+0000 7fb0313af640 1 --2- 172.21.15.114:0/3158559884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb02c0d56a0 0x7fb02c0d3b60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.143+0000 7fb0313af640 1 --2- 172.21.15.114:0/3158559884 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb02c0baf40 0x7fb02c0d5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.143+0000 7fb0313af640 1 -- 172.21.15.114:0/3158559884 >> 172.21.15.114:0/3158559884 conn(0x7fb02c0633a0 msgr2=0x7fb02c06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:52.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.143+0000 7fb0313af640 1 -- 172.21.15.114:0/3158559884 shutdown_connections 2024-04-28T13:07:52.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.143+0000 7fb0313af640 1 -- 172.21.15.114:0/3158559884 wait complete. 2024-04-28T13:07:52.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.145+0000 7fb0313af640 1 Processor -- start 2024-04-28T13:07:52.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.145+0000 7fb0313af640 1 -- start start 2024-04-28T13:07:52.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.145+0000 7fb0313af640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb02c0baf40 0x7fb02c0cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:52.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.145+0000 7fb0313af640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb02c0d56a0 0x7fb02c0cb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:52.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.145+0000 7fb0313af640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb02c15f430 0x7fb02c1542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:52.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.145+0000 7fb0313af640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb02c0d2190 con 0x7fb02c0baf40 2024-04-28T13:07:52.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.145+0000 7fb0313af640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb02c0d3360 con 0x7fb02c0d56a0 2024-04-28T13:07:52.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.145+0000 7fb0313af640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb02c0d40a0 con 0x7fb02c15f430 2024-04-28T13:07:52.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.145+0000 7fb02affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb02c0baf40 0x7fb02c0cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:52.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.146+0000 7fb02affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb02c0baf40 0x7fb02c0cdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43308/0 (socket says 172.21.15.114:43308) 2024-04-28T13:07:52.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.146+0000 7fb02affd640 1 -- 172.21.15.114:0/1717354457 learned_addr learned my addr 172.21.15.114:0/1717354457 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:52.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.146+0000 7fb02b7fe640 1 --2- 172.21.15.114:0/1717354457 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb02c15f430 0x7fb02c1542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:52.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.146+0000 7fb02affd640 1 -- 172.21.15.114:0/1717354457 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb02c15f430 msgr2=0x7fb02c1542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:52.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.146+0000 7fb02affd640 1 --2- 172.21.15.114:0/1717354457 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb02c15f430 0x7fb02c1542c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.146+0000 7fb02affd640 1 -- 172.21.15.114:0/1717354457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb02c0d56a0 msgr2=0x7fb02c0cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:52.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.146+0000 7fb02affd640 1 --2- 172.21.15.114:0/1717354457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb02c0d56a0 0x7fb02c0cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.146+0000 7fb02affd640 1 -- 172.21.15.114:0/1717354457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb02c1569b0 con 0x7fb02c0baf40 2024-04-28T13:07:52.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.146+0000 7fb02affd640 1 --2- 172.21.15.114:0/1717354457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb02c0baf40 0x7fb02c0cdd00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00c460 tx=0x7fb01c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:52.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.146+0000 7fb0137fe640 1 -- 172.21.15.114:0/1717354457 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01c018070 con 0x7fb02c0baf40 2024-04-28T13:07:52.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.146+0000 7fb0137fe640 1 -- 172.21.15.114:0/1717354457 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb01c007500 con 0x7fb02c0baf40 2024-04-28T13:07:52.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.146+0000 7fb0313af640 1 -- 172.21.15.114:0/1717354457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb02c0ce240 con 0x7fb02c0baf40 2024-04-28T13:07:52.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.146+0000 7fb0137fe640 1 -- 172.21.15.114:0/1717354457 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01c004a20 con 0x7fb02c0baf40 2024-04-28T13:07:52.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.146+0000 7fb0313af640 1 -- 172.21.15.114:0/1717354457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb02c0ceaa0 con 0x7fb02c0baf40 2024-04-28T13:07:52.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.147+0000 7fb0313af640 1 -- 172.21.15.114:0/1717354457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb02c075c40 con 0x7fb02c0baf40 2024-04-28T13:07:52.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.147+0000 7fb0137fe640 1 -- 172.21.15.114:0/1717354457 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb01c004bc0 con 0x7fb02c0baf40 2024-04-28T13:07:52.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.148+0000 7fb0137fe640 1 --2- 172.21.15.114:0/1717354457 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb01806c8f0 0x7fb01806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:52.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.148+0000 7fb0137fe640 1 -- 172.21.15.114:0/1717354457 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb01c08aee0 con 0x7fb02c0baf40 2024-04-28T13:07:52.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.148+0000 7fb02a7fc640 1 --2- 172.21.15.114:0/1717354457 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb01806c8f0 0x7fb01806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:52.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.148+0000 7fb02a7fc640 1 --2- 172.21.15.114:0/1717354457 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb01806c8f0 0x7fb01806edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb020006a90 tx=0x7fb020006a20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:52.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.152+0000 7fb0137fe640 1 -- 172.21.15.114:0/1717354457 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb01c059290 con 0x7fb02c0baf40 2024-04-28T13:07:52.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.325+0000 7fb0313af640 1 -- 172.21.15.114:0/1717354457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb02c06c350 con 0x7fb02c0baf40 2024-04-28T13:07:52.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.326+0000 7fb0137fe640 1 -- 172.21.15.114:0/1717354457 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fb01c058b90 con 0x7fb02c0baf40 2024-04-28T13:07:52.329 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-28T13:07:52.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.327+0000 7fb0313af640 1 -- 172.21.15.114:0/1717354457 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb01806c8f0 msgr2=0x7fb01806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:52.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.327+0000 7fb0313af640 1 --2- 172.21.15.114:0/1717354457 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb01806c8f0 0x7fb01806edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb020006a90 tx=0x7fb020006a20 comp rx=0 tx=0).stop 2024-04-28T13:07:52.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.327+0000 7fb0313af640 1 -- 172.21.15.114:0/1717354457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb02c0baf40 msgr2=0x7fb02c0cdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:52.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.327+0000 7fb0313af640 1 --2- 172.21.15.114:0/1717354457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb02c0baf40 0x7fb02c0cdd00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00c460 tx=0x7fb01c00c920 comp rx=0 tx=0).stop 2024-04-28T13:07:52.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.327+0000 7fb0313af640 1 -- 172.21.15.114:0/1717354457 shutdown_connections 2024-04-28T13:07:52.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.327+0000 7fb0313af640 1 --2- 172.21.15.114:0/1717354457 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb02c15f430 0x7fb02c1542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.327+0000 7fb0313af640 1 --2- 172.21.15.114:0/1717354457 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb01806c8f0 0x7fb01806edb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.327+0000 7fb0313af640 1 --2- 172.21.15.114:0/1717354457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb02c0d56a0 0x7fb02c0cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.327+0000 7fb0313af640 1 --2- 172.21.15.114:0/1717354457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb02c0baf40 0x7fb02c0cdd00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.328+0000 7fb0313af640 1 -- 172.21.15.114:0/1717354457 >> 172.21.15.114:0/1717354457 conn(0x7fb02c0633a0 msgr2=0x7fb02c0b6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:52.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.328+0000 7fb0313af640 1 -- 172.21.15.114:0/1717354457 shutdown_connections 2024-04-28T13:07:52.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.328+0000 7fb0313af640 1 -- 172.21.15.114:0/1717354457 wait complete. 2024-04-28T13:07:52.339 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-28T13:07:52.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.438+0000 7ff4913f0640 1 Processor -- start 2024-04-28T13:07:52.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.438+0000 7ff4913f0640 1 -- start start 2024-04-28T13:07:52.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.438+0000 7ff4913f0640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff48c0baf40 0x7ff48c0d5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:52.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.438+0000 7ff4913f0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff48c0d56a0 0x7ff48c0d3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:52.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.438+0000 7ff4913f0640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff48c0d2a40 con 0x7ff48c15f430 2024-04-28T13:07:52.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.438+0000 7ff4913f0640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7ff48c15f810 con 0x7ff48c0d56a0 2024-04-28T13:07:52.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.438+0000 7ff4913f0640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff48c0d36d0 con 0x7ff48c0baf40 2024-04-28T13:07:52.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.438+0000 7ff48b7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff48c0d56a0 0x7ff48c0d3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:52.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.439+0000 7ff48affd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff48c15f430 0x7ff48c0d1a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50002/0 (socket says 172.21.15.114:50002) 2024-04-28T13:07:52.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.439+0000 7ff48b7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff48c0d56a0 0x7ff48c0d3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43320/0 (socket says 172.21.15.114:43320) 2024-04-28T13:07:52.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.439+0000 7ff48affd640 1 -- 172.21.15.114:0/2720896476 learned_addr learned my addr 172.21.15.114:0/2720896476 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:52.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.439+0000 7ff48a7fc640 1 --2- 172.21.15.114:0/2720896476 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff48c0baf40 0x7ff48c0d5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:52.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.439+0000 7ff48b7fe640 1 -- 172.21.15.114:0/2720896476 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff48c0baf40 msgr2=0x7ff48c0d5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:52.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.439+0000 7ff48b7fe640 1 --2- 172.21.15.114:0/2720896476 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff48c0baf40 0x7ff48c0d5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.439+0000 7ff48b7fe640 1 -- 172.21.15.114:0/2720896476 >> v1:172.21.15.114:6789/0 conn(0x7ff48c15f430 legacy=0x7ff48c0d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:52.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.439+0000 7ff489ffb640 1 -- 172.21.15.114:0/2720896476 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3603707231 0 0) 0x7ff48c0d2a40 con 0x7ff48c15f430 2024-04-28T13:07:52.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.439+0000 7ff48b7fe640 1 -- 172.21.15.114:0/2720896476 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff48c0d2480 con 0x7ff48c0d56a0 2024-04-28T13:07:52.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.440+0000 7ff48b7fe640 1 --2- 172.21.15.114:0/2720896476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff48c0d56a0 0x7ff48c0d3b60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff484009d90 tx=0x7ff48402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f7adbedb81027ce server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:52.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.440+0000 7ff489ffb640 1 -- 172.21.15.114:0/2720896476 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff484007740 con 0x7ff48c0d56a0 2024-04-28T13:07:52.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.440+0000 7ff489ffb640 1 -- 172.21.15.114:0/2720896476 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4840078e0 con 0x7ff48c0d56a0 2024-04-28T13:07:52.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.440+0000 7ff489ffb640 1 -- 172.21.15.114:0/2720896476 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff484007cb0 con 0x7ff48c0d56a0 2024-04-28T13:07:52.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.440+0000 7ff4913f0640 1 -- 172.21.15.114:0/2720896476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff48c0d56a0 msgr2=0x7ff48c0d3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:52.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.440+0000 7ff4913f0640 1 --2- 172.21.15.114:0/2720896476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff48c0d56a0 0x7ff48c0d3b60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff484009d90 tx=0x7ff48402a660 comp rx=0 tx=0).stop 2024-04-28T13:07:52.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.440+0000 7ff4913f0640 1 -- 172.21.15.114:0/2720896476 shutdown_connections 2024-04-28T13:07:52.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.440+0000 7ff4913f0640 1 --2- 172.21.15.114:0/2720896476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff48c0d56a0 0x7ff48c0d3b60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.440+0000 7ff4913f0640 1 --2- 172.21.15.114:0/2720896476 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff48c0baf40 0x7ff48c0d5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.440+0000 7ff4913f0640 1 -- 172.21.15.114:0/2720896476 >> 172.21.15.114:0/2720896476 conn(0x7ff48c0633a0 msgr2=0x7ff48c06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:52.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.440+0000 7ff4913f0640 1 -- 172.21.15.114:0/2720896476 shutdown_connections 2024-04-28T13:07:52.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.440+0000 7ff4913f0640 1 -- 172.21.15.114:0/2720896476 wait complete. 2024-04-28T13:07:52.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.442+0000 7ff4913f0640 1 Processor -- start 2024-04-28T13:07:52.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.442+0000 7ff4913f0640 1 -- start start 2024-04-28T13:07:52.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.442+0000 7ff4913f0640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff48c0baf40 0x7ff48c0cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:52.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.442+0000 7ff4913f0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff48c0d56a0 0x7ff48c0cb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:52.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.442+0000 7ff4913f0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff48c15f430 0x7ff48c1542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:52.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.442+0000 7ff4913f0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c0d2190 con 0x7ff48c15f430 2024-04-28T13:07:52.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.442+0000 7ff4913f0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c0d3360 con 0x7ff48c0d56a0 2024-04-28T13:07:52.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.442+0000 7ff4913f0640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff48c0d40a0 con 0x7ff48c0baf40 2024-04-28T13:07:52.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.442+0000 7ff48b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff48c15f430 0x7ff48c1542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:52.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.442+0000 7ff48b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff48c15f430 0x7ff48c1542c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43326/0 (socket says 172.21.15.114:43326) 2024-04-28T13:07:52.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.442+0000 7ff48b7fe640 1 -- 172.21.15.114:0/2401044008 learned_addr learned my addr 172.21.15.114:0/2401044008 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:52.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.442+0000 7ff48affd640 1 --2- 172.21.15.114:0/2401044008 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff48c0baf40 0x7ff48c0cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:52.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.443+0000 7ff48a7fc640 1 --2- 172.21.15.114:0/2401044008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff48c0d56a0 0x7ff48c0cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:52.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.443+0000 7ff48b7fe640 1 -- 172.21.15.114:0/2401044008 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff48c0baf40 msgr2=0x7ff48c0cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:52.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.443+0000 7ff48b7fe640 1 --2- 172.21.15.114:0/2401044008 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff48c0baf40 0x7ff48c0cdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.443+0000 7ff48b7fe640 1 -- 172.21.15.114:0/2401044008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff48c0d56a0 msgr2=0x7ff48c0cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:52.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.443+0000 7ff48b7fe640 1 --2- 172.21.15.114:0/2401044008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff48c0d56a0 0x7ff48c0cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.443+0000 7ff48b7fe640 1 -- 172.21.15.114:0/2401044008 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff48c1569b0 con 0x7ff48c15f430 2024-04-28T13:07:52.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.443+0000 7ff48b7fe640 1 --2- 172.21.15.114:0/2401044008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff48c15f430 0x7ff48c1542c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff484009eb0 tx=0x7ff484004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:52.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.443+0000 7ff4737fe640 1 -- 172.21.15.114:0/2401044008 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff484040070 con 0x7ff48c15f430 2024-04-28T13:07:52.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.443+0000 7ff4737fe640 1 -- 172.21.15.114:0/2401044008 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff484031bc0 con 0x7ff48c15f430 2024-04-28T13:07:52.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.443+0000 7ff4913f0640 1 -- 172.21.15.114:0/2401044008 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff48c0ce240 con 0x7ff48c15f430 2024-04-28T13:07:52.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.443+0000 7ff4737fe640 1 -- 172.21.15.114:0/2401044008 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48403c420 con 0x7ff48c15f430 2024-04-28T13:07:52.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.443+0000 7ff4913f0640 1 -- 172.21.15.114:0/2401044008 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff48c0ce7c0 con 0x7ff48c15f430 2024-04-28T13:07:52.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.444+0000 7ff4913f0640 1 -- 172.21.15.114:0/2401044008 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff48c06a3d0 con 0x7ff48c15f430 2024-04-28T13:07:52.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.445+0000 7ff4737fe640 1 -- 172.21.15.114:0/2401044008 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff484039040 con 0x7ff48c15f430 2024-04-28T13:07:52.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.445+0000 7ff4737fe640 1 --2- 172.21.15.114:0/2401044008 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff47806c8f0 0x7ff47806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:52.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.445+0000 7ff4737fe640 1 -- 172.21.15.114:0/2401044008 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff4840acf30 con 0x7ff48c15f430 2024-04-28T13:07:52.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.445+0000 7ff48affd640 1 --2- 172.21.15.114:0/2401044008 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff47806c8f0 0x7ff47806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:52.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.445+0000 7ff48affd640 1 --2- 172.21.15.114:0/2401044008 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff47806c8f0 0x7ff47806edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff47c007fd0 tx=0x7ff47c007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:52.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.449+0000 7ff4737fe640 1 -- 172.21.15.114:0/2401044008 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff48407ad10 con 0x7ff48c15f430 2024-04-28T13:07:52.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.622+0000 7ff4913f0640 1 -- 172.21.15.114:0/2401044008 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff48c06c350 con 0x7ff48c15f430 2024-04-28T13:07:52.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.622+0000 7ff4737fe640 1 -- 172.21.15.114:0/2401044008 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7ff48407f010 con 0x7ff48c15f430 2024-04-28T13:07:52.623 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-04-28T13:07:52.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.624+0000 7ff4913f0640 1 -- 172.21.15.114:0/2401044008 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff47806c8f0 msgr2=0x7ff47806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:52.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.624+0000 7ff4913f0640 1 --2- 172.21.15.114:0/2401044008 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff47806c8f0 0x7ff47806edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff47c007fd0 tx=0x7ff47c007de0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.624+0000 7ff4913f0640 1 -- 172.21.15.114:0/2401044008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff48c15f430 msgr2=0x7ff48c1542c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:52.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.624+0000 7ff4913f0640 1 --2- 172.21.15.114:0/2401044008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff48c15f430 0x7ff48c1542c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff484009eb0 tx=0x7ff484004a40 comp rx=0 tx=0).stop 2024-04-28T13:07:52.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.624+0000 7ff4913f0640 1 -- 172.21.15.114:0/2401044008 shutdown_connections 2024-04-28T13:07:52.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.624+0000 7ff4913f0640 1 --2- 172.21.15.114:0/2401044008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff48c15f430 0x7ff48c1542c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.624+0000 7ff4913f0640 1 --2- 172.21.15.114:0/2401044008 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff47806c8f0 0x7ff47806edb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.624+0000 7ff4913f0640 1 --2- 172.21.15.114:0/2401044008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff48c0d56a0 0x7ff48c0cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.624+0000 7ff4913f0640 1 --2- 172.21.15.114:0/2401044008 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff48c0baf40 0x7ff48c0cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.624+0000 7ff4913f0640 1 -- 172.21.15.114:0/2401044008 >> 172.21.15.114:0/2401044008 conn(0x7ff48c0633a0 msgr2=0x7ff48c0b6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:52.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.624+0000 7ff4913f0640 1 -- 172.21.15.114:0/2401044008 shutdown_connections 2024-04-28T13:07:52.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.624+0000 7ff4913f0640 1 -- 172.21.15.114:0/2401044008 wait complete. 2024-04-28T13:07:52.635 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-28T13:07:52.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.735+0000 7f641aab0640 1 Processor -- start 2024-04-28T13:07:52.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.735+0000 7f641aab0640 1 -- start start 2024-04-28T13:07:52.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.736+0000 7f641aab0640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6414148dc0 0x7f64140d0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:52.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.736+0000 7f641aab0640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64140c8e70 con 0x7f64140c87e0 2024-04-28T13:07:52.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.736+0000 7f641aab0640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64140c9150 con 0x7f64140d1270 2024-04-28T13:07:52.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.736+0000 7f641aab0640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f64140c8c30 con 0x7f6414148dc0 2024-04-28T13:07:52.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.736+0000 7f641904d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f64140c87e0 0x7f64140cdd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50008/0 (socket says 172.21.15.114:50008) 2024-04-28T13:07:52.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.736+0000 7f641904d640 1 -- 172.21.15.114:0/2122411771 learned_addr learned my addr 172.21.15.114:0/2122411771 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:52.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.736+0000 7f641884c640 1 --2- 172.21.15.114:0/2122411771 >> v2:172.21.15.134:3300/0 conn(0x7f6414148dc0 0x7f64140d0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:52.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.737+0000 7f64137fe640 1 -- 172.21.15.114:0/2122411771 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4232360406 0 0) 0x7f64140c8e70 con 0x7f64140c87e0 2024-04-28T13:07:52.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.737+0000 7f64137fe640 1 -- 172.21.15.114:0/2122411771 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63fc003520 con 0x7f64140c87e0 2024-04-28T13:07:52.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.737+0000 7f641884c640 1 -- 172.21.15.114:0/2122411771 >> v1:172.21.15.134:6789/0 conn(0x7f64140d1270 legacy=0x7f64140c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:52.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.737+0000 7f641884c640 1 -- 172.21.15.114:0/2122411771 >> v1:172.21.15.114:6789/0 conn(0x7f64140c87e0 legacy=0x7f64140cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:52.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.737+0000 7f641884c640 1 -- 172.21.15.114:0/2122411771 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64140c9430 con 0x7f6414148dc0 2024-04-28T13:07:52.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.737+0000 7f641884c640 1 --2- 172.21.15.114:0/2122411771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6414148dc0 0x7f64140d0d30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f64040097a0 tx=0x7f640402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45c2a12c42bd68df server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:52.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.738+0000 7f64137fe640 1 -- 172.21.15.114:0/2122411771 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6404037070 con 0x7f6414148dc0 2024-04-28T13:07:52.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.738+0000 7f64137fe640 1 -- 172.21.15.114:0/2122411771 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6404032440 con 0x7f6414148dc0 2024-04-28T13:07:52.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.738+0000 7f64137fe640 1 -- 172.21.15.114:0/2122411771 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64040327f0 con 0x7f6414148dc0 2024-04-28T13:07:52.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.738+0000 7f641aab0640 1 -- 172.21.15.114:0/2122411771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6414148dc0 msgr2=0x7f64140d0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:52.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.738+0000 7f641aab0640 1 --2- 172.21.15.114:0/2122411771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6414148dc0 0x7f64140d0d30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f64040097a0 tx=0x7f640402a1a0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.738+0000 7f641aab0640 1 -- 172.21.15.114:0/2122411771 shutdown_connections 2024-04-28T13:07:52.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.738+0000 7f641aab0640 1 --2- 172.21.15.114:0/2122411771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6414148dc0 0x7f64140d0d30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.738+0000 7f641aab0640 1 -- 172.21.15.114:0/2122411771 >> 172.21.15.114:0/2122411771 conn(0x7f64140706f0 msgr2=0x7f6414070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:52.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.738+0000 7f641aab0640 1 -- 172.21.15.114:0/2122411771 shutdown_connections 2024-04-28T13:07:52.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.738+0000 7f641aab0640 1 -- 172.21.15.114:0/2122411771 wait complete. 2024-04-28T13:07:52.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.739+0000 7f641aab0640 1 Processor -- start 2024-04-28T13:07:52.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.739+0000 7f641aab0640 1 -- start start 2024-04-28T13:07:52.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.740+0000 7f641aab0640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64140c87e0 0x7f64140b8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:52.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.740+0000 7f641aab0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64140d1270 0x7f641413fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:52.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.740+0000 7f641aab0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6414148dc0 0x7f64140cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:52.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.740+0000 7f641aab0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f64140ce480 con 0x7f64140d1270 2024-04-28T13:07:52.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.740+0000 7f641aab0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f64140cd850 con 0x7f6414148dc0 2024-04-28T13:07:52.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.740+0000 7f641aab0640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f64140ce600 con 0x7f64140c87e0 2024-04-28T13:07:52.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.740+0000 7f6413fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64140d1270 0x7f641413fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:52.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.740+0000 7f6413fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64140d1270 0x7f641413fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43338/0 (socket says 172.21.15.114:43338) 2024-04-28T13:07:52.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.740+0000 7f6413fff640 1 -- 172.21.15.114:0/1095503503 learned_addr learned my addr 172.21.15.114:0/1095503503 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:52.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.741+0000 7f641904d640 1 --2- 172.21.15.114:0/1095503503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6414148dc0 0x7f64140cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:52.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.741+0000 7f641884c640 1 --2- 172.21.15.114:0/1095503503 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64140c87e0 0x7f64140b8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:52.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.741+0000 7f6413fff640 1 -- 172.21.15.114:0/1095503503 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64140c87e0 msgr2=0x7f64140b8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:52.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.741+0000 7f6413fff640 1 --2- 172.21.15.114:0/1095503503 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64140c87e0 0x7f64140b8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.741+0000 7f6413fff640 1 -- 172.21.15.114:0/1095503503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6414148dc0 msgr2=0x7f64140cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:52.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.741+0000 7f6413fff640 1 --2- 172.21.15.114:0/1095503503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6414148dc0 0x7f64140cb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.741+0000 7f6413fff640 1 -- 172.21.15.114:0/1095503503 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64141402b0 con 0x7f64140d1270 2024-04-28T13:07:52.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.741+0000 7f641904d640 1 --2- 172.21.15.114:0/1095503503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6414148dc0 0x7f64140cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:52.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.741+0000 7f641884c640 1 --2- 172.21.15.114:0/1095503503 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64140c87e0 0x7f64140b8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:52.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.741+0000 7f6413fff640 1 --2- 172.21.15.114:0/1095503503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64140d1270 0x7f641413fd70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f640800c430 tx=0x7f640800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:52.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.741+0000 7f64117fa640 1 -- 172.21.15.114:0/1095503503 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64080052d0 con 0x7f64140d1270 2024-04-28T13:07:52.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.741+0000 7f64117fa640 1 -- 172.21.15.114:0/1095503503 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6408005490 con 0x7f64140d1270 2024-04-28T13:07:52.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.741+0000 7f641aab0640 1 -- 172.21.15.114:0/1095503503 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64140cbc20 con 0x7f64140d1270 2024-04-28T13:07:52.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.741+0000 7f64117fa640 1 -- 172.21.15.114:0/1095503503 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6408007260 con 0x7f64140d1270 2024-04-28T13:07:52.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.741+0000 7f641aab0640 1 -- 172.21.15.114:0/1095503503 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64140cc1a0 con 0x7f64140d1270 2024-04-28T13:07:52.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.742+0000 7f641aab0640 1 -- 172.21.15.114:0/1095503503 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f641406a3d0 con 0x7f64140d1270 2024-04-28T13:07:52.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.743+0000 7f64117fa640 1 -- 172.21.15.114:0/1095503503 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6408007400 con 0x7f64140d1270 2024-04-28T13:07:52.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.743+0000 7f64117fa640 1 --2- 172.21.15.114:0/1095503503 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f640006c8f0 0x7f640006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:52.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.743+0000 7f64117fa640 1 -- 172.21.15.114:0/1095503503 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f640808b0b0 con 0x7f64140d1270 2024-04-28T13:07:52.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.743+0000 7f641884c640 1 --2- 172.21.15.114:0/1095503503 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f640006c8f0 0x7f640006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:52.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.743+0000 7f641884c640 1 --2- 172.21.15.114:0/1095503503 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f640006c8f0 0x7f640006edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6404034000 tx=0x7f640402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:52.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.747+0000 7f64117fa640 1 -- 172.21.15.114:0/1095503503 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f64141402b0 con 0x7f64140d1270 2024-04-28T13:07:52.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.920+0000 7f641aab0640 1 -- 172.21.15.114:0/1095503503 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f641415f530 con 0x7f64140d1270 2024-04-28T13:07:52.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.920+0000 7f64117fa640 1 -- 172.21.15.114:0/1095503503 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f64080594e0 con 0x7f64140d1270 2024-04-28T13:07:52.921 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-04-28T13:07:52.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.922+0000 7f641aab0640 1 -- 172.21.15.114:0/1095503503 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f640006c8f0 msgr2=0x7f640006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:52.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.922+0000 7f641aab0640 1 --2- 172.21.15.114:0/1095503503 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f640006c8f0 0x7f640006edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6404034000 tx=0x7f640402e000 comp rx=0 tx=0).stop 2024-04-28T13:07:52.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.922+0000 7f641aab0640 1 -- 172.21.15.114:0/1095503503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64140d1270 msgr2=0x7f641413fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:52.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.922+0000 7f641aab0640 1 --2- 172.21.15.114:0/1095503503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64140d1270 0x7f641413fd70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f640800c430 tx=0x7f640800c8f0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.922+0000 7f641aab0640 1 -- 172.21.15.114:0/1095503503 shutdown_connections 2024-04-28T13:07:52.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.922+0000 7f641aab0640 1 --2- 172.21.15.114:0/1095503503 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f640006c8f0 0x7f640006edb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.922+0000 7f641aab0640 1 --2- 172.21.15.114:0/1095503503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6414148dc0 0x7f64140cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.922+0000 7f641aab0640 1 --2- 172.21.15.114:0/1095503503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64140d1270 0x7f641413fd70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.922+0000 7f641aab0640 1 --2- 172.21.15.114:0/1095503503 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64140c87e0 0x7f64140b8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:52.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.922+0000 7f641aab0640 1 -- 172.21.15.114:0/1095503503 >> 172.21.15.114:0/1095503503 conn(0x7f64140706f0 msgr2=0x7f6414070ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:52.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.922+0000 7f641aab0640 1 -- 172.21.15.114:0/1095503503 shutdown_connections 2024-04-28T13:07:52.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:52.922+0000 7f641aab0640 1 -- 172.21.15.114:0/1095503503 wait complete. 2024-04-28T13:07:52.934 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:07:53.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.030+0000 7fb9d5a09640 1 Processor -- start 2024-04-28T13:07:53.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.030+0000 7fb9d5a09640 1 -- start start 2024-04-28T13:07:53.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.030+0000 7fb9d5a09640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9d015f540 0x7fb9d00d22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:53.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.030+0000 7fb9d5a09640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb9d00b83c0 0x7fb9d00d27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:53.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.030+0000 7fb9d5a09640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9d00cfeb0 con 0x7fb9d00d33c0 2024-04-28T13:07:53.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.030+0000 7fb9d5a09640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb9d00d3fa0 con 0x7fb9d00b83c0 2024-04-28T13:07:53.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.030+0000 7fb9d5a09640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb9d00d4280 con 0x7fb9d015f540 2024-04-28T13:07:53.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.030+0000 7fb9cf7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb9d00d33c0 0x7fb9d0162f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50012/0 (socket says 172.21.15.114:50012) 2024-04-28T13:07:53.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.030+0000 7fb9cf7fe640 1 -- 172.21.15.114:0/3456303028 learned_addr learned my addr 172.21.15.114:0/3456303028 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:53.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.031+0000 7fb9cdffb640 1 -- 172.21.15.114:0/3456303028 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1142852721 0 0) 0x7fb9d00cfeb0 con 0x7fb9d00d33c0 2024-04-28T13:07:53.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.031+0000 7fb9ceffd640 1 --2- 172.21.15.114:0/3456303028 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9d015f540 0x7fb9d00d22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:53.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.031+0000 7fb9ce7fc640 1 --2- 172.21.15.114:0/3456303028 >> v2:172.21.15.134:3300/0 conn(0x7fb9d00b83c0 0x7fb9d00d27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:53.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.031+0000 7fb9cdffb640 1 -- 172.21.15.114:0/3456303028 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9b8003520 con 0x7fb9d00d33c0 2024-04-28T13:07:53.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.031+0000 7fb9cdffb640 1 -- 172.21.15.114:0/3456303028 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1380670732 0 0) 0x7fb9b8003520 con 0x7fb9d00d33c0 2024-04-28T13:07:53.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.031+0000 7fb9cdffb640 1 -- 172.21.15.114:0/3456303028 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9d015f540 msgr2=0x7fb9d00d22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:53.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.031+0000 7fb9cdffb640 1 --2- 172.21.15.114:0/3456303028 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9d015f540 0x7fb9d00d22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.031+0000 7fb9cdffb640 1 -- 172.21.15.114:0/3456303028 >> v2:172.21.15.134:3300/0 conn(0x7fb9d00b83c0 msgr2=0x7fb9d00d27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:53.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.031+0000 7fb9cdffb640 1 --2- 172.21.15.114:0/3456303028 >> v2:172.21.15.134:3300/0 conn(0x7fb9d00b83c0 0x7fb9d00d27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.031+0000 7fb9cdffb640 1 -- 172.21.15.114:0/3456303028 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d00d49f0 con 0x7fb9d00d33c0 2024-04-28T13:07:53.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.031+0000 7fb9cdffb640 1 -- 172.21.15.114:0/3456303028 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7fb9c0001670 con 0x7fb9d00d33c0 2024-04-28T13:07:53.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.031+0000 7fb9cdffb640 1 -- 172.21.15.114:0/3456303028 >> v1:172.21.15.114:6789/0 conn(0x7fb9d00d33c0 legacy=0x7fb9d0162f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:53.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.031+0000 7fb9cdffb640 1 --2- 172.21.15.114:0/3456303028 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9d015f540 0x7fb9b80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:53.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.031+0000 7fb9cdffb640 1 --2- 172.21.15.114:0/3456303028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9b8003f30 0x7fb9b8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:53.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.031+0000 7fb9cdffb640 1 --2- 172.21.15.114:0/3456303028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9b8004d40 0x7fb9b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:53.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.031+0000 7fb9cdffb640 1 -- 172.21.15.114:0/3456303028 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d00d3fa0 con 0x7fb9b8004d40 2024-04-28T13:07:53.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.031+0000 7fb9cdffb640 1 -- 172.21.15.114:0/3456303028 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d00d4280 con 0x7fb9b8003f30 2024-04-28T13:07:53.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.031+0000 7fb9cdffb640 1 -- 172.21.15.114:0/3456303028 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb9b800ba10 con 0x7fb9d015f540 2024-04-28T13:07:53.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.031+0000 7fb9cf7fe640 1 --2- 172.21.15.114:0/3456303028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9b8004d40 0x7fb9b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:53.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.031+0000 7fb9ceffd640 1 --2- 172.21.15.114:0/3456303028 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9d015f540 0x7fb9b80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:53.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.031+0000 7fb9ce7fc640 1 --2- 172.21.15.114:0/3456303028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9b8003f30 0x7fb9b8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:53.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.031+0000 7fb9cf7fe640 1 -- 172.21.15.114:0/3456303028 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9d015f540 msgr2=0x7fb9b80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:53.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.031+0000 7fb9cf7fe640 1 --2- 172.21.15.114:0/3456303028 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9d015f540 0x7fb9b80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.031+0000 7fb9cf7fe640 1 -- 172.21.15.114:0/3456303028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9b8003f30 msgr2=0x7fb9b8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:53.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.031+0000 7fb9cf7fe640 1 --2- 172.21.15.114:0/3456303028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9b8003f30 0x7fb9b8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.031+0000 7fb9cf7fe640 1 -- 172.21.15.114:0/3456303028 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b8003520 con 0x7fb9b8004d40 2024-04-28T13:07:53.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.032+0000 7fb9cf7fe640 1 --2- 172.21.15.114:0/3456303028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9b8004d40 0x7fb9b80051c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000c210 tx=0x7fb9b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb3582a8ff7fd33 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:53.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.032+0000 7fb9cdffb640 1 -- 172.21.15.114:0/3456303028 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0007d50 con 0x7fb9b8004d40 2024-04-28T13:07:53.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.032+0000 7fb9cdffb640 1 -- 172.21.15.114:0/3456303028 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9c0005ad0 con 0x7fb9b8004d40 2024-04-28T13:07:53.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.032+0000 7fb9cdffb640 1 -- 172.21.15.114:0/3456303028 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0007070 con 0x7fb9b8004d40 2024-04-28T13:07:53.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.033+0000 7fb9d5a09640 1 -- 172.21.15.114:0/3456303028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9b8004d40 msgr2=0x7fb9b80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:53.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.033+0000 7fb9d5a09640 1 --2- 172.21.15.114:0/3456303028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9b8004d40 0x7fb9b80051c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000c210 tx=0x7fb9b8005830 comp rx=0 tx=0).stop 2024-04-28T13:07:53.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.033+0000 7fb9cf7fe640 1 -- 172.21.15.114:0/3456303028 reap_dead start 2024-04-28T13:07:53.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.033+0000 7fb9d5a09640 1 -- 172.21.15.114:0/3456303028 shutdown_connections 2024-04-28T13:07:53.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.033+0000 7fb9d5a09640 1 -- 172.21.15.114:0/3456303028 >> 172.21.15.114:0/3456303028 conn(0x7fb9d0063160 msgr2=0x7fb9d0063570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:53.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.033+0000 7fb9d5a09640 1 -- 172.21.15.114:0/3456303028 shutdown_connections 2024-04-28T13:07:53.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.033+0000 7fb9d5a09640 1 -- 172.21.15.114:0/3456303028 wait complete. 2024-04-28T13:07:53.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.034+0000 7fb9d5a09640 1 Processor -- start 2024-04-28T13:07:53.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.034+0000 7fb9d5a09640 1 -- start start 2024-04-28T13:07:53.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.035+0000 7fb9d5a09640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9b8004d40 0x7fb9d0156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:53.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.035+0000 7fb9d5a09640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9d0158b40 0x7fb9d0161d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:53.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.035+0000 7fb9d5a09640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d00cb470 0x7fb9d00cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:53.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.035+0000 7fb9d5a09640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d00d2420 con 0x7fb9b8004d40 2024-04-28T13:07:53.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.035+0000 7fb9d5a09640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d00d22a0 con 0x7fb9d00cb470 2024-04-28T13:07:53.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.035+0000 7fb9d5a09640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb9d00d25a0 con 0x7fb9d0158b40 2024-04-28T13:07:53.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.035+0000 7fb9ceffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9b8004d40 0x7fb9d0156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:53.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.035+0000 7fb9ceffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9b8004d40 0x7fb9d0156ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43348/0 (socket says 172.21.15.114:43348) 2024-04-28T13:07:53.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.035+0000 7fb9ceffd640 1 -- 172.21.15.114:0/2117255232 learned_addr learned my addr 172.21.15.114:0/2117255232 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:53.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.035+0000 7fb9ce7fc640 1 --2- 172.21.15.114:0/2117255232 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9d0158b40 0x7fb9d0161d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:53.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.035+0000 7fb9cf7fe640 1 --2- 172.21.15.114:0/2117255232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d00cb470 0x7fb9d00cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:53.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.035+0000 7fb9ceffd640 1 -- 172.21.15.114:0/2117255232 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9d0158b40 msgr2=0x7fb9d0161d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:53.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.035+0000 7fb9ceffd640 1 --2- 172.21.15.114:0/2117255232 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9d0158b40 0x7fb9d0161d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.035+0000 7fb9ceffd640 1 -- 172.21.15.114:0/2117255232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d00cb470 msgr2=0x7fb9d00cb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:53.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.035+0000 7fb9ceffd640 1 --2- 172.21.15.114:0/2117255232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d00cb470 0x7fb9d00cb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.035+0000 7fb9ceffd640 1 -- 172.21.15.114:0/2117255232 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d0159350 con 0x7fb9b8004d40 2024-04-28T13:07:53.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.035+0000 7fb9ce7fc640 1 --2- 172.21.15.114:0/2117255232 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9d0158b40 0x7fb9d0161d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:53.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.035+0000 7fb9ceffd640 1 --2- 172.21.15.114:0/2117255232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9b8004d40 0x7fb9d0156ac0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb9c80119a0 tx=0x7fb9c8011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:53.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.036+0000 7fb9b7fff640 1 -- 172.21.15.114:0/2117255232 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c800faf0 con 0x7fb9b8004d40 2024-04-28T13:07:53.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.036+0000 7fb9b7fff640 1 -- 172.21.15.114:0/2117255232 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9c800fc90 con 0x7fb9b8004d40 2024-04-28T13:07:53.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.036+0000 7fb9d5a09640 1 -- 172.21.15.114:0/2117255232 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9d0159630 con 0x7fb9b8004d40 2024-04-28T13:07:53.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.036+0000 7fb9b7fff640 1 -- 172.21.15.114:0/2117255232 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8014440 con 0x7fb9b8004d40 2024-04-28T13:07:53.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.036+0000 7fb9d5a09640 1 -- 172.21.15.114:0/2117255232 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9d0158fa0 con 0x7fb9b8004d40 2024-04-28T13:07:53.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.037+0000 7fb9d5a09640 1 -- 172.21.15.114:0/2117255232 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9d00d27b0 con 0x7fb9b8004d40 2024-04-28T13:07:53.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.037+0000 7fb9b7fff640 1 -- 172.21.15.114:0/2117255232 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb9c8012040 con 0x7fb9b8004d40 2024-04-28T13:07:53.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.037+0000 7fb9b7fff640 1 --2- 172.21.15.114:0/2117255232 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb9bc06c920 0x7fb9bc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:53.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.037+0000 7fb9b7fff640 1 -- 172.21.15.114:0/2117255232 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb9c808c190 con 0x7fb9b8004d40 2024-04-28T13:07:53.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.037+0000 7fb9ce7fc640 1 --2- 172.21.15.114:0/2117255232 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb9bc06c920 0x7fb9bc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:53.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.038+0000 7fb9ce7fc640 1 --2- 172.21.15.114:0/2117255232 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb9bc06c920 0x7fb9bc06ede0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb9d01550b0 tx=0x7fb9c400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:53.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.041+0000 7fb9b7fff640 1 -- 172.21.15.114:0/2117255232 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb9d00d27b0 con 0x7fb9b8004d40 2024-04-28T13:07:53.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.215+0000 7fb9d5a09640 1 -- 172.21.15.114:0/2117255232 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9d006a3d0 con 0x7fb9b8004d40 2024-04-28T13:07:53.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.216+0000 7fb9b7fff640 1 -- 172.21.15.114:0/2117255232 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7fb9c8019030 con 0x7fb9b8004d40 2024-04-28T13:07:53.217 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:53.217 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:07:27.292537+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-28T13:07:23.706359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-28T13:07:24.596188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:07:53.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.218+0000 7fb9d5a09640 1 -- 172.21.15.114:0/2117255232 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb9bc06c920 msgr2=0x7fb9bc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:53.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.218+0000 7fb9d5a09640 1 --2- 172.21.15.114:0/2117255232 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb9bc06c920 0x7fb9bc06ede0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb9d01550b0 tx=0x7fb9c400b040 comp rx=0 tx=0).stop 2024-04-28T13:07:53.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.218+0000 7fb9d5a09640 1 -- 172.21.15.114:0/2117255232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9b8004d40 msgr2=0x7fb9d0156ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:53.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.218+0000 7fb9d5a09640 1 --2- 172.21.15.114:0/2117255232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9b8004d40 0x7fb9d0156ac0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb9c80119a0 tx=0x7fb9c8011e60 comp rx=0 tx=0).stop 2024-04-28T13:07:53.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.218+0000 7fb9d5a09640 1 -- 172.21.15.114:0/2117255232 shutdown_connections 2024-04-28T13:07:53.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.218+0000 7fb9d5a09640 1 --2- 172.21.15.114:0/2117255232 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb9bc06c920 0x7fb9bc06ede0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.218+0000 7fb9d5a09640 1 --2- 172.21.15.114:0/2117255232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d00cb470 0x7fb9d00cb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.218+0000 7fb9d5a09640 1 --2- 172.21.15.114:0/2117255232 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9d0158b40 0x7fb9d0161d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.218+0000 7fb9d5a09640 1 --2- 172.21.15.114:0/2117255232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9b8004d40 0x7fb9d0156ac0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.218+0000 7fb9d5a09640 1 -- 172.21.15.114:0/2117255232 >> 172.21.15.114:0/2117255232 conn(0x7fb9d0063160 msgr2=0x7fb9d00b4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:53.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.218+0000 7fb9d5a09640 1 -- 172.21.15.114:0/2117255232 shutdown_connections 2024-04-28T13:07:53.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.218+0000 7fb9d5a09640 1 -- 172.21.15.114:0/2117255232 wait complete. 2024-04-28T13:07:53.230 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-28T13:07:14.721860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-28T13:07:23.706359+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-28T13:07:24.596188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-28T13:07:53.230 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-28T13:07:53.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.329+0000 7f79fb579640 1 Processor -- start 2024-04-28T13:07:53.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.329+0000 7f79fb579640 1 -- start start 2024-04-28T13:07:53.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.330+0000 7f79fb579640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f79f40b33f0 0x7f79f40b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:53.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.330+0000 7f79fb579640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79f40b6790 con 0x7f79f415f370 2024-04-28T13:07:53.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.330+0000 7f79fb579640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79f40b5700 con 0x7f79f40d55d0 2024-04-28T13:07:53.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.330+0000 7f79fb579640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f79f40b59e0 con 0x7f79f40b33f0 2024-04-28T13:07:53.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.330+0000 7f79f9315640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f79f415f370 0x7f79f40d4ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50026/0 (socket says 172.21.15.114:50026) 2024-04-28T13:07:53.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.330+0000 7f79f9315640 1 -- 172.21.15.114:0/2251796273 learned_addr learned my addr 172.21.15.114:0/2251796273 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:53.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.330+0000 7f79ebfff640 1 -- 172.21.15.114:0/2251796273 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 273988051 0 0) 0x7f79f40b6790 con 0x7f79f415f370 2024-04-28T13:07:53.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.330+0000 7f79ebfff640 1 -- 172.21.15.114:0/2251796273 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79e0003520 con 0x7f79f415f370 2024-04-28T13:07:53.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.330+0000 7f79f9b16640 1 --2- 172.21.15.114:0/2251796273 >> v2:172.21.15.134:3300/0 conn(0x7f79f40b33f0 0x7f79f40b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:53.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.330+0000 7f79ebfff640 1 -- 172.21.15.114:0/2251796273 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2430170046 0 0) 0x7f79e0003520 con 0x7f79f415f370 2024-04-28T13:07:53.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.330+0000 7f79ebfff640 1 -- 172.21.15.114:0/2251796273 >> v2:172.21.15.134:3300/0 conn(0x7f79f40b33f0 msgr2=0x7f79f40b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:53.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.330+0000 7f79ebfff640 1 --2- 172.21.15.114:0/2251796273 >> v2:172.21.15.134:3300/0 conn(0x7f79f40b33f0 0x7f79f40b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.330+0000 7f79ebfff640 1 -- 172.21.15.114:0/2251796273 >> v1:172.21.15.134:6789/0 conn(0x7f79f40d55d0 legacy=0x7f79f40d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:53.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.330+0000 7f79ebfff640 1 -- 172.21.15.114:0/2251796273 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79f40b5cc0 con 0x7f79f415f370 2024-04-28T13:07:53.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.330+0000 7f79ebfff640 1 -- 172.21.15.114:0/2251796273 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f79f0001690 con 0x7f79f415f370 2024-04-28T13:07:53.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.330+0000 7f79ebfff640 1 -- 172.21.15.114:0/2251796273 >> v1:172.21.15.114:6789/0 conn(0x7f79f415f370 legacy=0x7f79f40d4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:53.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.330+0000 7f79ebfff640 1 --2- 172.21.15.114:0/2251796273 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79e0003a00 0x7f79e0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:53.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.330+0000 7f79ebfff640 1 --2- 172.21.15.114:0/2251796273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79e0004800 0x7f79e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:53.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.330+0000 7f79ebfff640 1 --2- 172.21.15.114:0/2251796273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79e00051c0 0x7f79e000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:53.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.330+0000 7f79ebfff640 1 -- 172.21.15.114:0/2251796273 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f79f40b59e0 con 0x7f79e0004800 2024-04-28T13:07:53.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.330+0000 7f79ebfff640 1 -- 172.21.15.114:0/2251796273 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f79e000c0c0 con 0x7f79e00051c0 2024-04-28T13:07:53.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.330+0000 7f79ebfff640 1 -- 172.21.15.114:0/2251796273 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f79e000c2c0 con 0x7f79e0003a00 2024-04-28T13:07:53.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.330+0000 7f79f8b14640 1 --2- 172.21.15.114:0/2251796273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79e0004800 0x7f79e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:53.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.331+0000 7f79f9b16640 1 --2- 172.21.15.114:0/2251796273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79e00051c0 0x7f79e000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:53.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.331+0000 7f79f9315640 1 --2- 172.21.15.114:0/2251796273 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79e0003a00 0x7f79e0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:53.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.331+0000 7f79f8b14640 1 -- 172.21.15.114:0/2251796273 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79e0003a00 msgr2=0x7f79e0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:53.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.331+0000 7f79f8b14640 1 --2- 172.21.15.114:0/2251796273 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79e0003a00 0x7f79e0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.331+0000 7f79f8b14640 1 -- 172.21.15.114:0/2251796273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79e00051c0 msgr2=0x7f79e000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:53.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.331+0000 7f79f8b14640 1 --2- 172.21.15.114:0/2251796273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79e00051c0 0x7f79e000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.331+0000 7f79f9b16640 1 -- 172.21.15.114:0/2251796273 reap_dead start 2024-04-28T13:07:53.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.331+0000 7f79f8b14640 1 -- 172.21.15.114:0/2251796273 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e0003520 con 0x7f79e0004800 2024-04-28T13:07:53.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.331+0000 7f79f9315640 1 --2- 172.21.15.114:0/2251796273 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79e0003a00 0x7f79e0003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:53.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.331+0000 7f79f8b14640 1 --2- 172.21.15.114:0/2251796273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79e0004800 0x7f79e0004c80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f79e4001720 tx=0x7f79e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1871ceed4dc9b3e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:53.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.331+0000 7f79ebfff640 1 -- 172.21.15.114:0/2251796273 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e4001370 con 0x7f79e0004800 2024-04-28T13:07:53.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.332+0000 7f79ebfff640 1 -- 172.21.15.114:0/2251796273 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79e40052d0 con 0x7f79e0004800 2024-04-28T13:07:53.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.332+0000 7f79ebfff640 1 -- 172.21.15.114:0/2251796273 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e402ab90 con 0x7f79e0004800 2024-04-28T13:07:53.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.332+0000 7f79fb579640 1 -- 172.21.15.114:0/2251796273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79e0004800 msgr2=0x7f79e0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:53.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.332+0000 7f79fb579640 1 --2- 172.21.15.114:0/2251796273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79e0004800 0x7f79e0004c80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f79e4001720 tx=0x7f79e0005830 comp rx=0 tx=0).stop 2024-04-28T13:07:53.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.332+0000 7f79fb579640 1 -- 172.21.15.114:0/2251796273 shutdown_connections 2024-04-28T13:07:53.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.332+0000 7f79fb579640 1 --2- 172.21.15.114:0/2251796273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79e0004800 0x7f79e0004c80 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.332+0000 7f79fb579640 1 -- 172.21.15.114:0/2251796273 >> 172.21.15.114:0/2251796273 conn(0x7f79f408ec10 msgr2=0x7f79f409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:53.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.332+0000 7f79fb579640 1 -- 172.21.15.114:0/2251796273 shutdown_connections 2024-04-28T13:07:53.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.332+0000 7f79fb579640 1 -- 172.21.15.114:0/2251796273 wait complete. 2024-04-28T13:07:53.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.333+0000 7f79fb579640 1 Processor -- start 2024-04-28T13:07:53.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.333+0000 7f79fb579640 1 -- start start 2024-04-28T13:07:53.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.334+0000 7f79fb579640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79e0004800 0x7f79f41563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:53.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.334+0000 7f79fb579640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79f40a0a50 0x7f79f40cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:53.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.334+0000 7f79fb579640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79f40ce8b0 0x7f79f40ced40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:53.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.334+0000 7f79fb579640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f79f40b4920 con 0x7f79f40a0a50 2024-04-28T13:07:53.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.334+0000 7f79fb579640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f79f40b1ec0 con 0x7f79e0004800 2024-04-28T13:07:53.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.334+0000 7f79fb579640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f79f40b4aa0 con 0x7f79f40ce8b0 2024-04-28T13:07:53.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.334+0000 7f79f8b14640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79f40a0a50 0x7f79f40cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:53.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.334+0000 7f79f8b14640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79f40a0a50 0x7f79f40cc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43372/0 (socket says 172.21.15.114:43372) 2024-04-28T13:07:53.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.334+0000 7f79f8b14640 1 -- 172.21.15.114:0/1812708277 learned_addr learned my addr 172.21.15.114:0/1812708277 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:53.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.334+0000 7f79f9315640 1 --2- 172.21.15.114:0/1812708277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79e0004800 0x7f79f41563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:53.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.334+0000 7f79f8b14640 1 -- 172.21.15.114:0/1812708277 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79f40ce8b0 msgr2=0x7f79f40ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:53.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.334+0000 7f79f8b14640 1 --2- 172.21.15.114:0/1812708277 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79f40ce8b0 0x7f79f40ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.334+0000 7f79f8b14640 1 -- 172.21.15.114:0/1812708277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79e0004800 msgr2=0x7f79f41563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:53.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.334+0000 7f79f8b14640 1 --2- 172.21.15.114:0/1812708277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79e0004800 0x7f79f41563e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.334+0000 7f79f8b14640 1 -- 172.21.15.114:0/1812708277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79f40ccb50 con 0x7f79f40a0a50 2024-04-28T13:07:53.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.335+0000 7f79f8b14640 1 --2- 172.21.15.114:0/1812708277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79f40a0a50 0x7f79f40cc2c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f79e4005040 tx=0x7f79e4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:53.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.335+0000 7f79e9ffb640 1 -- 172.21.15.114:0/1812708277 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e403f020 con 0x7f79f40a0a50 2024-04-28T13:07:53.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.335+0000 7f79e9ffb640 1 -- 172.21.15.114:0/1812708277 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79e4005480 con 0x7f79f40a0a50 2024-04-28T13:07:53.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.335+0000 7f79fb579640 1 -- 172.21.15.114:0/1812708277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79f40cce30 con 0x7f79f40a0a50 2024-04-28T13:07:53.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.335+0000 7f79e9ffb640 1 -- 172.21.15.114:0/1812708277 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e4037040 con 0x7f79f40a0a50 2024-04-28T13:07:53.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.335+0000 7f79fb579640 1 -- 172.21.15.114:0/1812708277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79f40cd3f0 con 0x7f79f40a0a50 2024-04-28T13:07:53.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.336+0000 7f79fb579640 1 -- 172.21.15.114:0/1812708277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79f406a3d0 con 0x7f79f40a0a50 2024-04-28T13:07:53.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.336+0000 7f79e9ffb640 1 -- 172.21.15.114:0/1812708277 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f79e4042020 con 0x7f79f40a0a50 2024-04-28T13:07:53.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.337+0000 7f79e9ffb640 1 --2- 172.21.15.114:0/1812708277 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f79d806c8f0 0x7f79d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:53.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.337+0000 7f79f9315640 1 --2- 172.21.15.114:0/1812708277 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f79d806c8f0 0x7f79d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:53.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.337+0000 7f79e9ffb640 1 -- 172.21.15.114:0/1812708277 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f79e40ab600 con 0x7f79f40a0a50 2024-04-28T13:07:53.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.337+0000 7f79f9315640 1 --2- 172.21.15.114:0/1812708277 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f79d806c8f0 0x7f79d806edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f79f0001c10 tx=0x7f79f0001110 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:53.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.341+0000 7f79e9ffb640 1 -- 172.21.15.114:0/1812708277 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f79e4049030 con 0x7f79f40a0a50 2024-04-28T13:07:53.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.516+0000 7f79fb579640 1 -- 172.21.15.114:0/1812708277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f79f40753b0 con 0x7f79f40a0a50 2024-04-28T13:07:53.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.516+0000 7f79e9ffb640 1 -- 172.21.15.114:0/1812708277 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f79e4079a30 con 0x7f79f40a0a50 2024-04-28T13:07:53.517 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-28T13:07:53.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.518+0000 7f79fb579640 1 -- 172.21.15.114:0/1812708277 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f79d806c8f0 msgr2=0x7f79d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:53.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.518+0000 7f79fb579640 1 --2- 172.21.15.114:0/1812708277 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f79d806c8f0 0x7f79d806edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f79f0001c10 tx=0x7f79f0001110 comp rx=0 tx=0).stop 2024-04-28T13:07:53.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.518+0000 7f79fb579640 1 -- 172.21.15.114:0/1812708277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79f40a0a50 msgr2=0x7f79f40cc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:53.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.518+0000 7f79fb579640 1 --2- 172.21.15.114:0/1812708277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79f40a0a50 0x7f79f40cc2c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f79e4005040 tx=0x7f79e4001120 comp rx=0 tx=0).stop 2024-04-28T13:07:53.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.518+0000 7f79fb579640 1 -- 172.21.15.114:0/1812708277 shutdown_connections 2024-04-28T13:07:53.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.518+0000 7f79fb579640 1 --2- 172.21.15.114:0/1812708277 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79f40ce8b0 0x7f79f40ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.518+0000 7f79fb579640 1 --2- 172.21.15.114:0/1812708277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79f40a0a50 0x7f79f40cc2c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.518+0000 7f79fb579640 1 --2- 172.21.15.114:0/1812708277 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f79d806c8f0 0x7f79d806edb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.518+0000 7f79fb579640 1 --2- 172.21.15.114:0/1812708277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79e0004800 0x7f79f41563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.518+0000 7f79fb579640 1 -- 172.21.15.114:0/1812708277 >> 172.21.15.114:0/1812708277 conn(0x7f79f408ec10 msgr2=0x7f79f406e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:53.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.518+0000 7f79fb579640 1 -- 172.21.15.114:0/1812708277 shutdown_connections 2024-04-28T13:07:53.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.518+0000 7f79fb579640 1 -- 172.21.15.114:0/1812708277 wait complete. 2024-04-28T13:07:53.530 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-28T13:07:53.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.629+0000 7f04d0186640 1 Processor -- start 2024-04-28T13:07:53.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.629+0000 7f04d0186640 1 -- start start 2024-04-28T13:07:53.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.630+0000 7f04d0186640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f04c8148b20 0x7f04c80d2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:53.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.630+0000 7f04d0186640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04c8163770 con 0x7f04c8148600 2024-04-28T13:07:53.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.630+0000 7f04d0186640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04c8163a50 con 0x7f04c80d3460 2024-04-28T13:07:53.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.630+0000 7f04d0186640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f04c80d38b0 con 0x7f04c8148b20 2024-04-28T13:07:53.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.630+0000 7f04cd721640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f04c8148b20 0x7f04c80d2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:53.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.630+0000 7f04cdf22640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f04c8148600 0x7f04c8162ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50034/0 (socket says 172.21.15.114:50034) 2024-04-28T13:07:53.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.630+0000 7f04cd721640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f04c8148b20 0x7f04c80d2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43386/0 (socket says 172.21.15.114:43386) 2024-04-28T13:07:53.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.630+0000 7f04cdf22640 1 -- 172.21.15.114:0/626689137 learned_addr learned my addr 172.21.15.114:0/626689137 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:53.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.630+0000 7f04cd721640 1 -- 172.21.15.114:0/626689137 >> v1:172.21.15.134:6789/0 conn(0x7f04c80d3460 legacy=0x7f04c806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:53.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.630+0000 7f04cd721640 1 -- 172.21.15.114:0/626689137 >> v1:172.21.15.114:6789/0 conn(0x7f04c8148600 legacy=0x7f04c8162ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:53.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.630+0000 7f04cd721640 1 -- 172.21.15.114:0/626689137 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04c8163d30 con 0x7f04c8148b20 2024-04-28T13:07:53.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.630+0000 7f04ccf20640 1 -- 172.21.15.114:0/626689137 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1083107555 0 0) 0x7f04c8163770 con 0x7f04c8148600 2024-04-28T13:07:53.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.631+0000 7f04cd721640 1 --2- 172.21.15.114:0/626689137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04c8148b20 0x7f04c80d2f20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f04b80097a0 tx=0x7f04b802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8cc05b251ecef7 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:53.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.631+0000 7f04ccf20640 1 -- 172.21.15.114:0/626689137 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b8037070 con 0x7f04c8148b20 2024-04-28T13:07:53.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.631+0000 7f04ccf20640 1 -- 172.21.15.114:0/626689137 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04b8032440 con 0x7f04c8148b20 2024-04-28T13:07:53.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.631+0000 7f04ccf20640 1 -- 172.21.15.114:0/626689137 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b8032810 con 0x7f04c8148b20 2024-04-28T13:07:53.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.631+0000 7f04d0186640 1 -- 172.21.15.114:0/626689137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04c8148b20 msgr2=0x7f04c80d2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:53.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.631+0000 7f04d0186640 1 --2- 172.21.15.114:0/626689137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04c8148b20 0x7f04c80d2f20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f04b80097a0 tx=0x7f04b802a1e0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.632+0000 7f04d0186640 1 -- 172.21.15.114:0/626689137 shutdown_connections 2024-04-28T13:07:53.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.632+0000 7f04d0186640 1 --2- 172.21.15.114:0/626689137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04c8148b20 0x7f04c80d2f20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.632+0000 7f04d0186640 1 -- 172.21.15.114:0/626689137 >> 172.21.15.114:0/626689137 conn(0x7f04c80b83a0 msgr2=0x7f04c80b8780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:53.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.632+0000 7f04d0186640 1 -- 172.21.15.114:0/626689137 shutdown_connections 2024-04-28T13:07:53.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.632+0000 7f04d0186640 1 -- 172.21.15.114:0/626689137 wait complete. 2024-04-28T13:07:53.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.633+0000 7f04d0186640 1 Processor -- start 2024-04-28T13:07:53.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.633+0000 7f04d0186640 1 -- start start 2024-04-28T13:07:53.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.633+0000 7f04d0186640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04c80d3460 0x7f04c813fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:53.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.633+0000 7f04d0186640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04c8148600 0x7f04c8160370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:53.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.633+0000 7f04d0186640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04c8148b20 0x7f04c80b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:53.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.633+0000 7f04d0186640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f04c80cf9e0 con 0x7f04c80d3460 2024-04-28T13:07:53.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.633+0000 7f04d0186640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f04c806d740 con 0x7f04c8148600 2024-04-28T13:07:53.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.633+0000 7f04d0186640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f04c80cfb60 con 0x7f04c8148b20 2024-04-28T13:07:53.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.633+0000 7f04cdf22640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04c80d3460 0x7f04c813fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:53.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.634+0000 7f04cdf22640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04c80d3460 0x7f04c813fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43400/0 (socket says 172.21.15.114:43400) 2024-04-28T13:07:53.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.634+0000 7f04cdf22640 1 -- 172.21.15.114:0/979559920 learned_addr learned my addr 172.21.15.114:0/979559920 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:53.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.634+0000 7f04cd721640 1 --2- 172.21.15.114:0/979559920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04c8148600 0x7f04c8160370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:53.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.634+0000 7f04ce723640 1 --2- 172.21.15.114:0/979559920 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04c8148b20 0x7f04c80b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:53.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.634+0000 7f04cdf22640 1 -- 172.21.15.114:0/979559920 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04c8148b20 msgr2=0x7f04c80b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:53.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.634+0000 7f04cdf22640 1 --2- 172.21.15.114:0/979559920 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04c8148b20 0x7f04c80b3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.634+0000 7f04cdf22640 1 -- 172.21.15.114:0/979559920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04c8148600 msgr2=0x7f04c8160370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:53.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.634+0000 7f04cdf22640 1 --2- 172.21.15.114:0/979559920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04c8148600 0x7f04c8160370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.634+0000 7f04cdf22640 1 -- 172.21.15.114:0/979559920 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04c80b5490 con 0x7f04c80d3460 2024-04-28T13:07:53.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.634+0000 7f04cdf22640 1 --2- 172.21.15.114:0/979559920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04c80d3460 0x7f04c813fbe0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f04c400c4d0 tx=0x7f04c400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:53.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.634+0000 7f04be7fc640 1 -- 172.21.15.114:0/979559920 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c4018070 con 0x7f04c80d3460 2024-04-28T13:07:53.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.634+0000 7f04be7fc640 1 -- 172.21.15.114:0/979559920 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c4007500 con 0x7f04c80d3460 2024-04-28T13:07:53.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.634+0000 7f04d0186640 1 -- 172.21.15.114:0/979559920 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04c81608b0 con 0x7f04c80d3460 2024-04-28T13:07:53.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.634+0000 7f04be7fc640 1 -- 172.21.15.114:0/979559920 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c4004a20 con 0x7f04c80d3460 2024-04-28T13:07:53.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.634+0000 7f04d0186640 1 -- 172.21.15.114:0/979559920 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04c8140550 con 0x7f04c80d3460 2024-04-28T13:07:53.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.635+0000 7f04d0186640 1 -- 172.21.15.114:0/979559920 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04c806a3d0 con 0x7f04c80d3460 2024-04-28T13:07:53.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.635+0000 7f04be7fc640 1 -- 172.21.15.114:0/979559920 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f04c401b070 con 0x7f04c80d3460 2024-04-28T13:07:53.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.636+0000 7f04be7fc640 1 --2- 172.21.15.114:0/979559920 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f04ac06c8f0 0x7f04ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:53.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.636+0000 7f04be7fc640 1 -- 172.21.15.114:0/979559920 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f04c408adf0 con 0x7f04c80d3460 2024-04-28T13:07:53.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.636+0000 7f04cd721640 1 --2- 172.21.15.114:0/979559920 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f04ac06c8f0 0x7f04ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:53.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.636+0000 7f04cd721640 1 --2- 172.21.15.114:0/979559920 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f04ac06c8f0 0x7f04ac06edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f04b8034000 tx=0x7f04b802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:53.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.640+0000 7f04be7fc640 1 -- 172.21.15.114:0/979559920 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f04c80b5490 con 0x7f04c80d3460 2024-04-28T13:07:53.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.816+0000 7f04d0186640 1 -- 172.21.15.114:0/979559920 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f04c8071220 con 0x7f04c80d3460 2024-04-28T13:07:53.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.817+0000 7f04be7fc640 1 -- 172.21.15.114:0/979559920 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f04c40592b0 con 0x7f04c80d3460 2024-04-28T13:07:53.818 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-04-28T13:07:53.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.818+0000 7f04d0186640 1 -- 172.21.15.114:0/979559920 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f04ac06c8f0 msgr2=0x7f04ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:53.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.819+0000 7f04d0186640 1 --2- 172.21.15.114:0/979559920 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f04ac06c8f0 0x7f04ac06edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f04b8034000 tx=0x7f04b802e000 comp rx=0 tx=0).stop 2024-04-28T13:07:53.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.819+0000 7f04d0186640 1 -- 172.21.15.114:0/979559920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04c80d3460 msgr2=0x7f04c813fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:53.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.819+0000 7f04d0186640 1 --2- 172.21.15.114:0/979559920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04c80d3460 0x7f04c813fbe0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f04c400c4d0 tx=0x7f04c400c990 comp rx=0 tx=0).stop 2024-04-28T13:07:53.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.819+0000 7f04d0186640 1 -- 172.21.15.114:0/979559920 shutdown_connections 2024-04-28T13:07:53.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.819+0000 7f04d0186640 1 --2- 172.21.15.114:0/979559920 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04c8148b20 0x7f04c80b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.819+0000 7f04d0186640 1 --2- 172.21.15.114:0/979559920 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f04ac06c8f0 0x7f04ac06edb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.819+0000 7f04d0186640 1 --2- 172.21.15.114:0/979559920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04c8148600 0x7f04c8160370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.819+0000 7f04d0186640 1 --2- 172.21.15.114:0/979559920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04c80d3460 0x7f04c813fbe0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.819+0000 7f04d0186640 1 -- 172.21.15.114:0/979559920 >> 172.21.15.114:0/979559920 conn(0x7f04c80b83a0 msgr2=0x7f04c8062d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:53.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.819+0000 7f04d0186640 1 -- 172.21.15.114:0/979559920 shutdown_connections 2024-04-28T13:07:53.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.819+0000 7f04d0186640 1 -- 172.21.15.114:0/979559920 wait complete. 2024-04-28T13:07:53.830 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-28T13:07:53.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.930+0000 7fcf5fb7f640 1 Processor -- start 2024-04-28T13:07:53.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.931+0000 7fcf5fb7f640 1 -- start start 2024-04-28T13:07:53.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.931+0000 7fcf5fb7f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcf580baf40 0x7fcf580d5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:53.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.931+0000 7fcf5fb7f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf580d56a0 0x7fcf580d3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:53.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.931+0000 7fcf5fb7f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf580d2a40 con 0x7fcf5815f430 2024-04-28T13:07:53.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.931+0000 7fcf5fb7f640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fcf5815f810 con 0x7fcf580baf40 2024-04-28T13:07:53.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.931+0000 7fcf5fb7f640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fcf580d36d0 con 0x7fcf580d56a0 2024-04-28T13:07:53.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.931+0000 7fcf5d11a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcf580baf40 0x7fcf580d5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:53.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.932+0000 7fcf5d11a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcf580baf40 0x7fcf580d5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43408/0 (socket says 172.21.15.114:43408) 2024-04-28T13:07:53.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.932+0000 7fcf5d11a640 1 -- 172.21.15.114:0/453949997 learned_addr learned my addr 172.21.15.114:0/453949997 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:53.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.932+0000 7fcf5e11c640 1 --2- 172.21.15.114:0/453949997 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf580d56a0 0x7fcf580d3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:53.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.932+0000 7fcf5d11a640 1 -- 172.21.15.114:0/453949997 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf580d56a0 msgr2=0x7fcf580d3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:53.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.932+0000 7fcf5d11a640 1 --2- 172.21.15.114:0/453949997 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf580d56a0 0x7fcf580d3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.932+0000 7fcf5d11a640 1 -- 172.21.15.114:0/453949997 >> v1:172.21.15.134:6789/0 conn(0x7fcf5815f430 legacy=0x7fcf580d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:53.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.932+0000 7fcf5d11a640 1 -- 172.21.15.114:0/453949997 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf580d2480 con 0x7fcf580baf40 2024-04-28T13:07:53.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.932+0000 7fcf5e11c640 1 --2- 172.21.15.114:0/453949997 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf580d56a0 0x7fcf580d3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:53.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.932+0000 7fcf5d11a640 1 --2- 172.21.15.114:0/453949997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf580baf40 0x7fcf580d5160 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcf48009870 tx=0x7fcf4802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b430db8917cb54 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:53.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.933+0000 7fcf5c919640 1 -- 172.21.15.114:0/453949997 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf48037070 con 0x7fcf580baf40 2024-04-28T13:07:53.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.933+0000 7fcf5c919640 1 -- 172.21.15.114:0/453949997 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf48032440 con 0x7fcf580baf40 2024-04-28T13:07:53.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.933+0000 7fcf5c919640 1 -- 172.21.15.114:0/453949997 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf48032810 con 0x7fcf580baf40 2024-04-28T13:07:53.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.933+0000 7fcf5fb7f640 1 -- 172.21.15.114:0/453949997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf580baf40 msgr2=0x7fcf580d5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:53.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.933+0000 7fcf5fb7f640 1 --2- 172.21.15.114:0/453949997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf580baf40 0x7fcf580d5160 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcf48009870 tx=0x7fcf4802a270 comp rx=0 tx=0).stop 2024-04-28T13:07:53.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.933+0000 7fcf5fb7f640 1 -- 172.21.15.114:0/453949997 shutdown_connections 2024-04-28T13:07:53.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.933+0000 7fcf5fb7f640 1 --2- 172.21.15.114:0/453949997 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf580d56a0 0x7fcf580d3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.933+0000 7fcf5fb7f640 1 --2- 172.21.15.114:0/453949997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf580baf40 0x7fcf580d5160 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.933+0000 7fcf5fb7f640 1 -- 172.21.15.114:0/453949997 >> 172.21.15.114:0/453949997 conn(0x7fcf580633a0 msgr2=0x7fcf5806d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:53.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.933+0000 7fcf5fb7f640 1 -- 172.21.15.114:0/453949997 shutdown_connections 2024-04-28T13:07:53.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.933+0000 7fcf5fb7f640 1 -- 172.21.15.114:0/453949997 wait complete. 2024-04-28T13:07:53.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.934+0000 7fcf5fb7f640 1 Processor -- start 2024-04-28T13:07:53.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.934+0000 7fcf5fb7f640 1 -- start start 2024-04-28T13:07:53.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.935+0000 7fcf5fb7f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf580baf40 0x7fcf58151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:53.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.935+0000 7fcf5fb7f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf580d56a0 0x7fcf5815d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:53.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.935+0000 7fcf5fb7f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf5815f430 0x7fcf581f8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:53.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.935+0000 7fcf5fb7f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcf580d2190 con 0x7fcf580baf40 2024-04-28T13:07:53.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.935+0000 7fcf5fb7f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcf580d3360 con 0x7fcf5815f430 2024-04-28T13:07:53.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.935+0000 7fcf5fb7f640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fcf580d40a0 con 0x7fcf580d56a0 2024-04-28T13:07:53.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.935+0000 7fcf5d91b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf580baf40 0x7fcf58151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:53.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.935+0000 7fcf5d91b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf580baf40 0x7fcf58151620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43412/0 (socket says 172.21.15.114:43412) 2024-04-28T13:07:53.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.935+0000 7fcf5d91b640 1 -- 172.21.15.114:0/4269227659 learned_addr learned my addr 172.21.15.114:0/4269227659 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:53.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.935+0000 7fcf5d11a640 1 --2- 172.21.15.114:0/4269227659 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf580d56a0 0x7fcf5815d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:53.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.935+0000 7fcf5e11c640 1 --2- 172.21.15.114:0/4269227659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf5815f430 0x7fcf581f8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:53.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.935+0000 7fcf5d91b640 1 -- 172.21.15.114:0/4269227659 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf580d56a0 msgr2=0x7fcf5815d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:53.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.935+0000 7fcf5d91b640 1 --2- 172.21.15.114:0/4269227659 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf580d56a0 0x7fcf5815d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.935+0000 7fcf5d91b640 1 -- 172.21.15.114:0/4269227659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf5815f430 msgr2=0x7fcf581f8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:53.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.935+0000 7fcf5d91b640 1 --2- 172.21.15.114:0/4269227659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf5815f430 0x7fcf581f8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:53.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.935+0000 7fcf5d91b640 1 -- 172.21.15.114:0/4269227659 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf580ccd50 con 0x7fcf580baf40 2024-04-28T13:07:53.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.936+0000 7fcf5d91b640 1 --2- 172.21.15.114:0/4269227659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf580baf40 0x7fcf58151620 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400c3c0 tx=0x7fcf5400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:53.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.936+0000 7fcf4e7fc640 1 -- 172.21.15.114:0/4269227659 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf540052d0 con 0x7fcf580baf40 2024-04-28T13:07:53.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.936+0000 7fcf4e7fc640 1 -- 172.21.15.114:0/4269227659 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf54005490 con 0x7fcf580baf40 2024-04-28T13:07:53.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.936+0000 7fcf4e7fc640 1 -- 172.21.15.114:0/4269227659 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf54007260 con 0x7fcf580baf40 2024-04-28T13:07:53.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.936+0000 7fcf5fb7f640 1 -- 172.21.15.114:0/4269227659 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf58151b60 con 0x7fcf580baf40 2024-04-28T13:07:53.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.936+0000 7fcf5fb7f640 1 -- 172.21.15.114:0/4269227659 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf580cd5b0 con 0x7fcf580baf40 2024-04-28T13:07:53.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.937+0000 7fcf5fb7f640 1 -- 172.21.15.114:0/4269227659 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf58075c40 con 0x7fcf580baf40 2024-04-28T13:07:53.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.937+0000 7fcf4e7fc640 1 -- 172.21.15.114:0/4269227659 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcf54007400 con 0x7fcf580baf40 2024-04-28T13:07:53.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.938+0000 7fcf4e7fc640 1 --2- 172.21.15.114:0/4269227659 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fcf3c06c8f0 0x7fcf3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:53.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.938+0000 7fcf4e7fc640 1 -- 172.21.15.114:0/4269227659 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcf5408b050 con 0x7fcf580baf40 2024-04-28T13:07:53.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.938+0000 7fcf5d11a640 1 --2- 172.21.15.114:0/4269227659 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fcf3c06c8f0 0x7fcf3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:53.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.938+0000 7fcf5d11a640 1 --2- 172.21.15.114:0/4269227659 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fcf3c06c8f0 0x7fcf3c06edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcf48034000 tx=0x7fcf4802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:53.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:53.942+0000 7fcf4e7fc640 1 -- 172.21.15.114:0/4269227659 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fcf54059480 con 0x7fcf580baf40 2024-04-28T13:07:54.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.114+0000 7fcf5fb7f640 1 -- 172.21.15.114:0/4269227659 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcf5806a3d0 con 0x7fcf580baf40 2024-04-28T13:07:54.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.114+0000 7fcf4e7fc640 1 -- 172.21.15.114:0/4269227659 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7fcf54058d80 con 0x7fcf580baf40 2024-04-28T13:07:54.115 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-04-28T13:07:54.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.116+0000 7fcf5fb7f640 1 -- 172.21.15.114:0/4269227659 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fcf3c06c8f0 msgr2=0x7fcf3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:54.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.116+0000 7fcf5fb7f640 1 --2- 172.21.15.114:0/4269227659 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fcf3c06c8f0 0x7fcf3c06edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcf48034000 tx=0x7fcf4802e000 comp rx=0 tx=0).stop 2024-04-28T13:07:54.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.116+0000 7fcf5fb7f640 1 -- 172.21.15.114:0/4269227659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf580baf40 msgr2=0x7fcf58151620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:54.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.116+0000 7fcf5fb7f640 1 --2- 172.21.15.114:0/4269227659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf580baf40 0x7fcf58151620 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400c3c0 tx=0x7fcf5400c880 comp rx=0 tx=0).stop 2024-04-28T13:07:54.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.116+0000 7fcf5fb7f640 1 -- 172.21.15.114:0/4269227659 shutdown_connections 2024-04-28T13:07:54.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.116+0000 7fcf5fb7f640 1 --2- 172.21.15.114:0/4269227659 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fcf3c06c8f0 0x7fcf3c06edb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:54.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.116+0000 7fcf5fb7f640 1 --2- 172.21.15.114:0/4269227659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf5815f430 0x7fcf581f8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:54.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.116+0000 7fcf5fb7f640 1 --2- 172.21.15.114:0/4269227659 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf580d56a0 0x7fcf5815d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:54.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.116+0000 7fcf5fb7f640 1 --2- 172.21.15.114:0/4269227659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf580baf40 0x7fcf58151620 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:54.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.116+0000 7fcf5fb7f640 1 -- 172.21.15.114:0/4269227659 >> 172.21.15.114:0/4269227659 conn(0x7fcf580633a0 msgr2=0x7fcf5815fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:54.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.116+0000 7fcf5fb7f640 1 -- 172.21.15.114:0/4269227659 shutdown_connections 2024-04-28T13:07:54.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.116+0000 7fcf5fb7f640 1 -- 172.21.15.114:0/4269227659 wait complete. 2024-04-28T13:07:54.128 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:07:54.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.223+0000 7f09fa652640 1 Processor -- start 2024-04-28T13:07:54.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.223+0000 7f09fa652640 1 -- start start 2024-04-28T13:07:54.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.224+0000 7f09fa652640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09f41606d0 0x7f09f4072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:54.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.224+0000 7f09fa652640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09f406fef0 con 0x7f09f4156590 2024-04-28T13:07:54.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.224+0000 7f09fa652640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09f40701d0 con 0x7f09f40cd8b0 2024-04-28T13:07:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.224+0000 7f09fa652640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f09f40704b0 con 0x7f09f41606d0 2024-04-28T13:07:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.224+0000 7f09f3fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f09f4156590 0x7f09f40d0570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50040/0 (socket says 172.21.15.114:50040) 2024-04-28T13:07:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.224+0000 7f09f3fff640 1 -- 172.21.15.114:0/2110180900 learned_addr learned my addr 172.21.15.114:0/2110180900 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.224+0000 7f09f37fe640 1 --2- 172.21.15.114:0/2110180900 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09f41606d0 0x7f09f4072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.224+0000 7f09f2ffd640 1 -- 172.21.15.114:0/2110180900 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3436505928 0 0) 0x7f09f406fef0 con 0x7f09f4156590 2024-04-28T13:07:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.224+0000 7f09f2ffd640 1 -- 172.21.15.114:0/2110180900 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09dc003520 con 0x7f09f4156590 2024-04-28T13:07:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.224+0000 7f09f2ffd640 1 -- 172.21.15.114:0/2110180900 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1296608701 0 0) 0x7f09dc003520 con 0x7f09f4156590 2024-04-28T13:07:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.224+0000 7f09f2ffd640 1 -- 172.21.15.114:0/2110180900 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09f41606d0 msgr2=0x7f09f4072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.224+0000 7f09f2ffd640 1 --2- 172.21.15.114:0/2110180900 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09f41606d0 0x7f09f4072160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.224+0000 7f09f2ffd640 1 -- 172.21.15.114:0/2110180900 >> v1:172.21.15.134:6789/0 conn(0x7f09f40cd8b0 legacy=0x7f09f40cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.224+0000 7f09f2ffd640 1 -- 172.21.15.114:0/2110180900 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f4156970 con 0x7f09f4156590 2024-04-28T13:07:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.224+0000 7f09f2ffd640 1 -- 172.21.15.114:0/2110180900 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f09e4001670 con 0x7f09f4156590 2024-04-28T13:07:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.224+0000 7f09f2ffd640 1 -- 172.21.15.114:0/2110180900 >> v1:172.21.15.114:6789/0 conn(0x7f09f4156590 legacy=0x7f09f40d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.224+0000 7f09f2ffd640 1 --2- 172.21.15.114:0/2110180900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09dc0039e0 0x7f09dc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:54.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.224+0000 7f09f2ffd640 1 --2- 172.21.15.114:0/2110180900 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09f41606d0 0x7f09dc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:54.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.224+0000 7f09f2ffd640 1 --2- 172.21.15.114:0/2110180900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09dc004d40 0x7f09dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:54.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.224+0000 7f09f2ffd640 1 -- 172.21.15.114:0/2110180900 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f09f40704b0 con 0x7f09dc004d40 2024-04-28T13:07:54.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.224+0000 7f09f2ffd640 1 -- 172.21.15.114:0/2110180900 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f09dc00b9c0 con 0x7f09dc0039e0 2024-04-28T13:07:54.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.224+0000 7f09f2ffd640 1 -- 172.21.15.114:0/2110180900 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f09dc00bbc0 con 0x7f09f41606d0 2024-04-28T13:07:54.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.225+0000 7f09f8bef640 1 --2- 172.21.15.114:0/2110180900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09dc004d40 0x7f09dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:54.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.225+0000 7f09f3fff640 1 --2- 172.21.15.114:0/2110180900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09dc0039e0 0x7f09dc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:54.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.225+0000 7f09f37fe640 1 --2- 172.21.15.114:0/2110180900 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09f41606d0 0x7f09dc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:54.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.225+0000 7f09f8bef640 1 -- 172.21.15.114:0/2110180900 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09f41606d0 msgr2=0x7f09dc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:54.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.225+0000 7f09f8bef640 1 --2- 172.21.15.114:0/2110180900 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09f41606d0 0x7f09dc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:54.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.225+0000 7f09f8bef640 1 -- 172.21.15.114:0/2110180900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09dc0039e0 msgr2=0x7f09dc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:54.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.225+0000 7f09f8bef640 1 --2- 172.21.15.114:0/2110180900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09dc0039e0 0x7f09dc003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:54.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.225+0000 7f09f8bef640 1 -- 172.21.15.114:0/2110180900 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09dc003520 con 0x7f09dc004d40 2024-04-28T13:07:54.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.225+0000 7f09f8bef640 1 --2- 172.21.15.114:0/2110180900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09dc004d40 0x7f09dc0051c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f09ec002010 tx=0x7f09dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e4e80570e5f578a server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:54.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.226+0000 7f09f2ffd640 1 -- 172.21.15.114:0/2110180900 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ec036070 con 0x7f09dc004d40 2024-04-28T13:07:54.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.226+0000 7f09f2ffd640 1 -- 172.21.15.114:0/2110180900 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09ec031600 con 0x7f09dc004d40 2024-04-28T13:07:54.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.226+0000 7f09f2ffd640 1 -- 172.21.15.114:0/2110180900 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ec001be0 con 0x7f09dc004d40 2024-04-28T13:07:54.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.226+0000 7f09fa652640 1 -- 172.21.15.114:0/2110180900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09dc004d40 msgr2=0x7f09dc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:54.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.226+0000 7f09fa652640 1 --2- 172.21.15.114:0/2110180900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09dc004d40 0x7f09dc0051c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f09ec002010 tx=0x7f09dc005830 comp rx=0 tx=0).stop 2024-04-28T13:07:54.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.226+0000 7f09f8bef640 1 -- 172.21.15.114:0/2110180900 reap_dead start 2024-04-28T13:07:54.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.226+0000 7f09fa652640 1 -- 172.21.15.114:0/2110180900 shutdown_connections 2024-04-28T13:07:54.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.226+0000 7f09fa652640 1 -- 172.21.15.114:0/2110180900 >> 172.21.15.114:0/2110180900 conn(0x7f09f406c980 msgr2=0x7f09f40b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:54.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.226+0000 7f09fa652640 1 -- 172.21.15.114:0/2110180900 shutdown_connections 2024-04-28T13:07:54.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.226+0000 7f09fa652640 1 -- 172.21.15.114:0/2110180900 wait complete. 2024-04-28T13:07:54.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.227+0000 7f09fa652640 1 Processor -- start 2024-04-28T13:07:54.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.228+0000 7f09fa652640 1 -- start start 2024-04-28T13:07:54.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.228+0000 7f09fa652640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09dc004d40 0x7f09f40af770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:54.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.228+0000 7f09fa652640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09f40ae850 0x7f09f4141760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:54.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.228+0000 7f09fa652640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09f4157660 0x7f09f4157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:54.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.228+0000 7f09fa652640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f09f40cfaf0 con 0x7f09dc004d40 2024-04-28T13:07:54.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.228+0000 7f09fa652640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f09f4160b30 con 0x7f09f40ae850 2024-04-28T13:07:54.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.228+0000 7f09fa652640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f09f40cfc70 con 0x7f09f4157660 2024-04-28T13:07:54.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.228+0000 7f09f3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09dc004d40 0x7f09f40af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:54.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.228+0000 7f09f3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09dc004d40 0x7f09f40af770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43436/0 (socket says 172.21.15.114:43436) 2024-04-28T13:07:54.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.228+0000 7f09f3fff640 1 -- 172.21.15.114:0/1444151203 learned_addr learned my addr 172.21.15.114:0/1444151203 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:54.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.228+0000 7f09f8bef640 1 --2- 172.21.15.114:0/1444151203 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09f4157660 0x7f09f4157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:54.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.228+0000 7f09f37fe640 1 --2- 172.21.15.114:0/1444151203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09f40ae850 0x7f09f4141760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:54.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.229+0000 7f09f3fff640 1 -- 172.21.15.114:0/1444151203 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09f4157660 msgr2=0x7f09f4157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:54.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.229+0000 7f09f3fff640 1 --2- 172.21.15.114:0/1444151203 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09f4157660 0x7f09f4157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:54.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.229+0000 7f09f3fff640 1 -- 172.21.15.114:0/1444151203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09f40ae850 msgr2=0x7f09f4141760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:54.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.229+0000 7f09f3fff640 1 --2- 172.21.15.114:0/1444151203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09f40ae850 0x7f09f4141760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:54.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.229+0000 7f09f3fff640 1 -- 172.21.15.114:0/1444151203 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f4153ad0 con 0x7f09dc004d40 2024-04-28T13:07:54.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.229+0000 7f09f3fff640 1 --2- 172.21.15.114:0/1444151203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09dc004d40 0x7f09f40af770 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f09e40072c0 tx=0x7f09e40076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:54.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.229+0000 7f09f0ff9640 1 -- 172.21.15.114:0/1444151203 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e401a070 con 0x7f09dc004d40 2024-04-28T13:07:54.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.229+0000 7f09f0ff9640 1 -- 172.21.15.114:0/1444151203 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e400f960 con 0x7f09dc004d40 2024-04-28T13:07:54.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.229+0000 7f09f0ff9640 1 -- 172.21.15.114:0/1444151203 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e400fd50 con 0x7f09dc004d40 2024-04-28T13:07:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.229+0000 7f09fa652640 1 -- 172.21.15.114:0/1444151203 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09f40afd90 con 0x7f09dc004d40 2024-04-28T13:07:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.229+0000 7f09fa652640 1 -- 172.21.15.114:0/1444151203 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09f4153d70 con 0x7f09dc004d40 2024-04-28T13:07:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.230+0000 7f09fa652640 1 -- 172.21.15.114:0/1444151203 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09f406a3d0 con 0x7f09dc004d40 2024-04-28T13:07:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.230+0000 7f09f0ff9640 1 -- 172.21.15.114:0/1444151203 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f09e401d070 con 0x7f09dc004d40 2024-04-28T13:07:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.231+0000 7f09f0ff9640 1 --2- 172.21.15.114:0/1444151203 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f09e006c8f0 0x7f09e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.231+0000 7f09f0ff9640 1 -- 172.21.15.114:0/1444151203 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f09e408b5e0 con 0x7f09dc004d40 2024-04-28T13:07:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.231+0000 7f09f37fe640 1 --2- 172.21.15.114:0/1444151203 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f09e006c8f0 0x7f09e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.231+0000 7f09f37fe640 1 --2- 172.21.15.114:0/1444151203 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f09e006c8f0 0x7f09e006edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f09f4159c50 tx=0x7f09e8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.235+0000 7f09f0ff9640 1 -- 172.21.15.114:0/1444151203 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f09e4059450 con 0x7f09dc004d40 2024-04-28T13:07:54.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.412+0000 7f09fa652640 1 -- 172.21.15.114:0/1444151203 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f09f40b6020 con 0x7f09dc004d40 2024-04-28T13:07:54.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.413+0000 7f09f0ff9640 1 -- 172.21.15.114:0/1444151203 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7f09e405d750 con 0x7f09dc004d40 2024-04-28T13:07:54.414 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:54.414 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:07:27.292537+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-28T13:07:23.706359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-28T13:07:24.596188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:07:54.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.415+0000 7f09fa652640 1 -- 172.21.15.114:0/1444151203 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f09e006c8f0 msgr2=0x7f09e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:54.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.415+0000 7f09fa652640 1 --2- 172.21.15.114:0/1444151203 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f09e006c8f0 0x7f09e006edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f09f4159c50 tx=0x7f09e8009190 comp rx=0 tx=0).stop 2024-04-28T13:07:54.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.415+0000 7f09fa652640 1 -- 172.21.15.114:0/1444151203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09dc004d40 msgr2=0x7f09f40af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:54.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.415+0000 7f09fa652640 1 --2- 172.21.15.114:0/1444151203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09dc004d40 0x7f09f40af770 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f09e40072c0 tx=0x7f09e40076c0 comp rx=0 tx=0).stop 2024-04-28T13:07:54.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.415+0000 7f09fa652640 1 -- 172.21.15.114:0/1444151203 shutdown_connections 2024-04-28T13:07:54.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.415+0000 7f09fa652640 1 --2- 172.21.15.114:0/1444151203 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09f4157660 0x7f09f4157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:54.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.415+0000 7f09fa652640 1 --2- 172.21.15.114:0/1444151203 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f09e006c8f0 0x7f09e006edb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:54.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.415+0000 7f09fa652640 1 --2- 172.21.15.114:0/1444151203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09f40ae850 0x7f09f4141760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:54.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.415+0000 7f09fa652640 1 --2- 172.21.15.114:0/1444151203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09dc004d40 0x7f09f40af770 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:54.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.415+0000 7f09fa652640 1 -- 172.21.15.114:0/1444151203 >> 172.21.15.114:0/1444151203 conn(0x7f09f406c980 msgr2=0x7f09f40b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:54.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.415+0000 7f09fa652640 1 -- 172.21.15.114:0/1444151203 shutdown_connections 2024-04-28T13:07:54.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.415+0000 7f09fa652640 1 -- 172.21.15.114:0/1444151203 wait complete. 2024-04-28T13:07:54.427 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-28T13:07:14.721860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-28T13:07:23.706359+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-28T13:07:24.596188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-28T13:07:54.427 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-28T13:07:54.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.525+0000 7f4e883af640 1 Processor -- start 2024-04-28T13:07:54.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.525+0000 7f4e883af640 1 -- start start 2024-04-28T13:07:54.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.526+0000 7f4e883af640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e800ced80 0x7f4e800c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:54.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.526+0000 7f4e883af640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e800c8e70 con 0x7f4e800d1440 2024-04-28T13:07:54.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.526+0000 7f4e883af640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e800c9150 con 0x7f4e80148dc0 2024-04-28T13:07:54.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.526+0000 7f4e883af640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f4e800c9430 con 0x7f4e800ced80 2024-04-28T13:07:54.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.526+0000 7f4e8594a640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f4e800d1440 0x7f4e800c80d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50044/0 (socket says 172.21.15.114:50044) 2024-04-28T13:07:54.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.526+0000 7f4e8594a640 1 -- 172.21.15.114:0/3757276980 learned_addr learned my addr 172.21.15.114:0/3757276980 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:54.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.526+0000 7f4e8694c640 1 --2- 172.21.15.114:0/3757276980 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e800ced80 0x7f4e800c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:54.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.526+0000 7f4e85149640 1 -- 172.21.15.114:0/3757276980 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1873581927 0 0) 0x7f4e800c8e70 con 0x7f4e800d1440 2024-04-28T13:07:54.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.526+0000 7f4e85149640 1 -- 172.21.15.114:0/3757276980 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e6c003520 con 0x7f4e800d1440 2024-04-28T13:07:54.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.527+0000 7f4e85149640 1 -- 172.21.15.114:0/3757276980 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1940127233 0 0) 0x7f4e6c003520 con 0x7f4e800d1440 2024-04-28T13:07:54.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.527+0000 7f4e85149640 1 -- 172.21.15.114:0/3757276980 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e800ced80 msgr2=0x7f4e800c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:54.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.527+0000 7f4e85149640 1 --2- 172.21.15.114:0/3757276980 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e800ced80 0x7f4e800c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:54.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.527+0000 7f4e85149640 1 -- 172.21.15.114:0/3757276980 >> v1:172.21.15.134:6789/0 conn(0x7f4e80148dc0 legacy=0x7f4e800d0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:54.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.527+0000 7f4e85149640 1 -- 172.21.15.114:0/3757276980 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e800c9710 con 0x7f4e800d1440 2024-04-28T13:07:54.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.527+0000 7f4e85149640 1 -- 172.21.15.114:0/3757276980 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f4e70001670 con 0x7f4e800d1440 2024-04-28T13:07:54.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.527+0000 7f4e85149640 1 -- 172.21.15.114:0/3757276980 >> v1:172.21.15.114:6789/0 conn(0x7f4e800d1440 legacy=0x7f4e800c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:54.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.527+0000 7f4e85149640 1 --2- 172.21.15.114:0/3757276980 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e800ced80 0x7f4e6c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:54.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.527+0000 7f4e85149640 1 --2- 172.21.15.114:0/3757276980 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e6c003f60 0x7f4e6c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:54.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.527+0000 7f4e85149640 1 --2- 172.21.15.114:0/3757276980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e6c004d40 0x7f4e6c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:54.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.527+0000 7f4e85149640 1 -- 172.21.15.114:0/3757276980 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4e800c9430 con 0x7f4e6c003f60 2024-04-28T13:07:54.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.527+0000 7f4e85149640 1 -- 172.21.15.114:0/3757276980 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c00bb50 con 0x7f4e6c004d40 2024-04-28T13:07:54.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.527+0000 7f4e85149640 1 -- 172.21.15.114:0/3757276980 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f4e6c00bd50 con 0x7f4e800ced80 2024-04-28T13:07:54.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.527+0000 7f4e8594a640 1 --2- 172.21.15.114:0/3757276980 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e6c003f60 0x7f4e6c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:54.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.527+0000 7f4e8614b640 1 --2- 172.21.15.114:0/3757276980 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e800ced80 0x7f4e6c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:54.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.527+0000 7f4e8694c640 1 --2- 172.21.15.114:0/3757276980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e6c004d40 0x7f4e6c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:54.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.527+0000 7f4e8594a640 1 -- 172.21.15.114:0/3757276980 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e800ced80 msgr2=0x7f4e6c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:54.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.527+0000 7f4e8594a640 1 --2- 172.21.15.114:0/3757276980 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e800ced80 0x7f4e6c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:54.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.527+0000 7f4e8594a640 1 -- 172.21.15.114:0/3757276980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e6c004d40 msgr2=0x7f4e6c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:54.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.527+0000 7f4e8594a640 1 --2- 172.21.15.114:0/3757276980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e6c004d40 0x7f4e6c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:54.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.527+0000 7f4e8594a640 1 -- 172.21.15.114:0/3757276980 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e6c003520 con 0x7f4e6c003f60 2024-04-28T13:07:54.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.527+0000 7f4e8694c640 1 --2- 172.21.15.114:0/3757276980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e6c004d40 0x7f4e6c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:54.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.528+0000 7f4e8594a640 1 --2- 172.21.15.114:0/3757276980 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e6c003f60 0x7f4e6c004800 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4e7000c240 tx=0x7f4e6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=682662e03fb2e7d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:54.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.528+0000 7f4e85149640 1 -- 172.21.15.114:0/3757276980 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e70007d10 con 0x7f4e6c003f60 2024-04-28T13:07:54.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.528+0000 7f4e85149640 1 -- 172.21.15.114:0/3757276980 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e70005ad0 con 0x7f4e6c003f60 2024-04-28T13:07:54.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.528+0000 7f4e85149640 1 -- 172.21.15.114:0/3757276980 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e70007070 con 0x7f4e6c003f60 2024-04-28T13:07:54.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.528+0000 7f4e883af640 1 -- 172.21.15.114:0/3757276980 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e6c003f60 msgr2=0x7f4e6c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:54.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.528+0000 7f4e883af640 1 --2- 172.21.15.114:0/3757276980 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e6c003f60 0x7f4e6c004800 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4e7000c240 tx=0x7f4e6c005830 comp rx=0 tx=0).stop 2024-04-28T13:07:54.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.528+0000 7f4e8694c640 1 -- 172.21.15.114:0/3757276980 reap_dead start 2024-04-28T13:07:54.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.528+0000 7f4e883af640 1 -- 172.21.15.114:0/3757276980 shutdown_connections 2024-04-28T13:07:54.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.528+0000 7f4e883af640 1 -- 172.21.15.114:0/3757276980 >> 172.21.15.114:0/3757276980 conn(0x7f4e800706f0 msgr2=0x7f4e80070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:54.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.529+0000 7f4e883af640 1 -- 172.21.15.114:0/3757276980 shutdown_connections 2024-04-28T13:07:54.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.529+0000 7f4e883af640 1 -- 172.21.15.114:0/3757276980 wait complete. 2024-04-28T13:07:54.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.530+0000 7f4e883af640 1 Processor -- start 2024-04-28T13:07:54.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.530+0000 7f4e883af640 1 -- start start 2024-04-28T13:07:54.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.530+0000 7f4e883af640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e6c003f60 0x7f4e801400a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:54.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.530+0000 7f4e883af640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e801f4ba0 0x7f4e800caa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:54.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.530+0000 7f4e883af640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e8015fa40 0x7f4e8015fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:54.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.530+0000 7f4e883af640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4e800c8960 con 0x7f4e801f4ba0 2024-04-28T13:07:54.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.530+0000 7f4e883af640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4e800c87e0 con 0x7f4e6c003f60 2024-04-28T13:07:54.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.530+0000 7f4e883af640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f4e800c8ae0 con 0x7f4e8015fa40 2024-04-28T13:07:54.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.530+0000 7f4e8594a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e801f4ba0 0x7f4e800caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:54.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.530+0000 7f4e8594a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e801f4ba0 0x7f4e800caa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43454/0 (socket says 172.21.15.114:43454) 2024-04-28T13:07:54.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.530+0000 7f4e8594a640 1 -- 172.21.15.114:0/3730657710 learned_addr learned my addr 172.21.15.114:0/3730657710 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:54.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.531+0000 7f4e8694c640 1 --2- 172.21.15.114:0/3730657710 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e8015fa40 0x7f4e8015fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:54.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.531+0000 7f4e8614b640 1 --2- 172.21.15.114:0/3730657710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e6c003f60 0x7f4e801400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:54.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.531+0000 7f4e8594a640 1 -- 172.21.15.114:0/3730657710 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e8015fa40 msgr2=0x7f4e8015fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:54.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.531+0000 7f4e8594a640 1 --2- 172.21.15.114:0/3730657710 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e8015fa40 0x7f4e8015fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:54.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.531+0000 7f4e8594a640 1 -- 172.21.15.114:0/3730657710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e6c003f60 msgr2=0x7f4e801400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:54.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.531+0000 7f4e8594a640 1 --2- 172.21.15.114:0/3730657710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e6c003f60 0x7f4e801400a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:54.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.531+0000 7f4e8594a640 1 -- 172.21.15.114:0/3730657710 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e801f50a0 con 0x7f4e801f4ba0 2024-04-28T13:07:54.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.531+0000 7f4e8614b640 1 --2- 172.21.15.114:0/3730657710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e6c003f60 0x7f4e801400a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:07:54.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.531+0000 7f4e8594a640 1 --2- 172.21.15.114:0/3730657710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e801f4ba0 0x7f4e800caa20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4e70034040 tx=0x7f4e800c9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:54.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.531+0000 7f4e76ffd640 1 -- 172.21.15.114:0/3730657710 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e70007d10 con 0x7f4e801f4ba0 2024-04-28T13:07:54.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.531+0000 7f4e76ffd640 1 -- 172.21.15.114:0/3730657710 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e70043070 con 0x7f4e801f4ba0 2024-04-28T13:07:54.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.531+0000 7f4e76ffd640 1 -- 172.21.15.114:0/3730657710 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e70004df0 con 0x7f4e801f4ba0 2024-04-28T13:07:54.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.531+0000 7f4e883af640 1 -- 172.21.15.114:0/3730657710 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e801f5380 con 0x7f4e801f4ba0 2024-04-28T13:07:54.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.531+0000 7f4e883af640 1 -- 172.21.15.114:0/3730657710 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e801f5940 con 0x7f4e801f4ba0 2024-04-28T13:07:54.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.532+0000 7f4e883af640 1 -- 172.21.15.114:0/3730657710 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e8006a3d0 con 0x7f4e801f4ba0 2024-04-28T13:07:54.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.532+0000 7f4e76ffd640 1 -- 172.21.15.114:0/3730657710 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4e70007070 con 0x7f4e801f4ba0 2024-04-28T13:07:54.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.533+0000 7f4e76ffd640 1 --2- 172.21.15.114:0/3730657710 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f4e6406c920 0x7f4e6406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:54.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.533+0000 7f4e76ffd640 1 -- 172.21.15.114:0/3730657710 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4e700ac0f0 con 0x7f4e801f4ba0 2024-04-28T13:07:54.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.533+0000 7f4e8614b640 1 --2- 172.21.15.114:0/3730657710 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f4e6406c920 0x7f4e6406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:54.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.533+0000 7f4e8614b640 1 --2- 172.21.15.114:0/3730657710 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f4e6406c920 0x7f4e6406ede0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4e800cca90 tx=0x7f4e7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:54.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.537+0000 7f4e76ffd640 1 -- 172.21.15.114:0/3730657710 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4e7004d020 con 0x7f4e801f4ba0 2024-04-28T13:07:54.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.712+0000 7f4e883af640 1 -- 172.21.15.114:0/3730657710 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4e801f5b10 con 0x7f4e801f4ba0 2024-04-28T13:07:54.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.713+0000 7f4e76ffd640 1 -- 172.21.15.114:0/3730657710 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f4e7007a520 con 0x7f4e801f4ba0 2024-04-28T13:07:54.713 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-28T13:07:54.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.714+0000 7f4e883af640 1 -- 172.21.15.114:0/3730657710 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f4e6406c920 msgr2=0x7f4e6406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:54.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.714+0000 7f4e883af640 1 --2- 172.21.15.114:0/3730657710 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f4e6406c920 0x7f4e6406ede0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4e800cca90 tx=0x7f4e7c009040 comp rx=0 tx=0).stop 2024-04-28T13:07:54.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.714+0000 7f4e883af640 1 -- 172.21.15.114:0/3730657710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e801f4ba0 msgr2=0x7f4e800caa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:54.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.714+0000 7f4e883af640 1 --2- 172.21.15.114:0/3730657710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e801f4ba0 0x7f4e800caa20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4e70034040 tx=0x7f4e800c9040 comp rx=0 tx=0).stop 2024-04-28T13:07:54.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.715+0000 7f4e883af640 1 -- 172.21.15.114:0/3730657710 shutdown_connections 2024-04-28T13:07:54.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.715+0000 7f4e883af640 1 --2- 172.21.15.114:0/3730657710 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e8015fa40 0x7f4e8015fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:54.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.715+0000 7f4e883af640 1 --2- 172.21.15.114:0/3730657710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e801f4ba0 0x7f4e800caa20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:54.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.715+0000 7f4e883af640 1 --2- 172.21.15.114:0/3730657710 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f4e6406c920 0x7f4e6406ede0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:54.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.715+0000 7f4e883af640 1 --2- 172.21.15.114:0/3730657710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e6c003f60 0x7f4e801400a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:54.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.715+0000 7f4e883af640 1 -- 172.21.15.114:0/3730657710 >> 172.21.15.114:0/3730657710 conn(0x7f4e800706f0 msgr2=0x7f4e8006e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:54.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.715+0000 7f4e883af640 1 -- 172.21.15.114:0/3730657710 shutdown_connections 2024-04-28T13:07:54.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.715+0000 7f4e883af640 1 -- 172.21.15.114:0/3730657710 wait complete. 2024-04-28T13:07:54.728 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-28T13:07:54.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.828+0000 7f39799af640 1 Processor -- start 2024-04-28T13:07:54.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.828+0000 7f39799af640 1 -- start start 2024-04-28T13:07:54.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.829+0000 7f39799af640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f397415f430 0x7f39740d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:54.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.829+0000 7f39799af640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f39740d1fc0 0x7f39740d5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:54.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.829+0000 7f39799af640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39740d2a40 con 0x7f39740baf40 2024-04-28T13:07:54.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.829+0000 7f39799af640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f397415f810 con 0x7f39740d1fc0 2024-04-28T13:07:54.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.829+0000 7f39799af640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f39740d36d0 con 0x7f397415f430 2024-04-28T13:07:54.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.829+0000 7f39727fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f39740d1fc0 0x7f39740d5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:54.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.829+0000 7f39727fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f39740d1fc0 0x7f39740d5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43464/0 (socket says 172.21.15.114:43464) 2024-04-28T13:07:54.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.829+0000 7f39727fc640 1 -- 172.21.15.114:0/3519363291 learned_addr learned my addr 172.21.15.114:0/3519363291 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:54.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.829+0000 7f3972ffd640 1 --2- 172.21.15.114:0/3519363291 >> v2:172.21.15.134:3300/0 conn(0x7f397415f430 0x7f39740d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:54.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.829+0000 7f39727fc640 1 -- 172.21.15.114:0/3519363291 >> v2:172.21.15.134:3300/0 conn(0x7f397415f430 msgr2=0x7f39740d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:54.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.829+0000 7f39727fc640 1 --2- 172.21.15.114:0/3519363291 >> v2:172.21.15.134:3300/0 conn(0x7f397415f430 0x7f39740d1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:54.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.829+0000 7f39727fc640 1 -- 172.21.15.114:0/3519363291 >> v1:172.21.15.134:6789/0 conn(0x7f39740baf40 legacy=0x7f3974162ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:54.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.829+0000 7f39727fc640 1 -- 172.21.15.114:0/3519363291 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39740d2480 con 0x7f39740d1fc0 2024-04-28T13:07:54.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.830+0000 7f39727fc640 1 --2- 172.21.15.114:0/3519363291 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39740d1fc0 0x7f39740d5160 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f397406e1d0 tx=0x7f396802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9cdc40f40ea678 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:54.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.830+0000 7f3971ffb640 1 -- 172.21.15.114:0/3519363291 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3968037070 con 0x7f39740d1fc0 2024-04-28T13:07:54.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.830+0000 7f3971ffb640 1 -- 172.21.15.114:0/3519363291 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3968032440 con 0x7f39740d1fc0 2024-04-28T13:07:54.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.830+0000 7f3971ffb640 1 -- 172.21.15.114:0/3519363291 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3968032810 con 0x7f39740d1fc0 2024-04-28T13:07:54.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.831+0000 7f39799af640 1 -- 172.21.15.114:0/3519363291 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39740d1fc0 msgr2=0x7f39740d5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:54.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.831+0000 7f39799af640 1 --2- 172.21.15.114:0/3519363291 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39740d1fc0 0x7f39740d5160 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f397406e1d0 tx=0x7f396802a230 comp rx=0 tx=0).stop 2024-04-28T13:07:54.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.831+0000 7f39799af640 1 -- 172.21.15.114:0/3519363291 shutdown_connections 2024-04-28T13:07:54.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.831+0000 7f39799af640 1 --2- 172.21.15.114:0/3519363291 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39740d1fc0 0x7f39740d5160 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:54.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.831+0000 7f39799af640 1 --2- 172.21.15.114:0/3519363291 >> v2:172.21.15.134:3300/0 conn(0x7f397415f430 0x7f39740d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:54.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.831+0000 7f39799af640 1 -- 172.21.15.114:0/3519363291 >> 172.21.15.114:0/3519363291 conn(0x7f39740633a0 msgr2=0x7f397406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:54.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.831+0000 7f39799af640 1 -- 172.21.15.114:0/3519363291 shutdown_connections 2024-04-28T13:07:54.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.831+0000 7f39799af640 1 -- 172.21.15.114:0/3519363291 wait complete. 2024-04-28T13:07:54.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.832+0000 7f39799af640 1 Processor -- start 2024-04-28T13:07:54.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.832+0000 7f39799af640 1 -- start start 2024-04-28T13:07:54.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.833+0000 7f39799af640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39740baf40 0x7f39740ce520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:54.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.833+0000 7f39799af640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39740d1fc0 0x7f397415de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:54.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.833+0000 7f39799af640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f397415f430 0x7f397415e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:54.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.833+0000 7f39799af640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f39740d4b70 con 0x7f39740baf40 2024-04-28T13:07:54.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.833+0000 7f39799af640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f39740d3360 con 0x7f39740d1fc0 2024-04-28T13:07:54.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.833+0000 7f39799af640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f39740d4cf0 con 0x7f397415f430 2024-04-28T13:07:54.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.833+0000 7f3972ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39740baf40 0x7f39740ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:54.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.833+0000 7f3972ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39740baf40 0x7f39740ce520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43466/0 (socket says 172.21.15.114:43466) 2024-04-28T13:07:54.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.833+0000 7f3972ffd640 1 -- 172.21.15.114:0/2995752991 learned_addr learned my addr 172.21.15.114:0/2995752991 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:54.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.833+0000 7f39727fc640 1 --2- 172.21.15.114:0/2995752991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39740d1fc0 0x7f397415de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:54.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.833+0000 7f39737fe640 1 --2- 172.21.15.114:0/2995752991 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f397415f430 0x7f397415e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:54.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.833+0000 7f3972ffd640 1 -- 172.21.15.114:0/2995752991 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f397415f430 msgr2=0x7f397415e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:54.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.833+0000 7f3972ffd640 1 --2- 172.21.15.114:0/2995752991 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f397415f430 0x7f397415e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:54.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.833+0000 7f3972ffd640 1 -- 172.21.15.114:0/2995752991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39740d1fc0 msgr2=0x7f397415de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:54.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.833+0000 7f3972ffd640 1 --2- 172.21.15.114:0/2995752991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39740d1fc0 0x7f397415de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:54.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.833+0000 7f3972ffd640 1 -- 172.21.15.114:0/2995752991 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f397415e9b0 con 0x7f39740baf40 2024-04-28T13:07:54.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.834+0000 7f3972ffd640 1 --2- 172.21.15.114:0/2995752991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39740baf40 0x7f39740ce520 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f396400cd00 tx=0x7f396400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:54.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.834+0000 7f395bfff640 1 -- 172.21.15.114:0/2995752991 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3964003990 con 0x7f39740baf40 2024-04-28T13:07:54.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.834+0000 7f395bfff640 1 -- 172.21.15.114:0/2995752991 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3964003b30 con 0x7f39740baf40 2024-04-28T13:07:54.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.834+0000 7f39799af640 1 -- 172.21.15.114:0/2995752991 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39741f5180 con 0x7f39740baf40 2024-04-28T13:07:54.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.834+0000 7f395bfff640 1 -- 172.21.15.114:0/2995752991 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3964004020 con 0x7f39740baf40 2024-04-28T13:07:54.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.834+0000 7f39799af640 1 -- 172.21.15.114:0/2995752991 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f397415b6a0 con 0x7f39740baf40 2024-04-28T13:07:54.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.835+0000 7f39799af640 1 -- 172.21.15.114:0/2995752991 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3974075c40 con 0x7f39740baf40 2024-04-28T13:07:54.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.835+0000 7f395bfff640 1 -- 172.21.15.114:0/2995752991 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f39640041c0 con 0x7f39740baf40 2024-04-28T13:07:54.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.835+0000 7f395bfff640 1 --2- 172.21.15.114:0/2995752991 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f396006c8f0 0x7f396006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:54.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.836+0000 7f39727fc640 1 --2- 172.21.15.114:0/2995752991 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f396006c8f0 0x7f396006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:54.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.836+0000 7f395bfff640 1 -- 172.21.15.114:0/2995752991 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f396408c070 con 0x7f39740baf40 2024-04-28T13:07:54.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.836+0000 7f39727fc640 1 --2- 172.21.15.114:0/2995752991 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f396006c8f0 0x7f396006edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3968034000 tx=0x7f396802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:54.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:54.840+0000 7f395bfff640 1 -- 172.21.15.114:0/2995752991 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3964014030 con 0x7f39740baf40 2024-04-28T13:07:55.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.013+0000 7f39799af640 1 -- 172.21.15.114:0/2995752991 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f397406a3d0 con 0x7f39740baf40 2024-04-28T13:07:55.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.013+0000 7f395bfff640 1 -- 172.21.15.114:0/2995752991 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f396405a4a0 con 0x7f39740baf40 2024-04-28T13:07:55.015 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-04-28T13:07:55.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.015+0000 7f39799af640 1 -- 172.21.15.114:0/2995752991 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f396006c8f0 msgr2=0x7f396006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:55.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.015+0000 7f39799af640 1 --2- 172.21.15.114:0/2995752991 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f396006c8f0 0x7f396006edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3968034000 tx=0x7f396802e000 comp rx=0 tx=0).stop 2024-04-28T13:07:55.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.015+0000 7f39799af640 1 -- 172.21.15.114:0/2995752991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39740baf40 msgr2=0x7f39740ce520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:55.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.015+0000 7f39799af640 1 --2- 172.21.15.114:0/2995752991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39740baf40 0x7f39740ce520 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f396400cd00 tx=0x7f396400a5c0 comp rx=0 tx=0).stop 2024-04-28T13:07:55.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.015+0000 7f39799af640 1 -- 172.21.15.114:0/2995752991 shutdown_connections 2024-04-28T13:07:55.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.015+0000 7f39799af640 1 --2- 172.21.15.114:0/2995752991 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f397415f430 0x7f397415e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:55.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.015+0000 7f39799af640 1 --2- 172.21.15.114:0/2995752991 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f396006c8f0 0x7f396006edb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:55.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.015+0000 7f39799af640 1 --2- 172.21.15.114:0/2995752991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39740d1fc0 0x7f397415de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:55.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.015+0000 7f39799af640 1 --2- 172.21.15.114:0/2995752991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39740baf40 0x7f39740ce520 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:55.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.015+0000 7f39799af640 1 -- 172.21.15.114:0/2995752991 >> 172.21.15.114:0/2995752991 conn(0x7f39740633a0 msgr2=0x7f39740cb630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:55.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.016+0000 7f39799af640 1 -- 172.21.15.114:0/2995752991 shutdown_connections 2024-04-28T13:07:55.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.016+0000 7f39799af640 1 -- 172.21.15.114:0/2995752991 wait complete. 2024-04-28T13:07:55.027 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-28T13:07:55.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.125+0000 7f3bd46cc640 1 Processor -- start 2024-04-28T13:07:55.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.125+0000 7f3bd46cc640 1 -- start start 2024-04-28T13:07:55.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.126+0000 7f3bd46cc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3bcc073b30 0x7f3bcc160dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:55.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.126+0000 7f3bd46cc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bcc146f80 con 0x7f3bcc06f860 2024-04-28T13:07:55.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.126+0000 7f3bd46cc640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bcc161530 con 0x7f3bcc146ba0 2024-04-28T13:07:55.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.126+0000 7f3bd46cc640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f3bcc0d0ca0 con 0x7f3bcc073b30 2024-04-28T13:07:55.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.126+0000 7f3bd1c67640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3bcc06f860 0x7f3bcc073420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50046/0 (socket says 172.21.15.114:50046) 2024-04-28T13:07:55.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.126+0000 7f3bd1c67640 1 -- 172.21.15.114:0/639055638 learned_addr learned my addr 172.21.15.114:0/639055638 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:55.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.126+0000 7f3bd2c69640 1 --2- 172.21.15.114:0/639055638 >> v2:172.21.15.134:3300/0 conn(0x7f3bcc073b30 0x7f3bcc160dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:55.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.126+0000 7f3bd1466640 1 -- 172.21.15.114:0/639055638 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3678326230 0 0) 0x7f3bbc001110 con 0x7f3bcc06f860 2024-04-28T13:07:55.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.126+0000 7f3bd1466640 1 -- 172.21.15.114:0/639055638 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bb8003520 con 0x7f3bcc06f860 2024-04-28T13:07:55.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.126+0000 7f3bd1466640 1 -- 172.21.15.114:0/639055638 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3943555724 0 0) 0x7f3bb8003520 con 0x7f3bcc06f860 2024-04-28T13:07:55.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.126+0000 7f3bd1466640 1 -- 172.21.15.114:0/639055638 >> v2:172.21.15.134:3300/0 conn(0x7f3bcc073b30 msgr2=0x7f3bcc160dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:55.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.126+0000 7f3bd1466640 1 --2- 172.21.15.114:0/639055638 >> v2:172.21.15.134:3300/0 conn(0x7f3bcc073b30 0x7f3bcc160dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:55.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.126+0000 7f3bd1466640 1 -- 172.21.15.114:0/639055638 >> v1:172.21.15.134:6789/0 conn(0x7f3bcc146ba0 legacy=0x7f3bcc0cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:55.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.126+0000 7f3bd1466640 1 -- 172.21.15.114:0/639055638 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bcc161810 con 0x7f3bcc06f860 2024-04-28T13:07:55.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.126+0000 7f3bd1466640 1 -- 172.21.15.114:0/639055638 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f3bbc001840 con 0x7f3bcc06f860 2024-04-28T13:07:55.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.126+0000 7f3bd2c69640 1 --2- 172.21.15.114:0/639055638 >> v2:172.21.15.134:3300/0 conn(0x7f3bcc073b30 0x7f3bcc160dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:07:55.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.126+0000 7f3bd1466640 1 -- 172.21.15.114:0/639055638 >> v1:172.21.15.114:6789/0 conn(0x7f3bcc06f860 legacy=0x7f3bcc073420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:55.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.126+0000 7f3bd1466640 1 --2- 172.21.15.114:0/639055638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bb80039b0 0x7f3bb8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:55.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.126+0000 7f3bd1466640 1 --2- 172.21.15.114:0/639055638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bb8004800 0x7f3bb8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:55.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.126+0000 7f3bd1466640 1 --2- 172.21.15.114:0/639055638 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3bb80051c0 0x7f3bb800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:55.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.126+0000 7f3bd1466640 1 -- 172.21.15.114:0/639055638 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3bcc0d0ca0 con 0x7f3bb8004800 2024-04-28T13:07:55.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.126+0000 7f3bd1466640 1 -- 172.21.15.114:0/639055638 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb800c160 con 0x7f3bb80039b0 2024-04-28T13:07:55.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.126+0000 7f3bd1466640 1 -- 172.21.15.114:0/639055638 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3bb800c360 con 0x7f3bb80051c0 2024-04-28T13:07:55.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.126+0000 7f3bd1c67640 1 --2- 172.21.15.114:0/639055638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bb8004800 0x7f3bb8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:55.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.127+0000 7f3bd2468640 1 --2- 172.21.15.114:0/639055638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bb80039b0 0x7f3bb8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:55.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.127+0000 7f3bd2c69640 1 --2- 172.21.15.114:0/639055638 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3bb80051c0 0x7f3bb800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:55.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.127+0000 7f3bd1c67640 1 -- 172.21.15.114:0/639055638 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3bb80051c0 msgr2=0x7f3bb800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:55.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.127+0000 7f3bd1c67640 1 --2- 172.21.15.114:0/639055638 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3bb80051c0 0x7f3bb800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:55.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.127+0000 7f3bd1c67640 1 -- 172.21.15.114:0/639055638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bb80039b0 msgr2=0x7f3bb8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:55.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.127+0000 7f3bd1c67640 1 --2- 172.21.15.114:0/639055638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bb80039b0 0x7f3bb8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:55.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.127+0000 7f3bd1c67640 1 -- 172.21.15.114:0/639055638 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bb8003520 con 0x7f3bb8004800 2024-04-28T13:07:55.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.127+0000 7f3bd2c69640 1 -- 172.21.15.114:0/639055638 reap_dead start 2024-04-28T13:07:55.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.127+0000 7f3bd1c67640 1 --2- 172.21.15.114:0/639055638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bb8004800 0x7f3bb8004c80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc00c4c0 tx=0x7f3bb8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=209bf6d13c62f029 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:55.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.128+0000 7f3bd1466640 1 -- 172.21.15.114:0/639055638 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc00c0e0 con 0x7f3bb8004800 2024-04-28T13:07:55.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.128+0000 7f3bd1466640 1 -- 172.21.15.114:0/639055638 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bbc034070 con 0x7f3bb8004800 2024-04-28T13:07:55.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.128+0000 7f3bd1466640 1 -- 172.21.15.114:0/639055638 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc005d70 con 0x7f3bb8004800 2024-04-28T13:07:55.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.128+0000 7f3bd46cc640 1 -- 172.21.15.114:0/639055638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bb8004800 msgr2=0x7f3bb8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:55.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.128+0000 7f3bd46cc640 1 --2- 172.21.15.114:0/639055638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bb8004800 0x7f3bb8004c80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc00c4c0 tx=0x7f3bb8005830 comp rx=0 tx=0).stop 2024-04-28T13:07:55.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.128+0000 7f3bd46cc640 1 -- 172.21.15.114:0/639055638 shutdown_connections 2024-04-28T13:07:55.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.128+0000 7f3bd46cc640 1 --2- 172.21.15.114:0/639055638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bb8004800 0x7f3bb8004c80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:55.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.128+0000 7f3bd46cc640 1 -- 172.21.15.114:0/639055638 >> 172.21.15.114:0/639055638 conn(0x7f3bcc06c980 msgr2=0x7f3bcc0b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:55.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.128+0000 7f3bd46cc640 1 -- 172.21.15.114:0/639055638 shutdown_connections 2024-04-28T13:07:55.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.128+0000 7f3bd46cc640 1 -- 172.21.15.114:0/639055638 wait complete. 2024-04-28T13:07:55.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.129+0000 7f3bd46cc640 1 Processor -- start 2024-04-28T13:07:55.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.129+0000 7f3bd46cc640 1 -- start start 2024-04-28T13:07:55.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.130+0000 7f3bd46cc640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3bb8004800 0x7f3bcc13a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:55.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.130+0000 7f3bd46cc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bcc13baa0 0x7f3bcc13bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:55.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.130+0000 7f3bd46cc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bcc1e86b0 0x7f3bcc1e8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:55.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.130+0000 7f3bd46cc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3bcc160f40 con 0x7f3bcc1e86b0 2024-04-28T13:07:55.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.130+0000 7f3bd46cc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3bcc160dc0 con 0x7f3bcc13baa0 2024-04-28T13:07:55.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.130+0000 7f3bd46cc640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3bcc1610c0 con 0x7f3bb8004800 2024-04-28T13:07:55.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.130+0000 7f3bd2c69640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bcc1e86b0 0x7f3bcc1e8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:55.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.130+0000 7f3bd2c69640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bcc1e86b0 0x7f3bcc1e8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43474/0 (socket says 172.21.15.114:43474) 2024-04-28T13:07:55.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.130+0000 7f3bd2c69640 1 -- 172.21.15.114:0/3689184899 learned_addr learned my addr 172.21.15.114:0/3689184899 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:55.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.130+0000 7f3bd2468640 1 --2- 172.21.15.114:0/3689184899 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3bb8004800 0x7f3bcc13a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:55.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.130+0000 7f3bd1c67640 1 --2- 172.21.15.114:0/3689184899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bcc13baa0 0x7f3bcc13bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:55.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.130+0000 7f3bd2c69640 1 -- 172.21.15.114:0/3689184899 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3bb8004800 msgr2=0x7f3bcc13a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:55.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.130+0000 7f3bd2c69640 1 --2- 172.21.15.114:0/3689184899 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3bb8004800 0x7f3bcc13a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:55.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.130+0000 7f3bd2c69640 1 -- 172.21.15.114:0/3689184899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bcc13baa0 msgr2=0x7f3bcc13bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:55.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.130+0000 7f3bd2c69640 1 --2- 172.21.15.114:0/3689184899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bcc13baa0 0x7f3bcc13bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:55.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.130+0000 7f3bd2c69640 1 -- 172.21.15.114:0/3689184899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bcc13a890 con 0x7f3bcc1e86b0 2024-04-28T13:07:55.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.131+0000 7f3bd2c69640 1 --2- 172.21.15.114:0/3689184899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bcc1e86b0 0x7f3bcc1e8b30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc0b3bc0 tx=0x7f3bc4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:55.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.131+0000 7f3bc2ffd640 1 -- 172.21.15.114:0/3689184899 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4011e30 con 0x7f3bcc1e86b0 2024-04-28T13:07:55.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.131+0000 7f3bc2ffd640 1 -- 172.21.15.114:0/3689184899 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bc401b070 con 0x7f3bcc1e86b0 2024-04-28T13:07:55.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.131+0000 7f3bc2ffd640 1 -- 172.21.15.114:0/3689184899 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4003990 con 0x7f3bcc1e86b0 2024-04-28T13:07:55.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.131+0000 7f3bd46cc640 1 -- 172.21.15.114:0/3689184899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bcc1e9420 con 0x7f3bcc1e86b0 2024-04-28T13:07:55.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.131+0000 7f3bd46cc640 1 -- 172.21.15.114:0/3689184899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bcc15e210 con 0x7f3bcc1e86b0 2024-04-28T13:07:55.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.132+0000 7f3bd46cc640 1 -- 172.21.15.114:0/3689184899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bcc06a3d0 con 0x7f3bcc1e86b0 2024-04-28T13:07:55.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.132+0000 7f3bc2ffd640 1 -- 172.21.15.114:0/3689184899 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3bc4003b30 con 0x7f3bcc1e86b0 2024-04-28T13:07:55.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.132+0000 7f3bc2ffd640 1 --2- 172.21.15.114:0/3689184899 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3bb006c8f0 0x7f3bb006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:55.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.133+0000 7f3bc2ffd640 1 -- 172.21.15.114:0/3689184899 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3bc408c420 con 0x7f3bcc1e86b0 2024-04-28T13:07:55.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.133+0000 7f3bd2468640 1 --2- 172.21.15.114:0/3689184899 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3bb006c8f0 0x7f3bb006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:55.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.133+0000 7f3bd2468640 1 --2- 172.21.15.114:0/3689184899 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3bb006c8f0 0x7f3bb006edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8000c00 tx=0x7f3bc8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:55.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.137+0000 7f3bc2ffd640 1 -- 172.21.15.114:0/3689184899 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3bc4003e20 con 0x7f3bcc1e86b0 2024-04-28T13:07:55.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.335+0000 7f3bd46cc640 1 -- 172.21.15.114:0/3689184899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3bcc0ccfb0 con 0x7f3bcc1e86b0 2024-04-28T13:07:55.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.336+0000 7f3bc2ffd640 1 -- 172.21.15.114:0/3689184899 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f3bc405a200 con 0x7f3bcc1e86b0 2024-04-28T13:07:55.337 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-04-28T13:07:55.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.338+0000 7f3bd46cc640 1 -- 172.21.15.114:0/3689184899 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3bb006c8f0 msgr2=0x7f3bb006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:55.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.338+0000 7f3bd46cc640 1 --2- 172.21.15.114:0/3689184899 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3bb006c8f0 0x7f3bb006edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8000c00 tx=0x7f3bc8009040 comp rx=0 tx=0).stop 2024-04-28T13:07:55.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.338+0000 7f3bd46cc640 1 -- 172.21.15.114:0/3689184899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bcc1e86b0 msgr2=0x7f3bcc1e8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:55.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.338+0000 7f3bd46cc640 1 --2- 172.21.15.114:0/3689184899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bcc1e86b0 0x7f3bcc1e8b30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc0b3bc0 tx=0x7f3bc4009f90 comp rx=0 tx=0).stop 2024-04-28T13:07:55.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.338+0000 7f3bd46cc640 1 -- 172.21.15.114:0/3689184899 shutdown_connections 2024-04-28T13:07:55.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.338+0000 7f3bd46cc640 1 --2- 172.21.15.114:0/3689184899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bcc1e86b0 0x7f3bcc1e8b30 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:55.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.338+0000 7f3bd46cc640 1 --2- 172.21.15.114:0/3689184899 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3bb006c8f0 0x7f3bb006edb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:55.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.338+0000 7f3bd46cc640 1 --2- 172.21.15.114:0/3689184899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bcc13baa0 0x7f3bcc13bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:55.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.338+0000 7f3bd46cc640 1 --2- 172.21.15.114:0/3689184899 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3bb8004800 0x7f3bcc13a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:55.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.338+0000 7f3bd46cc640 1 -- 172.21.15.114:0/3689184899 >> 172.21.15.114:0/3689184899 conn(0x7f3bcc06c980 msgr2=0x7f3bcc06e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:55.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.338+0000 7f3bd46cc640 1 -- 172.21.15.114:0/3689184899 shutdown_connections 2024-04-28T13:07:55.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.338+0000 7f3bd46cc640 1 -- 172.21.15.114:0/3689184899 wait complete. 2024-04-28T13:07:55.419 INFO:tasks.cephfs_test_runner:Starting test: test_nonexistent_subvolume_group_snapshot_rm (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) 2024-04-28T13:07:55.419 INFO:tasks.cephfs_test_runner:test_nonexistent_subvolume_group_snapshot_rm (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) ... skipped 'skipping subvolumegroup snapshot tests' 2024-04-28T13:07:55.419 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_group_snapshot_create_and_rm (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) 2024-04-28T13:07:55.419 INFO:tasks.cephfs_test_runner:test_subvolume_group_snapshot_create_and_rm (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) ... skipped 'skipping subvolumegroup snapshot tests' 2024-04-28T13:07:55.420 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_group_snapshot_idempotence (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) 2024-04-28T13:07:55.420 INFO:tasks.cephfs_test_runner:test_subvolume_group_snapshot_idempotence (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) ... skipped 'skipping subvolumegroup snapshot tests' 2024-04-28T13:07:55.420 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_group_snapshot_ls (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) 2024-04-28T13:07:55.420 INFO:tasks.cephfs_test_runner:test_subvolume_group_snapshot_ls (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) ... skipped 'skipping subvolumegroup snapshot tests' 2024-04-28T13:07:55.420 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_group_snapshot_rm_force (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) 2024-04-28T13:07:55.420 INFO:tasks.cephfs_test_runner:test_subvolume_group_snapshot_rm_force (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) ... skipped 'skipping subvolumegroup snapshot tests' 2024-04-28T13:07:55.420 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_group_snapshot_unsupported_status (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) 2024-04-28T13:07:55.420 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:07:55.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.517+0000 7f4581bda640 1 Processor -- start 2024-04-28T13:07:55.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.517+0000 7f4581bda640 1 -- start start 2024-04-28T13:07:55.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.518+0000 7f4581bda640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f457c0cda00 0x7f457c0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:55.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.518+0000 7f4581bda640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f457c0d07b0 0x7f457c15fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:55.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.518+0000 7f4581bda640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f457c0d2be0 con 0x7f457c0cdde0 2024-04-28T13:07:55.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.518+0000 7f4581bda640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f457c160980 con 0x7f457c0d07b0 2024-04-28T13:07:55.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.518+0000 7f4581bda640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f457c1606a0 con 0x7f457c0cda00 2024-04-28T13:07:55.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.518+0000 7f457affd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f457c0d07b0 0x7f457c15fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:55.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.518+0000 7f457bfff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f457c0cdde0 0x7f457c155fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50058/0 (socket says 172.21.15.114:50058) 2024-04-28T13:07:55.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.518+0000 7f457bfff640 1 -- 172.21.15.114:0/722967298 learned_addr learned my addr 172.21.15.114:0/722967298 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:55.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.518+0000 7f457affd640 1 -- 172.21.15.114:0/722967298 >> v2:172.21.15.134:3300/0 conn(0x7f457c0cda00 msgr2=0x7f457c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:55.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.518+0000 7f457affd640 1 --2- 172.21.15.114:0/722967298 >> v2:172.21.15.134:3300/0 conn(0x7f457c0cda00 0x7f457c0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:55.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.518+0000 7f457affd640 1 -- 172.21.15.114:0/722967298 >> v1:172.21.15.114:6789/0 conn(0x7f457c0cdde0 legacy=0x7f457c155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:55.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.518+0000 7f457affd640 1 -- 172.21.15.114:0/722967298 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f457c0cf7b0 con 0x7f457c0d07b0 2024-04-28T13:07:55.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.518+0000 7f457a7fc640 1 -- 172.21.15.114:0/722967298 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2708336298 0 0) 0x7f457c0d2be0 con 0x7f457c0cdde0 2024-04-28T13:07:55.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.519+0000 7f457affd640 1 --2- 172.21.15.114:0/722967298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f457c0d07b0 0x7f457c15fac0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f457c063d50 tx=0x7f457002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ddb5aa800ccdee6 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:55.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.519+0000 7f457a7fc640 1 -- 172.21.15.114:0/722967298 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4570037070 con 0x7f457c0d07b0 2024-04-28T13:07:55.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.519+0000 7f457a7fc640 1 -- 172.21.15.114:0/722967298 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4570032440 con 0x7f457c0d07b0 2024-04-28T13:07:55.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.519+0000 7f457a7fc640 1 -- 172.21.15.114:0/722967298 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4570032810 con 0x7f457c0d07b0 2024-04-28T13:07:55.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.519+0000 7f4581bda640 1 -- 172.21.15.114:0/722967298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f457c0d07b0 msgr2=0x7f457c15fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:55.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.519+0000 7f4581bda640 1 --2- 172.21.15.114:0/722967298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f457c0d07b0 0x7f457c15fac0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f457c063d50 tx=0x7f457002a1a0 comp rx=0 tx=0).stop 2024-04-28T13:07:55.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.519+0000 7f4581bda640 1 -- 172.21.15.114:0/722967298 shutdown_connections 2024-04-28T13:07:55.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.519+0000 7f4581bda640 1 --2- 172.21.15.114:0/722967298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f457c0d07b0 0x7f457c15fac0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:55.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.519+0000 7f4581bda640 1 --2- 172.21.15.114:0/722967298 >> v2:172.21.15.134:3300/0 conn(0x7f457c0cda00 0x7f457c0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:55.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.519+0000 7f4581bda640 1 -- 172.21.15.114:0/722967298 >> 172.21.15.114:0/722967298 conn(0x7f457c0706f0 msgr2=0x7f457c070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:55.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.519+0000 7f4581bda640 1 -- 172.21.15.114:0/722967298 shutdown_connections 2024-04-28T13:07:55.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.519+0000 7f4581bda640 1 -- 172.21.15.114:0/722967298 wait complete. 2024-04-28T13:07:55.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.520+0000 7f4581bda640 1 Processor -- start 2024-04-28T13:07:55.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.521+0000 7f4581bda640 1 -- start start 2024-04-28T13:07:55.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.521+0000 7f4581bda640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f457c0cda00 0x7f457c151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:55.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.521+0000 7f4581bda640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f457c0cdde0 0x7f457c1f6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:55.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.521+0000 7f4581bda640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f457c0d07b0 0x7f457c0b8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:55.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.521+0000 7f4581bda640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f457c1566d0 con 0x7f457c0d07b0 2024-04-28T13:07:55.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.521+0000 7f4581bda640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f457c0cfd70 con 0x7f457c0cdde0 2024-04-28T13:07:55.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.521+0000 7f4581bda640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f457c156850 con 0x7f457c0cda00 2024-04-28T13:07:55.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.521+0000 7f457bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f457c0d07b0 0x7f457c0b8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:55.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.522+0000 7f457bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f457c0d07b0 0x7f457c0b8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43494/0 (socket says 172.21.15.114:43494) 2024-04-28T13:07:55.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.522+0000 7f457bfff640 1 -- 172.21.15.114:0/1209651973 learned_addr learned my addr 172.21.15.114:0/1209651973 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:55.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.522+0000 7f457bfff640 1 -- 172.21.15.114:0/1209651973 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f457c0cda00 msgr2=0x7f457c151730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:55.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.522+0000 7f457b7fe640 1 --2- 172.21.15.114:0/1209651973 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f457c0cda00 0x7f457c151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:55.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.522+0000 7f457affd640 1 --2- 172.21.15.114:0/1209651973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f457c0cdde0 0x7f457c1f6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:55.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.522+0000 7f457bfff640 1 --2- 172.21.15.114:0/1209651973 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f457c0cda00 0x7f457c151730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:55.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.522+0000 7f457bfff640 1 -- 172.21.15.114:0/1209651973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f457c0cdde0 msgr2=0x7f457c1f6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:55.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.522+0000 7f457bfff640 1 --2- 172.21.15.114:0/1209651973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f457c0cdde0 0x7f457c1f6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:55.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.522+0000 7f457bfff640 1 -- 172.21.15.114:0/1209651973 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f457c0b5720 con 0x7f457c0d07b0 2024-04-28T13:07:55.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.522+0000 7f457bfff640 1 --2- 172.21.15.114:0/1209651973 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f457c0d07b0 0x7f457c0b8080 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f457400caf0 tx=0x7f457400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:55.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.522+0000 7f4563fff640 1 -- 172.21.15.114:0/1209651973 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457400aca0 con 0x7f457c0d07b0 2024-04-28T13:07:55.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.522+0000 7f4563fff640 1 -- 172.21.15.114:0/1209651973 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f457400ae40 con 0x7f457c0d07b0 2024-04-28T13:07:55.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.522+0000 7f4581bda640 1 -- 172.21.15.114:0/1209651973 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f457c0b4770 con 0x7f457c0d07b0 2024-04-28T13:07:55.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.522+0000 7f4563fff640 1 -- 172.21.15.114:0/1209651973 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4574012620 con 0x7f457c0d07b0 2024-04-28T13:07:55.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.522+0000 7f4581bda640 1 -- 172.21.15.114:0/1209651973 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f457c160c90 con 0x7f457c0d07b0 2024-04-28T13:07:55.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.523+0000 7f4581bda640 1 -- 172.21.15.114:0/1209651973 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f457c06a3d0 con 0x7f457c0d07b0 2024-04-28T13:07:55.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.523+0000 7f4563fff640 1 -- 172.21.15.114:0/1209651973 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4574012880 con 0x7f457c0d07b0 2024-04-28T13:07:55.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.524+0000 7f4563fff640 1 --2- 172.21.15.114:0/1209651973 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f456806c8f0 0x7f456806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:55.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.524+0000 7f4563fff640 1 -- 172.21.15.114:0/1209651973 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f457408c150 con 0x7f457c0d07b0 2024-04-28T13:07:55.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.524+0000 7f457b7fe640 1 --2- 172.21.15.114:0/1209651973 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f456806c8f0 0x7f456806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:55.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.524+0000 7f457b7fe640 1 --2- 172.21.15.114:0/1209651973 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f456806c8f0 0x7f456806edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f456c00a770 tx=0x7f456c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:55.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.528+0000 7f4563fff640 1 -- 172.21.15.114:0/1209651973 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f457405a610 con 0x7f457c0d07b0 2024-04-28T13:07:55.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.704+0000 7f4581bda640 1 -- 172.21.15.114:0/1209651973 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f457c1563d0 con 0x7f457c0d07b0 2024-04-28T13:07:55.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.705+0000 7f4563fff640 1 -- 172.21.15.114:0/1209651973 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7f4574059f10 con 0x7f457c0d07b0 2024-04-28T13:07:55.706 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:55.706 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:07:27.292537+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-28T13:07:23.706359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-28T13:07:24.596188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:07:55.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.707+0000 7f4581bda640 1 -- 172.21.15.114:0/1209651973 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f456806c8f0 msgr2=0x7f456806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:55.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.707+0000 7f4581bda640 1 --2- 172.21.15.114:0/1209651973 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f456806c8f0 0x7f456806edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f456c00a770 tx=0x7f456c008040 comp rx=0 tx=0).stop 2024-04-28T13:07:55.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.707+0000 7f4581bda640 1 -- 172.21.15.114:0/1209651973 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f457c0d07b0 msgr2=0x7f457c0b8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:55.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.707+0000 7f4581bda640 1 --2- 172.21.15.114:0/1209651973 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f457c0d07b0 0x7f457c0b8080 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f457400caf0 tx=0x7f457400a060 comp rx=0 tx=0).stop 2024-04-28T13:07:55.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.707+0000 7f4581bda640 1 -- 172.21.15.114:0/1209651973 shutdown_connections 2024-04-28T13:07:55.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.707+0000 7f4581bda640 1 --2- 172.21.15.114:0/1209651973 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f457c0d07b0 0x7f457c0b8080 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:55.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.707+0000 7f4581bda640 1 --2- 172.21.15.114:0/1209651973 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f456806c8f0 0x7f456806edb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:55.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.707+0000 7f4581bda640 1 --2- 172.21.15.114:0/1209651973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f457c0cdde0 0x7f457c1f6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:55.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.707+0000 7f4581bda640 1 --2- 172.21.15.114:0/1209651973 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f457c0cda00 0x7f457c151730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:55.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.707+0000 7f4581bda640 1 -- 172.21.15.114:0/1209651973 >> 172.21.15.114:0/1209651973 conn(0x7f457c0706f0 msgr2=0x7f457c154c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:55.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.707+0000 7f4581bda640 1 -- 172.21.15.114:0/1209651973 shutdown_connections 2024-04-28T13:07:55.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.707+0000 7f4581bda640 1 -- 172.21.15.114:0/1209651973 wait complete. 2024-04-28T13:07:55.719 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-28T13:07:14.721860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-28T13:07:23.706359+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-28T13:07:24.596188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-28T13:07:55.719 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-28T13:07:55.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.817+0000 7f3588b91640 1 Processor -- start 2024-04-28T13:07:55.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.817+0000 7f3588b91640 1 -- start start 2024-04-28T13:07:55.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.818+0000 7f3588b91640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f35840732b0 0x7f358415ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:55.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.818+0000 7f3588b91640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35840d02b0 con 0x7f35840b4850 2024-04-28T13:07:55.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.818+0000 7f3588b91640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35840cedc0 con 0x7f3584072e30 2024-04-28T13:07:55.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.818+0000 7f3588b91640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f3584073cc0 con 0x7f35840732b0 2024-04-28T13:07:55.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.818+0000 7f358259c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f35840b4850 0x7f35840b4c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50072/0 (socket says 172.21.15.114:50072) 2024-04-28T13:07:55.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.818+0000 7f358259c640 1 -- 172.21.15.114:0/2574382853 learned_addr learned my addr 172.21.15.114:0/2574382853 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:55.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.818+0000 7f3582d9d640 1 --2- 172.21.15.114:0/2574382853 >> v2:172.21.15.134:3300/0 conn(0x7f35840732b0 0x7f358415ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:55.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.818+0000 7f358159a640 1 -- 172.21.15.114:0/2574382853 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1247326478 0 0) 0x7f35840d02b0 con 0x7f35840b4850 2024-04-28T13:07:55.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.818+0000 7f358159a640 1 -- 172.21.15.114:0/2574382853 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f356c003520 con 0x7f35840b4850 2024-04-28T13:07:55.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.818+0000 7f358159a640 1 -- 172.21.15.114:0/2574382853 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2778311393 0 0) 0x7f35840cedc0 con 0x7f3584072e30 2024-04-28T13:07:55.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.819+0000 7f358159a640 1 -- 172.21.15.114:0/2574382853 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35840d02b0 con 0x7f3584072e30 2024-04-28T13:07:55.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.819+0000 7f358159a640 1 -- 172.21.15.114:0/2574382853 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3074997061 0 0) 0x7f356c003520 con 0x7f35840b4850 2024-04-28T13:07:55.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.819+0000 7f3582d9d640 1 -- 172.21.15.114:0/2574382853 >> v1:172.21.15.134:6789/0 conn(0x7f3584072e30 legacy=0x7f358415c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:55.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.819+0000 7f3582d9d640 1 -- 172.21.15.114:0/2574382853 >> v1:172.21.15.114:6789/0 conn(0x7f35840b4850 legacy=0x7f35840b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:55.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.819+0000 7f3582d9d640 1 -- 172.21.15.114:0/2574382853 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3584073fa0 con 0x7f35840732b0 2024-04-28T13:07:55.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.819+0000 7f3582d9d640 1 --2- 172.21.15.114:0/2574382853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35840732b0 0x7f358415ca80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f357c0097a0 tx=0x7f357c02a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=948cc969fbc5da8f server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:55.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.820+0000 7f358159a640 1 -- 172.21.15.114:0/2574382853 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357c037070 con 0x7f35840732b0 2024-04-28T13:07:55.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.820+0000 7f358159a640 1 -- 172.21.15.114:0/2574382853 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f357c02abc0 con 0x7f35840732b0 2024-04-28T13:07:55.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.820+0000 7f358159a640 1 -- 172.21.15.114:0/2574382853 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35740019f0 con 0x7f35840732b0 2024-04-28T13:07:55.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.820+0000 7f3588b91640 1 -- 172.21.15.114:0/2574382853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35840732b0 msgr2=0x7f358415ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:55.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.820+0000 7f3588b91640 1 --2- 172.21.15.114:0/2574382853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35840732b0 0x7f358415ca80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f357c0097a0 tx=0x7f357c02a130 comp rx=0 tx=0).stop 2024-04-28T13:07:55.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.820+0000 7f3588b91640 1 -- 172.21.15.114:0/2574382853 shutdown_connections 2024-04-28T13:07:55.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.820+0000 7f3588b91640 1 --2- 172.21.15.114:0/2574382853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35840732b0 0x7f358415ca80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:55.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.820+0000 7f3588b91640 1 -- 172.21.15.114:0/2574382853 >> 172.21.15.114:0/2574382853 conn(0x7f358406c980 msgr2=0x7f35840b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:55.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.820+0000 7f3588b91640 1 -- 172.21.15.114:0/2574382853 shutdown_connections 2024-04-28T13:07:55.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.820+0000 7f3588b91640 1 -- 172.21.15.114:0/2574382853 wait complete. 2024-04-28T13:07:55.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.821+0000 7f3588b91640 1 Processor -- start 2024-04-28T13:07:55.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.822+0000 7f3588b91640 1 -- start start 2024-04-28T13:07:55.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.822+0000 7f3588b91640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3584072e30 0x7f358415c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:55.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.822+0000 7f3588b91640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35840732b0 0x7f358415dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:55.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.822+0000 7f3588b91640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35840b4850 0x7f3584147ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:55.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.822+0000 7f3588b91640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f35840736e0 con 0x7f3584072e30 2024-04-28T13:07:55.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.822+0000 7f3588b91640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3584074560 con 0x7f35840732b0 2024-04-28T13:07:55.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.822+0000 7f3588b91640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f358406e3e0 con 0x7f35840b4850 2024-04-28T13:07:55.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.822+0000 7f358259c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3584072e30 0x7f358415c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:55.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.822+0000 7f358259c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3584072e30 0x7f358415c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43510/0 (socket says 172.21.15.114:43510) 2024-04-28T13:07:55.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.822+0000 7f358259c640 1 -- 172.21.15.114:0/2205830774 learned_addr learned my addr 172.21.15.114:0/2205830774 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:55.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.822+0000 7f3581d9b640 1 --2- 172.21.15.114:0/2205830774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35840732b0 0x7f358415dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:55.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.822+0000 7f3582d9d640 1 --2- 172.21.15.114:0/2205830774 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35840b4850 0x7f3584147ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:55.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.823+0000 7f358259c640 1 -- 172.21.15.114:0/2205830774 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35840b4850 msgr2=0x7f3584147ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:55.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.823+0000 7f358259c640 1 --2- 172.21.15.114:0/2205830774 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35840b4850 0x7f3584147ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:55.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.823+0000 7f358259c640 1 -- 172.21.15.114:0/2205830774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35840732b0 msgr2=0x7f358415dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:55.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.823+0000 7f358259c640 1 --2- 172.21.15.114:0/2205830774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35840732b0 0x7f358415dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:55.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.823+0000 7f358259c640 1 -- 172.21.15.114:0/2205830774 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f358414efd0 con 0x7f3584072e30 2024-04-28T13:07:55.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.823+0000 7f358259c640 1 --2- 172.21.15.114:0/2205830774 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3584072e30 0x7f358415c370 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3574001f60 tx=0x7f357400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:55.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.823+0000 7f3572ffd640 1 -- 172.21.15.114:0/2205830774 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3574017070 con 0x7f3584072e30 2024-04-28T13:07:55.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.823+0000 7f3572ffd640 1 -- 172.21.15.114:0/2205830774 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3574012400 con 0x7f3584072e30 2024-04-28T13:07:55.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.823+0000 7f3588b91640 1 -- 172.21.15.114:0/2205830774 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f358414f2b0 con 0x7f3584072e30 2024-04-28T13:07:55.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.823+0000 7f3572ffd640 1 -- 172.21.15.114:0/2205830774 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3574012830 con 0x7f3584072e30 2024-04-28T13:07:55.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.823+0000 7f3588b91640 1 -- 172.21.15.114:0/2205830774 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3584141370 con 0x7f3584072e30 2024-04-28T13:07:55.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.824+0000 7f3588b91640 1 -- 172.21.15.114:0/2205830774 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f358406a3d0 con 0x7f3584072e30 2024-04-28T13:07:55.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.824+0000 7f3572ffd640 1 -- 172.21.15.114:0/2205830774 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f357401a070 con 0x7f3584072e30 2024-04-28T13:07:55.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.825+0000 7f3572ffd640 1 --2- 172.21.15.114:0/2205830774 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f356406c8f0 0x7f356406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:55.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.825+0000 7f3581d9b640 1 --2- 172.21.15.114:0/2205830774 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f356406c8f0 0x7f356406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:55.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.825+0000 7f3572ffd640 1 -- 172.21.15.114:0/2205830774 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f357408ba00 con 0x7f3584072e30 2024-04-28T13:07:55.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.825+0000 7f3581d9b640 1 --2- 172.21.15.114:0/2205830774 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f356406c8f0 0x7f356406edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3584157040 tx=0x7f3578009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:55.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:55.829+0000 7f3572ffd640 1 -- 172.21.15.114:0/2205830774 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3574059870 con 0x7f3584072e30 2024-04-28T13:07:56.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.005+0000 7f3588b91640 1 -- 172.21.15.114:0/2205830774 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f35840ccf40 con 0x7f3584072e30 2024-04-28T13:07:56.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.006+0000 7f3572ffd640 1 -- 172.21.15.114:0/2205830774 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f357405db70 con 0x7f3584072e30 2024-04-28T13:07:56.009 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-28T13:07:56.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.007+0000 7f3588b91640 1 -- 172.21.15.114:0/2205830774 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f356406c8f0 msgr2=0x7f356406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:56.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.007+0000 7f3588b91640 1 --2- 172.21.15.114:0/2205830774 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f356406c8f0 0x7f356406edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3584157040 tx=0x7f3578009040 comp rx=0 tx=0).stop 2024-04-28T13:07:56.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.007+0000 7f3588b91640 1 -- 172.21.15.114:0/2205830774 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3584072e30 msgr2=0x7f358415c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:56.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.007+0000 7f3588b91640 1 --2- 172.21.15.114:0/2205830774 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3584072e30 0x7f358415c370 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3574001f60 tx=0x7f357400cf90 comp rx=0 tx=0).stop 2024-04-28T13:07:56.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.008+0000 7f3588b91640 1 -- 172.21.15.114:0/2205830774 shutdown_connections 2024-04-28T13:07:56.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.008+0000 7f3588b91640 1 --2- 172.21.15.114:0/2205830774 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35840b4850 0x7f3584147ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:56.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.008+0000 7f3588b91640 1 --2- 172.21.15.114:0/2205830774 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f356406c8f0 0x7f356406edb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:56.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.008+0000 7f3588b91640 1 --2- 172.21.15.114:0/2205830774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35840732b0 0x7f358415dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:56.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.008+0000 7f3588b91640 1 --2- 172.21.15.114:0/2205830774 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3584072e30 0x7f358415c370 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:56.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.008+0000 7f3588b91640 1 -- 172.21.15.114:0/2205830774 >> 172.21.15.114:0/2205830774 conn(0x7f358406c980 msgr2=0x7f358414bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:56.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.008+0000 7f3588b91640 1 -- 172.21.15.114:0/2205830774 shutdown_connections 2024-04-28T13:07:56.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.008+0000 7f3588b91640 1 -- 172.21.15.114:0/2205830774 wait complete. 2024-04-28T13:07:56.019 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-28T13:07:56.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.118+0000 7ff751d14640 1 Processor -- start 2024-04-28T13:07:56.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.119+0000 7ff751d14640 1 -- start start 2024-04-28T13:07:56.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.119+0000 7ff751d14640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff74c15f430 0x7ff74c0d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:56.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.119+0000 7ff751d14640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff74c0d5870 0x7ff74c0d3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:56.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.119+0000 7ff751d14640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff74c0d2a40 con 0x7ff74c0d1fc0 2024-04-28T13:07:56.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.119+0000 7ff751d14640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ff74c15f810 con 0x7ff74c0d5870 2024-04-28T13:07:56.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.119+0000 7ff751d14640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff74c0d36d0 con 0x7ff74c15f430 2024-04-28T13:07:56.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.120+0000 7ff74b7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff74c15f430 0x7ff74c0d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:56.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.120+0000 7ff74bfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff74c0d5870 0x7ff74c0d3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:56.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.120+0000 7ff74affd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ff74c0d1fc0 0x7ff74c0d5160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:57310/0 (socket says 172.21.15.114:57310) 2024-04-28T13:07:56.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.120+0000 7ff74affd640 1 -- 172.21.15.114:0/2850502031 learned_addr learned my addr 172.21.15.114:0/2850502031 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:56.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.120+0000 7ff74a7fc640 1 -- 172.21.15.114:0/2850502031 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1239332650 0 0) 0x7ff74c0d2a40 con 0x7ff74c0d1fc0 2024-04-28T13:07:56.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.120+0000 7ff74a7fc640 1 -- 172.21.15.114:0/2850502031 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff738003520 con 0x7ff74c0d1fc0 2024-04-28T13:07:56.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.120+0000 7ff74b7fe640 1 -- 172.21.15.114:0/2850502031 >> v2:172.21.15.134:3300/0 conn(0x7ff74c0d5870 msgr2=0x7ff74c0d3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:56.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.120+0000 7ff74b7fe640 1 --2- 172.21.15.114:0/2850502031 >> v2:172.21.15.134:3300/0 conn(0x7ff74c0d5870 0x7ff74c0d3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:56.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.120+0000 7ff74b7fe640 1 -- 172.21.15.114:0/2850502031 >> v1:172.21.15.134:6789/0 conn(0x7ff74c0d1fc0 legacy=0x7ff74c0d5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:56.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.120+0000 7ff74b7fe640 1 -- 172.21.15.114:0/2850502031 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff74c0d2480 con 0x7ff74c15f430 2024-04-28T13:07:56.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.120+0000 7ff74bfff640 1 --2- 172.21.15.114:0/2850502031 >> v2:172.21.15.134:3300/0 conn(0x7ff74c0d5870 0x7ff74c0d3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:07:56.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.121+0000 7ff74b7fe640 1 --2- 172.21.15.114:0/2850502031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff74c15f430 0x7ff74c0d1a80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff73c009d90 tx=0x7ff73c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbdf160016c1bd9c server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:56.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.121+0000 7ff74a7fc640 1 -- 172.21.15.114:0/2850502031 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c007740 con 0x7ff74c15f430 2024-04-28T13:07:56.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.121+0000 7ff74a7fc640 1 -- 172.21.15.114:0/2850502031 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff73c0078e0 con 0x7ff74c15f430 2024-04-28T13:07:56.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.121+0000 7ff74a7fc640 1 -- 172.21.15.114:0/2850502031 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c007c90 con 0x7ff74c15f430 2024-04-28T13:07:56.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.121+0000 7ff751d14640 1 -- 172.21.15.114:0/2850502031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff74c15f430 msgr2=0x7ff74c0d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:56.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.121+0000 7ff751d14640 1 --2- 172.21.15.114:0/2850502031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff74c15f430 0x7ff74c0d1a80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff73c009d90 tx=0x7ff73c02a660 comp rx=0 tx=0).stop 2024-04-28T13:07:56.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.121+0000 7ff751d14640 1 -- 172.21.15.114:0/2850502031 shutdown_connections 2024-04-28T13:07:56.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.121+0000 7ff751d14640 1 --2- 172.21.15.114:0/2850502031 >> v2:172.21.15.134:3300/0 conn(0x7ff74c0d5870 0x7ff74c0d3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:56.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.121+0000 7ff751d14640 1 --2- 172.21.15.114:0/2850502031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff74c15f430 0x7ff74c0d1a80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:56.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.121+0000 7ff751d14640 1 -- 172.21.15.114:0/2850502031 >> 172.21.15.114:0/2850502031 conn(0x7ff74c0633a0 msgr2=0x7ff74c06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:56.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.122+0000 7ff751d14640 1 -- 172.21.15.114:0/2850502031 shutdown_connections 2024-04-28T13:07:56.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.122+0000 7ff751d14640 1 -- 172.21.15.114:0/2850502031 wait complete. 2024-04-28T13:07:56.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.123+0000 7ff751d14640 1 Processor -- start 2024-04-28T13:07:56.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.123+0000 7ff751d14640 1 -- start start 2024-04-28T13:07:56.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.124+0000 7ff751d14640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff74c0d1fc0 0x7ff74c0cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:56.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.124+0000 7ff751d14640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff74c0d5870 0x7ff74c1585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:56.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.124+0000 7ff751d14640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff74c15f430 0x7ff74c0ca270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:56.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.124+0000 7ff751d14640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff74c0baf40 con 0x7ff74c15f430 2024-04-28T13:07:56.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.124+0000 7ff751d14640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff74c0d3360 con 0x7ff74c0d1fc0 2024-04-28T13:07:56.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.124+0000 7ff751d14640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff74c0bb0c0 con 0x7ff74c0d5870 2024-04-28T13:07:56.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.124+0000 7ff74bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff74c15f430 0x7ff74c0ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:56.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.124+0000 7ff74bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff74c15f430 0x7ff74c0ca270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43518/0 (socket says 172.21.15.114:43518) 2024-04-28T13:07:56.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.124+0000 7ff74bfff640 1 -- 172.21.15.114:0/2614071212 learned_addr learned my addr 172.21.15.114:0/2614071212 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:56.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.124+0000 7ff74affd640 1 --2- 172.21.15.114:0/2614071212 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff74c0d5870 0x7ff74c1585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:56.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.124+0000 7ff74b7fe640 1 --2- 172.21.15.114:0/2614071212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff74c0d1fc0 0x7ff74c0cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:56.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.124+0000 7ff74bfff640 1 -- 172.21.15.114:0/2614071212 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff74c0d5870 msgr2=0x7ff74c1585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:56.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.124+0000 7ff74bfff640 1 --2- 172.21.15.114:0/2614071212 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff74c0d5870 0x7ff74c1585c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:56.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.124+0000 7ff74bfff640 1 -- 172.21.15.114:0/2614071212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff74c0d1fc0 msgr2=0x7ff74c0cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:56.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.124+0000 7ff74bfff640 1 --2- 172.21.15.114:0/2614071212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff74c0d1fc0 0x7ff74c0cdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:56.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.124+0000 7ff74bfff640 1 -- 172.21.15.114:0/2614071212 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff74c158b00 con 0x7ff74c15f430 2024-04-28T13:07:56.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.124+0000 7ff74bfff640 1 --2- 172.21.15.114:0/2614071212 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff74c15f430 0x7ff74c0ca270 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff74400e890 tx=0x7ff74400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:56.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.124+0000 7ff743fff640 1 -- 172.21.15.114:0/2614071212 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff744017070 con 0x7ff74c15f430 2024-04-28T13:07:56.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.124+0000 7ff743fff640 1 -- 172.21.15.114:0/2614071212 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff74400c940 con 0x7ff74c15f430 2024-04-28T13:07:56.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.124+0000 7ff751d14640 1 -- 172.21.15.114:0/2614071212 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff74c1f59b0 con 0x7ff74c15f430 2024-04-28T13:07:56.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.124+0000 7ff743fff640 1 -- 172.21.15.114:0/2614071212 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74400cd10 con 0x7ff74c15f430 2024-04-28T13:07:56.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.124+0000 7ff751d14640 1 -- 172.21.15.114:0/2614071212 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff74c0cd770 con 0x7ff74c15f430 2024-04-28T13:07:56.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.125+0000 7ff751d14640 1 -- 172.21.15.114:0/2614071212 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff74c075c40 con 0x7ff74c15f430 2024-04-28T13:07:56.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.126+0000 7ff743fff640 1 -- 172.21.15.114:0/2614071212 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff74401a070 con 0x7ff74c15f430 2024-04-28T13:07:56.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.126+0000 7ff743fff640 1 --2- 172.21.15.114:0/2614071212 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff72c06c920 0x7ff72c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:56.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.126+0000 7ff74b7fe640 1 --2- 172.21.15.114:0/2614071212 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff72c06c920 0x7ff72c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:56.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.127+0000 7ff743fff640 1 -- 172.21.15.114:0/2614071212 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff74408b9a0 con 0x7ff74c15f430 2024-04-28T13:07:56.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.127+0000 7ff74b7fe640 1 --2- 172.21.15.114:0/2614071212 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff72c06c920 0x7ff72c06ede0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff73c034000 tx=0x7ff73c033040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:56.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.131+0000 7ff743fff640 1 -- 172.21.15.114:0/2614071212 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff744059dd0 con 0x7ff74c15f430 2024-04-28T13:07:56.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.305+0000 7ff751d14640 1 -- 172.21.15.114:0/2614071212 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff74c06a3d0 con 0x7ff74c15f430 2024-04-28T13:07:56.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.305+0000 7ff743fff640 1 -- 172.21.15.114:0/2614071212 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7ff7440596d0 con 0x7ff74c15f430 2024-04-28T13:07:56.306 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-04-28T13:07:56.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.307+0000 7ff751d14640 1 -- 172.21.15.114:0/2614071212 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff72c06c920 msgr2=0x7ff72c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:56.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.307+0000 7ff751d14640 1 --2- 172.21.15.114:0/2614071212 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff72c06c920 0x7ff72c06ede0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff73c034000 tx=0x7ff73c033040 comp rx=0 tx=0).stop 2024-04-28T13:07:56.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.307+0000 7ff751d14640 1 -- 172.21.15.114:0/2614071212 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff74c15f430 msgr2=0x7ff74c0ca270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:56.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.307+0000 7ff751d14640 1 --2- 172.21.15.114:0/2614071212 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff74c15f430 0x7ff74c0ca270 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff74400e890 tx=0x7ff74400ed50 comp rx=0 tx=0).stop 2024-04-28T13:07:56.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.307+0000 7ff751d14640 1 -- 172.21.15.114:0/2614071212 shutdown_connections 2024-04-28T13:07:56.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.307+0000 7ff751d14640 1 --2- 172.21.15.114:0/2614071212 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff74c15f430 0x7ff74c0ca270 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:56.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.307+0000 7ff751d14640 1 --2- 172.21.15.114:0/2614071212 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff74c0d5870 0x7ff74c1585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:56.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.307+0000 7ff751d14640 1 --2- 172.21.15.114:0/2614071212 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff72c06c920 0x7ff72c06ede0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:56.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.307+0000 7ff751d14640 1 --2- 172.21.15.114:0/2614071212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff74c0d1fc0 0x7ff74c0cdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:56.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.307+0000 7ff751d14640 1 -- 172.21.15.114:0/2614071212 >> 172.21.15.114:0/2614071212 conn(0x7ff74c0633a0 msgr2=0x7ff74c0d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:56.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.307+0000 7ff751d14640 1 -- 172.21.15.114:0/2614071212 shutdown_connections 2024-04-28T13:07:56.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.307+0000 7ff751d14640 1 -- 172.21.15.114:0/2614071212 wait complete. 2024-04-28T13:07:56.319 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-28T13:07:56.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.417+0000 7f914b16a640 1 Processor -- start 2024-04-28T13:07:56.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.417+0000 7f914b16a640 1 -- start start 2024-04-28T13:07:56.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.418+0000 7f914b16a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f91440ce2f0 0x7f9144140fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:56.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.418+0000 7f914b16a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f91440b3ed0 0x7f914415c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:56.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.418+0000 7f914b16a640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9144141800 con 0x7f914415cb80 2024-04-28T13:07:56.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.418+0000 7f914b16a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f914415c1b0 con 0x7f91440ce2f0 2024-04-28T13:07:56.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.418+0000 7f914b16a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f9144141ae0 con 0x7f91440b3ed0 2024-04-28T13:07:56.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.418+0000 7f9149707640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f914415cb80 0x7f914406f690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50082/0 (socket says 172.21.15.114:50082) 2024-04-28T13:07:56.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.418+0000 7f9149707640 1 -- 172.21.15.114:0/4059600149 learned_addr learned my addr 172.21.15.114:0/4059600149 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:56.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.418+0000 7f9143fff640 1 --2- 172.21.15.114:0/4059600149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f91440b3ed0 0x7f914415c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:56.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.418+0000 7f9148f06640 1 --2- 172.21.15.114:0/4059600149 >> v2:172.21.15.134:3300/0 conn(0x7f91440ce2f0 0x7f9144140fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:56.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.418+0000 7f91437fe640 1 -- 172.21.15.114:0/4059600149 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 975299233 0 0) 0x7f9144141800 con 0x7f914415cb80 2024-04-28T13:07:56.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.418+0000 7f91437fe640 1 -- 172.21.15.114:0/4059600149 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9134004630 con 0x7f914415cb80 2024-04-28T13:07:56.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.418+0000 7f91437fe640 1 -- 172.21.15.114:0/4059600149 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1002156266 0 0) 0x7f9134004630 con 0x7f914415cb80 2024-04-28T13:07:56.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.418+0000 7f91437fe640 1 -- 172.21.15.114:0/4059600149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f91440b3ed0 msgr2=0x7f914415c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:56.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.418+0000 7f91437fe640 1 --2- 172.21.15.114:0/4059600149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f91440b3ed0 0x7f914415c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:56.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.418+0000 7f91437fe640 1 -- 172.21.15.114:0/4059600149 >> v2:172.21.15.134:3300/0 conn(0x7f91440ce2f0 msgr2=0x7f9144140fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:56.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.418+0000 7f91437fe640 1 --2- 172.21.15.114:0/4059600149 >> v2:172.21.15.134:3300/0 conn(0x7f91440ce2f0 0x7f9144140fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:56.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.418+0000 7f91437fe640 1 -- 172.21.15.114:0/4059600149 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9144141dc0 con 0x7f914415cb80 2024-04-28T13:07:56.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.418+0000 7f91437fe640 1 -- 172.21.15.114:0/4059600149 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f913c0019f0 con 0x7f914415cb80 2024-04-28T13:07:56.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.418+0000 7f91437fe640 1 -- 172.21.15.114:0/4059600149 >> v1:172.21.15.114:6789/0 conn(0x7f914415cb80 legacy=0x7f914406f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:56.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.418+0000 7f91437fe640 1 --2- 172.21.15.114:0/4059600149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9134004ac0 0x7f9134004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:56.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.418+0000 7f91437fe640 1 --2- 172.21.15.114:0/4059600149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f91440b3ed0 0x7f9134005910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:56.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.418+0000 7f91437fe640 1 --2- 172.21.15.114:0/4059600149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9134005e50 0x7f91340062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:56.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.418+0000 7f91437fe640 1 -- 172.21.15.114:0/4059600149 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f914415c1b0 con 0x7f9134004ac0 2024-04-28T13:07:56.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.418+0000 7f91437fe640 1 -- 172.21.15.114:0/4059600149 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9144141ae0 con 0x7f9134005e50 2024-04-28T13:07:56.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.418+0000 7f91437fe640 1 -- 172.21.15.114:0/4059600149 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f913400cad0 con 0x7f91440b3ed0 2024-04-28T13:07:56.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.418+0000 7f9148f06640 1 --2- 172.21.15.114:0/4059600149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9134004ac0 0x7f9134004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:56.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.419+0000 7f9143fff640 1 --2- 172.21.15.114:0/4059600149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f91440b3ed0 0x7f9134005910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:56.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.419+0000 7f9149707640 1 --2- 172.21.15.114:0/4059600149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9134005e50 0x7f91340062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:56.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.419+0000 7f9148f06640 1 -- 172.21.15.114:0/4059600149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f91440b3ed0 msgr2=0x7f9134005910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:56.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.419+0000 7f9148f06640 1 --2- 172.21.15.114:0/4059600149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f91440b3ed0 0x7f9134005910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:56.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.419+0000 7f9148f06640 1 -- 172.21.15.114:0/4059600149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9134005e50 msgr2=0x7f91340062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:56.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.419+0000 7f9148f06640 1 --2- 172.21.15.114:0/4059600149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9134005e50 0x7f91340062d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:56.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.419+0000 7f9148f06640 1 -- 172.21.15.114:0/4059600149 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9134004630 con 0x7f9134004ac0 2024-04-28T13:07:56.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.419+0000 7f9143fff640 1 --2- 172.21.15.114:0/4059600149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f91440b3ed0 0x7f9134005910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:56.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.419+0000 7f9148f06640 1 --2- 172.21.15.114:0/4059600149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9134004ac0 0x7f9134004ee0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9138009ac0 tx=0x7f9134006940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923183301873dd60 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:56.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.419+0000 7f91437fe640 1 -- 172.21.15.114:0/4059600149 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9138036070 con 0x7f9134004ac0 2024-04-28T13:07:56.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.420+0000 7f91437fe640 1 -- 172.21.15.114:0/4059600149 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9138031400 con 0x7f9134004ac0 2024-04-28T13:07:56.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.420+0000 7f91437fe640 1 -- 172.21.15.114:0/4059600149 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9138009690 con 0x7f9134004ac0 2024-04-28T13:07:56.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.420+0000 7f914b16a640 1 -- 172.21.15.114:0/4059600149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9134004ac0 msgr2=0x7f9134004ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:56.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.420+0000 7f914b16a640 1 --2- 172.21.15.114:0/4059600149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9134004ac0 0x7f9134004ee0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9138009ac0 tx=0x7f9134006940 comp rx=0 tx=0).stop 2024-04-28T13:07:56.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.420+0000 7f9149707640 1 -- 172.21.15.114:0/4059600149 reap_dead start 2024-04-28T13:07:56.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.420+0000 7f914b16a640 1 -- 172.21.15.114:0/4059600149 shutdown_connections 2024-04-28T13:07:56.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.420+0000 7f914b16a640 1 -- 172.21.15.114:0/4059600149 >> 172.21.15.114:0/4059600149 conn(0x7f914406c980 msgr2=0x7f91440b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:56.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.420+0000 7f914b16a640 1 -- 172.21.15.114:0/4059600149 shutdown_connections 2024-04-28T13:07:56.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.420+0000 7f914b16a640 1 -- 172.21.15.114:0/4059600149 wait complete. 2024-04-28T13:07:56.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.421+0000 7f914b16a640 1 Processor -- start 2024-04-28T13:07:56.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.421+0000 7f914b16a640 1 -- start start 2024-04-28T13:07:56.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.422+0000 7f914b16a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9134004ac0 0x7f91440b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:56.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.422+0000 7f914b16a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9144157410 0x7f91440afb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:56.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.422+0000 7f914b16a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f91441562e0 0x7f9144156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:56.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.422+0000 7f914b16a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f914406fda0 con 0x7f9134004ac0 2024-04-28T13:07:56.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.422+0000 7f914b16a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f914415bdd0 con 0x7f9144157410 2024-04-28T13:07:56.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.422+0000 7f914b16a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f914406ff20 con 0x7f91441562e0 2024-04-28T13:07:56.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.422+0000 7f9148f06640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9134004ac0 0x7f91440b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:56.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.422+0000 7f9148f06640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9134004ac0 0x7f91440b1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43536/0 (socket says 172.21.15.114:43536) 2024-04-28T13:07:56.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.422+0000 7f9148f06640 1 -- 172.21.15.114:0/3319426914 learned_addr learned my addr 172.21.15.114:0/3319426914 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:56.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.422+0000 7f9143fff640 1 --2- 172.21.15.114:0/3319426914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9144157410 0x7f91440afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:56.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.422+0000 7f9148f06640 1 -- 172.21.15.114:0/3319426914 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f91441562e0 msgr2=0x7f9144156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:56.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.422+0000 7f9148f06640 1 --2- 172.21.15.114:0/3319426914 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f91441562e0 0x7f9144156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:56.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.422+0000 7f9148f06640 1 -- 172.21.15.114:0/3319426914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9144157410 msgr2=0x7f91440afb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:56.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.422+0000 7f9148f06640 1 --2- 172.21.15.114:0/3319426914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9144157410 0x7f91440afb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:56.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.422+0000 7f9148f06640 1 -- 172.21.15.114:0/3319426914 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91440b28b0 con 0x7f9134004ac0 2024-04-28T13:07:56.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.423+0000 7f9148f06640 1 --2- 172.21.15.114:0/3319426914 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9134004ac0 0x7f91440b1f80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9138009be0 tx=0x7f9138004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:56.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.423+0000 7f91417fa640 1 -- 172.21.15.114:0/3319426914 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9138040020 con 0x7f9134004ac0 2024-04-28T13:07:56.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.423+0000 7f91417fa640 1 -- 172.21.15.114:0/3319426914 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91380038d0 con 0x7f9134004ac0 2024-04-28T13:07:56.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.423+0000 7f914b16a640 1 -- 172.21.15.114:0/3319426914 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91440b2b90 con 0x7f9134004ac0 2024-04-28T13:07:56.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.423+0000 7f91417fa640 1 -- 172.21.15.114:0/3319426914 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9138036040 con 0x7f9134004ac0 2024-04-28T13:07:56.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.423+0000 7f914b16a640 1 -- 172.21.15.114:0/3319426914 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91440b3150 con 0x7f9134004ac0 2024-04-28T13:07:56.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.424+0000 7f914b16a640 1 -- 172.21.15.114:0/3319426914 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f914406a3d0 con 0x7f9134004ac0 2024-04-28T13:07:56.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.424+0000 7f91417fa640 1 -- 172.21.15.114:0/3319426914 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9138043020 con 0x7f9134004ac0 2024-04-28T13:07:56.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.425+0000 7f91417fa640 1 --2- 172.21.15.114:0/3319426914 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f912806c920 0x7f912806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:56.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.425+0000 7f91417fa640 1 -- 172.21.15.114:0/3319426914 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f91380abf90 con 0x7f9134004ac0 2024-04-28T13:07:56.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.425+0000 7f9143fff640 1 --2- 172.21.15.114:0/3319426914 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f912806c920 0x7f912806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:56.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.425+0000 7f9143fff640 1 --2- 172.21.15.114:0/3319426914 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f912806c920 0x7f912806ede0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f914415db90 tx=0x7f9130008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:56.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.429+0000 7f91417fa640 1 -- 172.21.15.114:0/3319426914 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f913804a030 con 0x7f9134004ac0 2024-04-28T13:07:56.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.603+0000 7f914b16a640 1 -- 172.21.15.114:0/3319426914 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9144074050 con 0x7f9134004ac0 2024-04-28T13:07:56.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.603+0000 7f91417fa640 1 -- 172.21.15.114:0/3319426914 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f913807a330 con 0x7f9134004ac0 2024-04-28T13:07:56.604 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-04-28T13:07:56.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.605+0000 7f914b16a640 1 -- 172.21.15.114:0/3319426914 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f912806c920 msgr2=0x7f912806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:56.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.605+0000 7f914b16a640 1 --2- 172.21.15.114:0/3319426914 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f912806c920 0x7f912806ede0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f914415db90 tx=0x7f9130008040 comp rx=0 tx=0).stop 2024-04-28T13:07:56.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.605+0000 7f914b16a640 1 -- 172.21.15.114:0/3319426914 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9134004ac0 msgr2=0x7f91440b1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:56.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.605+0000 7f914b16a640 1 --2- 172.21.15.114:0/3319426914 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9134004ac0 0x7f91440b1f80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9138009be0 tx=0x7f9138004730 comp rx=0 tx=0).stop 2024-04-28T13:07:56.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.605+0000 7f914b16a640 1 -- 172.21.15.114:0/3319426914 shutdown_connections 2024-04-28T13:07:56.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.605+0000 7f914b16a640 1 --2- 172.21.15.114:0/3319426914 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f91441562e0 0x7f9144156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:56.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.605+0000 7f914b16a640 1 --2- 172.21.15.114:0/3319426914 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f912806c920 0x7f912806ede0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:56.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.605+0000 7f914b16a640 1 --2- 172.21.15.114:0/3319426914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9144157410 0x7f91440afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:56.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.605+0000 7f914b16a640 1 --2- 172.21.15.114:0/3319426914 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9134004ac0 0x7f91440b1f80 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:56.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.605+0000 7f914b16a640 1 -- 172.21.15.114:0/3319426914 >> 172.21.15.114:0/3319426914 conn(0x7f914406c980 msgr2=0x7f914415e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:56.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.605+0000 7f914b16a640 1 -- 172.21.15.114:0/3319426914 shutdown_connections 2024-04-28T13:07:56.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.605+0000 7f914b16a640 1 -- 172.21.15.114:0/3319426914 wait complete. 2024-04-28T13:07:56.617 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots.test_subvolume_group_snapshot_unsupported_status' 2024-04-28T13:07:56.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.713+0000 7fc9cd2dc640 1 Processor -- start 2024-04-28T13:07:56.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.713+0000 7fc9cd2dc640 1 -- start start 2024-04-28T13:07:56.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.714+0000 7fc9cd2dc640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9c80b5a20 0x7fc9c806cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:56.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.714+0000 7fc9cd2dc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc9c8160200 0x7fc9c8073320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:56.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.714+0000 7fc9cd2dc640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9c81639e0 con 0x7fc9c80b5640 2024-04-28T13:07:56.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.714+0000 7fc9cd2dc640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc9c806c8d0 con 0x7fc9c8160200 2024-04-28T13:07:56.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.714+0000 7fc9cd2dc640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc9c806d2a0 con 0x7fc9c80b5a20 2024-04-28T13:07:56.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.715+0000 7fc9c67fc640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9c80b5a20 0x7fc9c806cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:56.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.715+0000 7fc9c77fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc9c8160200 0x7fc9c8073320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:56.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.715+0000 7fc9c67fc640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9c80b5a20 0x7fc9c806cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:34044/0 (socket says 172.21.15.114:34044) 2024-04-28T13:07:56.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.715+0000 7fc9c67fc640 1 -- 172.21.15.114:0/510012673 learned_addr learned my addr 172.21.15.114:0/510012673 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:56.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.715+0000 7fc9c67fc640 1 -- 172.21.15.114:0/510012673 >> v2:172.21.15.134:3300/0 conn(0x7fc9c8160200 msgr2=0x7fc9c8073320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:56.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.715+0000 7fc9c67fc640 1 --2- 172.21.15.114:0/510012673 >> v2:172.21.15.134:3300/0 conn(0x7fc9c8160200 0x7fc9c8073320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:56.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.715+0000 7fc9c67fc640 1 -- 172.21.15.114:0/510012673 >> v1:172.21.15.134:6789/0 conn(0x7fc9c80b5640 legacy=0x7fc9c8162fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:56.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.715+0000 7fc9c67fc640 1 -- 172.21.15.114:0/510012673 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c8163cc0 con 0x7fc9c80b5a20 2024-04-28T13:07:56.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.715+0000 7fc9c77fe640 1 --2- 172.21.15.114:0/510012673 >> v2:172.21.15.134:3300/0 conn(0x7fc9c8160200 0x7fc9c8073320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:07:56.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.716+0000 7fc9c67fc640 1 --2- 172.21.15.114:0/510012673 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9c80b5a20 0x7fc9c806cd60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0009870 tx=0x7fc9b002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd8209959281fb10 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:56.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.716+0000 7fc9c5ffb640 1 -- 172.21.15.114:0/510012673 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0037070 con 0x7fc9c80b5a20 2024-04-28T13:07:56.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.716+0000 7fc9c5ffb640 1 -- 172.21.15.114:0/510012673 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b0032440 con 0x7fc9c80b5a20 2024-04-28T13:07:56.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.716+0000 7fc9c5ffb640 1 -- 172.21.15.114:0/510012673 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0032810 con 0x7fc9c80b5a20 2024-04-28T13:07:56.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.716+0000 7fc9cd2dc640 1 -- 172.21.15.114:0/510012673 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9c80b5a20 msgr2=0x7fc9c806cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:56.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.716+0000 7fc9cd2dc640 1 --2- 172.21.15.114:0/510012673 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9c80b5a20 0x7fc9c806cd60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0009870 tx=0x7fc9b002a270 comp rx=0 tx=0).stop 2024-04-28T13:07:56.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.716+0000 7fc9cd2dc640 1 -- 172.21.15.114:0/510012673 shutdown_connections 2024-04-28T13:07:56.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.716+0000 7fc9cd2dc640 1 --2- 172.21.15.114:0/510012673 >> v2:172.21.15.134:3300/0 conn(0x7fc9c8160200 0x7fc9c8073320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:56.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.716+0000 7fc9cd2dc640 1 --2- 172.21.15.114:0/510012673 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9c80b5a20 0x7fc9c806cd60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:56.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.716+0000 7fc9cd2dc640 1 -- 172.21.15.114:0/510012673 >> 172.21.15.114:0/510012673 conn(0x7fc9c80d2090 msgr2=0x7fc9c80d2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:56.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.716+0000 7fc9cd2dc640 1 -- 172.21.15.114:0/510012673 shutdown_connections 2024-04-28T13:07:56.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.716+0000 7fc9cd2dc640 1 -- 172.21.15.114:0/510012673 wait complete. 2024-04-28T13:07:56.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.718+0000 7fc9cd2dc640 1 Processor -- start 2024-04-28T13:07:56.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.718+0000 7fc9cd2dc640 1 -- start start 2024-04-28T13:07:56.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.718+0000 7fc9cd2dc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9c80b5640 0x7fc9c814e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:56.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.718+0000 7fc9cd2dc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9c80b5a20 0x7fc9c80afd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:56.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.718+0000 7fc9cd2dc640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9c8160200 0x7fc9c81589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:56.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.718+0000 7fc9cd2dc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c80d2d40 con 0x7fc9c80b5a20 2024-04-28T13:07:56.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.718+0000 7fc9cd2dc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c81636c0 con 0x7fc9c80b5640 2024-04-28T13:07:56.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.718+0000 7fc9cd2dc640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc9c80d2ec0 con 0x7fc9c8160200 2024-04-28T13:07:56.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.719+0000 7fc9c67fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9c80b5a20 0x7fc9c80afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:56.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.719+0000 7fc9c67fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9c80b5a20 0x7fc9c80afd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43552/0 (socket says 172.21.15.114:43552) 2024-04-28T13:07:56.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.719+0000 7fc9c67fc640 1 -- 172.21.15.114:0/1834443244 learned_addr learned my addr 172.21.15.114:0/1834443244 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:56.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.719+0000 7fc9c77fe640 1 --2- 172.21.15.114:0/1834443244 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9c8160200 0x7fc9c81589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:56.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.719+0000 7fc9c6ffd640 1 --2- 172.21.15.114:0/1834443244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9c80b5640 0x7fc9c814e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:56.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.719+0000 7fc9c67fc640 1 -- 172.21.15.114:0/1834443244 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9c8160200 msgr2=0x7fc9c81589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:56.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.719+0000 7fc9c67fc640 1 --2- 172.21.15.114:0/1834443244 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9c8160200 0x7fc9c81589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:56.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.719+0000 7fc9c67fc640 1 -- 172.21.15.114:0/1834443244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9c80b5640 msgr2=0x7fc9c814e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:56.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.719+0000 7fc9c67fc640 1 --2- 172.21.15.114:0/1834443244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9c80b5640 0x7fc9c814e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:56.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.719+0000 7fc9c67fc640 1 -- 172.21.15.114:0/1834443244 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c814f850 con 0x7fc9c80b5a20 2024-04-28T13:07:56.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.719+0000 7fc9c67fc640 1 --2- 172.21.15.114:0/1834443244 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9c80b5a20 0x7fc9c80afd00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0000c00 tx=0x7fc9b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:56.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.719+0000 7fc9bf7fe640 1 -- 172.21.15.114:0/1834443244 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0037040 con 0x7fc9c80b5a20 2024-04-28T13:07:56.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.719+0000 7fc9bf7fe640 1 -- 172.21.15.114:0/1834443244 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b0042070 con 0x7fc9c80b5a20 2024-04-28T13:07:56.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.719+0000 7fc9cd2dc640 1 -- 172.21.15.114:0/1834443244 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9c814fac0 con 0x7fc9c80b5a20 2024-04-28T13:07:56.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.719+0000 7fc9bf7fe640 1 -- 172.21.15.114:0/1834443244 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0030880 con 0x7fc9c80b5a20 2024-04-28T13:07:56.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.719+0000 7fc9cd2dc640 1 -- 172.21.15.114:0/1834443244 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9c8150080 con 0x7fc9c80b5a20 2024-04-28T13:07:56.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.720+0000 7fc9cd2dc640 1 -- 172.21.15.114:0/1834443244 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9c806a3d0 con 0x7fc9c80b5a20 2024-04-28T13:07:56.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.721+0000 7fc9bf7fe640 1 -- 172.21.15.114:0/1834443244 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc9b0030a20 con 0x7fc9c80b5a20 2024-04-28T13:07:56.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.721+0000 7fc9bf7fe640 1 --2- 172.21.15.114:0/1834443244 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc9a806c8f0 0x7fc9a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:56.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.721+0000 7fc9bf7fe640 1 -- 172.21.15.114:0/1834443244 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc9b00ac400 con 0x7fc9c80b5a20 2024-04-28T13:07:56.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.721+0000 7fc9c6ffd640 1 --2- 172.21.15.114:0/1834443244 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc9a806c8f0 0x7fc9a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:56.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.721+0000 7fc9c6ffd640 1 --2- 172.21.15.114:0/1834443244 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc9a806c8f0 0x7fc9a806edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0001f10 tx=0x7fc9c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:56.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.725+0000 7fc9bf7fe640 1 -- 172.21.15.114:0/1834443244 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc9b007a7b0 con 0x7fc9c80b5a20 2024-04-28T13:07:56.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:56.969+0000 7fc9cd2dc640 1 -- 172.21.15.114:0/1834443244 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots.test_subvolume_group_snapshot_unsupported_status"]} v 0) -- 0x7fc9c8070250 con 0x7fc9c80b5a20 2024-04-28T13:07:57.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.379+0000 7fc9bf7fe640 1 -- 172.21.15.114:0/1834443244 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots.test_subvolume_group_snapshot_unsupported_status"]}]=0 v52) ==== 184+0+0 (secure 0 0 0) 0x7fc9b007a0b0 con 0x7fc9c80b5a20 2024-04-28T13:07:57.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.381+0000 7fc9cd2dc640 1 -- 172.21.15.114:0/1834443244 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc9a806c8f0 msgr2=0x7fc9a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:57.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.381+0000 7fc9cd2dc640 1 --2- 172.21.15.114:0/1834443244 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc9a806c8f0 0x7fc9a806edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0001f10 tx=0x7fc9c0009040 comp rx=0 tx=0).stop 2024-04-28T13:07:57.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.381+0000 7fc9cd2dc640 1 -- 172.21.15.114:0/1834443244 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9c80b5a20 msgr2=0x7fc9c80afd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:57.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.381+0000 7fc9cd2dc640 1 --2- 172.21.15.114:0/1834443244 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9c80b5a20 0x7fc9c80afd00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0000c00 tx=0x7fc9b00046c0 comp rx=0 tx=0).stop 2024-04-28T13:07:57.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.381+0000 7fc9cd2dc640 1 -- 172.21.15.114:0/1834443244 shutdown_connections 2024-04-28T13:07:57.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.381+0000 7fc9cd2dc640 1 --2- 172.21.15.114:0/1834443244 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9c8160200 0x7fc9c81589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:57.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.381+0000 7fc9cd2dc640 1 --2- 172.21.15.114:0/1834443244 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9c80b5a20 0x7fc9c80afd00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:57.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.381+0000 7fc9cd2dc640 1 --2- 172.21.15.114:0/1834443244 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc9a806c8f0 0x7fc9a806edb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:57.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.381+0000 7fc9cd2dc640 1 --2- 172.21.15.114:0/1834443244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9c80b5640 0x7fc9c814e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:57.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.381+0000 7fc9cd2dc640 1 -- 172.21.15.114:0/1834443244 >> 172.21.15.114:0/1834443244 conn(0x7fc9c80d2090 msgr2=0x7fc9c80ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:57.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.381+0000 7fc9cd2dc640 1 -- 172.21.15.114:0/1834443244 shutdown_connections 2024-04-28T13:07:57.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.381+0000 7fc9cd2dc640 1 -- 172.21.15.114:0/1834443244 wait complete. 2024-04-28T13:07:57.393 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-28T13:07:57.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.491+0000 7fd6013bf640 1 Processor -- start 2024-04-28T13:07:57.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.492+0000 7fd6013bf640 1 -- start start 2024-04-28T13:07:57.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.492+0000 7fd6013bf640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd5fc15f650 0x7fd5fc0b5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:57.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.492+0000 7fd6013bf640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd5fc09c0f0 0x7fd5fc0ce100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:57.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.492+0000 7fd6013bf640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5fc0d2240 con 0x7fd5fc0d1db0 2024-04-28T13:07:57.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.492+0000 7fd6013bf640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fd5fc0cd6b0 con 0x7fd5fc09c0f0 2024-04-28T13:07:57.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.492+0000 7fd6013bf640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fd5fc0cdc70 con 0x7fd5fc15f650 2024-04-28T13:07:57.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.492+0000 7fd5fb7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd5fc09c0f0 0x7fd5fc0ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:57.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.492+0000 7fd5fa7fc640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd5fc0d1db0 0x7fd5fc09b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50092/0 (socket says 172.21.15.114:50092) 2024-04-28T13:07:57.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.492+0000 7fd5fb7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd5fc09c0f0 0x7fd5fc0ce100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43556/0 (socket says 172.21.15.114:43556) 2024-04-28T13:07:57.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.492+0000 7fd5fa7fc640 1 -- 172.21.15.114:0/818016366 learned_addr learned my addr 172.21.15.114:0/818016366 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:57.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.493+0000 7fd5faffd640 1 --2- 172.21.15.114:0/818016366 >> v2:172.21.15.134:3300/0 conn(0x7fd5fc15f650 0x7fd5fc0b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:57.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.493+0000 7fd5fb7fe640 1 -- 172.21.15.114:0/818016366 >> v2:172.21.15.134:3300/0 conn(0x7fd5fc15f650 msgr2=0x7fd5fc0b5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:57.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.493+0000 7fd5fb7fe640 1 --2- 172.21.15.114:0/818016366 >> v2:172.21.15.134:3300/0 conn(0x7fd5fc15f650 0x7fd5fc0b5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:57.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.493+0000 7fd5fb7fe640 1 -- 172.21.15.114:0/818016366 >> v1:172.21.15.114:6789/0 conn(0x7fd5fc0d1db0 legacy=0x7fd5fc09b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:57.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.493+0000 7fd5fb7fe640 1 -- 172.21.15.114:0/818016366 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5fc0d2520 con 0x7fd5fc09c0f0 2024-04-28T13:07:57.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.493+0000 7fd5f9ffb640 1 -- 172.21.15.114:0/818016366 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3489450491 0 0) 0x7fd5fc0d2240 con 0x7fd5fc0d1db0 2024-04-28T13:07:57.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.493+0000 7fd5faffd640 1 --2- 172.21.15.114:0/818016366 >> v2:172.21.15.134:3300/0 conn(0x7fd5fc15f650 0x7fd5fc0b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:57.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.493+0000 7fd5fb7fe640 1 --2- 172.21.15.114:0/818016366 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5fc09c0f0 0x7fd5fc0ce100 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc0735e0 tx=0x7fd5ec02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b498459b9fa577e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:57.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.494+0000 7fd5f9ffb640 1 -- 172.21.15.114:0/818016366 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec037070 con 0x7fd5fc09c0f0 2024-04-28T13:07:57.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.494+0000 7fd5f9ffb640 1 -- 172.21.15.114:0/818016366 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5ec032440 con 0x7fd5fc09c0f0 2024-04-28T13:07:57.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.494+0000 7fd5f9ffb640 1 -- 172.21.15.114:0/818016366 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec032810 con 0x7fd5fc09c0f0 2024-04-28T13:07:57.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.494+0000 7fd6013bf640 1 -- 172.21.15.114:0/818016366 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5fc09c0f0 msgr2=0x7fd5fc0ce100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:57.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.494+0000 7fd6013bf640 1 --2- 172.21.15.114:0/818016366 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5fc09c0f0 0x7fd5fc0ce100 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc0735e0 tx=0x7fd5ec02a1a0 comp rx=0 tx=0).stop 2024-04-28T13:07:57.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.494+0000 7fd6013bf640 1 -- 172.21.15.114:0/818016366 shutdown_connections 2024-04-28T13:07:57.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.494+0000 7fd6013bf640 1 --2- 172.21.15.114:0/818016366 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5fc09c0f0 0x7fd5fc0ce100 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:57.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.494+0000 7fd6013bf640 1 --2- 172.21.15.114:0/818016366 >> v2:172.21.15.134:3300/0 conn(0x7fd5fc15f650 0x7fd5fc0b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:57.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.494+0000 7fd6013bf640 1 -- 172.21.15.114:0/818016366 >> 172.21.15.114:0/818016366 conn(0x7fd5fc0b4b50 msgr2=0x7fd5fc0b4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:57.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.494+0000 7fd6013bf640 1 -- 172.21.15.114:0/818016366 shutdown_connections 2024-04-28T13:07:57.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.494+0000 7fd6013bf640 1 -- 172.21.15.114:0/818016366 wait complete. 2024-04-28T13:07:57.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.495+0000 7fd6013bf640 1 Processor -- start 2024-04-28T13:07:57.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.496+0000 7fd6013bf640 1 -- start start 2024-04-28T13:07:57.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.496+0000 7fd6013bf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5fc09c0f0 0x7fd5fc0c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:57.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.496+0000 7fd6013bf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5fc15f650 0x7fd5fc0c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:57.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.496+0000 7fd6013bf640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd5fc1f59f0 0x7fd5fc154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:57.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.496+0000 7fd6013bf640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd5fc09c730 con 0x7fd5fc09c0f0 2024-04-28T13:07:57.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.496+0000 7fd6013bf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd5fc15fa30 con 0x7fd5fc15f650 2024-04-28T13:07:57.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.496+0000 7fd6013bf640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fd5fc09c8b0 con 0x7fd5fc1f59f0 2024-04-28T13:07:57.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.496+0000 7fd5faffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5fc09c0f0 0x7fd5fc0c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:57.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.496+0000 7fd5faffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5fc09c0f0 0x7fd5fc0c6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43562/0 (socket says 172.21.15.114:43562) 2024-04-28T13:07:57.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.496+0000 7fd5faffd640 1 -- 172.21.15.114:0/2702840733 learned_addr learned my addr 172.21.15.114:0/2702840733 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:57.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.497+0000 7fd5fb7fe640 1 --2- 172.21.15.114:0/2702840733 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd5fc1f59f0 0x7fd5fc154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:57.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.497+0000 7fd5faffd640 1 -- 172.21.15.114:0/2702840733 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd5fc1f59f0 msgr2=0x7fd5fc154010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:57.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.497+0000 7fd5faffd640 1 --2- 172.21.15.114:0/2702840733 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd5fc1f59f0 0x7fd5fc154010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:57.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.497+0000 7fd5fa7fc640 1 --2- 172.21.15.114:0/2702840733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5fc15f650 0x7fd5fc0c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:57.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.497+0000 7fd5faffd640 1 -- 172.21.15.114:0/2702840733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5fc15f650 msgr2=0x7fd5fc0c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:57.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.497+0000 7fd5faffd640 1 --2- 172.21.15.114:0/2702840733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5fc15f650 0x7fd5fc0c9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:57.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.497+0000 7fd5faffd640 1 -- 172.21.15.114:0/2702840733 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5fc0c73c0 con 0x7fd5fc09c0f0 2024-04-28T13:07:57.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.497+0000 7fd5faffd640 1 --2- 172.21.15.114:0/2702840733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5fc09c0f0 0x7fd5fc0c6b70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd5f400d100 tx=0x7fd5f400d5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:57.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.497+0000 7fd5f37fe640 1 -- 172.21.15.114:0/2702840733 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f401a070 con 0x7fd5fc09c0f0 2024-04-28T13:07:57.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.497+0000 7fd5f37fe640 1 -- 172.21.15.114:0/2702840733 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f4003b90 con 0x7fd5fc09c0f0 2024-04-28T13:07:57.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.497+0000 7fd6013bf640 1 -- 172.21.15.114:0/2702840733 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5fc0c76a0 con 0x7fd5fc09c0f0 2024-04-28T13:07:57.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.497+0000 7fd5f37fe640 1 -- 172.21.15.114:0/2702840733 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4004030 con 0x7fd5fc09c0f0 2024-04-28T13:07:57.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.497+0000 7fd6013bf640 1 -- 172.21.15.114:0/2702840733 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5fc0c7c60 con 0x7fd5fc09c0f0 2024-04-28T13:07:57.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.498+0000 7fd6013bf640 1 -- 172.21.15.114:0/2702840733 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5fc0b58c0 con 0x7fd5fc09c0f0 2024-04-28T13:07:57.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.498+0000 7fd5f37fe640 1 -- 172.21.15.114:0/2702840733 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd5f401d070 con 0x7fd5fc09c0f0 2024-04-28T13:07:57.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.499+0000 7fd5f37fe640 1 --2- 172.21.15.114:0/2702840733 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd5dc06c8f0 0x7fd5dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:57.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.499+0000 7fd5f37fe640 1 -- 172.21.15.114:0/2702840733 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd5f408bd50 con 0x7fd5fc09c0f0 2024-04-28T13:07:57.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.499+0000 7fd5fa7fc640 1 --2- 172.21.15.114:0/2702840733 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd5dc06c8f0 0x7fd5dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:57.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.499+0000 7fd5fa7fc640 1 --2- 172.21.15.114:0/2702840733 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd5dc06c8f0 0x7fd5dc06edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc0b2760 tx=0x7fd5e4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:57.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.503+0000 7fd5f37fe640 1 -- 172.21.15.114:0/2702840733 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd5f408f030 con 0x7fd5fc09c0f0 2024-04-28T13:07:57.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.678+0000 7fd6013bf640 1 -- 172.21.15.114:0/2702840733 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd5fc0c70b0 con 0x7fd5fc09c0f0 2024-04-28T13:07:57.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.681+0000 7fd5f37fe640 1 -- 172.21.15.114:0/2702840733 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fd5f4010070 con 0x7fd5fc09c0f0 2024-04-28T13:07:57.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.683+0000 7fd6013bf640 1 -- 172.21.15.114:0/2702840733 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd5dc06c8f0 msgr2=0x7fd5dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:57.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.683+0000 7fd6013bf640 1 --2- 172.21.15.114:0/2702840733 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd5dc06c8f0 0x7fd5dc06edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc0b2760 tx=0x7fd5e4009040 comp rx=0 tx=0).stop 2024-04-28T13:07:57.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.684+0000 7fd6013bf640 1 -- 172.21.15.114:0/2702840733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5fc09c0f0 msgr2=0x7fd5fc0c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:57.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.684+0000 7fd6013bf640 1 --2- 172.21.15.114:0/2702840733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5fc09c0f0 0x7fd5fc0c6b70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd5f400d100 tx=0x7fd5f400d5c0 comp rx=0 tx=0).stop 2024-04-28T13:07:57.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.684+0000 7fd6013bf640 1 -- 172.21.15.114:0/2702840733 shutdown_connections 2024-04-28T13:07:57.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.684+0000 7fd6013bf640 1 --2- 172.21.15.114:0/2702840733 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd5fc1f59f0 0x7fd5fc154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:57.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.684+0000 7fd6013bf640 1 --2- 172.21.15.114:0/2702840733 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd5dc06c8f0 0x7fd5dc06edb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:57.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.684+0000 7fd6013bf640 1 --2- 172.21.15.114:0/2702840733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5fc15f650 0x7fd5fc0c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:57.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.684+0000 7fd6013bf640 1 --2- 172.21.15.114:0/2702840733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5fc09c0f0 0x7fd5fc0c6b70 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:57.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.684+0000 7fd6013bf640 1 -- 172.21.15.114:0/2702840733 >> 172.21.15.114:0/2702840733 conn(0x7fd5fc0b4b50 msgr2=0x7fd5fc15e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:57.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.684+0000 7fd6013bf640 1 -- 172.21.15.114:0/2702840733 shutdown_connections 2024-04-28T13:07:57.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:57.684+0000 7fd6013bf640 1 -- 172.21.15.114:0/2702840733 wait complete. 2024-04-28T13:07:57.695 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-28T13:07:57.696 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-28T13:07:57.734 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-28T13:07:57.780 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-28T13:07:57.780 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:07:57.780 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-28T13:07:57.795 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:07:57.795 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-28T13:07:57.850 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:07:57.851 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-28T13:07:57.906 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:07:58.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.042+0000 7f657ae07640 1 Processor -- start 2024-04-28T13:07:58.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.042+0000 7f657ae07640 1 -- start start 2024-04-28T13:07:58.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.042+0000 7f657ae07640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f657415eb10 0x7f65740ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:58.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.043+0000 7f657ae07640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6574146fe0 con 0x7f6574146c00 2024-04-28T13:07:58.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.043+0000 7f657ae07640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6574073440 con 0x7f65740cd890 2024-04-28T13:07:58.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.043+0000 7f657ae07640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f65740cf390 con 0x7f657415eb10 2024-04-28T13:07:58.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.043+0000 7f6573fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f657415eb10 0x7f65740ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:58.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.043+0000 7f6578ba3640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6574146c00 0x7f657415e390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50100/0 (socket says 172.21.15.114:50100) 2024-04-28T13:07:58.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.043+0000 7f6573fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f657415eb10 0x7f65740ced60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43572/0 (socket says 172.21.15.114:43572) 2024-04-28T13:07:58.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.043+0000 7f6578ba3640 1 -- 172.21.15.114:0/563575882 learned_addr learned my addr 172.21.15.114:0/563575882 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:58.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.043+0000 7f6573fff640 1 -- 172.21.15.114:0/563575882 >> v1:172.21.15.134:6789/0 conn(0x7f65740cd890 legacy=0x7f65740cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:58.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.043+0000 7f6573fff640 1 -- 172.21.15.114:0/563575882 >> v1:172.21.15.114:6789/0 conn(0x7f6574146c00 legacy=0x7f657415e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:58.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.043+0000 7f6573fff640 1 -- 172.21.15.114:0/563575882 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65740cf670 con 0x7f657415eb10 2024-04-28T13:07:58.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.044+0000 7f6573fff640 1 --2- 172.21.15.114:0/563575882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f657415eb10 0x7f65740ced60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f65600097a0 tx=0x7f656002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cce6156af7869d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:58.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.044+0000 7f65737fe640 1 -- 172.21.15.114:0/563575882 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6560037070 con 0x7f657415eb10 2024-04-28T13:07:58.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.044+0000 7f65737fe640 1 -- 172.21.15.114:0/563575882 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6560032440 con 0x7f657415eb10 2024-04-28T13:07:58.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.044+0000 7f65737fe640 1 -- 172.21.15.114:0/563575882 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6560032810 con 0x7f657415eb10 2024-04-28T13:07:58.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.044+0000 7f657ae07640 1 -- 172.21.15.114:0/563575882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f657415eb10 msgr2=0x7f65740ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:58.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.044+0000 7f657ae07640 1 --2- 172.21.15.114:0/563575882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f657415eb10 0x7f65740ced60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f65600097a0 tx=0x7f656002a1e0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.044+0000 7f657ae07640 1 -- 172.21.15.114:0/563575882 shutdown_connections 2024-04-28T13:07:58.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.044+0000 7f657ae07640 1 --2- 172.21.15.114:0/563575882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f657415eb10 0x7f65740ced60 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.044+0000 7f657ae07640 1 -- 172.21.15.114:0/563575882 >> 172.21.15.114:0/563575882 conn(0x7f657406c980 msgr2=0x7f65740b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:58.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.044+0000 7f657ae07640 1 -- 172.21.15.114:0/563575882 shutdown_connections 2024-04-28T13:07:58.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.044+0000 7f657ae07640 1 -- 172.21.15.114:0/563575882 wait complete. 2024-04-28T13:07:58.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.045+0000 7f657ae07640 1 Processor -- start 2024-04-28T13:07:58.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.045+0000 7f657ae07640 1 -- start start 2024-04-28T13:07:58.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.046+0000 7f657ae07640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65740cd890 0x7f65740cca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:58.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.046+0000 7f657ae07640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6574146c00 0x7f657415c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:58.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.046+0000 7f657ae07640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f657415eb10 0x7f657415c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:58.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.046+0000 7f657ae07640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6574073920 con 0x7f65740cd890 2024-04-28T13:07:58.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.046+0000 7f657ae07640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f65740cfc30 con 0x7f657415eb10 2024-04-28T13:07:58.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.046+0000 7f657ae07640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f6574073aa0 con 0x7f6574146c00 2024-04-28T13:07:58.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.046+0000 7f6578ba3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65740cd890 0x7f65740cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:58.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.046+0000 7f6578ba3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65740cd890 0x7f65740cca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43588/0 (socket says 172.21.15.114:43588) 2024-04-28T13:07:58.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.046+0000 7f6578ba3640 1 -- 172.21.15.114:0/2313034977 learned_addr learned my addr 172.21.15.114:0/2313034977 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:58.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.047+0000 7f65793a4640 1 --2- 172.21.15.114:0/2313034977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f657415eb10 0x7f657415c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:58.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.047+0000 7f6573fff640 1 --2- 172.21.15.114:0/2313034977 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6574146c00 0x7f657415c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:58.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.047+0000 7f6578ba3640 1 -- 172.21.15.114:0/2313034977 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6574146c00 msgr2=0x7f657415c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:58.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.047+0000 7f6578ba3640 1 --2- 172.21.15.114:0/2313034977 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6574146c00 0x7f657415c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.047+0000 7f6578ba3640 1 -- 172.21.15.114:0/2313034977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f657415eb10 msgr2=0x7f657415c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:58.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.047+0000 7f6578ba3640 1 --2- 172.21.15.114:0/2313034977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f657415eb10 0x7f657415c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.047+0000 7f6578ba3640 1 -- 172.21.15.114:0/2313034977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657415fde0 con 0x7f65740cd890 2024-04-28T13:07:58.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.047+0000 7f6578ba3640 1 --2- 172.21.15.114:0/2313034977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65740cd890 0x7f65740cca10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f656800c430 tx=0x7f656800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:58.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.047+0000 7f65717fa640 1 -- 172.21.15.114:0/2313034977 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6568017070 con 0x7f65740cd890 2024-04-28T13:07:58.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.047+0000 7f65717fa640 1 -- 172.21.15.114:0/2313034977 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6568005ce0 con 0x7f65740cd890 2024-04-28T13:07:58.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.047+0000 7f657ae07640 1 -- 172.21.15.114:0/2313034977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65741600c0 con 0x7f65740cd890 2024-04-28T13:07:58.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.047+0000 7f65717fa640 1 -- 172.21.15.114:0/2313034977 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6568007310 con 0x7f65740cd890 2024-04-28T13:07:58.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.047+0000 7f657ae07640 1 -- 172.21.15.114:0/2313034977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f657414bb80 con 0x7f65740cd890 2024-04-28T13:07:58.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.048+0000 7f657ae07640 1 -- 172.21.15.114:0/2313034977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f657406a3d0 con 0x7f65740cd890 2024-04-28T13:07:58.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.049+0000 7f65717fa640 1 -- 172.21.15.114:0/2313034977 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f656801a070 con 0x7f65740cd890 2024-04-28T13:07:58.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.049+0000 7f65717fa640 1 --2- 172.21.15.114:0/2313034977 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f655806c8f0 0x7f655806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:58.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.049+0000 7f65717fa640 1 -- 172.21.15.114:0/2313034977 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f656808af30 con 0x7f65740cd890 2024-04-28T13:07:58.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.049+0000 7f6573fff640 1 --2- 172.21.15.114:0/2313034977 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f655806c8f0 0x7f655806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:58.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.049+0000 7f6573fff640 1 --2- 172.21.15.114:0/2313034977 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f655806c8f0 0x7f655806edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6560034000 tx=0x7f656002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:58.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.053+0000 7f65717fa640 1 -- 172.21.15.114:0/2313034977 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6574146fe0 con 0x7f65740cd890 2024-04-28T13:07:58.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.229+0000 7f657ae07640 1 -- 172.21.15.114:0/2313034977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f657415d2a0 con 0x7f65740cd890 2024-04-28T13:07:58.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.230+0000 7f65717fa640 1 -- 172.21.15.114:0/2313034977 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7f6568059360 con 0x7f65740cd890 2024-04-28T13:07:58.231 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:58.231 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:07:27.292537+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-28T13:07:23.706359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-28T13:07:24.596188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:07:58.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.232+0000 7f657ae07640 1 -- 172.21.15.114:0/2313034977 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f655806c8f0 msgr2=0x7f655806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:58.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.232+0000 7f657ae07640 1 --2- 172.21.15.114:0/2313034977 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f655806c8f0 0x7f655806edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6560034000 tx=0x7f656002e000 comp rx=0 tx=0).stop 2024-04-28T13:07:58.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.232+0000 7f657ae07640 1 -- 172.21.15.114:0/2313034977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65740cd890 msgr2=0x7f65740cca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:58.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.232+0000 7f657ae07640 1 --2- 172.21.15.114:0/2313034977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65740cd890 0x7f65740cca10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f656800c430 tx=0x7f656800c8f0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.232+0000 7f657ae07640 1 -- 172.21.15.114:0/2313034977 shutdown_connections 2024-04-28T13:07:58.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.232+0000 7f657ae07640 1 --2- 172.21.15.114:0/2313034977 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f655806c8f0 0x7f655806edb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.232+0000 7f657ae07640 1 --2- 172.21.15.114:0/2313034977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f657415eb10 0x7f657415c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.232+0000 7f657ae07640 1 --2- 172.21.15.114:0/2313034977 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6574146c00 0x7f657415c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.232+0000 7f657ae07640 1 --2- 172.21.15.114:0/2313034977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65740cd890 0x7f65740cca10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.232+0000 7f657ae07640 1 -- 172.21.15.114:0/2313034977 >> 172.21.15.114:0/2313034977 conn(0x7f657406c980 msgr2=0x7f65740b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:58.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.232+0000 7f657ae07640 1 -- 172.21.15.114:0/2313034977 shutdown_connections 2024-04-28T13:07:58.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.232+0000 7f657ae07640 1 -- 172.21.15.114:0/2313034977 wait complete. 2024-04-28T13:07:58.244 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-28T13:07:14.721860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-28T13:07:23.706359+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-28T13:07:24.596188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-28T13:07:58.244 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-28T13:07:58.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.345+0000 7f441a050640 1 Processor -- start 2024-04-28T13:07:58.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.346+0000 7f441a050640 1 -- start start 2024-04-28T13:07:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.346+0000 7f441a050640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f44140baf40 0x7f44140d5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.346+0000 7f441a050640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f44140d56a0 0x7f44140d3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.346+0000 7f441a050640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44140d2a40 con 0x7f441415f430 2024-04-28T13:07:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.346+0000 7f441a050640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f441415f810 con 0x7f44140d56a0 2024-04-28T13:07:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.346+0000 7f441a050640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f44140d36d0 con 0x7f44140baf40 2024-04-28T13:07:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.347+0000 7f44137fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f441415f430 0x7f44140d1a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:57346/0 (socket says 172.21.15.114:57346) 2024-04-28T13:07:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.347+0000 7f4412ffd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f44140baf40 0x7f44140d5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.347+0000 7f44137fe640 1 -- 172.21.15.114:0/1586760244 learned_addr learned my addr 172.21.15.114:0/1586760244 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.347+0000 7f4413fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f44140d56a0 0x7f44140d3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.347+0000 7f44127fc640 1 -- 172.21.15.114:0/1586760244 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2393938565 0 0) 0x7f44140d2a40 con 0x7f441415f430 2024-04-28T13:07:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.347+0000 7f44127fc640 1 -- 172.21.15.114:0/1586760244 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43fc003520 con 0x7f441415f430 2024-04-28T13:07:58.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.347+0000 7f4413fff640 1 -- 172.21.15.114:0/1586760244 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f44140baf40 msgr2=0x7f44140d5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:58.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.347+0000 7f4413fff640 1 --2- 172.21.15.114:0/1586760244 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f44140baf40 0x7f44140d5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.347+0000 7f4413fff640 1 -- 172.21.15.114:0/1586760244 >> v1:172.21.15.134:6789/0 conn(0x7f441415f430 legacy=0x7f44140d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:58.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.347+0000 7f4413fff640 1 -- 172.21.15.114:0/1586760244 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44140d2480 con 0x7f44140d56a0 2024-04-28T13:07:58.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.347+0000 7f4412ffd640 1 --2- 172.21.15.114:0/1586760244 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f44140baf40 0x7f44140d5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:07:58.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.348+0000 7f4413fff640 1 --2- 172.21.15.114:0/1586760244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44140d56a0 0x7f44140d3b60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f440c009d90 tx=0x7f440c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e41c9ff696389a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:58.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.348+0000 7f44127fc640 1 -- 172.21.15.114:0/1586760244 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f440c007740 con 0x7f44140d56a0 2024-04-28T13:07:58.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.348+0000 7f44127fc640 1 -- 172.21.15.114:0/1586760244 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f440c0078e0 con 0x7f44140d56a0 2024-04-28T13:07:58.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.348+0000 7f44127fc640 1 -- 172.21.15.114:0/1586760244 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f440c007cb0 con 0x7f44140d56a0 2024-04-28T13:07:58.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.348+0000 7f441a050640 1 -- 172.21.15.114:0/1586760244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44140d56a0 msgr2=0x7f44140d3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:58.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.348+0000 7f441a050640 1 --2- 172.21.15.114:0/1586760244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44140d56a0 0x7f44140d3b60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f440c009d90 tx=0x7f440c02a660 comp rx=0 tx=0).stop 2024-04-28T13:07:58.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.348+0000 7f441a050640 1 -- 172.21.15.114:0/1586760244 shutdown_connections 2024-04-28T13:07:58.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.348+0000 7f441a050640 1 --2- 172.21.15.114:0/1586760244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44140d56a0 0x7f44140d3b60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.348+0000 7f441a050640 1 --2- 172.21.15.114:0/1586760244 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f44140baf40 0x7f44140d5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.348+0000 7f441a050640 1 -- 172.21.15.114:0/1586760244 >> 172.21.15.114:0/1586760244 conn(0x7f44140633a0 msgr2=0x7f441406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:58.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.349+0000 7f441a050640 1 -- 172.21.15.114:0/1586760244 shutdown_connections 2024-04-28T13:07:58.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.349+0000 7f441a050640 1 -- 172.21.15.114:0/1586760244 wait complete. 2024-04-28T13:07:58.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.350+0000 7f441a050640 1 Processor -- start 2024-04-28T13:07:58.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.350+0000 7f441a050640 1 -- start start 2024-04-28T13:07:58.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.350+0000 7f441a050640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44140baf40 0x7f4414154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:58.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.350+0000 7f441a050640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44140d56a0 0x7f44141f4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:58.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.350+0000 7f441a050640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f441415f430 0x7f44141f8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:58.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.350+0000 7f441a050640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f44140d2190 con 0x7f44140d56a0 2024-04-28T13:07:58.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.350+0000 7f441a050640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f44140d3360 con 0x7f44140baf40 2024-04-28T13:07:58.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.350+0000 7f441a050640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f44140d40a0 con 0x7f441415f430 2024-04-28T13:07:58.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.351+0000 7f4412ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44140d56a0 0x7f44141f4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:58.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.351+0000 7f4412ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44140d56a0 0x7f44141f4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43598/0 (socket says 172.21.15.114:43598) 2024-04-28T13:07:58.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.351+0000 7f4412ffd640 1 -- 172.21.15.114:0/1890338816 learned_addr learned my addr 172.21.15.114:0/1890338816 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:58.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.351+0000 7f4413fff640 1 --2- 172.21.15.114:0/1890338816 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f441415f430 0x7f44141f8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:58.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.351+0000 7f44137fe640 1 --2- 172.21.15.114:0/1890338816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44140baf40 0x7f4414154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:58.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.351+0000 7f4412ffd640 1 -- 172.21.15.114:0/1890338816 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f441415f430 msgr2=0x7f44141f8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:58.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.351+0000 7f4412ffd640 1 --2- 172.21.15.114:0/1890338816 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f441415f430 0x7f44141f8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.351+0000 7f4412ffd640 1 -- 172.21.15.114:0/1890338816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44140baf40 msgr2=0x7f4414154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:58.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.351+0000 7f4412ffd640 1 --2- 172.21.15.114:0/1890338816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44140baf40 0x7f4414154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.351+0000 7f4412ffd640 1 -- 172.21.15.114:0/1890338816 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44141f82f0 con 0x7f44140d56a0 2024-04-28T13:07:58.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.351+0000 7f4412ffd640 1 --2- 172.21.15.114:0/1890338816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44140d56a0 0x7f44141f4d00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f440400e9b0 tx=0x7f440400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:58.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.351+0000 7f43fbfff640 1 -- 172.21.15.114:0/1890338816 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4404017070 con 0x7f44140d56a0 2024-04-28T13:07:58.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.351+0000 7f43fbfff640 1 -- 172.21.15.114:0/1890338816 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f440400ca00 con 0x7f44140d56a0 2024-04-28T13:07:58.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.351+0000 7f441a050640 1 -- 172.21.15.114:0/1890338816 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44141f5550 con 0x7f44140d56a0 2024-04-28T13:07:58.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.351+0000 7f43fbfff640 1 -- 172.21.15.114:0/1890338816 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f440400cdf0 con 0x7f44140d56a0 2024-04-28T13:07:58.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.351+0000 7f441a050640 1 -- 172.21.15.114:0/1890338816 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44141f5b10 con 0x7f44140d56a0 2024-04-28T13:07:58.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.352+0000 7f441a050640 1 -- 172.21.15.114:0/1890338816 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4414160340 con 0x7f44140d56a0 2024-04-28T13:07:58.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.353+0000 7f43fbfff640 1 -- 172.21.15.114:0/1890338816 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f440401a070 con 0x7f44140d56a0 2024-04-28T13:07:58.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.353+0000 7f43fbfff640 1 --2- 172.21.15.114:0/1890338816 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f440006c8f0 0x7f440006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:58.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.353+0000 7f43fbfff640 1 -- 172.21.15.114:0/1890338816 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f440408b690 con 0x7f44140d56a0 2024-04-28T13:07:58.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.353+0000 7f44137fe640 1 --2- 172.21.15.114:0/1890338816 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f440006c8f0 0x7f440006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:58.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.353+0000 7f44137fe640 1 --2- 172.21.15.114:0/1890338816 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f440006c8f0 0x7f440006edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4408005880 tx=0x7f4408009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:58.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.357+0000 7f43fbfff640 1 -- 172.21.15.114:0/1890338816 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4414160340 con 0x7f44140d56a0 2024-04-28T13:07:58.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.533+0000 7f441a050640 1 -- 172.21.15.114:0/1890338816 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f44140cae40 con 0x7f44140d56a0 2024-04-28T13:07:58.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.533+0000 7f43fbfff640 1 -- 172.21.15.114:0/1890338816 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f4404059470 con 0x7f44140d56a0 2024-04-28T13:07:58.534 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-28T13:07:58.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.535+0000 7f441a050640 1 -- 172.21.15.114:0/1890338816 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f440006c8f0 msgr2=0x7f440006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:58.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.535+0000 7f441a050640 1 --2- 172.21.15.114:0/1890338816 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f440006c8f0 0x7f440006edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4408005880 tx=0x7f4408009040 comp rx=0 tx=0).stop 2024-04-28T13:07:58.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.535+0000 7f441a050640 1 -- 172.21.15.114:0/1890338816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44140d56a0 msgr2=0x7f44141f4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:58.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.535+0000 7f441a050640 1 --2- 172.21.15.114:0/1890338816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44140d56a0 0x7f44141f4d00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f440400e9b0 tx=0x7f440400ee70 comp rx=0 tx=0).stop 2024-04-28T13:07:58.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.535+0000 7f441a050640 1 -- 172.21.15.114:0/1890338816 shutdown_connections 2024-04-28T13:07:58.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.535+0000 7f441a050640 1 --2- 172.21.15.114:0/1890338816 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f441415f430 0x7f44141f8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.535+0000 7f441a050640 1 --2- 172.21.15.114:0/1890338816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44140d56a0 0x7f44141f4d00 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.535+0000 7f441a050640 1 --2- 172.21.15.114:0/1890338816 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f440006c8f0 0x7f440006edb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.535+0000 7f441a050640 1 --2- 172.21.15.114:0/1890338816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44140baf40 0x7f4414154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.535+0000 7f441a050640 1 -- 172.21.15.114:0/1890338816 >> 172.21.15.114:0/1890338816 conn(0x7f44140633a0 msgr2=0x7f441415fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:58.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.535+0000 7f441a050640 1 -- 172.21.15.114:0/1890338816 shutdown_connections 2024-04-28T13:07:58.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.535+0000 7f441a050640 1 -- 172.21.15.114:0/1890338816 wait complete. 2024-04-28T13:07:58.547 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-28T13:07:58.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.645+0000 7fddccf51640 1 Processor -- start 2024-04-28T13:07:58.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.645+0000 7fddccf51640 1 -- start start 2024-04-28T13:07:58.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.646+0000 7fddccf51640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fddc80732b0 0x7fddc815ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:58.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.646+0000 7fddccf51640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddc80d02b0 con 0x7fddc80b4850 2024-04-28T13:07:58.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.646+0000 7fddccf51640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddc80cedc0 con 0x7fddc8072e30 2024-04-28T13:07:58.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.646+0000 7fddccf51640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fddc8073cc0 con 0x7fddc80732b0 2024-04-28T13:07:58.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.646+0000 7fddc6d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fddc80732b0 0x7fddc815ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:58.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.646+0000 7fddc659c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fddc80b4850 0x7fddc80b4c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50108/0 (socket says 172.21.15.114:50108) 2024-04-28T13:07:58.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.646+0000 7fddc659c640 1 -- 172.21.15.114:0/3162743932 learned_addr learned my addr 172.21.15.114:0/3162743932 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:58.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.647+0000 7fddc6d9d640 1 -- 172.21.15.114:0/3162743932 >> v1:172.21.15.134:6789/0 conn(0x7fddc8072e30 legacy=0x7fddc815c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:58.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.647+0000 7fddc6d9d640 1 -- 172.21.15.114:0/3162743932 >> v1:172.21.15.114:6789/0 conn(0x7fddc80b4850 legacy=0x7fddc80b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:58.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.647+0000 7fddc559a640 1 -- 172.21.15.114:0/3162743932 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1203687980 0 0) 0x7fddc80d02b0 con 0x7fddc80b4850 2024-04-28T13:07:58.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.647+0000 7fddc6d9d640 1 -- 172.21.15.114:0/3162743932 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddc8073fa0 con 0x7fddc80732b0 2024-04-28T13:07:58.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.647+0000 7fddc6d9d640 1 --2- 172.21.15.114:0/3162743932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddc80732b0 0x7fddc815ca80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fddc00097a0 tx=0x7fddc002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c4634c3d96eec6 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:58.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.648+0000 7fddc559a640 1 -- 172.21.15.114:0/3162743932 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc0037070 con 0x7fddc80732b0 2024-04-28T13:07:58.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.648+0000 7fddc559a640 1 -- 172.21.15.114:0/3162743932 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc0032440 con 0x7fddc80732b0 2024-04-28T13:07:58.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.648+0000 7fddc559a640 1 -- 172.21.15.114:0/3162743932 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc0032810 con 0x7fddc80732b0 2024-04-28T13:07:58.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.648+0000 7fddccf51640 1 -- 172.21.15.114:0/3162743932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddc80732b0 msgr2=0x7fddc815ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:58.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.648+0000 7fddccf51640 1 --2- 172.21.15.114:0/3162743932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddc80732b0 0x7fddc815ca80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fddc00097a0 tx=0x7fddc002a1a0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.648+0000 7fddccf51640 1 -- 172.21.15.114:0/3162743932 shutdown_connections 2024-04-28T13:07:58.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.648+0000 7fddccf51640 1 --2- 172.21.15.114:0/3162743932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddc80732b0 0x7fddc815ca80 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.648+0000 7fddccf51640 1 -- 172.21.15.114:0/3162743932 >> 172.21.15.114:0/3162743932 conn(0x7fddc806c980 msgr2=0x7fddc80b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:58.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.648+0000 7fddccf51640 1 -- 172.21.15.114:0/3162743932 shutdown_connections 2024-04-28T13:07:58.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.648+0000 7fddccf51640 1 -- 172.21.15.114:0/3162743932 wait complete. 2024-04-28T13:07:58.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.650+0000 7fddccf51640 1 Processor -- start 2024-04-28T13:07:58.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.650+0000 7fddccf51640 1 -- start start 2024-04-28T13:07:58.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.650+0000 7fddccf51640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddc8072e30 0x7fddc8148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:58.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.650+0000 7fddccf51640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fddc80732b0 0x7fddc815e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:58.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.650+0000 7fddccf51640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddc80b4850 0x7fddc815edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.650+0000 7fddccf51640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fddc80736e0 con 0x7fddc8072e30 2024-04-28T13:07:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.650+0000 7fddccf51640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fddc8074560 con 0x7fddc80b4850 2024-04-28T13:07:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.650+0000 7fddccf51640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fddc806e3e0 con 0x7fddc80732b0 2024-04-28T13:07:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.650+0000 7fddc659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddc8072e30 0x7fddc8148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.650+0000 7fddc659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddc8072e30 0x7fddc8148ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43620/0 (socket says 172.21.15.114:43620) 2024-04-28T13:07:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.650+0000 7fddc659c640 1 -- 172.21.15.114:0/1534170227 learned_addr learned my addr 172.21.15.114:0/1534170227 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.651+0000 7fddc5d9b640 1 --2- 172.21.15.114:0/1534170227 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fddc80732b0 0x7fddc815e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.651+0000 7fddc6d9d640 1 --2- 172.21.15.114:0/1534170227 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddc80b4850 0x7fddc815edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.651+0000 7fddc659c640 1 -- 172.21.15.114:0/1534170227 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fddc80732b0 msgr2=0x7fddc815e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.651+0000 7fddc659c640 1 --2- 172.21.15.114:0/1534170227 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fddc80732b0 0x7fddc815e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.651+0000 7fddc659c640 1 -- 172.21.15.114:0/1534170227 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddc80b4850 msgr2=0x7fddc815edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.651+0000 7fddc659c640 1 --2- 172.21.15.114:0/1534170227 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddc80b4850 0x7fddc815edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.651+0000 7fddc659c640 1 -- 172.21.15.114:0/1534170227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddc815d1b0 con 0x7fddc8072e30 2024-04-28T13:07:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.651+0000 7fddc659c640 1 --2- 172.21.15.114:0/1534170227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddc8072e30 0x7fddc8148ca0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fddb800c8f0 tx=0x7fddb800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.651+0000 7fddb6ffd640 1 -- 172.21.15.114:0/1534170227 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb8018070 con 0x7fddc8072e30 2024-04-28T13:07:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.651+0000 7fddb6ffd640 1 -- 172.21.15.114:0/1534170227 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddb800a640 con 0x7fddc8072e30 2024-04-28T13:07:58.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.651+0000 7fddb6ffd640 1 -- 172.21.15.114:0/1534170227 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb800aa30 con 0x7fddc8072e30 2024-04-28T13:07:58.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.651+0000 7fddccf51640 1 -- 172.21.15.114:0/1534170227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddc815d420 con 0x7fddc8072e30 2024-04-28T13:07:58.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.651+0000 7fddccf51640 1 -- 172.21.15.114:0/1534170227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddc815d9e0 con 0x7fddc8072e30 2024-04-28T13:07:58.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.652+0000 7fddccf51640 1 -- 172.21.15.114:0/1534170227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddc806a3d0 con 0x7fddc8072e30 2024-04-28T13:07:58.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.652+0000 7fddb6ffd640 1 -- 172.21.15.114:0/1534170227 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fddb801b070 con 0x7fddc8072e30 2024-04-28T13:07:58.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.653+0000 7fddb6ffd640 1 --2- 172.21.15.114:0/1534170227 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fdda806c8f0 0x7fdda806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:58.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.653+0000 7fddb6ffd640 1 -- 172.21.15.114:0/1534170227 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fddb808b1e0 con 0x7fddc8072e30 2024-04-28T13:07:58.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.653+0000 7fddc5d9b640 1 --2- 172.21.15.114:0/1534170227 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fdda806c8f0 0x7fdda806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:58.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.653+0000 7fddc5d9b640 1 --2- 172.21.15.114:0/1534170227 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fdda806c8f0 0x7fdda806edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fddc80cd240 tx=0x7fddbc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:58.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.657+0000 7fddb6ffd640 1 -- 172.21.15.114:0/1534170227 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fddb8059610 con 0x7fddc8072e30 2024-04-28T13:07:58.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.833+0000 7fddccf51640 1 -- 172.21.15.114:0/1534170227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fddc80cf3f0 con 0x7fddc8072e30 2024-04-28T13:07:58.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.833+0000 7fddb6ffd640 1 -- 172.21.15.114:0/1534170227 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7fddb8058f10 con 0x7fddc8072e30 2024-04-28T13:07:58.834 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-04-28T13:07:58.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.835+0000 7fddccf51640 1 -- 172.21.15.114:0/1534170227 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fdda806c8f0 msgr2=0x7fdda806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:58.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.835+0000 7fddccf51640 1 --2- 172.21.15.114:0/1534170227 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fdda806c8f0 0x7fdda806edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fddc80cd240 tx=0x7fddbc009040 comp rx=0 tx=0).stop 2024-04-28T13:07:58.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.835+0000 7fddccf51640 1 -- 172.21.15.114:0/1534170227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddc8072e30 msgr2=0x7fddc8148ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:58.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.835+0000 7fddccf51640 1 --2- 172.21.15.114:0/1534170227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddc8072e30 0x7fddc8148ca0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fddb800c8f0 tx=0x7fddb800cdb0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.835+0000 7fddccf51640 1 -- 172.21.15.114:0/1534170227 shutdown_connections 2024-04-28T13:07:58.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.835+0000 7fddccf51640 1 --2- 172.21.15.114:0/1534170227 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fdda806c8f0 0x7fdda806edb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.835+0000 7fddccf51640 1 --2- 172.21.15.114:0/1534170227 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddc80b4850 0x7fddc815edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.835+0000 7fddccf51640 1 --2- 172.21.15.114:0/1534170227 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fddc80732b0 0x7fddc815e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.835+0000 7fddccf51640 1 --2- 172.21.15.114:0/1534170227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddc8072e30 0x7fddc8148ca0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.835+0000 7fddccf51640 1 -- 172.21.15.114:0/1534170227 >> 172.21.15.114:0/1534170227 conn(0x7fddc806c980 msgr2=0x7fddc815b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:58.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.835+0000 7fddccf51640 1 -- 172.21.15.114:0/1534170227 shutdown_connections 2024-04-28T13:07:58.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.835+0000 7fddccf51640 1 -- 172.21.15.114:0/1534170227 wait complete. 2024-04-28T13:07:58.846 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-28T13:07:58.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.944+0000 7fbc1ac2a640 1 Processor -- start 2024-04-28T13:07:58.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.944+0000 7fbc1ac2a640 1 -- start start 2024-04-28T13:07:58.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.945+0000 7fbc1ac2a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbc1415f3d0 0x7fbc140b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:58.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.945+0000 7fbc1ac2a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc14162fb0 0x7fbc141633f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:58.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.945+0000 7fbc1ac2a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbc140cf280 0x7fbc140cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:58.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.945+0000 7fbc1ac2a640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fbc140b6940 con 0x7fbc140cf280 2024-04-28T13:07:58.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.945+0000 7fbc1ac2a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fbc140b4c40 con 0x7fbc1415f3d0 2024-04-28T13:07:58.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.945+0000 7fbc1ac2a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fbc14163930 con 0x7fbc14162fb0 2024-04-28T13:07:58.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.945+0000 7fbc191c7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbc140cf280 0x7fbc140cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:58.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.945+0000 7fbc191c7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbc140cf280 0x7fbc140cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43630/0 (socket says 172.21.15.114:43630) 2024-04-28T13:07:58.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.945+0000 7fbc191c7640 1 -- 172.21.15.114:0/3407763564 learned_addr learned my addr 172.21.15.114:0/3407763564 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:58.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.945+0000 7fbc13fff640 1 --2- 172.21.15.114:0/3407763564 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc14162fb0 0x7fbc141633f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:58.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.945+0000 7fbc189c6640 1 --2- 172.21.15.114:0/3407763564 >> v2:172.21.15.134:3300/0 conn(0x7fbc1415f3d0 0x7fbc140b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:58.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.946+0000 7fbc191c7640 1 -- 172.21.15.114:0/3407763564 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc14162fb0 msgr2=0x7fbc141633f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:58.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.946+0000 7fbc191c7640 1 --2- 172.21.15.114:0/3407763564 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc14162fb0 0x7fbc141633f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.946+0000 7fbc191c7640 1 -- 172.21.15.114:0/3407763564 >> v2:172.21.15.134:3300/0 conn(0x7fbc1415f3d0 msgr2=0x7fbc140b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:58.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.946+0000 7fbc191c7640 1 --2- 172.21.15.114:0/3407763564 >> v2:172.21.15.134:3300/0 conn(0x7fbc1415f3d0 0x7fbc140b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.946+0000 7fbc191c7640 1 -- 172.21.15.114:0/3407763564 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc140b6050 con 0x7fbc140cf280 2024-04-28T13:07:58.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.946+0000 7fbc191c7640 1 --2- 172.21.15.114:0/3407763564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc140cf280 0x7fbc140cf710 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbc140d22c0 tx=0x7fbc0c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d6a1dab2e07c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:58.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.946+0000 7fbc137fe640 1 -- 172.21.15.114:0/3407763564 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c036070 con 0x7fbc140cf280 2024-04-28T13:07:58.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.946+0000 7fbc137fe640 1 -- 172.21.15.114:0/3407763564 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc0c031600 con 0x7fbc140cf280 2024-04-28T13:07:58.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.946+0000 7fbc137fe640 1 -- 172.21.15.114:0/3407763564 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c0319d0 con 0x7fbc140cf280 2024-04-28T13:07:58.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.947+0000 7fbc1ac2a640 1 -- 172.21.15.114:0/3407763564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc140cf280 msgr2=0x7fbc140cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:58.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.947+0000 7fbc1ac2a640 1 --2- 172.21.15.114:0/3407763564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc140cf280 0x7fbc140cf710 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbc140d22c0 tx=0x7fbc0c02a6a0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.947+0000 7fbc1ac2a640 1 -- 172.21.15.114:0/3407763564 shutdown_connections 2024-04-28T13:07:58.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.947+0000 7fbc1ac2a640 1 --2- 172.21.15.114:0/3407763564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc140cf280 0x7fbc140cf710 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.947+0000 7fbc1ac2a640 1 --2- 172.21.15.114:0/3407763564 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc14162fb0 0x7fbc141633f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.947+0000 7fbc1ac2a640 1 --2- 172.21.15.114:0/3407763564 >> v2:172.21.15.134:3300/0 conn(0x7fbc1415f3d0 0x7fbc140b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.947+0000 7fbc1ac2a640 1 -- 172.21.15.114:0/3407763564 >> 172.21.15.114:0/3407763564 conn(0x7fbc140d16b0 msgr2=0x7fbc140d1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:58.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.947+0000 7fbc1ac2a640 1 -- 172.21.15.114:0/3407763564 shutdown_connections 2024-04-28T13:07:58.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.947+0000 7fbc1ac2a640 1 -- 172.21.15.114:0/3407763564 wait complete. 2024-04-28T13:07:58.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.948+0000 7fbc1ac2a640 1 Processor -- start 2024-04-28T13:07:58.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.948+0000 7fbc1ac2a640 1 -- start start 2024-04-28T13:07:58.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.949+0000 7fbc1ac2a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc140cf280 0x7fbc14162190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:58.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.949+0000 7fbc1ac2a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc1415f3d0 0x7fbc1415cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:58.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.949+0000 7fbc1ac2a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc14162fb0 0x7fbc1415d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:58.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.949+0000 7fbc1ac2a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbc140b65d0 con 0x7fbc140cf280 2024-04-28T13:07:58.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.949+0000 7fbc1ac2a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbc140b62f0 con 0x7fbc14162fb0 2024-04-28T13:07:58.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.949+0000 7fbc1ac2a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fbc1415f7b0 con 0x7fbc1415f3d0 2024-04-28T13:07:58.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.949+0000 7fbc189c6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc140cf280 0x7fbc14162190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:58.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.949+0000 7fbc189c6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc140cf280 0x7fbc14162190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43638/0 (socket says 172.21.15.114:43638) 2024-04-28T13:07:58.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.949+0000 7fbc189c6640 1 -- 172.21.15.114:0/348408238 learned_addr learned my addr 172.21.15.114:0/348408238 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:58.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.949+0000 7fbc191c7640 1 --2- 172.21.15.114:0/348408238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc14162fb0 0x7fbc1415d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:58.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.949+0000 7fbc189c6640 1 -- 172.21.15.114:0/348408238 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc1415f3d0 msgr2=0x7fbc1415cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:58.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.949+0000 7fbc189c6640 1 --2- 172.21.15.114:0/348408238 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc1415f3d0 0x7fbc1415cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.949+0000 7fbc189c6640 1 -- 172.21.15.114:0/348408238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc14162fb0 msgr2=0x7fbc1415d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:58.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.949+0000 7fbc189c6640 1 --2- 172.21.15.114:0/348408238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc14162fb0 0x7fbc1415d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:58.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.949+0000 7fbc189c6640 1 -- 172.21.15.114:0/348408238 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc140c73a0 con 0x7fbc140cf280 2024-04-28T13:07:58.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.949+0000 7fbc189c6640 1 --2- 172.21.15.114:0/348408238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc140cf280 0x7fbc14162190 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbc0400e890 tx=0x7fbc0400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:58.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.950+0000 7fbc117fa640 1 -- 172.21.15.114:0/348408238 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc04017070 con 0x7fbc140cf280 2024-04-28T13:07:58.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.950+0000 7fbc117fa640 1 -- 172.21.15.114:0/348408238 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc0400c940 con 0x7fbc140cf280 2024-04-28T13:07:58.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.950+0000 7fbc117fa640 1 -- 172.21.15.114:0/348408238 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0400cd10 con 0x7fbc140cf280 2024-04-28T13:07:58.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.950+0000 7fbc1ac2a640 1 -- 172.21.15.114:0/348408238 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc140c7680 con 0x7fbc140cf280 2024-04-28T13:07:58.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.950+0000 7fbc1ac2a640 1 -- 172.21.15.114:0/348408238 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc141f6430 con 0x7fbc140cf280 2024-04-28T13:07:58.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.951+0000 7fbc1ac2a640 1 -- 172.21.15.114:0/348408238 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc141f6240 con 0x7fbc140cf280 2024-04-28T13:07:58.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.951+0000 7fbc117fa640 1 -- 172.21.15.114:0/348408238 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbc0401a070 con 0x7fbc140cf280 2024-04-28T13:07:58.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.951+0000 7fbc117fa640 1 --2- 172.21.15.114:0/348408238 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbc0006c920 0x7fbc0006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:58.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.952+0000 7fbc117fa640 1 -- 172.21.15.114:0/348408238 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbc0408be20 con 0x7fbc140cf280 2024-04-28T13:07:58.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.952+0000 7fbc13fff640 1 --2- 172.21.15.114:0/348408238 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbc0006c920 0x7fbc0006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:58.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.952+0000 7fbc13fff640 1 --2- 172.21.15.114:0/348408238 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbc0006c920 0x7fbc0006ede0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbc08006a90 tx=0x7fbc08006a20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:58.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:58.956+0000 7fbc117fa640 1 -- 172.21.15.114:0/348408238 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbc0405a2e0 con 0x7fbc140cf280 2024-04-28T13:07:59.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.128+0000 7fbc1ac2a640 1 -- 172.21.15.114:0/348408238 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbc1406a3d0 con 0x7fbc140cf280 2024-04-28T13:07:59.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.129+0000 7fbc117fa640 1 -- 172.21.15.114:0/348408238 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7fbc04059be0 con 0x7fbc140cf280 2024-04-28T13:07:59.130 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-04-28T13:07:59.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.131+0000 7fbc1ac2a640 1 -- 172.21.15.114:0/348408238 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbc0006c920 msgr2=0x7fbc0006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:59.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.131+0000 7fbc1ac2a640 1 --2- 172.21.15.114:0/348408238 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbc0006c920 0x7fbc0006ede0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbc08006a90 tx=0x7fbc08006a20 comp rx=0 tx=0).stop 2024-04-28T13:07:59.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.131+0000 7fbc1ac2a640 1 -- 172.21.15.114:0/348408238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc140cf280 msgr2=0x7fbc14162190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:59.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.131+0000 7fbc1ac2a640 1 --2- 172.21.15.114:0/348408238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc140cf280 0x7fbc14162190 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbc0400e890 tx=0x7fbc0400ed50 comp rx=0 tx=0).stop 2024-04-28T13:07:59.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.131+0000 7fbc1ac2a640 1 -- 172.21.15.114:0/348408238 shutdown_connections 2024-04-28T13:07:59.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.131+0000 7fbc1ac2a640 1 --2- 172.21.15.114:0/348408238 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbc0006c920 0x7fbc0006ede0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:59.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.131+0000 7fbc1ac2a640 1 --2- 172.21.15.114:0/348408238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc14162fb0 0x7fbc1415d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:59.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.131+0000 7fbc1ac2a640 1 --2- 172.21.15.114:0/348408238 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc1415f3d0 0x7fbc1415cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:59.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.131+0000 7fbc1ac2a640 1 --2- 172.21.15.114:0/348408238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc140cf280 0x7fbc14162190 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:59.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.131+0000 7fbc1ac2a640 1 -- 172.21.15.114:0/348408238 >> 172.21.15.114:0/348408238 conn(0x7fbc140d16b0 msgr2=0x7fbc140728b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:59.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.131+0000 7fbc1ac2a640 1 -- 172.21.15.114:0/348408238 shutdown_connections 2024-04-28T13:07:59.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.131+0000 7fbc1ac2a640 1 -- 172.21.15.114:0/348408238 wait complete. 2024-04-28T13:07:59.143 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-28T13:07:59.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.239+0000 7f8e4ce2a640 1 Processor -- start 2024-04-28T13:07:59.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.239+0000 7f8e4ce2a640 1 -- start start 2024-04-28T13:07:59.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.240+0000 7f8e4ce2a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8e4815d010 0x7f8e480d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:59.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.240+0000 7f8e4ce2a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8e480d12c0 0x7f8e4815fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:59.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.240+0000 7f8e4ce2a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e48072d10 con 0x7f8e481603c0 2024-04-28T13:07:59.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.240+0000 7f8e4ce2a640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f8e48072ac0 con 0x7f8e4815d010 2024-04-28T13:07:59.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.240+0000 7f8e4ce2a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f8e48072ff0 con 0x7f8e480d12c0 2024-04-28T13:07:59.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.240+0000 7f8e4659c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8e4815d010 0x7f8e480d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:59.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.240+0000 7f8e4659c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8e4815d010 0x7f8e480d0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43654/0 (socket says 172.21.15.114:43654) 2024-04-28T13:07:59.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.240+0000 7f8e4659c640 1 -- 172.21.15.114:0/155124415 learned_addr learned my addr 172.21.15.114:0/155124415 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:59.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.241+0000 7f8e45d9b640 1 --2- 172.21.15.114:0/155124415 >> v2:172.21.15.134:3300/0 conn(0x7f8e480d12c0 0x7f8e4815fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:59.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.241+0000 7f8e4659c640 1 -- 172.21.15.114:0/155124415 >> v2:172.21.15.134:3300/0 conn(0x7f8e480d12c0 msgr2=0x7f8e4815fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:59.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.241+0000 7f8e4659c640 1 --2- 172.21.15.114:0/155124415 >> v2:172.21.15.134:3300/0 conn(0x7f8e480d12c0 0x7f8e4815fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:59.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.241+0000 7f8e4659c640 1 -- 172.21.15.114:0/155124415 >> v1:172.21.15.134:6789/0 conn(0x7f8e481603c0 legacy=0x7f8e4806f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:59.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.241+0000 7f8e4659c640 1 -- 172.21.15.114:0/155124415 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e480732d0 con 0x7f8e4815d010 2024-04-28T13:07:59.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.241+0000 7f8e45d9b640 1 --2- 172.21.15.114:0/155124415 >> v2:172.21.15.134:3300/0 conn(0x7f8e480d12c0 0x7f8e4815fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:59.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.241+0000 7f8e4659c640 1 --2- 172.21.15.114:0/155124415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e4815d010 0x7f8e480d0d80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8e480cd770 tx=0x7f8e4002c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51509dd7c2148272 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:59.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.242+0000 7f8e4559a640 1 -- 172.21.15.114:0/155124415 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4000b2d0 con 0x7f8e4815d010 2024-04-28T13:07:59.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.242+0000 7f8e4559a640 1 -- 172.21.15.114:0/155124415 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e4000b470 con 0x7f8e4815d010 2024-04-28T13:07:59.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.242+0000 7f8e4559a640 1 -- 172.21.15.114:0/155124415 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e40009820 con 0x7f8e4815d010 2024-04-28T13:07:59.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.242+0000 7f8e4ce2a640 1 -- 172.21.15.114:0/155124415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e4815d010 msgr2=0x7f8e480d0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:59.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.242+0000 7f8e4ce2a640 1 --2- 172.21.15.114:0/155124415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e4815d010 0x7f8e480d0d80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8e480cd770 tx=0x7f8e4002c8b0 comp rx=0 tx=0).stop 2024-04-28T13:07:59.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.242+0000 7f8e4ce2a640 1 -- 172.21.15.114:0/155124415 shutdown_connections 2024-04-28T13:07:59.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.242+0000 7f8e4ce2a640 1 --2- 172.21.15.114:0/155124415 >> v2:172.21.15.134:3300/0 conn(0x7f8e480d12c0 0x7f8e4815fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:59.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.242+0000 7f8e4ce2a640 1 --2- 172.21.15.114:0/155124415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e4815d010 0x7f8e480d0d80 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:59.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.242+0000 7f8e4ce2a640 1 -- 172.21.15.114:0/155124415 >> 172.21.15.114:0/155124415 conn(0x7f8e480cd8b0 msgr2=0x7f8e480cdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:59.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.242+0000 7f8e4ce2a640 1 -- 172.21.15.114:0/155124415 shutdown_connections 2024-04-28T13:07:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.242+0000 7f8e4ce2a640 1 -- 172.21.15.114:0/155124415 wait complete. 2024-04-28T13:07:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.243+0000 7f8e4ce2a640 1 Processor -- start 2024-04-28T13:07:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.244+0000 7f8e4ce2a640 1 -- start start 2024-04-28T13:07:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.244+0000 7f8e4ce2a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e480d12c0 0x7f8e48146b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.244+0000 7f8e4ce2a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e4815d010 0x7f8e48153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.244+0000 7f8e4ce2a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e481603c0 0x7f8e481542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.244+0000 7f8e4ce2a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8e48073ad0 con 0x7f8e4815d010 2024-04-28T13:07:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.244+0000 7f8e4ce2a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8e480d0640 con 0x7f8e481603c0 2024-04-28T13:07:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.244+0000 7f8e4ce2a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f8e48160810 con 0x7f8e480d12c0 2024-04-28T13:07:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.244+0000 7f8e45d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e4815d010 0x7f8e48153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.244+0000 7f8e45d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e4815d010 0x7f8e48153db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43670/0 (socket says 172.21.15.114:43670) 2024-04-28T13:07:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.244+0000 7f8e45d9b640 1 -- 172.21.15.114:0/43675149 learned_addr learned my addr 172.21.15.114:0/43675149 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.244+0000 7f8e4659c640 1 --2- 172.21.15.114:0/43675149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e480d12c0 0x7f8e48146b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.244+0000 7f8e46d9d640 1 --2- 172.21.15.114:0/43675149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e481603c0 0x7f8e481542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:59.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.245+0000 7f8e45d9b640 1 -- 172.21.15.114:0/43675149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e480d12c0 msgr2=0x7f8e48146b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:59.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.245+0000 7f8e45d9b640 1 --2- 172.21.15.114:0/43675149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e480d12c0 0x7f8e48146b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:59.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.245+0000 7f8e45d9b640 1 -- 172.21.15.114:0/43675149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e481603c0 msgr2=0x7f8e481542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:59.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.245+0000 7f8e45d9b640 1 --2- 172.21.15.114:0/43675149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e481603c0 0x7f8e481542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:59.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.245+0000 7f8e45d9b640 1 -- 172.21.15.114:0/43675149 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e4814bdc0 con 0x7f8e4815d010 2024-04-28T13:07:59.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.245+0000 7f8e4659c640 1 --2- 172.21.15.114:0/43675149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e480d12c0 0x7f8e48146b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:59.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.245+0000 7f8e46d9d640 1 --2- 172.21.15.114:0/43675149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e481603c0 0x7f8e481542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:07:59.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.245+0000 7f8e45d9b640 1 --2- 172.21.15.114:0/43675149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e4815d010 0x7f8e48153db0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000e760 tx=0x7f8e3000ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:59.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.245+0000 7f8e3effd640 1 -- 172.21.15.114:0/43675149 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e3000f040 con 0x7f8e4815d010 2024-04-28T13:07:59.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.245+0000 7f8e3effd640 1 -- 172.21.15.114:0/43675149 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e30004230 con 0x7f8e4815d010 2024-04-28T13:07:59.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.245+0000 7f8e4ce2a640 1 -- 172.21.15.114:0/43675149 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e48147060 con 0x7f8e4815d010 2024-04-28T13:07:59.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.245+0000 7f8e3effd640 1 -- 172.21.15.114:0/43675149 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e3000ee70 con 0x7f8e4815d010 2024-04-28T13:07:59.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.245+0000 7f8e4ce2a640 1 -- 172.21.15.114:0/43675149 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e480b4c80 con 0x7f8e4815d010 2024-04-28T13:07:59.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.246+0000 7f8e4ce2a640 1 -- 172.21.15.114:0/43675149 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e4806a3d0 con 0x7f8e4815d010 2024-04-28T13:07:59.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.246+0000 7f8e3effd640 1 -- 172.21.15.114:0/43675149 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8e3000c6d0 con 0x7f8e4815d010 2024-04-28T13:07:59.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.247+0000 7f8e3effd640 1 --2- 172.21.15.114:0/43675149 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f8e2806c920 0x7f8e2806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:59.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.247+0000 7f8e3effd640 1 -- 172.21.15.114:0/43675149 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8e3008b880 con 0x7f8e4815d010 2024-04-28T13:07:59.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.247+0000 7f8e4659c640 1 --2- 172.21.15.114:0/43675149 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f8e2806c920 0x7f8e2806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:59.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.247+0000 7f8e4659c640 1 --2- 172.21.15.114:0/43675149 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f8e2806c920 0x7f8e2806ede0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8e40036000 tx=0x7f8e4000b000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:59.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.251+0000 7f8e3effd640 1 -- 172.21.15.114:0/43675149 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8e30017020 con 0x7f8e4815d010 2024-04-28T13:07:59.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.439+0000 7f8e4ce2a640 1 -- 172.21.15.114:0/43675149 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8e480d0f90 con 0x7f8e4815d010 2024-04-28T13:07:59.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.439+0000 7f8e3effd640 1 -- 172.21.15.114:0/43675149 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f8e30059cb0 con 0x7f8e4815d010 2024-04-28T13:07:59.440 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-04-28T13:07:59.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.441+0000 7f8e4ce2a640 1 -- 172.21.15.114:0/43675149 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f8e2806c920 msgr2=0x7f8e2806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:59.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.441+0000 7f8e4ce2a640 1 --2- 172.21.15.114:0/43675149 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f8e2806c920 0x7f8e2806ede0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8e40036000 tx=0x7f8e4000b000 comp rx=0 tx=0).stop 2024-04-28T13:07:59.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.441+0000 7f8e4ce2a640 1 -- 172.21.15.114:0/43675149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e4815d010 msgr2=0x7f8e48153db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:59.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.441+0000 7f8e4ce2a640 1 --2- 172.21.15.114:0/43675149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e4815d010 0x7f8e48153db0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000e760 tx=0x7f8e3000ec20 comp rx=0 tx=0).stop 2024-04-28T13:07:59.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.441+0000 7f8e4ce2a640 1 -- 172.21.15.114:0/43675149 shutdown_connections 2024-04-28T13:07:59.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.441+0000 7f8e4ce2a640 1 --2- 172.21.15.114:0/43675149 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f8e2806c920 0x7f8e2806ede0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:59.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.441+0000 7f8e4ce2a640 1 --2- 172.21.15.114:0/43675149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e481603c0 0x7f8e481542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:59.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.441+0000 7f8e4ce2a640 1 --2- 172.21.15.114:0/43675149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e4815d010 0x7f8e48153db0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:59.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.441+0000 7f8e4ce2a640 1 --2- 172.21.15.114:0/43675149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e480d12c0 0x7f8e48146b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:59.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.441+0000 7f8e4ce2a640 1 -- 172.21.15.114:0/43675149 >> 172.21.15.114:0/43675149 conn(0x7f8e480cd8b0 msgr2=0x7f8e480cfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:59.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.441+0000 7f8e4ce2a640 1 -- 172.21.15.114:0/43675149 shutdown_connections 2024-04-28T13:07:59.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.441+0000 7f8e4ce2a640 1 -- 172.21.15.114:0/43675149 wait complete. 2024-04-28T13:07:59.453 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-28T13:07:59.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:59.453 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-04-28T13:07:59.477 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-04-28T13:07:59.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:07:59.477 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-28T13:07:59.539 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:07:59.539 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-28T13:07:59.557 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:07:59.558 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-28T13:07:59.616 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:07:59.616 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-28T13:07:59.673 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:07:59.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.770+0000 7f29b992b640 1 Processor -- start 2024-04-28T13:07:59.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.770+0000 7f29b992b640 1 -- start start 2024-04-28T13:07:59.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.770+0000 7f29b992b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f29b415f3f0 0x7f29b40d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:59.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.770+0000 7f29b992b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f29b40d4ca0 0x7f29b40b6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:59.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.770+0000 7f29b992b640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29b40b82a0 con 0x7f29b40b71d0 2024-04-28T13:07:59.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.770+0000 7f29b992b640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f29b40b7640 con 0x7f29b40d4ca0 2024-04-28T13:07:59.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.770+0000 7f29b992b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f29b415f7d0 con 0x7f29b415f3f0 2024-04-28T13:07:59.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.771+0000 7f29b27fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f29b40d4ca0 0x7f29b40b6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:59.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.771+0000 7f29b37fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f29b40b71d0 0x7f29b40b3c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50124/0 (socket says 172.21.15.114:50124) 2024-04-28T13:07:59.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.771+0000 7f29b37fe640 1 -- 172.21.15.114:0/424096948 learned_addr learned my addr 172.21.15.114:0/424096948 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:07:59.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.771+0000 7f29b27fc640 1 -- 172.21.15.114:0/424096948 >> v2:172.21.15.134:3300/0 conn(0x7f29b415f3f0 msgr2=0x7f29b40d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:07:59.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.771+0000 7f29b27fc640 1 --2- 172.21.15.114:0/424096948 >> v2:172.21.15.134:3300/0 conn(0x7f29b415f3f0 0x7f29b40d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:59.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.771+0000 7f29b27fc640 1 -- 172.21.15.114:0/424096948 >> v1:172.21.15.114:6789/0 conn(0x7f29b40b71d0 legacy=0x7f29b40b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:59.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.771+0000 7f29b27fc640 1 -- 172.21.15.114:0/424096948 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b40d4a00 con 0x7f29b40d4ca0 2024-04-28T13:07:59.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.771+0000 7f29b1ffb640 1 -- 172.21.15.114:0/424096948 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3220533303 0 0) 0x7f29b40b82a0 con 0x7f29b40b71d0 2024-04-28T13:07:59.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.772+0000 7f29b27fc640 1 --2- 172.21.15.114:0/424096948 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29b40d4ca0 0x7f29b40b6c90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f29b40d2d90 tx=0x7f29a802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45eb972244716425 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:59.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.772+0000 7f29b1ffb640 1 -- 172.21.15.114:0/424096948 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8037070 con 0x7f29b40d4ca0 2024-04-28T13:07:59.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.772+0000 7f29b1ffb640 1 -- 172.21.15.114:0/424096948 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29a8032440 con 0x7f29b40d4ca0 2024-04-28T13:07:59.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.772+0000 7f29b1ffb640 1 -- 172.21.15.114:0/424096948 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8032810 con 0x7f29b40d4ca0 2024-04-28T13:07:59.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.772+0000 7f29b992b640 1 -- 172.21.15.114:0/424096948 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29b40d4ca0 msgr2=0x7f29b40b6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:59.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.772+0000 7f29b992b640 1 --2- 172.21.15.114:0/424096948 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29b40d4ca0 0x7f29b40b6c90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f29b40d2d90 tx=0x7f29a802a1a0 comp rx=0 tx=0).stop 2024-04-28T13:07:59.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.772+0000 7f29b992b640 1 -- 172.21.15.114:0/424096948 shutdown_connections 2024-04-28T13:07:59.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.772+0000 7f29b992b640 1 --2- 172.21.15.114:0/424096948 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29b40d4ca0 0x7f29b40b6c90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:59.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.772+0000 7f29b992b640 1 --2- 172.21.15.114:0/424096948 >> v2:172.21.15.134:3300/0 conn(0x7f29b415f3f0 0x7f29b40d32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:59.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.772+0000 7f29b992b640 1 -- 172.21.15.114:0/424096948 >> 172.21.15.114:0/424096948 conn(0x7f29b40633a0 msgr2=0x7f29b40d1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:59.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.772+0000 7f29b992b640 1 -- 172.21.15.114:0/424096948 shutdown_connections 2024-04-28T13:07:59.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.772+0000 7f29b992b640 1 -- 172.21.15.114:0/424096948 wait complete. 2024-04-28T13:07:59.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.773+0000 7f29b992b640 1 Processor -- start 2024-04-28T13:07:59.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.774+0000 7f29b992b640 1 -- start start 2024-04-28T13:07:59.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.774+0000 7f29b992b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29b40b71d0 0x7f29b41505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:59.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.774+0000 7f29b992b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f29b40d4ca0 0x7f29b40cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:59.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.774+0000 7f29b992b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29b415f3f0 0x7f29b4160b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:59.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.774+0000 7f29b992b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f29b40d3e40 con 0x7f29b40b71d0 2024-04-28T13:07:59.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.774+0000 7f29b992b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f29b40d3b60 con 0x7f29b415f3f0 2024-04-28T13:07:59.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.774+0000 7f29b992b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f29b40d4120 con 0x7f29b40d4ca0 2024-04-28T13:07:59.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.774+0000 7f29b2ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29b40b71d0 0x7f29b41505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:59.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.774+0000 7f29b2ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29b40b71d0 0x7f29b41505d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43686/0 (socket says 172.21.15.114:43686) 2024-04-28T13:07:59.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.774+0000 7f29b2ffd640 1 -- 172.21.15.114:0/601005375 learned_addr learned my addr 172.21.15.114:0/601005375 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:07:59.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.775+0000 7f29b37fe640 1 --2- 172.21.15.114:0/601005375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29b415f3f0 0x7f29b4160b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:59.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.775+0000 7f29b27fc640 1 --2- 172.21.15.114:0/601005375 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f29b40d4ca0 0x7f29b40cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:59.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.775+0000 7f29b2ffd640 1 -- 172.21.15.114:0/601005375 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f29b40d4ca0 msgr2=0x7f29b40cc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:59.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.775+0000 7f29b2ffd640 1 --2- 172.21.15.114:0/601005375 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f29b40d4ca0 0x7f29b40cc2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:59.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.775+0000 7f29b2ffd640 1 -- 172.21.15.114:0/601005375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29b415f3f0 msgr2=0x7f29b4160b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:59.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.775+0000 7f29b2ffd640 1 --2- 172.21.15.114:0/601005375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29b415f3f0 0x7f29b4160b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:59.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.775+0000 7f29b2ffd640 1 -- 172.21.15.114:0/601005375 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b40ccbc0 con 0x7f29b40b71d0 2024-04-28T13:07:59.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.775+0000 7f29b2ffd640 1 --2- 172.21.15.114:0/601005375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29b40b71d0 0x7f29b41505d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f29a400b410 tx=0x7f29a400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:59.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.775+0000 7f299bfff640 1 -- 172.21.15.114:0/601005375 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a4015020 con 0x7f29b40b71d0 2024-04-28T13:07:59.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.775+0000 7f299bfff640 1 -- 172.21.15.114:0/601005375 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29a4011850 con 0x7f29b40b71d0 2024-04-28T13:07:59.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.775+0000 7f299bfff640 1 -- 172.21.15.114:0/601005375 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a4011c40 con 0x7f29b40b71d0 2024-04-28T13:07:59.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.775+0000 7f29b992b640 1 -- 172.21.15.114:0/601005375 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b40ccea0 con 0x7f29b40b71d0 2024-04-28T13:07:59.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.775+0000 7f29b992b640 1 -- 172.21.15.114:0/601005375 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b40cd460 con 0x7f29b40b71d0 2024-04-28T13:07:59.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.776+0000 7f29b992b640 1 -- 172.21.15.114:0/601005375 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29b406a3d0 con 0x7f29b40b71d0 2024-04-28T13:07:59.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.776+0000 7f299bfff640 1 -- 172.21.15.114:0/601005375 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f29a4018020 con 0x7f29b40b71d0 2024-04-28T13:07:59.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.777+0000 7f299bfff640 1 --2- 172.21.15.114:0/601005375 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f29a006c8f0 0x7f29a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:07:59.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.777+0000 7f299bfff640 1 -- 172.21.15.114:0/601005375 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f29a408bac0 con 0x7f29b40b71d0 2024-04-28T13:07:59.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.777+0000 7f29b27fc640 1 --2- 172.21.15.114:0/601005375 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f29a006c8f0 0x7f29a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:07:59.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.777+0000 7f29b27fc640 1 --2- 172.21.15.114:0/601005375 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f29a006c8f0 0x7f29a006edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f29a8034000 tx=0x7f29a802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:07:59.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.781+0000 7f299bfff640 1 -- 172.21.15.114:0/601005375 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f29a401f020 con 0x7f29b40b71d0 2024-04-28T13:07:59.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.956+0000 7f29b992b640 1 -- 172.21.15.114:0/601005375 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29b4069690 con 0x7f29b40b71d0 2024-04-28T13:07:59.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.957+0000 7f299bfff640 1 -- 172.21.15.114:0/601005375 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7f29a40172c0 con 0x7f29b40b71d0 2024-04-28T13:07:59.958 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:07:59.958 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:07:27.292537+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-28T13:07:23.706359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-28T13:07:24.596188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:07:59.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.959+0000 7f29b992b640 1 -- 172.21.15.114:0/601005375 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f29a006c8f0 msgr2=0x7f29a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:59.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.959+0000 7f29b992b640 1 --2- 172.21.15.114:0/601005375 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f29a006c8f0 0x7f29a006edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f29a8034000 tx=0x7f29a802e000 comp rx=0 tx=0).stop 2024-04-28T13:07:59.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.959+0000 7f29b992b640 1 -- 172.21.15.114:0/601005375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29b40b71d0 msgr2=0x7f29b41505d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:07:59.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.959+0000 7f29b992b640 1 --2- 172.21.15.114:0/601005375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29b40b71d0 0x7f29b41505d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f29a400b410 tx=0x7f29a400b8d0 comp rx=0 tx=0).stop 2024-04-28T13:07:59.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.959+0000 7f29b992b640 1 -- 172.21.15.114:0/601005375 shutdown_connections 2024-04-28T13:07:59.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.959+0000 7f29b992b640 1 --2- 172.21.15.114:0/601005375 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f29a006c8f0 0x7f29a006edb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:59.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.959+0000 7f29b992b640 1 --2- 172.21.15.114:0/601005375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29b415f3f0 0x7f29b4160b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:59.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.959+0000 7f29b992b640 1 --2- 172.21.15.114:0/601005375 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f29b40d4ca0 0x7f29b40cc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:59.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.959+0000 7f29b992b640 1 --2- 172.21.15.114:0/601005375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29b40b71d0 0x7f29b41505d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:07:59.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.959+0000 7f29b992b640 1 -- 172.21.15.114:0/601005375 >> 172.21.15.114:0/601005375 conn(0x7f29b40633a0 msgr2=0x7f29b40b92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:07:59.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.959+0000 7f29b992b640 1 -- 172.21.15.114:0/601005375 shutdown_connections 2024-04-28T13:07:59.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:07:59.959+0000 7f29b992b640 1 -- 172.21.15.114:0/601005375 wait complete. 2024-04-28T13:07:59.971 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-28T13:07:14.721860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-28T13:07:23.706359+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-28T13:07:24.596188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-28T13:07:59.971 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-28T13:08:00.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.070+0000 7faf5931b640 1 Processor -- start 2024-04-28T13:08:00.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.070+0000 7faf5931b640 1 -- start start 2024-04-28T13:08:00.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.071+0000 7faf5931b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf540baf40 0x7faf540d5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:00.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.071+0000 7faf5931b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7faf540d56a0 0x7faf540d3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:00.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.071+0000 7faf5931b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf540d2a40 con 0x7faf5415f430 2024-04-28T13:08:00.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.071+0000 7faf5931b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7faf5415f810 con 0x7faf540d56a0 2024-04-28T13:08:00.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.071+0000 7faf5931b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7faf540d36d0 con 0x7faf540baf40 2024-04-28T13:08:00.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.071+0000 7faf537fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7faf540d56a0 0x7faf540d3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:00.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.071+0000 7faf527fc640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf540baf40 0x7faf540d5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:00.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.071+0000 7faf52ffd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7faf5415f430 0x7faf540d1a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:57360/0 (socket says 172.21.15.114:57360) 2024-04-28T13:08:00.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.071+0000 7faf52ffd640 1 -- 172.21.15.114:0/837782978 learned_addr learned my addr 172.21.15.114:0/837782978 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:00.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.071+0000 7faf527fc640 1 -- 172.21.15.114:0/837782978 >> v2:172.21.15.134:3300/0 conn(0x7faf540d56a0 msgr2=0x7faf540d3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:00.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.071+0000 7faf527fc640 1 --2- 172.21.15.114:0/837782978 >> v2:172.21.15.134:3300/0 conn(0x7faf540d56a0 0x7faf540d3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.071+0000 7faf527fc640 1 -- 172.21.15.114:0/837782978 >> v1:172.21.15.134:6789/0 conn(0x7faf5415f430 legacy=0x7faf540d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:00.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.071+0000 7faf527fc640 1 -- 172.21.15.114:0/837782978 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf540d2480 con 0x7faf540baf40 2024-04-28T13:08:00.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.071+0000 7faf537fe640 1 --2- 172.21.15.114:0/837782978 >> v2:172.21.15.134:3300/0 conn(0x7faf540d56a0 0x7faf540d3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:08:00.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.072+0000 7faf527fc640 1 --2- 172.21.15.114:0/837782978 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf540baf40 0x7faf540d5160 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faf480097a0 tx=0x7faf4802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6bd47370e2b79b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:00.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.072+0000 7faf51ffb640 1 -- 172.21.15.114:0/837782978 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf48037070 con 0x7faf540baf40 2024-04-28T13:08:00.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.072+0000 7faf51ffb640 1 -- 172.21.15.114:0/837782978 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf48032440 con 0x7faf540baf40 2024-04-28T13:08:00.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.072+0000 7faf51ffb640 1 -- 172.21.15.114:0/837782978 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf48032810 con 0x7faf540baf40 2024-04-28T13:08:00.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.073+0000 7faf5931b640 1 -- 172.21.15.114:0/837782978 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf540baf40 msgr2=0x7faf540d5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:00.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.073+0000 7faf5931b640 1 --2- 172.21.15.114:0/837782978 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf540baf40 0x7faf540d5160 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faf480097a0 tx=0x7faf4802a180 comp rx=0 tx=0).stop 2024-04-28T13:08:00.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.073+0000 7faf5931b640 1 -- 172.21.15.114:0/837782978 shutdown_connections 2024-04-28T13:08:00.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.073+0000 7faf5931b640 1 --2- 172.21.15.114:0/837782978 >> v2:172.21.15.134:3300/0 conn(0x7faf540d56a0 0x7faf540d3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.073+0000 7faf5931b640 1 --2- 172.21.15.114:0/837782978 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf540baf40 0x7faf540d5160 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.073+0000 7faf5931b640 1 -- 172.21.15.114:0/837782978 >> 172.21.15.114:0/837782978 conn(0x7faf540633a0 msgr2=0x7faf5406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:00.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.073+0000 7faf5931b640 1 -- 172.21.15.114:0/837782978 shutdown_connections 2024-04-28T13:08:00.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.073+0000 7faf5931b640 1 -- 172.21.15.114:0/837782978 wait complete. 2024-04-28T13:08:00.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.074+0000 7faf5931b640 1 Processor -- start 2024-04-28T13:08:00.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.074+0000 7faf5931b640 1 -- start start 2024-04-28T13:08:00.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.075+0000 7faf5931b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf540baf40 0x7faf540cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:00.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.075+0000 7faf5931b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf540d56a0 0x7faf540cec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:00.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.075+0000 7faf5931b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf5415f430 0x7faf541511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:00.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.075+0000 7faf5931b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7faf540d2190 con 0x7faf5415f430 2024-04-28T13:08:00.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.075+0000 7faf5931b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faf540d3360 con 0x7faf540d56a0 2024-04-28T13:08:00.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.075+0000 7faf5931b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7faf540d40a0 con 0x7faf540baf40 2024-04-28T13:08:00.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.075+0000 7faf537fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf5415f430 0x7faf541511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:00.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.075+0000 7faf537fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf5415f430 0x7faf541511e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43696/0 (socket says 172.21.15.114:43696) 2024-04-28T13:08:00.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.075+0000 7faf537fe640 1 -- 172.21.15.114:0/1448404008 learned_addr learned my addr 172.21.15.114:0/1448404008 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:00.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.075+0000 7faf52ffd640 1 --2- 172.21.15.114:0/1448404008 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf540baf40 0x7faf540cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:00.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.075+0000 7faf527fc640 1 --2- 172.21.15.114:0/1448404008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf540d56a0 0x7faf540cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:00.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.075+0000 7faf537fe640 1 -- 172.21.15.114:0/1448404008 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf540baf40 msgr2=0x7faf540cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:00.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.075+0000 7faf537fe640 1 --2- 172.21.15.114:0/1448404008 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf540baf40 0x7faf540cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.075+0000 7faf537fe640 1 -- 172.21.15.114:0/1448404008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf540d56a0 msgr2=0x7faf540cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:00.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.075+0000 7faf537fe640 1 --2- 172.21.15.114:0/1448404008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf540d56a0 0x7faf540cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.075+0000 7faf537fe640 1 -- 172.21.15.114:0/1448404008 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf540cd090 con 0x7faf5415f430 2024-04-28T13:08:00.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.075+0000 7faf52ffd640 1 --2- 172.21.15.114:0/1448404008 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf540baf40 0x7faf540cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:00.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.076+0000 7faf537fe640 1 --2- 172.21.15.114:0/1448404008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf5415f430 0x7faf541511e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009f00 tx=0x7faf4c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:00.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.076+0000 7faf3b7fe640 1 -- 172.21.15.114:0/1448404008 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4c018030 con 0x7faf5415f430 2024-04-28T13:08:00.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.076+0000 7faf3b7fe640 1 -- 172.21.15.114:0/1448404008 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf4c00ce50 con 0x7faf5415f430 2024-04-28T13:08:00.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.076+0000 7faf5931b640 1 -- 172.21.15.114:0/1448404008 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf5415c720 con 0x7faf5415f430 2024-04-28T13:08:00.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.076+0000 7faf3b7fe640 1 -- 172.21.15.114:0/1448404008 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4c003bb0 con 0x7faf5415f430 2024-04-28T13:08:00.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.076+0000 7faf5931b640 1 -- 172.21.15.114:0/1448404008 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf5415cce0 con 0x7faf5415f430 2024-04-28T13:08:00.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.077+0000 7faf5931b640 1 -- 172.21.15.114:0/1448404008 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf54075c40 con 0x7faf5415f430 2024-04-28T13:08:00.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.077+0000 7faf3b7fe640 1 -- 172.21.15.114:0/1448404008 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faf4c01b070 con 0x7faf5415f430 2024-04-28T13:08:00.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.077+0000 7faf3b7fe640 1 --2- 172.21.15.114:0/1448404008 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7faf4006c8f0 0x7faf4006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:00.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.078+0000 7faf3b7fe640 1 -- 172.21.15.114:0/1448404008 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7faf4c08c5d0 con 0x7faf5415f430 2024-04-28T13:08:00.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.078+0000 7faf52ffd640 1 --2- 172.21.15.114:0/1448404008 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7faf4006c8f0 0x7faf4006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:00.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.078+0000 7faf52ffd640 1 --2- 172.21.15.114:0/1448404008 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7faf4006c8f0 0x7faf4006edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faf44000f60 tx=0x7faf44009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:00.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.082+0000 7faf3b7fe640 1 -- 172.21.15.114:0/1448404008 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7faf4c010040 con 0x7faf5415f430 2024-04-28T13:08:00.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.257+0000 7faf5931b640 1 -- 172.21.15.114:0/1448404008 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7faf541627b0 con 0x7faf5415f430 2024-04-28T13:08:00.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.257+0000 7faf3b7fe640 1 -- 172.21.15.114:0/1448404008 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7faf4c05aa10 con 0x7faf5415f430 2024-04-28T13:08:00.258 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-28T13:08:00.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.259+0000 7faf5931b640 1 -- 172.21.15.114:0/1448404008 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7faf4006c8f0 msgr2=0x7faf4006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:00.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.259+0000 7faf5931b640 1 --2- 172.21.15.114:0/1448404008 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7faf4006c8f0 0x7faf4006edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faf44000f60 tx=0x7faf44009040 comp rx=0 tx=0).stop 2024-04-28T13:08:00.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.259+0000 7faf5931b640 1 -- 172.21.15.114:0/1448404008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf5415f430 msgr2=0x7faf541511e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:00.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.259+0000 7faf5931b640 1 --2- 172.21.15.114:0/1448404008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf5415f430 0x7faf541511e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009f00 tx=0x7faf4c00c490 comp rx=0 tx=0).stop 2024-04-28T13:08:00.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.259+0000 7faf5931b640 1 -- 172.21.15.114:0/1448404008 shutdown_connections 2024-04-28T13:08:00.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.259+0000 7faf5931b640 1 --2- 172.21.15.114:0/1448404008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf5415f430 0x7faf541511e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.259+0000 7faf5931b640 1 --2- 172.21.15.114:0/1448404008 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7faf4006c8f0 0x7faf4006edb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.259+0000 7faf5931b640 1 --2- 172.21.15.114:0/1448404008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf540d56a0 0x7faf540cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.259+0000 7faf5931b640 1 --2- 172.21.15.114:0/1448404008 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf540baf40 0x7faf540cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.259+0000 7faf5931b640 1 -- 172.21.15.114:0/1448404008 >> 172.21.15.114:0/1448404008 conn(0x7faf540633a0 msgr2=0x7faf54160040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:00.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.259+0000 7faf5931b640 1 -- 172.21.15.114:0/1448404008 shutdown_connections 2024-04-28T13:08:00.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.259+0000 7faf5931b640 1 -- 172.21.15.114:0/1448404008 wait complete. 2024-04-28T13:08:00.271 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-28T13:08:00.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.370+0000 7f114a862640 1 Processor -- start 2024-04-28T13:08:00.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.370+0000 7f114a862640 1 -- start start 2024-04-28T13:08:00.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.371+0000 7f114a862640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1144159600 0x7f114406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:00.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.371+0000 7f114a862640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f11440cd8b0 0x7f11440cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:00.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.371+0000 7f114a862640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f114415bef0 0x7f114415c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:00.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.371+0000 7f114a862640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f114415cdb0 con 0x7f11440cd8b0 2024-04-28T13:08:00.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.371+0000 7f114a862640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f114415cad0 con 0x7f1144159600 2024-04-28T13:08:00.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.371+0000 7f114a862640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f114406e480 con 0x7f114415bef0 2024-04-28T13:08:00.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.371+0000 7f11437fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f11440cd8b0 0x7f11440cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:00.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.371+0000 7f11437fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f11440cd8b0 0x7f11440cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43708/0 (socket says 172.21.15.114:43708) 2024-04-28T13:08:00.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.371+0000 7f11437fe640 1 -- 172.21.15.114:0/1807263807 learned_addr learned my addr 172.21.15.114:0/1807263807 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:00.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.371+0000 7f1143fff640 1 --2- 172.21.15.114:0/1807263807 >> v2:172.21.15.134:3300/0 conn(0x7f1144159600 0x7f114406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:00.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.371+0000 7f1148dff640 1 --2- 172.21.15.114:0/1807263807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f114415bef0 0x7f114415c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:00.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.371+0000 7f11437fe640 1 -- 172.21.15.114:0/1807263807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f114415bef0 msgr2=0x7f114415c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:00.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.371+0000 7f11437fe640 1 --2- 172.21.15.114:0/1807263807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f114415bef0 0x7f114415c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.371+0000 7f11437fe640 1 -- 172.21.15.114:0/1807263807 >> v2:172.21.15.134:3300/0 conn(0x7f1144159600 msgr2=0x7f114406ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:00.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.371+0000 7f11437fe640 1 --2- 172.21.15.114:0/1807263807 >> v2:172.21.15.134:3300/0 conn(0x7f1144159600 0x7f114406ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.371+0000 7f11437fe640 1 -- 172.21.15.114:0/1807263807 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f114406e760 con 0x7f11440cd8b0 2024-04-28T13:08:00.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.372+0000 7f11437fe640 1 --2- 172.21.15.114:0/1807263807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11440cd8b0 0x7f11440cdd40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1144070650 tx=0x7f113802a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7289278b4ae38e8e server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:00.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.372+0000 7f1142ffd640 1 -- 172.21.15.114:0/1807263807 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113800b040 con 0x7f11440cd8b0 2024-04-28T13:08:00.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.372+0000 7f1142ffd640 1 -- 172.21.15.114:0/1807263807 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f113802f710 con 0x7f11440cd8b0 2024-04-28T13:08:00.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.372+0000 7f1142ffd640 1 -- 172.21.15.114:0/1807263807 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113802fae0 con 0x7f11440cd8b0 2024-04-28T13:08:00.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.373+0000 7f114a862640 1 -- 172.21.15.114:0/1807263807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11440cd8b0 msgr2=0x7f11440cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:00.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.373+0000 7f114a862640 1 --2- 172.21.15.114:0/1807263807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11440cd8b0 0x7f11440cdd40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1144070650 tx=0x7f113802a480 comp rx=0 tx=0).stop 2024-04-28T13:08:00.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.373+0000 7f114a862640 1 -- 172.21.15.114:0/1807263807 shutdown_connections 2024-04-28T13:08:00.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.373+0000 7f114a862640 1 --2- 172.21.15.114:0/1807263807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f114415bef0 0x7f114415c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.373+0000 7f114a862640 1 --2- 172.21.15.114:0/1807263807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11440cd8b0 0x7f11440cdd40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.373+0000 7f114a862640 1 --2- 172.21.15.114:0/1807263807 >> v2:172.21.15.134:3300/0 conn(0x7f1144159600 0x7f114406ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.373+0000 7f114a862640 1 -- 172.21.15.114:0/1807263807 >> 172.21.15.114:0/1807263807 conn(0x7f114406c980 msgr2=0x7f11440b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:00.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.373+0000 7f114a862640 1 -- 172.21.15.114:0/1807263807 shutdown_connections 2024-04-28T13:08:00.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.373+0000 7f114a862640 1 -- 172.21.15.114:0/1807263807 wait complete. 2024-04-28T13:08:00.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.374+0000 7f114a862640 1 Processor -- start 2024-04-28T13:08:00.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.374+0000 7f114a862640 1 -- start start 2024-04-28T13:08:00.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.375+0000 7f114a862640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11440cd8b0 0x7f114415f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:00.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.375+0000 7f114a862640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1144159600 0x7f11440afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:00.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.375+0000 7f114a862640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f114415bef0 0x7f11440ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:00.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.375+0000 7f114a862640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f11440b32e0 con 0x7f11440cd8b0 2024-04-28T13:08:00.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.375+0000 7f114a862640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f11440b6310 con 0x7f1144159600 2024-04-28T13:08:00.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.375+0000 7f114a862640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f11440b3460 con 0x7f114415bef0 2024-04-28T13:08:00.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.375+0000 7f1143fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11440cd8b0 0x7f114415f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:00.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.375+0000 7f1143fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11440cd8b0 0x7f114415f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43714/0 (socket says 172.21.15.114:43714) 2024-04-28T13:08:00.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.375+0000 7f1143fff640 1 -- 172.21.15.114:0/2961829737 learned_addr learned my addr 172.21.15.114:0/2961829737 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:00.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.375+0000 7f1148dff640 1 --2- 172.21.15.114:0/2961829737 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f114415bef0 0x7f11440ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:00.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.375+0000 7f11437fe640 1 --2- 172.21.15.114:0/2961829737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1144159600 0x7f11440afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:00.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.375+0000 7f1143fff640 1 -- 172.21.15.114:0/2961829737 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f114415bef0 msgr2=0x7f11440ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:00.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.375+0000 7f1143fff640 1 --2- 172.21.15.114:0/2961829737 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f114415bef0 0x7f11440ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.375+0000 7f1143fff640 1 -- 172.21.15.114:0/2961829737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1144159600 msgr2=0x7f11440afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:00.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.375+0000 7f1143fff640 1 --2- 172.21.15.114:0/2961829737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1144159600 0x7f11440afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.375+0000 7f1143fff640 1 -- 172.21.15.114:0/2961829737 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f114415e5a0 con 0x7f11440cd8b0 2024-04-28T13:08:00.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.375+0000 7f1148dff640 1 --2- 172.21.15.114:0/2961829737 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f114415bef0 0x7f11440ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:00.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.375+0000 7f11437fe640 1 --2- 172.21.15.114:0/2961829737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1144159600 0x7f11440afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:00.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.376+0000 7f1143fff640 1 --2- 172.21.15.114:0/2961829737 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11440cd8b0 0x7f114415f640 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f113400fd80 tx=0x7f113400b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:00.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.376+0000 7f1140ff9640 1 -- 172.21.15.114:0/2961829737 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1134011650 con 0x7f11440cd8b0 2024-04-28T13:08:00.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.376+0000 7f1140ff9640 1 -- 172.21.15.114:0/2961829737 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f113400de50 con 0x7f11440cd8b0 2024-04-28T13:08:00.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.376+0000 7f114a862640 1 -- 172.21.15.114:0/2961829737 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f114415e880 con 0x7f11440cd8b0 2024-04-28T13:08:00.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.376+0000 7f1140ff9640 1 -- 172.21.15.114:0/2961829737 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1134011a10 con 0x7f11440cd8b0 2024-04-28T13:08:00.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.376+0000 7f114a862640 1 -- 172.21.15.114:0/2961829737 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f114415ee40 con 0x7f11440cd8b0 2024-04-28T13:08:00.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.377+0000 7f114a862640 1 -- 172.21.15.114:0/2961829737 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f114406a3d0 con 0x7f11440cd8b0 2024-04-28T13:08:00.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.377+0000 7f1140ff9640 1 -- 172.21.15.114:0/2961829737 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1134011bb0 con 0x7f11440cd8b0 2024-04-28T13:08:00.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.377+0000 7f1140ff9640 1 --2- 172.21.15.114:0/2961829737 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f113006c8f0 0x7f113006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:00.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.378+0000 7f1140ff9640 1 -- 172.21.15.114:0/2961829737 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f113408e740 con 0x7f11440cd8b0 2024-04-28T13:08:00.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.378+0000 7f11437fe640 1 --2- 172.21.15.114:0/2961829737 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f113006c8f0 0x7f113006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:00.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.378+0000 7f11437fe640 1 --2- 172.21.15.114:0/2961829737 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f113006c8f0 0x7f113006edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1138034000 tx=0x7f113800c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:00.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.382+0000 7f1140ff9640 1 -- 172.21.15.114:0/2961829737 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f113405cae0 con 0x7f11440cd8b0 2024-04-28T13:08:00.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.556+0000 7f114a862640 1 -- 172.21.15.114:0/2961829737 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f11440aab50 con 0x7f11440cd8b0 2024-04-28T13:08:00.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.557+0000 7f1140ff9640 1 -- 172.21.15.114:0/2961829737 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f113405c3e0 con 0x7f11440cd8b0 2024-04-28T13:08:00.557 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-04-28T13:08:00.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.558+0000 7f114a862640 1 -- 172.21.15.114:0/2961829737 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f113006c8f0 msgr2=0x7f113006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:00.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.558+0000 7f114a862640 1 --2- 172.21.15.114:0/2961829737 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f113006c8f0 0x7f113006edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1138034000 tx=0x7f113800c040 comp rx=0 tx=0).stop 2024-04-28T13:08:00.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.558+0000 7f114a862640 1 -- 172.21.15.114:0/2961829737 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11440cd8b0 msgr2=0x7f114415f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:00.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.558+0000 7f114a862640 1 --2- 172.21.15.114:0/2961829737 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11440cd8b0 0x7f114415f640 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f113400fd80 tx=0x7f113400b6a0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.559+0000 7f114a862640 1 -- 172.21.15.114:0/2961829737 shutdown_connections 2024-04-28T13:08:00.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.559+0000 7f114a862640 1 --2- 172.21.15.114:0/2961829737 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f114415bef0 0x7f11440ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.559+0000 7f114a862640 1 --2- 172.21.15.114:0/2961829737 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f113006c8f0 0x7f113006edb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.559+0000 7f114a862640 1 --2- 172.21.15.114:0/2961829737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1144159600 0x7f11440afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.559+0000 7f114a862640 1 --2- 172.21.15.114:0/2961829737 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11440cd8b0 0x7f114415f640 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.559+0000 7f114a862640 1 -- 172.21.15.114:0/2961829737 >> 172.21.15.114:0/2961829737 conn(0x7f114406c980 msgr2=0x7f11440b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:00.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.559+0000 7f114a862640 1 -- 172.21.15.114:0/2961829737 shutdown_connections 2024-04-28T13:08:00.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.559+0000 7f114a862640 1 -- 172.21.15.114:0/2961829737 wait complete. 2024-04-28T13:08:00.570 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-28T13:08:00.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.669+0000 7f96d62bd640 1 Processor -- start 2024-04-28T13:08:00.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.669+0000 7f96d62bd640 1 -- start start 2024-04-28T13:08:00.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.670+0000 7f96d62bd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f96d00b6cb0 0x7f96d006dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:00.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.670+0000 7f96d62bd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96d00d0270 0x7f96d00b82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:00.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.670+0000 7f96d62bd640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96d00d0710 con 0x7f96d015f4d0 2024-04-28T13:08:00.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.670+0000 7f96d62bd640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f96d00d3e80 con 0x7f96d00b6cb0 2024-04-28T13:08:00.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.670+0000 7f96d62bd640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f96d00d3550 con 0x7f96d00d0270 2024-04-28T13:08:00.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.670+0000 7f96cffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f96d00b6cb0 0x7f96d006dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:00.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.670+0000 7f96cf7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96d00d0270 0x7f96d00b82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:00.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.670+0000 7f96cf7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96d00d0270 0x7f96d00b82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:34404/0 (socket says 172.21.15.114:34404) 2024-04-28T13:08:00.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.670+0000 7f96d485a640 1 --1- 172.21.15.114:0/1959058064 >> v1:172.21.15.134:6789/0 conn(0x7f96d015f4d0 0x7f96d00b7090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:58704/0 (socket says 172.21.15.114:58704) 2024-04-28T13:08:00.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.670+0000 7f96cf7fe640 1 -- 172.21.15.114:0/1959058064 learned_addr learned my addr 172.21.15.114:0/1959058064 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:00.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.671+0000 7f96cf7fe640 1 -- 172.21.15.114:0/1959058064 >> v2:172.21.15.134:3300/0 conn(0x7f96d00b6cb0 msgr2=0x7f96d006dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:00.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.671+0000 7f96cf7fe640 1 --2- 172.21.15.114:0/1959058064 >> v2:172.21.15.134:3300/0 conn(0x7f96d00b6cb0 0x7f96d006dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.671+0000 7f96cf7fe640 1 -- 172.21.15.114:0/1959058064 >> v1:172.21.15.134:6789/0 conn(0x7f96d015f4d0 legacy=0x7f96d00b7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:00.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.671+0000 7f96cf7fe640 1 -- 172.21.15.114:0/1959058064 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d00d3830 con 0x7f96d00d0270 2024-04-28T13:08:00.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.671+0000 7f96cffff640 1 --2- 172.21.15.114:0/1959058064 >> v2:172.21.15.134:3300/0 conn(0x7f96d00b6cb0 0x7f96d006dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:08:00.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.671+0000 7f96cf7fe640 1 --2- 172.21.15.114:0/1959058064 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96d00d0270 0x7f96d00b82a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f96c4009870 tx=0x7f96c402a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21529a9a66fe23fe server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:00.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.671+0000 7f96ceffd640 1 -- 172.21.15.114:0/1959058064 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c4037070 con 0x7f96d00d0270 2024-04-28T13:08:00.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.671+0000 7f96ceffd640 1 -- 172.21.15.114:0/1959058064 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96c402ae50 con 0x7f96d00d0270 2024-04-28T13:08:00.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.671+0000 7f96ceffd640 1 -- 172.21.15.114:0/1959058064 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c4032860 con 0x7f96d00d0270 2024-04-28T13:08:00.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.672+0000 7f96d62bd640 1 -- 172.21.15.114:0/1959058064 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96d00d0270 msgr2=0x7f96d00b82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:00.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.672+0000 7f96d62bd640 1 --2- 172.21.15.114:0/1959058064 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96d00d0270 0x7f96d00b82a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f96c4009870 tx=0x7f96c402a300 comp rx=0 tx=0).stop 2024-04-28T13:08:00.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.672+0000 7f96d62bd640 1 -- 172.21.15.114:0/1959058064 shutdown_connections 2024-04-28T13:08:00.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.672+0000 7f96d62bd640 1 --2- 172.21.15.114:0/1959058064 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96d00d0270 0x7f96d00b82a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.672+0000 7f96d62bd640 1 --2- 172.21.15.114:0/1959058064 >> v2:172.21.15.134:3300/0 conn(0x7f96d00b6cb0 0x7f96d006dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.672+0000 7f96d62bd640 1 -- 172.21.15.114:0/1959058064 >> 172.21.15.114:0/1959058064 conn(0x7f96d00633a0 msgr2=0x7f96d00d1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:00.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.672+0000 7f96d62bd640 1 -- 172.21.15.114:0/1959058064 shutdown_connections 2024-04-28T13:08:00.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.672+0000 7f96d62bd640 1 -- 172.21.15.114:0/1959058064 wait complete. 2024-04-28T13:08:00.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.673+0000 7f96d62bd640 1 Processor -- start 2024-04-28T13:08:00.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.673+0000 7f96d62bd640 1 -- start start 2024-04-28T13:08:00.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.674+0000 7f96d62bd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96d00b6cb0 0x7f96d00ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:00.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.674+0000 7f96d62bd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96d00d0270 0x7f96d015bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:00.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.674+0000 7f96d62bd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96d015f4d0 0x7f96d0156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:00.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.674+0000 7f96d62bd640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f96d00d4310 con 0x7f96d00d0270 2024-04-28T13:08:00.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.674+0000 7f96d62bd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f96d00b48e0 con 0x7f96d00b6cb0 2024-04-28T13:08:00.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.674+0000 7f96d62bd640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f96d00d4490 con 0x7f96d015f4d0 2024-04-28T13:08:00.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.674+0000 7f96cf7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96d00d0270 0x7f96d015bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:00.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.674+0000 7f96cf7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96d00d0270 0x7f96d015bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36270/0 (socket says 172.21.15.114:36270) 2024-04-28T13:08:00.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.674+0000 7f96cf7fe640 1 -- 172.21.15.114:0/2392009232 learned_addr learned my addr 172.21.15.114:0/2392009232 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:00.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.674+0000 7f96d485a640 1 --2- 172.21.15.114:0/2392009232 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96d015f4d0 0x7f96d0156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:00.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.674+0000 7f96cffff640 1 --2- 172.21.15.114:0/2392009232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96d00b6cb0 0x7f96d00ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:00.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.674+0000 7f96cf7fe640 1 -- 172.21.15.114:0/2392009232 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96d015f4d0 msgr2=0x7f96d0156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:00.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.674+0000 7f96cf7fe640 1 --2- 172.21.15.114:0/2392009232 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96d015f4d0 0x7f96d0156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.674+0000 7f96cf7fe640 1 -- 172.21.15.114:0/2392009232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96d00b6cb0 msgr2=0x7f96d00ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:00.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.674+0000 7f96cf7fe640 1 --2- 172.21.15.114:0/2392009232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96d00b6cb0 0x7f96d00ca6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.674+0000 7f96cf7fe640 1 -- 172.21.15.114:0/2392009232 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d00ce110 con 0x7f96d00d0270 2024-04-28T13:08:00.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.674+0000 7f96cffff640 1 --2- 172.21.15.114:0/2392009232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96d00b6cb0 0x7f96d00ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:00.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.675+0000 7f96cf7fe640 1 --2- 172.21.15.114:0/2392009232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96d00d0270 0x7f96d015bf00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f96c4000c00 tx=0x7f96c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:00.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.675+0000 7f96ccff9640 1 -- 172.21.15.114:0/2392009232 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c4041070 con 0x7f96d00d0270 2024-04-28T13:08:00.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.675+0000 7f96ccff9640 1 -- 172.21.15.114:0/2392009232 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96c403c660 con 0x7f96d00d0270 2024-04-28T13:08:00.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.675+0000 7f96ccff9640 1 -- 172.21.15.114:0/2392009232 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c4037040 con 0x7f96d00d0270 2024-04-28T13:08:00.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.675+0000 7f96d62bd640 1 -- 172.21.15.114:0/2392009232 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96d00ce3f0 con 0x7f96d00d0270 2024-04-28T13:08:00.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.675+0000 7f96d62bd640 1 -- 172.21.15.114:0/2392009232 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96d00ce9b0 con 0x7f96d00d0270 2024-04-28T13:08:00.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.676+0000 7f96d62bd640 1 -- 172.21.15.114:0/2392009232 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96d00b45f0 con 0x7f96d00d0270 2024-04-28T13:08:00.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.676+0000 7f96ccff9640 1 -- 172.21.15.114:0/2392009232 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f96c4044070 con 0x7f96d00d0270 2024-04-28T13:08:00.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.677+0000 7f96ccff9640 1 --2- 172.21.15.114:0/2392009232 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f96bc06c8f0 0x7f96bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:00.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.677+0000 7f96ccff9640 1 -- 172.21.15.114:0/2392009232 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f96c40ac250 con 0x7f96d00d0270 2024-04-28T13:08:00.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.677+0000 7f96cffff640 1 --2- 172.21.15.114:0/2392009232 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f96bc06c8f0 0x7f96bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:00.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.677+0000 7f96cffff640 1 --2- 172.21.15.114:0/2392009232 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f96bc06c8f0 0x7f96bc06edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f96c0009ac0 tx=0x7f96c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:00.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.681+0000 7f96ccff9640 1 -- 172.21.15.114:0/2392009232 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f96d00b45f0 con 0x7f96d00d0270 2024-04-28T13:08:00.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.856+0000 7f96d62bd640 1 -- 172.21.15.114:0/2392009232 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f96d006a3d0 con 0x7f96d00d0270 2024-04-28T13:08:00.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.856+0000 7f96ccff9640 1 -- 172.21.15.114:0/2392009232 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f96c407a710 con 0x7f96d00d0270 2024-04-28T13:08:00.857 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-04-28T13:08:00.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.858+0000 7f96d62bd640 1 -- 172.21.15.114:0/2392009232 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f96bc06c8f0 msgr2=0x7f96bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:00.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.858+0000 7f96d62bd640 1 --2- 172.21.15.114:0/2392009232 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f96bc06c8f0 0x7f96bc06edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f96c0009ac0 tx=0x7f96c0008040 comp rx=0 tx=0).stop 2024-04-28T13:08:00.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.858+0000 7f96d62bd640 1 -- 172.21.15.114:0/2392009232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96d00d0270 msgr2=0x7f96d015bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:00.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.858+0000 7f96d62bd640 1 --2- 172.21.15.114:0/2392009232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96d00d0270 0x7f96d015bf00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f96c4000c00 tx=0x7f96c40046c0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.858+0000 7f96d62bd640 1 -- 172.21.15.114:0/2392009232 shutdown_connections 2024-04-28T13:08:00.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.858+0000 7f96d62bd640 1 --2- 172.21.15.114:0/2392009232 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96d015f4d0 0x7f96d0156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.858+0000 7f96d62bd640 1 --2- 172.21.15.114:0/2392009232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96d00d0270 0x7f96d015bf00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.858+0000 7f96d62bd640 1 --2- 172.21.15.114:0/2392009232 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f96bc06c8f0 0x7f96bc06edb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.858+0000 7f96d62bd640 1 --2- 172.21.15.114:0/2392009232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96d00b6cb0 0x7f96d00ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.858+0000 7f96d62bd640 1 -- 172.21.15.114:0/2392009232 >> 172.21.15.114:0/2392009232 conn(0x7f96d00633a0 msgr2=0x7f96d00b54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:00.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.859+0000 7f96d62bd640 1 -- 172.21.15.114:0/2392009232 shutdown_connections 2024-04-28T13:08:00.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.859+0000 7f96d62bd640 1 -- 172.21.15.114:0/2392009232 wait complete. 2024-04-28T13:08:00.871 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-28T13:08:00.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.967+0000 7ff432e37640 1 Processor -- start 2024-04-28T13:08:00.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.968+0000 7ff432e37640 1 -- start start 2024-04-28T13:08:00.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.968+0000 7ff432e37640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff42c15e390 0x7ff42c0d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:00.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.968+0000 7ff432e37640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff42c0d12c0 0x7ff42c145f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:00.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.968+0000 7ff432e37640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff42c160c60 con 0x7ff42c15ac50 2024-04-28T13:08:00.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.968+0000 7ff432e37640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7ff42c0d1710 con 0x7ff42c0d12c0 2024-04-28T13:08:00.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.968+0000 7ff432e37640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff42c160f40 con 0x7ff42c15e390 2024-04-28T13:08:00.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.968+0000 7ff4313d4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff42c0d12c0 0x7ff42c145f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:00.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.968+0000 7ff430bd3640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff42c15ac50 0x7ff42c0b3e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46752/0 (socket says 172.21.15.114:46752) 2024-04-28T13:08:00.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.968+0000 7ff430bd3640 1 -- 172.21.15.114:0/3368849907 learned_addr learned my addr 172.21.15.114:0/3368849907 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:00.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.969+0000 7ff42bfff640 1 --2- 172.21.15.114:0/3368849907 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff42c15e390 0x7ff42c0d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:00.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.969+0000 7ff4313d4640 1 -- 172.21.15.114:0/3368849907 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff42c15e390 msgr2=0x7ff42c0d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:00.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.969+0000 7ff4313d4640 1 --2- 172.21.15.114:0/3368849907 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff42c15e390 0x7ff42c0d0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.969+0000 7ff4313d4640 1 -- 172.21.15.114:0/3368849907 >> v1:172.21.15.114:6789/0 conn(0x7ff42c15ac50 legacy=0x7ff42c0b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:00.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.969+0000 7ff42b7fe640 1 -- 172.21.15.114:0/3368849907 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 41754084 0 0) 0x7ff42c160c60 con 0x7ff42c15ac50 2024-04-28T13:08:00.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.969+0000 7ff4313d4640 1 -- 172.21.15.114:0/3368849907 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff42c161220 con 0x7ff42c0d12c0 2024-04-28T13:08:00.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.969+0000 7ff42bfff640 1 --2- 172.21.15.114:0/3368849907 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff42c15e390 0x7ff42c0d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:00.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.969+0000 7ff4313d4640 1 --2- 172.21.15.114:0/3368849907 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff42c0d12c0 0x7ff42c145f80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff424009d90 tx=0x7ff42402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2030cb824672caf server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:00.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.970+0000 7ff42b7fe640 1 -- 172.21.15.114:0/3368849907 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff424007740 con 0x7ff42c0d12c0 2024-04-28T13:08:00.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.970+0000 7ff42b7fe640 1 -- 172.21.15.114:0/3368849907 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4240078e0 con 0x7ff42c0d12c0 2024-04-28T13:08:00.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.970+0000 7ff42b7fe640 1 -- 172.21.15.114:0/3368849907 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff424007cb0 con 0x7ff42c0d12c0 2024-04-28T13:08:00.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.970+0000 7ff432e37640 1 -- 172.21.15.114:0/3368849907 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff42c0d12c0 msgr2=0x7ff42c145f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:00.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.970+0000 7ff432e37640 1 --2- 172.21.15.114:0/3368849907 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff42c0d12c0 0x7ff42c145f80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff424009d90 tx=0x7ff42402a660 comp rx=0 tx=0).stop 2024-04-28T13:08:00.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.970+0000 7ff432e37640 1 -- 172.21.15.114:0/3368849907 shutdown_connections 2024-04-28T13:08:00.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.970+0000 7ff432e37640 1 --2- 172.21.15.114:0/3368849907 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff42c0d12c0 0x7ff42c145f80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.970+0000 7ff432e37640 1 --2- 172.21.15.114:0/3368849907 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff42c15e390 0x7ff42c0d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.970+0000 7ff432e37640 1 -- 172.21.15.114:0/3368849907 >> 172.21.15.114:0/3368849907 conn(0x7ff42c0cd8b0 msgr2=0x7ff42c0cdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:00.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.970+0000 7ff432e37640 1 -- 172.21.15.114:0/3368849907 shutdown_connections 2024-04-28T13:08:00.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.970+0000 7ff432e37640 1 -- 172.21.15.114:0/3368849907 wait complete. 2024-04-28T13:08:00.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.971+0000 7ff432e37640 1 Processor -- start 2024-04-28T13:08:00.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.971+0000 7ff432e37640 1 -- start start 2024-04-28T13:08:00.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.972+0000 7ff432e37640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff42c0d12c0 0x7ff42c139570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:00.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.972+0000 7ff432e37640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff42c15ac50 0x7ff42c0ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:00.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.972+0000 7ff432e37640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff42c15e390 0x7ff42c0cf560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:00.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.972+0000 7ff432e37640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff42c15b030 con 0x7ff42c15ac50 2024-04-28T13:08:00.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.972+0000 7ff432e37640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff42c1617e0 con 0x7ff42c15e390 2024-04-28T13:08:00.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.972+0000 7ff432e37640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff42c1464c0 con 0x7ff42c0d12c0 2024-04-28T13:08:00.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.972+0000 7ff42bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff42c15ac50 0x7ff42c0ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:00.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.972+0000 7ff42bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff42c15ac50 0x7ff42c0ae850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36284/0 (socket says 172.21.15.114:36284) 2024-04-28T13:08:00.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.972+0000 7ff42bfff640 1 -- 172.21.15.114:0/249549344 learned_addr learned my addr 172.21.15.114:0/249549344 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:00.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.972+0000 7ff430bd3640 1 --2- 172.21.15.114:0/249549344 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff42c0d12c0 0x7ff42c139570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:00.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.972+0000 7ff4313d4640 1 --2- 172.21.15.114:0/249549344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff42c15e390 0x7ff42c0cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:00.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.973+0000 7ff42bfff640 1 -- 172.21.15.114:0/249549344 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff42c0d12c0 msgr2=0x7ff42c139570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:00.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.973+0000 7ff42bfff640 1 --2- 172.21.15.114:0/249549344 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff42c0d12c0 0x7ff42c139570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.973+0000 7ff42bfff640 1 -- 172.21.15.114:0/249549344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff42c15e390 msgr2=0x7ff42c0cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:00.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.973+0000 7ff42bfff640 1 --2- 172.21.15.114:0/249549344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff42c15e390 0x7ff42c0cf560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:00.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.973+0000 7ff42bfff640 1 -- 172.21.15.114:0/249549344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff42c0af1a0 con 0x7ff42c15ac50 2024-04-28T13:08:00.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.973+0000 7ff4313d4640 1 --2- 172.21.15.114:0/249549344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff42c15e390 0x7ff42c0cf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:00.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.973+0000 7ff42bfff640 1 --2- 172.21.15.114:0/249549344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff42c15ac50 0x7ff42c0ae850 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff41800c7f0 tx=0x7ff41800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:00.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.973+0000 7ff4297fa640 1 -- 172.21.15.114:0/249549344 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff418015070 con 0x7ff42c15ac50 2024-04-28T13:08:00.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.973+0000 7ff4297fa640 1 -- 172.21.15.114:0/249549344 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff418007820 con 0x7ff42c15ac50 2024-04-28T13:08:00.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.973+0000 7ff432e37640 1 -- 172.21.15.114:0/249549344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff42c0af480 con 0x7ff42c15ac50 2024-04-28T13:08:00.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.973+0000 7ff4297fa640 1 -- 172.21.15.114:0/249549344 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff418007bd0 con 0x7ff42c15ac50 2024-04-28T13:08:00.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.973+0000 7ff432e37640 1 -- 172.21.15.114:0/249549344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff42c0afa40 con 0x7ff42c15ac50 2024-04-28T13:08:00.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.974+0000 7ff432e37640 1 -- 172.21.15.114:0/249549344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff42c06a3d0 con 0x7ff42c15ac50 2024-04-28T13:08:00.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.974+0000 7ff4297fa640 1 -- 172.21.15.114:0/249549344 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff418018070 con 0x7ff42c15ac50 2024-04-28T13:08:00.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.975+0000 7ff4297fa640 1 --2- 172.21.15.114:0/249549344 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff41006c8f0 0x7ff41006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:00.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.975+0000 7ff4297fa640 1 -- 172.21.15.114:0/249549344 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff41808b950 con 0x7ff42c15ac50 2024-04-28T13:08:00.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.975+0000 7ff430bd3640 1 --2- 172.21.15.114:0/249549344 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff41006c8f0 0x7ff41006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:00.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.975+0000 7ff430bd3640 1 --2- 172.21.15.114:0/249549344 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff41006c8f0 0x7ff41006edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff420000f60 tx=0x7ff420007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:00.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:00.979+0000 7ff4297fa640 1 -- 172.21.15.114:0/249549344 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff4180597c0 con 0x7ff42c15ac50 2024-04-28T13:08:01.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.166+0000 7ff432e37640 1 -- 172.21.15.114:0/249549344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff42c0b08b0 con 0x7ff42c15ac50 2024-04-28T13:08:01.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.167+0000 7ff4297fa640 1 -- 172.21.15.114:0/249549344 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7ff41805dac0 con 0x7ff42c15ac50 2024-04-28T13:08:01.167 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-04-28T13:08:01.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.169+0000 7ff432e37640 1 -- 172.21.15.114:0/249549344 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff41006c8f0 msgr2=0x7ff41006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:01.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.169+0000 7ff432e37640 1 --2- 172.21.15.114:0/249549344 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff41006c8f0 0x7ff41006edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff420000f60 tx=0x7ff420007d50 comp rx=0 tx=0).stop 2024-04-28T13:08:01.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.169+0000 7ff432e37640 1 -- 172.21.15.114:0/249549344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff42c15ac50 msgr2=0x7ff42c0ae850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:01.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.169+0000 7ff432e37640 1 --2- 172.21.15.114:0/249549344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff42c15ac50 0x7ff42c0ae850 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff41800c7f0 tx=0x7ff41800ccb0 comp rx=0 tx=0).stop 2024-04-28T13:08:01.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.169+0000 7ff432e37640 1 -- 172.21.15.114:0/249549344 shutdown_connections 2024-04-28T13:08:01.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.169+0000 7ff432e37640 1 --2- 172.21.15.114:0/249549344 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff41006c8f0 0x7ff41006edb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:01.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.169+0000 7ff432e37640 1 --2- 172.21.15.114:0/249549344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff42c15e390 0x7ff42c0cf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:01.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.169+0000 7ff432e37640 1 --2- 172.21.15.114:0/249549344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff42c15ac50 0x7ff42c0ae850 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:01.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.169+0000 7ff432e37640 1 --2- 172.21.15.114:0/249549344 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff42c0d12c0 0x7ff42c139570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:01.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.169+0000 7ff432e37640 1 -- 172.21.15.114:0/249549344 >> 172.21.15.114:0/249549344 conn(0x7ff42c0cd8b0 msgr2=0x7ff42c15cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:01.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.169+0000 7ff432e37640 1 -- 172.21.15.114:0/249549344 shutdown_connections 2024-04-28T13:08:01.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.169+0000 7ff432e37640 1 -- 172.21.15.114:0/249549344 wait complete. 2024-04-28T13:08:01.180 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-28T13:08:01.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:01.180 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-04-28T13:08:01.211 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2024-04-28T13:08:01.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:01.211 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-28T13:08:01.285 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:08:01.285 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-28T13:08:01.301 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:08:01.301 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-28T13:08:01.355 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:08:01.355 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-28T13:08:01.411 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:08:01.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.546+0000 7fc8efb12640 1 Processor -- start 2024-04-28T13:08:01.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.546+0000 7fc8efb12640 1 -- start start 2024-04-28T13:08:01.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.546+0000 7fc8efb12640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc8e8140120 0x7fc8e8070650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:01.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.547+0000 7fc8efb12640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8e815e380 con 0x7fc8e815dd60 2024-04-28T13:08:01.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.547+0000 7fc8efb12640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8e8160de0 con 0x7fc8e81618c0 2024-04-28T13:08:01.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.547+0000 7fc8efb12640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fc8e815e660 con 0x7fc8e8140120 2024-04-28T13:08:01.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.547+0000 7fc8ed8ae640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc8e8140120 0x7fc8e8070650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:01.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.547+0000 7fc8ed8ae640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc8e8140120 0x7fc8e8070650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36300/0 (socket says 172.21.15.114:36300) 2024-04-28T13:08:01.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.547+0000 7fc8ee0af640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc8e815dd60 0x7fc8e80d19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46758/0 (socket says 172.21.15.114:46758) 2024-04-28T13:08:01.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.547+0000 7fc8ed8ae640 1 -- 172.21.15.114:0/3332542308 learned_addr learned my addr 172.21.15.114:0/3332542308 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:01.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.547+0000 7fc8ed8ae640 1 -- 172.21.15.114:0/3332542308 >> v1:172.21.15.134:6789/0 conn(0x7fc8e81618c0 legacy=0x7fc8e815d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:01.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.547+0000 7fc8ed8ae640 1 -- 172.21.15.114:0/3332542308 >> v1:172.21.15.114:6789/0 conn(0x7fc8e815dd60 legacy=0x7fc8e80d19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:01.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.547+0000 7fc8ed8ae640 1 -- 172.21.15.114:0/3332542308 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8e81610c0 con 0x7fc8e8140120 2024-04-28T13:08:01.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.547+0000 7fc8ec8ac640 1 -- 172.21.15.114:0/3332542308 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1672583926 0 0) 0x7fc8e815e380 con 0x7fc8e815dd60 2024-04-28T13:08:01.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.548+0000 7fc8ed8ae640 1 --2- 172.21.15.114:0/3332542308 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8e8140120 0x7fc8e8070650 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0009870 tx=0x7fc8e002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1fca9173d93b1a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:01.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.548+0000 7fc8ec8ac640 1 -- 172.21.15.114:0/3332542308 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0037070 con 0x7fc8e8140120 2024-04-28T13:08:01.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.548+0000 7fc8ec8ac640 1 -- 172.21.15.114:0/3332542308 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8e0032440 con 0x7fc8e8140120 2024-04-28T13:08:01.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.548+0000 7fc8ec8ac640 1 -- 172.21.15.114:0/3332542308 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0032810 con 0x7fc8e8140120 2024-04-28T13:08:01.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.548+0000 7fc8efb12640 1 -- 172.21.15.114:0/3332542308 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8e8140120 msgr2=0x7fc8e8070650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:01.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.548+0000 7fc8efb12640 1 --2- 172.21.15.114:0/3332542308 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8e8140120 0x7fc8e8070650 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0009870 tx=0x7fc8e002a2a0 comp rx=0 tx=0).stop 2024-04-28T13:08:01.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.548+0000 7fc8efb12640 1 -- 172.21.15.114:0/3332542308 shutdown_connections 2024-04-28T13:08:01.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.548+0000 7fc8efb12640 1 --2- 172.21.15.114:0/3332542308 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8e8140120 0x7fc8e8070650 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:01.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.548+0000 7fc8efb12640 1 -- 172.21.15.114:0/3332542308 >> 172.21.15.114:0/3332542308 conn(0x7fc8e80b4c60 msgr2=0x7fc8e80b5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:01.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.548+0000 7fc8efb12640 1 -- 172.21.15.114:0/3332542308 shutdown_connections 2024-04-28T13:08:01.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.548+0000 7fc8efb12640 1 -- 172.21.15.114:0/3332542308 wait complete. 2024-04-28T13:08:01.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.549+0000 7fc8efb12640 1 Processor -- start 2024-04-28T13:08:01.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.550+0000 7fc8efb12640 1 -- start start 2024-04-28T13:08:01.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.550+0000 7fc8efb12640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8e8140120 0x7fc8e80b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:01.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.550+0000 7fc8efb12640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8e815dd60 0x7fc8e815c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:01.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.550+0000 7fc8efb12640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8e81618c0 0x7fc8e815c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:01.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.550+0000 7fc8efb12640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e8070f20 con 0x7fc8e815dd60 2024-04-28T13:08:01.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.550+0000 7fc8efb12640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e8070da0 con 0x7fc8e8140120 2024-04-28T13:08:01.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.550+0000 7fc8efb12640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc8e8140500 con 0x7fc8e81618c0 2024-04-28T13:08:01.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.550+0000 7fc8ed0ad640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8e815dd60 0x7fc8e815c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:01.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.550+0000 7fc8ed0ad640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8e815dd60 0x7fc8e815c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36314/0 (socket says 172.21.15.114:36314) 2024-04-28T13:08:01.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.550+0000 7fc8ed0ad640 1 -- 172.21.15.114:0/3980809803 learned_addr learned my addr 172.21.15.114:0/3980809803 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:01.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.551+0000 7fc8ed8ae640 1 --2- 172.21.15.114:0/3980809803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8e8140120 0x7fc8e80b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:01.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.551+0000 7fc8ee0af640 1 --2- 172.21.15.114:0/3980809803 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8e81618c0 0x7fc8e815c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:01.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.551+0000 7fc8ed0ad640 1 -- 172.21.15.114:0/3980809803 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8e81618c0 msgr2=0x7fc8e815c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:01.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.551+0000 7fc8ed0ad640 1 --2- 172.21.15.114:0/3980809803 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8e81618c0 0x7fc8e815c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:01.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.551+0000 7fc8ed0ad640 1 -- 172.21.15.114:0/3980809803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8e8140120 msgr2=0x7fc8e80b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:01.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.551+0000 7fc8ed0ad640 1 --2- 172.21.15.114:0/3980809803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8e8140120 0x7fc8e80b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:01.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.551+0000 7fc8ed0ad640 1 -- 172.21.15.114:0/3980809803 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8e81f63f0 con 0x7fc8e815dd60 2024-04-28T13:08:01.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.551+0000 7fc8ed0ad640 1 --2- 172.21.15.114:0/3980809803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8e815dd60 0x7fc8e815c120 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc8d800b410 tx=0x7fc8d800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:01.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.551+0000 7fc8de7fc640 1 -- 172.21.15.114:0/3980809803 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d8015020 con 0x7fc8e815dd60 2024-04-28T13:08:01.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.551+0000 7fc8de7fc640 1 -- 172.21.15.114:0/3980809803 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8d8011830 con 0x7fc8e815dd60 2024-04-28T13:08:01.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.551+0000 7fc8de7fc640 1 -- 172.21.15.114:0/3980809803 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d8011c20 con 0x7fc8e815dd60 2024-04-28T13:08:01.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.551+0000 7fc8efb12640 1 -- 172.21.15.114:0/3980809803 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8e81425d0 con 0x7fc8e815dd60 2024-04-28T13:08:01.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.551+0000 7fc8efb12640 1 -- 172.21.15.114:0/3980809803 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8e8142b90 con 0x7fc8e815dd60 2024-04-28T13:08:01.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.552+0000 7fc8efb12640 1 -- 172.21.15.114:0/3980809803 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8e806a3d0 con 0x7fc8e815dd60 2024-04-28T13:08:01.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.552+0000 7fc8de7fc640 1 -- 172.21.15.114:0/3980809803 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc8d8018020 con 0x7fc8e815dd60 2024-04-28T13:08:01.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.553+0000 7fc8de7fc640 1 --2- 172.21.15.114:0/3980809803 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc8cc06c8f0 0x7fc8cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:01.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.553+0000 7fc8de7fc640 1 -- 172.21.15.114:0/3980809803 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc8d808ba40 con 0x7fc8e815dd60 2024-04-28T13:08:01.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.553+0000 7fc8ed8ae640 1 --2- 172.21.15.114:0/3980809803 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc8cc06c8f0 0x7fc8cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:01.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.553+0000 7fc8ed8ae640 1 --2- 172.21.15.114:0/3980809803 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc8cc06c8f0 0x7fc8cc06edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0034000 tx=0x7fc8e002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:01.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.557+0000 7fc8de7fc640 1 -- 172.21.15.114:0/3980809803 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc8d801f020 con 0x7fc8e815dd60 2024-04-28T13:08:01.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.732+0000 7fc8efb12640 1 -- 172.21.15.114:0/3980809803 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8e80b5840 con 0x7fc8e815dd60 2024-04-28T13:08:01.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.733+0000 7fc8de7fc640 1 -- 172.21.15.114:0/3980809803 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7fc8d808be20 con 0x7fc8e815dd60 2024-04-28T13:08:01.734 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:01.734 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:07:27.292537+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-28T13:07:23.706359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-28T13:07:24.596188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:08:01.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.735+0000 7fc8efb12640 1 -- 172.21.15.114:0/3980809803 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc8cc06c8f0 msgr2=0x7fc8cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:01.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.735+0000 7fc8efb12640 1 --2- 172.21.15.114:0/3980809803 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc8cc06c8f0 0x7fc8cc06edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0034000 tx=0x7fc8e002e000 comp rx=0 tx=0).stop 2024-04-28T13:08:01.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.735+0000 7fc8efb12640 1 -- 172.21.15.114:0/3980809803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8e815dd60 msgr2=0x7fc8e815c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:01.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.735+0000 7fc8efb12640 1 --2- 172.21.15.114:0/3980809803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8e815dd60 0x7fc8e815c120 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc8d800b410 tx=0x7fc8d800b8d0 comp rx=0 tx=0).stop 2024-04-28T13:08:01.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.735+0000 7fc8efb12640 1 -- 172.21.15.114:0/3980809803 shutdown_connections 2024-04-28T13:08:01.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.735+0000 7fc8efb12640 1 --2- 172.21.15.114:0/3980809803 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8e81618c0 0x7fc8e815c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:01.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.735+0000 7fc8efb12640 1 --2- 172.21.15.114:0/3980809803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8e815dd60 0x7fc8e815c120 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:01.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.735+0000 7fc8efb12640 1 --2- 172.21.15.114:0/3980809803 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc8cc06c8f0 0x7fc8cc06edb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:01.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.735+0000 7fc8efb12640 1 --2- 172.21.15.114:0/3980809803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8e8140120 0x7fc8e80b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:01.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.735+0000 7fc8efb12640 1 -- 172.21.15.114:0/3980809803 >> 172.21.15.114:0/3980809803 conn(0x7fc8e80b4c60 msgr2=0x7fc8e8156080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:01.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.735+0000 7fc8efb12640 1 -- 172.21.15.114:0/3980809803 shutdown_connections 2024-04-28T13:08:01.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.735+0000 7fc8efb12640 1 -- 172.21.15.114:0/3980809803 wait complete. 2024-04-28T13:08:01.747 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-28T13:07:14.721860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-28T13:07:23.706359+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-28T13:07:24.596188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-28T13:08:01.748 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-28T13:08:01.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.847+0000 7f1783538640 1 Processor -- start 2024-04-28T13:08:01.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.847+0000 7f1783538640 1 -- start start 2024-04-28T13:08:01.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.848+0000 7f1783538640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f177c146ba0 0x7f177c160dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:01.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.848+0000 7f1783538640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f177c146f80 con 0x7f177c06f860 2024-04-28T13:08:01.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.848+0000 7f1783538640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f177c161530 con 0x7f177c073420 2024-04-28T13:08:01.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.848+0000 7f1783538640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f177c0d0ca0 con 0x7f177c146ba0 2024-04-28T13:08:01.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.848+0000 7f1780ad3640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f177c06f860 0x7f177c0cf450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46764/0 (socket says 172.21.15.114:46764) 2024-04-28T13:08:01.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.848+0000 7f1780ad3640 1 -- 172.21.15.114:0/2166270999 learned_addr learned my addr 172.21.15.114:0/2166270999 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:01.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.848+0000 7f17812d4640 1 --2- 172.21.15.114:0/2166270999 >> v2:172.21.15.134:3300/0 conn(0x7f177c146ba0 0x7f177c160dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:01.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.848+0000 7f1773fff640 1 -- 172.21.15.114:0/2166270999 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4046840505 0 0) 0x7f176c001110 con 0x7f177c06f860 2024-04-28T13:08:01.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.848+0000 7f1773fff640 1 -- 172.21.15.114:0/2166270999 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1768003520 con 0x7f177c06f860 2024-04-28T13:08:01.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.848+0000 7f1773fff640 1 -- 172.21.15.114:0/2166270999 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3229825536 0 0) 0x7f1768003520 con 0x7f177c06f860 2024-04-28T13:08:01.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.848+0000 7f1773fff640 1 -- 172.21.15.114:0/2166270999 >> v2:172.21.15.134:3300/0 conn(0x7f177c146ba0 msgr2=0x7f177c160dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:01.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.848+0000 7f1773fff640 1 --2- 172.21.15.114:0/2166270999 >> v2:172.21.15.134:3300/0 conn(0x7f177c146ba0 0x7f177c160dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:01.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.848+0000 7f1773fff640 1 -- 172.21.15.114:0/2166270999 >> v1:172.21.15.134:6789/0 conn(0x7f177c073420 legacy=0x7f177c0cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:01.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.848+0000 7f1773fff640 1 -- 172.21.15.114:0/2166270999 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f177c161810 con 0x7f177c06f860 2024-04-28T13:08:01.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.848+0000 7f1773fff640 1 -- 172.21.15.114:0/2166270999 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f176c001860 con 0x7f177c06f860 2024-04-28T13:08:01.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.848+0000 7f1773fff640 1 -- 172.21.15.114:0/2166270999 >> v1:172.21.15.114:6789/0 conn(0x7f177c06f860 legacy=0x7f177c0cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:01.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.848+0000 7f1773fff640 1 --2- 172.21.15.114:0/2166270999 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17680039b0 0x7f1768003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:01.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.848+0000 7f1773fff640 1 --2- 172.21.15.114:0/2166270999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1768004800 0x7f1768004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:01.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.848+0000 7f1773fff640 1 --2- 172.21.15.114:0/2166270999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17680051c0 0x7f176800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:01.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.848+0000 7f1773fff640 1 -- 172.21.15.114:0/2166270999 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f177c0d0ca0 con 0x7f17680051c0 2024-04-28T13:08:01.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.848+0000 7f1773fff640 1 -- 172.21.15.114:0/2166270999 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f176800c160 con 0x7f1768004800 2024-04-28T13:08:01.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.848+0000 7f1773fff640 1 -- 172.21.15.114:0/2166270999 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f176800c360 con 0x7f17680039b0 2024-04-28T13:08:01.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.849+0000 7f1781ad5640 1 --2- 172.21.15.114:0/2166270999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17680051c0 0x7f176800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:01.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.849+0000 7f1780ad3640 1 --2- 172.21.15.114:0/2166270999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1768004800 0x7f1768004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:01.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.849+0000 7f17812d4640 1 --2- 172.21.15.114:0/2166270999 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17680039b0 0x7f1768003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:01.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.849+0000 7f1781ad5640 1 -- 172.21.15.114:0/2166270999 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17680039b0 msgr2=0x7f1768003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:01.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.849+0000 7f1781ad5640 1 --2- 172.21.15.114:0/2166270999 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17680039b0 0x7f1768003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:01.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.849+0000 7f1781ad5640 1 -- 172.21.15.114:0/2166270999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1768004800 msgr2=0x7f1768004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:01.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.849+0000 7f1781ad5640 1 --2- 172.21.15.114:0/2166270999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1768004800 0x7f1768004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:01.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.849+0000 7f1781ad5640 1 -- 172.21.15.114:0/2166270999 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1768003520 con 0x7f17680051c0 2024-04-28T13:08:01.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.849+0000 7f1781ad5640 1 -- 172.21.15.114:0/2166270999 reap_dead start 2024-04-28T13:08:01.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.849+0000 7f1781ad5640 1 --2- 172.21.15.114:0/2166270999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17680051c0 0x7f176800b9c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1774001e50 tx=0x7f1768005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb69c5394c9a15e server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:01.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.850+0000 7f1773fff640 1 -- 172.21.15.114:0/2166270999 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1774001a70 con 0x7f17680051c0 2024-04-28T13:08:01.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.850+0000 7f1773fff640 1 -- 172.21.15.114:0/2166270999 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1774003970 con 0x7f17680051c0 2024-04-28T13:08:01.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.850+0000 7f1773fff640 1 -- 172.21.15.114:0/2166270999 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1774003d60 con 0x7f17680051c0 2024-04-28T13:08:01.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.850+0000 7f1783538640 1 -- 172.21.15.114:0/2166270999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17680051c0 msgr2=0x7f176800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:01.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.850+0000 7f1783538640 1 --2- 172.21.15.114:0/2166270999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17680051c0 0x7f176800b9c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1774001e50 tx=0x7f1768005830 comp rx=0 tx=0).stop 2024-04-28T13:08:01.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.850+0000 7f1783538640 1 -- 172.21.15.114:0/2166270999 shutdown_connections 2024-04-28T13:08:01.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.850+0000 7f1783538640 1 --2- 172.21.15.114:0/2166270999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17680051c0 0x7f176800b9c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:01.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.850+0000 7f1783538640 1 -- 172.21.15.114:0/2166270999 >> 172.21.15.114:0/2166270999 conn(0x7f177c06c980 msgr2=0x7f177c0b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:01.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.850+0000 7f1783538640 1 -- 172.21.15.114:0/2166270999 shutdown_connections 2024-04-28T13:08:01.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.850+0000 7f1783538640 1 -- 172.21.15.114:0/2166270999 wait complete. 2024-04-28T13:08:01.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.851+0000 7f1783538640 1 Processor -- start 2024-04-28T13:08:01.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.851+0000 7f1783538640 1 -- start start 2024-04-28T13:08:01.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.852+0000 7f1783538640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17680051c0 0x7f177c1f2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:01.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.852+0000 7f1783538640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f177c1e75f0 0x7f177c13d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:01.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.852+0000 7f1783538640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f177c1e7a70 0x7f177c13dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:01.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.852+0000 7f1783538640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f177c073a10 con 0x7f177c1e7a70 2024-04-28T13:08:01.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.852+0000 7f1783538640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f177c073890 con 0x7f177c1e75f0 2024-04-28T13:08:01.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.852+0000 7f1783538640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f177c073b90 con 0x7f17680051c0 2024-04-28T13:08:01.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.852+0000 7f1781ad5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f177c1e7a70 0x7f177c13dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:01.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.852+0000 7f1781ad5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f177c1e7a70 0x7f177c13dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36334/0 (socket says 172.21.15.114:36334) 2024-04-28T13:08:01.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.852+0000 7f1781ad5640 1 -- 172.21.15.114:0/1251289311 learned_addr learned my addr 172.21.15.114:0/1251289311 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:01.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.852+0000 7f1780ad3640 1 --2- 172.21.15.114:0/1251289311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f177c1e75f0 0x7f177c13d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:01.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.852+0000 7f17812d4640 1 --2- 172.21.15.114:0/1251289311 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17680051c0 0x7f177c1f2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:01.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.852+0000 7f1781ad5640 1 -- 172.21.15.114:0/1251289311 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17680051c0 msgr2=0x7f177c1f2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:01.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.852+0000 7f1781ad5640 1 --2- 172.21.15.114:0/1251289311 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17680051c0 0x7f177c1f2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:01.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.852+0000 7f1781ad5640 1 -- 172.21.15.114:0/1251289311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f177c1e75f0 msgr2=0x7f177c13d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:01.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.852+0000 7f1781ad5640 1 --2- 172.21.15.114:0/1251289311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f177c1e75f0 0x7f177c13d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:01.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.852+0000 7f1781ad5640 1 -- 172.21.15.114:0/1251289311 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f177c13f8e0 con 0x7f177c1e7a70 2024-04-28T13:08:01.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.853+0000 7f1781ad5640 1 --2- 172.21.15.114:0/1251289311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f177c1e7a70 0x7f177c13dce0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1774001f70 tx=0x7f17740014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:01.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.853+0000 7f1771ffb640 1 -- 172.21.15.114:0/1251289311 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1774001a70 con 0x7f177c1e7a70 2024-04-28T13:08:01.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.853+0000 7f1771ffb640 1 -- 172.21.15.114:0/1251289311 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f177402ac70 con 0x7f177c1e7a70 2024-04-28T13:08:01.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.853+0000 7f1771ffb640 1 -- 172.21.15.114:0/1251289311 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1774006d70 con 0x7f177c1e7a70 2024-04-28T13:08:01.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.853+0000 7f1783538640 1 -- 172.21.15.114:0/1251289311 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f177c1e8040 con 0x7f177c1e7a70 2024-04-28T13:08:01.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.853+0000 7f1783538640 1 -- 172.21.15.114:0/1251289311 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f177c13fb80 con 0x7f177c1e7a70 2024-04-28T13:08:01.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.854+0000 7f1783538640 1 -- 172.21.15.114:0/1251289311 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f177c1e8560 con 0x7f177c1e7a70 2024-04-28T13:08:01.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.854+0000 7f1771ffb640 1 -- 172.21.15.114:0/1251289311 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1774007030 con 0x7f177c1e7a70 2024-04-28T13:08:01.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.855+0000 7f1771ffb640 1 --2- 172.21.15.114:0/1251289311 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f176006c8f0 0x7f176006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:01.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.855+0000 7f1771ffb640 1 -- 172.21.15.114:0/1251289311 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f17740ab790 con 0x7f177c1e7a70 2024-04-28T13:08:01.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.855+0000 7f17812d4640 1 --2- 172.21.15.114:0/1251289311 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f176006c8f0 0x7f176006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:01.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.855+0000 7f17812d4640 1 --2- 172.21.15.114:0/1251289311 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f176006c8f0 0x7f176006edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1778009a80 tx=0x7f1778008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:01.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:01.859+0000 7f1771ffb640 1 -- 172.21.15.114:0/1251289311 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f177c1e8560 con 0x7f177c1e7a70 2024-04-28T13:08:02.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.032+0000 7f1783538640 1 -- 172.21.15.114:0/1251289311 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f177c06a3d0 con 0x7f177c1e7a70 2024-04-28T13:08:02.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.033+0000 7f1771ffb640 1 -- 172.21.15.114:0/1251289311 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f1774043060 con 0x7f177c1e7a70 2024-04-28T13:08:02.034 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-28T13:08:02.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.035+0000 7f1783538640 1 -- 172.21.15.114:0/1251289311 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f176006c8f0 msgr2=0x7f176006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:02.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.035+0000 7f1783538640 1 --2- 172.21.15.114:0/1251289311 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f176006c8f0 0x7f176006edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1778009a80 tx=0x7f1778008040 comp rx=0 tx=0).stop 2024-04-28T13:08:02.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.035+0000 7f1783538640 1 -- 172.21.15.114:0/1251289311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f177c1e7a70 msgr2=0x7f177c13dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:02.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.035+0000 7f1783538640 1 --2- 172.21.15.114:0/1251289311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f177c1e7a70 0x7f177c13dce0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1774001f70 tx=0x7f17740014a0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.035+0000 7f1783538640 1 -- 172.21.15.114:0/1251289311 shutdown_connections 2024-04-28T13:08:02.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.035+0000 7f1783538640 1 --2- 172.21.15.114:0/1251289311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f177c1e7a70 0x7f177c13dce0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.035+0000 7f1783538640 1 --2- 172.21.15.114:0/1251289311 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f176006c8f0 0x7f176006edb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.035+0000 7f1783538640 1 --2- 172.21.15.114:0/1251289311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f177c1e75f0 0x7f177c13d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.035+0000 7f1783538640 1 --2- 172.21.15.114:0/1251289311 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17680051c0 0x7f177c1f2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.035+0000 7f1783538640 1 -- 172.21.15.114:0/1251289311 >> 172.21.15.114:0/1251289311 conn(0x7f177c06c980 msgr2=0x7f177c06e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:02.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.035+0000 7f1783538640 1 -- 172.21.15.114:0/1251289311 shutdown_connections 2024-04-28T13:08:02.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.035+0000 7f1783538640 1 -- 172.21.15.114:0/1251289311 wait complete. 2024-04-28T13:08:02.046 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-28T13:08:02.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.145+0000 7fc4f6be4640 1 Processor -- start 2024-04-28T13:08:02.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.145+0000 7fc4f6be4640 1 -- start start 2024-04-28T13:08:02.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.146+0000 7fc4f6be4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4f00b3ed0 0x7fc4f015c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:02.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.146+0000 7fc4f6be4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4f0141800 con 0x7fc4f015cb80 2024-04-28T13:08:02.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.146+0000 7fc4f6be4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4f0141ae0 con 0x7fc4f00ce2f0 2024-04-28T13:08:02.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.146+0000 7fc4f6be4640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc4f015c1b0 con 0x7fc4f00b3ed0 2024-04-28T13:08:02.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.146+0000 7fc4f5181640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc4f015cb80 0x7fc4f006f690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46772/0 (socket says 172.21.15.114:46772) 2024-04-28T13:08:02.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.146+0000 7fc4f5181640 1 -- 172.21.15.114:0/101735678 learned_addr learned my addr 172.21.15.114:0/101735678 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:02.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.146+0000 7fc4ef7fe640 1 -- 172.21.15.114:0/101735678 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 582237160 0 0) 0x7fc4f0141800 con 0x7fc4f015cb80 2024-04-28T13:08:02.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.146+0000 7fc4effff640 1 --2- 172.21.15.114:0/101735678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4f00b3ed0 0x7fc4f015c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:02.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.146+0000 7fc4ef7fe640 1 -- 172.21.15.114:0/101735678 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4d8003520 con 0x7fc4f015cb80 2024-04-28T13:08:02.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.146+0000 7fc4ef7fe640 1 -- 172.21.15.114:0/101735678 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2019499700 0 0) 0x7fc4d8003520 con 0x7fc4f015cb80 2024-04-28T13:08:02.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.146+0000 7fc4ef7fe640 1 -- 172.21.15.114:0/101735678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4f00b3ed0 msgr2=0x7fc4f015c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:02.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.146+0000 7fc4ef7fe640 1 --2- 172.21.15.114:0/101735678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4f00b3ed0 0x7fc4f015c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.146+0000 7fc4ef7fe640 1 -- 172.21.15.114:0/101735678 >> v1:172.21.15.134:6789/0 conn(0x7fc4f00ce2f0 legacy=0x7fc4f0140fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:02.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.146+0000 7fc4ef7fe640 1 -- 172.21.15.114:0/101735678 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f0141dc0 con 0x7fc4f015cb80 2024-04-28T13:08:02.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.146+0000 7fc4ef7fe640 1 -- 172.21.15.114:0/101735678 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7fc4e80019f0 con 0x7fc4f015cb80 2024-04-28T13:08:02.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.146+0000 7fc4ef7fe640 1 -- 172.21.15.114:0/101735678 >> v1:172.21.15.114:6789/0 conn(0x7fc4f015cb80 legacy=0x7fc4f006f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:02.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.146+0000 7fc4ef7fe640 1 --2- 172.21.15.114:0/101735678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4f00b3ed0 0x7fc4d80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:02.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.146+0000 7fc4ef7fe640 1 --2- 172.21.15.114:0/101735678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4d8003f20 0x7fc4d8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:02.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.146+0000 7fc4ef7fe640 1 --2- 172.21.15.114:0/101735678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4d8004d40 0x7fc4d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:02.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.146+0000 7fc4ef7fe640 1 -- 172.21.15.114:0/101735678 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f015c1b0 con 0x7fc4d8004d40 2024-04-28T13:08:02.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.146+0000 7fc4ef7fe640 1 -- 172.21.15.114:0/101735678 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d800cb30 con 0x7fc4d8003f20 2024-04-28T13:08:02.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.146+0000 7fc4ef7fe640 1 -- 172.21.15.114:0/101735678 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc4d800cd30 con 0x7fc4f00b3ed0 2024-04-28T13:08:02.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.146+0000 7fc4f5181640 1 --2- 172.21.15.114:0/101735678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4d8004d40 0x7fc4d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:02.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.146+0000 7fc4f4980640 1 --2- 172.21.15.114:0/101735678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4f00b3ed0 0x7fc4d80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:02.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.147+0000 7fc4effff640 1 --2- 172.21.15.114:0/101735678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4d8003f20 0x7fc4d8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:02.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.147+0000 7fc4f5181640 1 -- 172.21.15.114:0/101735678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4f00b3ed0 msgr2=0x7fc4d80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:02.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.147+0000 7fc4f5181640 1 --2- 172.21.15.114:0/101735678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4f00b3ed0 0x7fc4d80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.147+0000 7fc4f5181640 1 -- 172.21.15.114:0/101735678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4d8003f20 msgr2=0x7fc4d8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:02.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.147+0000 7fc4f5181640 1 --2- 172.21.15.114:0/101735678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4d8003f20 0x7fc4d8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.147+0000 7fc4f5181640 1 -- 172.21.15.114:0/101735678 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d8003520 con 0x7fc4d8004d40 2024-04-28T13:08:02.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.147+0000 7fc4f5181640 1 --2- 172.21.15.114:0/101735678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4d8004d40 0x7fc4d80051c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc4e800a920 tx=0x7fc4d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402e50a7c0aa4f59 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:02.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.147+0000 7fc4ef7fe640 1 -- 172.21.15.114:0/101735678 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e800a4c0 con 0x7fc4d8004d40 2024-04-28T13:08:02.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.148+0000 7fc4ef7fe640 1 -- 172.21.15.114:0/101735678 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4e802f070 con 0x7fc4d8004d40 2024-04-28T13:08:02.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.148+0000 7fc4ef7fe640 1 -- 172.21.15.114:0/101735678 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e802bd20 con 0x7fc4d8004d40 2024-04-28T13:08:02.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.148+0000 7fc4f6be4640 1 -- 172.21.15.114:0/101735678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4d8004d40 msgr2=0x7fc4d80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:02.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.148+0000 7fc4f6be4640 1 --2- 172.21.15.114:0/101735678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4d8004d40 0x7fc4d80051c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc4e800a920 tx=0x7fc4d8005830 comp rx=0 tx=0).stop 2024-04-28T13:08:02.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.148+0000 7fc4f5181640 1 -- 172.21.15.114:0/101735678 reap_dead start 2024-04-28T13:08:02.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.148+0000 7fc4f6be4640 1 -- 172.21.15.114:0/101735678 shutdown_connections 2024-04-28T13:08:02.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.148+0000 7fc4f6be4640 1 -- 172.21.15.114:0/101735678 >> 172.21.15.114:0/101735678 conn(0x7fc4f006c980 msgr2=0x7fc4f00b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:02.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.148+0000 7fc4f6be4640 1 -- 172.21.15.114:0/101735678 shutdown_connections 2024-04-28T13:08:02.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.148+0000 7fc4f6be4640 1 -- 172.21.15.114:0/101735678 wait complete. 2024-04-28T13:08:02.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.149+0000 7fc4f6be4640 1 Processor -- start 2024-04-28T13:08:02.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.149+0000 7fc4f6be4640 1 -- start start 2024-04-28T13:08:02.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.150+0000 7fc4f6be4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4d8004d40 0x7fc4f0135d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:02.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.150+0000 7fc4f6be4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4f0137150 0x7fc4f01343c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:02.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.150+0000 7fc4f6be4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4f00b2fc0 0x7fc4f0154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:02.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.150+0000 7fc4f6be4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f006ff20 con 0x7fc4f00b2fc0 2024-04-28T13:08:02.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.150+0000 7fc4f6be4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f006fda0 con 0x7fc4f0137150 2024-04-28T13:08:02.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.150+0000 7fc4f6be4640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc4f015c640 con 0x7fc4d8004d40 2024-04-28T13:08:02.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.150+0000 7fc4f5181640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4f00b2fc0 0x7fc4f0154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:02.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.150+0000 7fc4f5181640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4f00b2fc0 0x7fc4f0154b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36356/0 (socket says 172.21.15.114:36356) 2024-04-28T13:08:02.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.150+0000 7fc4f5181640 1 -- 172.21.15.114:0/1407831610 learned_addr learned my addr 172.21.15.114:0/1407831610 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:02.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.150+0000 7fc4f4980640 1 --2- 172.21.15.114:0/1407831610 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4d8004d40 0x7fc4f0135d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:02.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.150+0000 7fc4effff640 1 --2- 172.21.15.114:0/1407831610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4f0137150 0x7fc4f01343c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:02.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.151+0000 7fc4f5181640 1 -- 172.21.15.114:0/1407831610 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4d8004d40 msgr2=0x7fc4f0135d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:02.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.151+0000 7fc4f5181640 1 --2- 172.21.15.114:0/1407831610 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4d8004d40 0x7fc4f0135d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.151+0000 7fc4f5181640 1 -- 172.21.15.114:0/1407831610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4f0137150 msgr2=0x7fc4f01343c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:02.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.151+0000 7fc4f5181640 1 --2- 172.21.15.114:0/1407831610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4f0137150 0x7fc4f01343c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.151+0000 7fc4f5181640 1 -- 172.21.15.114:0/1407831610 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f0134cc0 con 0x7fc4f00b2fc0 2024-04-28T13:08:02.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.151+0000 7fc4f5181640 1 --2- 172.21.15.114:0/1407831610 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4f00b2fc0 0x7fc4f0154b30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc4e800aa40 tx=0x7fc4e8001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:02.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.151+0000 7fc4ed7fa640 1 -- 172.21.15.114:0/1407831610 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e800a4c0 con 0x7fc4f00b2fc0 2024-04-28T13:08:02.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.151+0000 7fc4ed7fa640 1 -- 172.21.15.114:0/1407831610 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4e802cb40 con 0x7fc4f00b2fc0 2024-04-28T13:08:02.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.151+0000 7fc4f6be4640 1 -- 172.21.15.114:0/1407831610 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4f0134fa0 con 0x7fc4f00b2fc0 2024-04-28T13:08:02.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.151+0000 7fc4ed7fa640 1 -- 172.21.15.114:0/1407831610 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8034470 con 0x7fc4f00b2fc0 2024-04-28T13:08:02.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.151+0000 7fc4f6be4640 1 -- 172.21.15.114:0/1407831610 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4f0135560 con 0x7fc4f00b2fc0 2024-04-28T13:08:02.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.152+0000 7fc4f6be4640 1 -- 172.21.15.114:0/1407831610 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4f0069600 con 0x7fc4f00b2fc0 2024-04-28T13:08:02.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.152+0000 7fc4ed7fa640 1 -- 172.21.15.114:0/1407831610 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc4e8046060 con 0x7fc4f00b2fc0 2024-04-28T13:08:02.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.153+0000 7fc4ed7fa640 1 --2- 172.21.15.114:0/1407831610 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc4dc06c920 0x7fc4dc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:02.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.153+0000 7fc4f4980640 1 --2- 172.21.15.114:0/1407831610 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc4dc06c920 0x7fc4dc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:02.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.153+0000 7fc4ed7fa640 1 -- 172.21.15.114:0/1407831610 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc4e80ab800 con 0x7fc4f00b2fc0 2024-04-28T13:08:02.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.153+0000 7fc4f4980640 1 --2- 172.21.15.114:0/1407831610 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc4dc06c920 0x7fc4dc06ede0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0001910 tx=0x7fc4e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:02.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.157+0000 7fc4ed7fa640 1 -- 172.21.15.114:0/1407831610 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc4f0069600 con 0x7fc4f00b2fc0 2024-04-28T13:08:02.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.331+0000 7fc4f6be4640 1 -- 172.21.15.114:0/1407831610 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc4f006a3d0 con 0x7fc4f00b2fc0 2024-04-28T13:08:02.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.332+0000 7fc4ed7fa640 1 -- 172.21.15.114:0/1407831610 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7fc4e8079cf0 con 0x7fc4f00b2fc0 2024-04-28T13:08:02.333 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-04-28T13:08:02.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.333+0000 7fc4f6be4640 1 -- 172.21.15.114:0/1407831610 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc4dc06c920 msgr2=0x7fc4dc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:02.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.333+0000 7fc4f6be4640 1 --2- 172.21.15.114:0/1407831610 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc4dc06c920 0x7fc4dc06ede0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0001910 tx=0x7fc4e0009040 comp rx=0 tx=0).stop 2024-04-28T13:08:02.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.333+0000 7fc4f6be4640 1 -- 172.21.15.114:0/1407831610 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4f00b2fc0 msgr2=0x7fc4f0154b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:02.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.333+0000 7fc4f6be4640 1 --2- 172.21.15.114:0/1407831610 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4f00b2fc0 0x7fc4f0154b30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc4e800aa40 tx=0x7fc4e8001dc0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.334+0000 7fc4f6be4640 1 -- 172.21.15.114:0/1407831610 shutdown_connections 2024-04-28T13:08:02.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.334+0000 7fc4f6be4640 1 --2- 172.21.15.114:0/1407831610 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4f00b2fc0 0x7fc4f0154b30 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.334+0000 7fc4f6be4640 1 --2- 172.21.15.114:0/1407831610 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc4dc06c920 0x7fc4dc06ede0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.334+0000 7fc4f6be4640 1 --2- 172.21.15.114:0/1407831610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4f0137150 0x7fc4f01343c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.334+0000 7fc4f6be4640 1 --2- 172.21.15.114:0/1407831610 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4d8004d40 0x7fc4f0135d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.334+0000 7fc4f6be4640 1 -- 172.21.15.114:0/1407831610 >> 172.21.15.114:0/1407831610 conn(0x7fc4f006c980 msgr2=0x7fc4f015e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:02.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.334+0000 7fc4f6be4640 1 -- 172.21.15.114:0/1407831610 shutdown_connections 2024-04-28T13:08:02.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.334+0000 7fc4f6be4640 1 -- 172.21.15.114:0/1407831610 wait complete. 2024-04-28T13:08:02.345 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-28T13:08:02.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.445+0000 7f58af4d9640 1 Processor -- start 2024-04-28T13:08:02.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.445+0000 7f58af4d9640 1 -- start start 2024-04-28T13:08:02.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.446+0000 7f58af4d9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f58a806c350 0x7f58a80b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:02.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.446+0000 7f58af4d9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f58a80ce9a0 0x7f58a8162f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:02.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.446+0000 7f58af4d9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58a8163600 con 0x7f58a806c730 2024-04-28T13:08:02.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.446+0000 7f58af4d9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f58a8163ea0 con 0x7f58a80ce9a0 2024-04-28T13:08:02.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.446+0000 7f58af4d9640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f58a81638e0 con 0x7f58a806c350 2024-04-28T13:08:02.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.446+0000 7f58aca74640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f58a80ce9a0 0x7f58a8162f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:02.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.446+0000 7f58aca74640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f58a80ce9a0 0x7f58a8162f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36368/0 (socket says 172.21.15.114:36368) 2024-04-28T13:08:02.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.446+0000 7f58ada76640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f58a806c730 0x7f58a8070e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46786/0 (socket says 172.21.15.114:46786) 2024-04-28T13:08:02.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.446+0000 7f58aca74640 1 -- 172.21.15.114:0/2158399095 learned_addr learned my addr 172.21.15.114:0/2158399095 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:02.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.446+0000 7f58ad275640 1 --2- 172.21.15.114:0/2158399095 >> v2:172.21.15.134:3300/0 conn(0x7f58a806c350 0x7f58a80b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:02.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.446+0000 7f58aca74640 1 -- 172.21.15.114:0/2158399095 >> v2:172.21.15.134:3300/0 conn(0x7f58a806c350 msgr2=0x7f58a80b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:02.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.446+0000 7f58aca74640 1 --2- 172.21.15.114:0/2158399095 >> v2:172.21.15.134:3300/0 conn(0x7f58a806c350 0x7f58a80b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.446+0000 7f58aca74640 1 -- 172.21.15.114:0/2158399095 >> v1:172.21.15.114:6789/0 conn(0x7f58a806c730 legacy=0x7f58a8070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:02.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.446+0000 7f58aca74640 1 -- 172.21.15.114:0/2158399095 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a8163bc0 con 0x7f58a80ce9a0 2024-04-28T13:08:02.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.446+0000 7f589ffff640 1 -- 172.21.15.114:0/2158399095 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2024134139 0 0) 0x7f58a8163600 con 0x7f58a806c730 2024-04-28T13:08:02.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.447+0000 7f58aca74640 1 --2- 172.21.15.114:0/2158399095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58a80ce9a0 0x7f58a8162f00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f58a8073390 tx=0x7f589802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62cc978f40b3a9ec server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:02.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.447+0000 7f589ffff640 1 -- 172.21.15.114:0/2158399095 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5898037070 con 0x7f58a80ce9a0 2024-04-28T13:08:02.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.447+0000 7f589ffff640 1 -- 172.21.15.114:0/2158399095 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5898032440 con 0x7f58a80ce9a0 2024-04-28T13:08:02.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.447+0000 7f589ffff640 1 -- 172.21.15.114:0/2158399095 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5898032810 con 0x7f58a80ce9a0 2024-04-28T13:08:02.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.448+0000 7f58af4d9640 1 -- 172.21.15.114:0/2158399095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58a80ce9a0 msgr2=0x7f58a8162f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:02.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.448+0000 7f58af4d9640 1 --2- 172.21.15.114:0/2158399095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58a80ce9a0 0x7f58a8162f00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f58a8073390 tx=0x7f589802a1e0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.448+0000 7f58af4d9640 1 -- 172.21.15.114:0/2158399095 shutdown_connections 2024-04-28T13:08:02.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.448+0000 7f58af4d9640 1 --2- 172.21.15.114:0/2158399095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58a80ce9a0 0x7f58a8162f00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.448+0000 7f58af4d9640 1 --2- 172.21.15.114:0/2158399095 >> v2:172.21.15.134:3300/0 conn(0x7f58a806c350 0x7f58a80b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.448+0000 7f58af4d9640 1 -- 172.21.15.114:0/2158399095 >> 172.21.15.114:0/2158399095 conn(0x7f58a806f4f0 msgr2=0x7f58a806f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:02.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.448+0000 7f58af4d9640 1 -- 172.21.15.114:0/2158399095 shutdown_connections 2024-04-28T13:08:02.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.448+0000 7f58af4d9640 1 -- 172.21.15.114:0/2158399095 wait complete. 2024-04-28T13:08:02.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.449+0000 7f58af4d9640 1 Processor -- start 2024-04-28T13:08:02.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.449+0000 7f58af4d9640 1 -- start start 2024-04-28T13:08:02.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.449+0000 7f58af4d9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f58a806c350 0x7f58a8154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:02.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.450+0000 7f58af4d9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58a806c730 0x7f58a80b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:02.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.450+0000 7f58af4d9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58a80ce9a0 0x7f58a80b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:02.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.450+0000 7f58af4d9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f58a8148f40 con 0x7f58a80ce9a0 2024-04-28T13:08:02.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.450+0000 7f58af4d9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f58a8148dc0 con 0x7f58a806c730 2024-04-28T13:08:02.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.450+0000 7f58af4d9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f58a8071540 con 0x7f58a806c350 2024-04-28T13:08:02.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.450+0000 7f58ada76640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58a80ce9a0 0x7f58a80b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:02.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.450+0000 7f58ada76640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58a80ce9a0 0x7f58a80b0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36376/0 (socket says 172.21.15.114:36376) 2024-04-28T13:08:02.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.450+0000 7f58ada76640 1 -- 172.21.15.114:0/721827591 learned_addr learned my addr 172.21.15.114:0/721827591 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:02.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.450+0000 7f58aca74640 1 --2- 172.21.15.114:0/721827591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58a806c730 0x7f58a80b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:02.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.450+0000 7f58ad275640 1 --2- 172.21.15.114:0/721827591 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f58a806c350 0x7f58a8154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:02.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.450+0000 7f58ada76640 1 -- 172.21.15.114:0/721827591 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f58a806c350 msgr2=0x7f58a8154c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:02.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.450+0000 7f58ada76640 1 --2- 172.21.15.114:0/721827591 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f58a806c350 0x7f58a8154c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.450+0000 7f58ada76640 1 -- 172.21.15.114:0/721827591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58a806c730 msgr2=0x7f58a80b0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:02.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.450+0000 7f58ada76640 1 --2- 172.21.15.114:0/721827591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58a806c730 0x7f58a80b0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.450+0000 7f58ada76640 1 -- 172.21.15.114:0/721827591 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a81410b0 con 0x7f58a80ce9a0 2024-04-28T13:08:02.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.450+0000 7f58aca74640 1 --2- 172.21.15.114:0/721827591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58a806c730 0x7f58a80b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:02.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.450+0000 7f58ada76640 1 --2- 172.21.15.114:0/721827591 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58a80ce9a0 0x7f58a80b0f60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f58a000c7a0 tx=0x7f58a000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:02.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.450+0000 7f589dffb640 1 -- 172.21.15.114:0/721827591 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a0018070 con 0x7f58a80ce9a0 2024-04-28T13:08:02.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.450+0000 7f589dffb640 1 -- 172.21.15.114:0/721827591 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a000a640 con 0x7f58a80ce9a0 2024-04-28T13:08:02.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.450+0000 7f589dffb640 1 -- 172.21.15.114:0/721827591 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a000aa70 con 0x7f58a80ce9a0 2024-04-28T13:08:02.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.450+0000 7f58af4d9640 1 -- 172.21.15.114:0/721827591 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58a8141390 con 0x7f58a80ce9a0 2024-04-28T13:08:02.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.450+0000 7f58af4d9640 1 -- 172.21.15.114:0/721827591 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58a8141950 con 0x7f58a80ce9a0 2024-04-28T13:08:02.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.451+0000 7f58af4d9640 1 -- 172.21.15.114:0/721827591 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58a806a3d0 con 0x7f58a80ce9a0 2024-04-28T13:08:02.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.452+0000 7f589dffb640 1 -- 172.21.15.114:0/721827591 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f58a001b070 con 0x7f58a80ce9a0 2024-04-28T13:08:02.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.452+0000 7f589dffb640 1 --2- 172.21.15.114:0/721827591 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f588c06c8f0 0x7f588c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:02.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.452+0000 7f58ad275640 1 --2- 172.21.15.114:0/721827591 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f588c06c8f0 0x7f588c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:02.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.452+0000 7f589dffb640 1 -- 172.21.15.114:0/721827591 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f58a008b0f0 con 0x7f58a80ce9a0 2024-04-28T13:08:02.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.453+0000 7f58ad275640 1 --2- 172.21.15.114:0/721827591 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f588c06c8f0 0x7f588c06edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f58a4006fd0 tx=0x7f58a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:02.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.457+0000 7f589dffb640 1 -- 172.21.15.114:0/721827591 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f58a00595b0 con 0x7f58a80ce9a0 2024-04-28T13:08:02.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.630+0000 7f58af4d9640 1 -- 172.21.15.114:0/721827591 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f58a8073810 con 0x7f58a80ce9a0 2024-04-28T13:08:02.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.630+0000 7f589dffb640 1 -- 172.21.15.114:0/721827591 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f58a0058eb0 con 0x7f58a80ce9a0 2024-04-28T13:08:02.631 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-04-28T13:08:02.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.632+0000 7f58af4d9640 1 -- 172.21.15.114:0/721827591 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f588c06c8f0 msgr2=0x7f588c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:02.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.632+0000 7f58af4d9640 1 --2- 172.21.15.114:0/721827591 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f588c06c8f0 0x7f588c06edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f58a4006fd0 tx=0x7f58a4008040 comp rx=0 tx=0).stop 2024-04-28T13:08:02.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.632+0000 7f58af4d9640 1 -- 172.21.15.114:0/721827591 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58a80ce9a0 msgr2=0x7f58a80b0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:02.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.632+0000 7f58af4d9640 1 --2- 172.21.15.114:0/721827591 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58a80ce9a0 0x7f58a80b0f60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f58a000c7a0 tx=0x7f58a000cc60 comp rx=0 tx=0).stop 2024-04-28T13:08:02.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.632+0000 7f58af4d9640 1 -- 172.21.15.114:0/721827591 shutdown_connections 2024-04-28T13:08:02.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.632+0000 7f58af4d9640 1 --2- 172.21.15.114:0/721827591 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58a80ce9a0 0x7f58a80b0f60 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.632+0000 7f58af4d9640 1 --2- 172.21.15.114:0/721827591 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f588c06c8f0 0x7f588c06edb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.632+0000 7f58af4d9640 1 --2- 172.21.15.114:0/721827591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58a806c730 0x7f58a80b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.632+0000 7f58af4d9640 1 --2- 172.21.15.114:0/721827591 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f58a806c350 0x7f58a8154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.632+0000 7f58af4d9640 1 -- 172.21.15.114:0/721827591 >> 172.21.15.114:0/721827591 conn(0x7f58a806f4f0 msgr2=0x7f58a8070d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:02.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.633+0000 7f58af4d9640 1 -- 172.21.15.114:0/721827591 shutdown_connections 2024-04-28T13:08:02.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.633+0000 7f58af4d9640 1 -- 172.21.15.114:0/721827591 wait complete. 2024-04-28T13:08:02.644 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-28T13:08:02.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.741+0000 7f6531b39640 1 Processor -- start 2024-04-28T13:08:02.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.741+0000 7f6531b39640 1 -- start start 2024-04-28T13:08:02.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.742+0000 7f6531b39640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f652c09b9e0 0x7f652c09bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:02.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.742+0000 7f6531b39640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f652c0d1480 con 0x7f652c06ea40 2024-04-28T13:08:02.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.742+0000 7f6531b39640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f652c09c300 con 0x7f652c15fa10 2024-04-28T13:08:02.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.742+0000 7f6531b39640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f652c0d2050 con 0x7f652c09b9e0 2024-04-28T13:08:02.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.742+0000 7f652bfff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f652c06ea40 0x7f652c0d24e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46796/0 (socket says 172.21.15.114:46796) 2024-04-28T13:08:02.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.742+0000 7f652bfff640 1 -- 172.21.15.114:0/2421022433 learned_addr learned my addr 172.21.15.114:0/2421022433 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:02.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.743+0000 7f652b7fe640 1 --2- 172.21.15.114:0/2421022433 >> v2:172.21.15.134:3300/0 conn(0x7f652c09b9e0 0x7f652c09bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:02.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.743+0000 7f652a7fc640 1 -- 172.21.15.114:0/2421022433 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 143802211 0 0) 0x7f652c0d1480 con 0x7f652c06ea40 2024-04-28T13:08:02.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.743+0000 7f652a7fc640 1 -- 172.21.15.114:0/2421022433 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6514003520 con 0x7f652c06ea40 2024-04-28T13:08:02.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.743+0000 7f652b7fe640 1 -- 172.21.15.114:0/2421022433 >> v1:172.21.15.134:6789/0 conn(0x7f652c15fa10 legacy=0x7f652c0cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:02.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.743+0000 7f652b7fe640 1 -- 172.21.15.114:0/2421022433 >> v1:172.21.15.114:6789/0 conn(0x7f652c06ea40 legacy=0x7f652c0d24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:02.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.743+0000 7f652b7fe640 1 -- 172.21.15.114:0/2421022433 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652c0d1720 con 0x7f652c09b9e0 2024-04-28T13:08:02.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.744+0000 7f652b7fe640 1 --2- 172.21.15.114:0/2421022433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f652c09b9e0 0x7f652c09bdc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f651c0097a0 tx=0x7f651c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18d3b65b0383a26c server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:02.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.744+0000 7f652a7fc640 1 -- 172.21.15.114:0/2421022433 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651c037070 con 0x7f652c09b9e0 2024-04-28T13:08:02.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.744+0000 7f652a7fc640 1 -- 172.21.15.114:0/2421022433 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f651c032440 con 0x7f652c09b9e0 2024-04-28T13:08:02.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.744+0000 7f652a7fc640 1 -- 172.21.15.114:0/2421022433 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651c0327f0 con 0x7f652c09b9e0 2024-04-28T13:08:02.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.744+0000 7f6531b39640 1 -- 172.21.15.114:0/2421022433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f652c09b9e0 msgr2=0x7f652c09bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:02.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.744+0000 7f6531b39640 1 --2- 172.21.15.114:0/2421022433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f652c09b9e0 0x7f652c09bdc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f651c0097a0 tx=0x7f651c02a230 comp rx=0 tx=0).stop 2024-04-28T13:08:02.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.744+0000 7f6531b39640 1 -- 172.21.15.114:0/2421022433 shutdown_connections 2024-04-28T13:08:02.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.744+0000 7f6531b39640 1 --2- 172.21.15.114:0/2421022433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f652c09b9e0 0x7f652c09bdc0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.744+0000 7f6531b39640 1 -- 172.21.15.114:0/2421022433 >> 172.21.15.114:0/2421022433 conn(0x7f652c0b4a50 msgr2=0x7f652c0b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:02.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.744+0000 7f6531b39640 1 -- 172.21.15.114:0/2421022433 shutdown_connections 2024-04-28T13:08:02.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.744+0000 7f6531b39640 1 -- 172.21.15.114:0/2421022433 wait complete. 2024-04-28T13:08:02.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.745+0000 7f6531b39640 1 Processor -- start 2024-04-28T13:08:02.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.746+0000 7f6531b39640 1 -- start start 2024-04-28T13:08:02.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.746+0000 7f6531b39640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f652c06ea40 0x7f652c14b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:02.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.746+0000 7f6531b39640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f652c09b9e0 0x7f652c0caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:02.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.746+0000 7f6531b39640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f652c15fa10 0x7f652c0caf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:02.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.746+0000 7f6531b39640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f652c0cdcc0 con 0x7f652c15fa10 2024-04-28T13:08:02.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.746+0000 7f6531b39640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f652c0d1ce0 con 0x7f652c06ea40 2024-04-28T13:08:02.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.746+0000 7f6531b39640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f652c0cde40 con 0x7f652c09b9e0 2024-04-28T13:08:02.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.746+0000 7f652bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f652c15fa10 0x7f652c0caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:02.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.747+0000 7f652bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f652c15fa10 0x7f652c0caf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36378/0 (socket says 172.21.15.114:36378) 2024-04-28T13:08:02.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.747+0000 7f652bfff640 1 -- 172.21.15.114:0/561679246 learned_addr learned my addr 172.21.15.114:0/561679246 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:02.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.747+0000 7f652affd640 1 --2- 172.21.15.114:0/561679246 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f652c09b9e0 0x7f652c0caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:02.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.747+0000 7f652b7fe640 1 --2- 172.21.15.114:0/561679246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f652c06ea40 0x7f652c14b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:02.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.747+0000 7f652bfff640 1 -- 172.21.15.114:0/561679246 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f652c09b9e0 msgr2=0x7f652c0caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:02.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.747+0000 7f652bfff640 1 --2- 172.21.15.114:0/561679246 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f652c09b9e0 0x7f652c0caa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.747+0000 7f652bfff640 1 -- 172.21.15.114:0/561679246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f652c06ea40 msgr2=0x7f652c14b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:02.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.747+0000 7f652bfff640 1 --2- 172.21.15.114:0/561679246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f652c06ea40 0x7f652c14b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.747+0000 7f652bfff640 1 -- 172.21.15.114:0/561679246 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652c158990 con 0x7f652c15fa10 2024-04-28T13:08:02.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.747+0000 7f652bfff640 1 --2- 172.21.15.114:0/561679246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f652c15fa10 0x7f652c0caf80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f652400cb70 tx=0x7f652400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:02.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.747+0000 7f6513fff640 1 -- 172.21.15.114:0/561679246 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6524017070 con 0x7f652c15fa10 2024-04-28T13:08:02.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.747+0000 7f6513fff640 1 -- 172.21.15.114:0/561679246 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f652400ad40 con 0x7f652c15fa10 2024-04-28T13:08:02.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.747+0000 7f6513fff640 1 -- 172.21.15.114:0/561679246 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6524012620 con 0x7f652c15fa10 2024-04-28T13:08:02.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.747+0000 7f6531b39640 1 -- 172.21.15.114:0/561679246 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f652c0cb5b0 con 0x7f652c15fa10 2024-04-28T13:08:02.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.747+0000 7f6531b39640 1 -- 172.21.15.114:0/561679246 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f652c0b5a20 con 0x7f652c15fa10 2024-04-28T13:08:02.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.748+0000 7f6531b39640 1 -- 172.21.15.114:0/561679246 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f652c0cbad0 con 0x7f652c15fa10 2024-04-28T13:08:02.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.748+0000 7f6513fff640 1 -- 172.21.15.114:0/561679246 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f652401a070 con 0x7f652c15fa10 2024-04-28T13:08:02.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.749+0000 7f6513fff640 1 --2- 172.21.15.114:0/561679246 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f651806c8f0 0x7f651806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:02.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.749+0000 7f6513fff640 1 -- 172.21.15.114:0/561679246 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f652408b930 con 0x7f652c15fa10 2024-04-28T13:08:02.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.749+0000 7f652b7fe640 1 --2- 172.21.15.114:0/561679246 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f651806c8f0 0x7f651806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:02.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.749+0000 7f652b7fe640 1 --2- 172.21.15.114:0/561679246 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f651806c8f0 0x7f651806edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f651c034000 tx=0x7f651c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:02.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.753+0000 7f6513fff640 1 -- 172.21.15.114:0/561679246 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6524059df0 con 0x7f652c15fa10 2024-04-28T13:08:02.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.941+0000 7f6531b39640 1 -- 172.21.15.114:0/561679246 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f652c0b2970 con 0x7f652c15fa10 2024-04-28T13:08:02.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.942+0000 7f6513fff640 1 -- 172.21.15.114:0/561679246 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f65240596f0 con 0x7f652c15fa10 2024-04-28T13:08:02.943 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-04-28T13:08:02.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.944+0000 7f6531b39640 1 -- 172.21.15.114:0/561679246 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f651806c8f0 msgr2=0x7f651806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:02.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.944+0000 7f6531b39640 1 --2- 172.21.15.114:0/561679246 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f651806c8f0 0x7f651806edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f651c034000 tx=0x7f651c02e000 comp rx=0 tx=0).stop 2024-04-28T13:08:02.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.944+0000 7f6531b39640 1 -- 172.21.15.114:0/561679246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f652c15fa10 msgr2=0x7f652c0caf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:02.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.944+0000 7f6531b39640 1 --2- 172.21.15.114:0/561679246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f652c15fa10 0x7f652c0caf80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f652400cb70 tx=0x7f652400a430 comp rx=0 tx=0).stop 2024-04-28T13:08:02.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.944+0000 7f6531b39640 1 -- 172.21.15.114:0/561679246 shutdown_connections 2024-04-28T13:08:02.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.944+0000 7f6531b39640 1 --2- 172.21.15.114:0/561679246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f652c15fa10 0x7f652c0caf80 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.944+0000 7f6531b39640 1 --2- 172.21.15.114:0/561679246 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f652c09b9e0 0x7f652c0caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.944+0000 7f6531b39640 1 --2- 172.21.15.114:0/561679246 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f651806c8f0 0x7f651806edb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.944+0000 7f6531b39640 1 --2- 172.21.15.114:0/561679246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f652c06ea40 0x7f652c14b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:02.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.944+0000 7f6531b39640 1 -- 172.21.15.114:0/561679246 >> 172.21.15.114:0/561679246 conn(0x7f652c0b4a50 msgr2=0x7f652c071220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:02.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.944+0000 7f6531b39640 1 -- 172.21.15.114:0/561679246 shutdown_connections 2024-04-28T13:08:02.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:02.944+0000 7f6531b39640 1 -- 172.21.15.114:0/561679246 wait complete. 2024-04-28T13:08:02.955 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-04-28T13:08:02.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:02.955 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-04-28T13:08:02.980 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-04-28T13:08:02.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:02.980 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-28T13:08:03.035 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:08:03.036 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-28T13:08:03.055 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:08:03.055 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-28T13:08:03.112 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:08:03.112 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-28T13:08:03.170 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:08:03.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.266+0000 7f3e98ada640 1 Processor -- start 2024-04-28T13:08:03.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.266+0000 7f3e98ada640 1 -- start start 2024-04-28T13:08:03.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.267+0000 7f3e98ada640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3e9415d160 0x7f3e9406fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:03.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.267+0000 7f3e98ada640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e9415e4b0 con 0x7f3e9406da70 2024-04-28T13:08:03.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.267+0000 7f3e98ada640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e9415e790 con 0x7f3e940b0e90 2024-04-28T13:08:03.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.267+0000 7f3e98ada640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f3e9415ea70 con 0x7f3e9415d160 2024-04-28T13:08:03.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.267+0000 7f3e9259c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3e9415d160 0x7f3e9406fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:03.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.267+0000 7f3e92d9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3e9406da70 0x7f3e9415f270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46808/0 (socket says 172.21.15.114:46808) 2024-04-28T13:08:03.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.267+0000 7f3e92d9d640 1 -- 172.21.15.114:0/3886590969 learned_addr learned my addr 172.21.15.114:0/3886590969 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:03.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.267+0000 7f3e91d9b640 1 -- 172.21.15.114:0/3886590969 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3359316591 0 0) 0x7f3e9415e4b0 con 0x7f3e9406da70 2024-04-28T13:08:03.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.267+0000 7f3e91d9b640 1 -- 172.21.15.114:0/3886590969 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e80003520 con 0x7f3e9406da70 2024-04-28T13:08:03.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.267+0000 7f3e9259c640 1 -- 172.21.15.114:0/3886590969 >> v1:172.21.15.134:6789/0 conn(0x7f3e940b0e90 legacy=0x7f3e9406d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:03.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.267+0000 7f3e9259c640 1 -- 172.21.15.114:0/3886590969 >> v1:172.21.15.114:6789/0 conn(0x7f3e9406da70 legacy=0x7f3e9415f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:03.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.267+0000 7f3e9259c640 1 -- 172.21.15.114:0/3886590969 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e9415ed50 con 0x7f3e9415d160 2024-04-28T13:08:03.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.268+0000 7f3e9259c640 1 --2- 172.21.15.114:0/3886590969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e9415d160 0x7f3e9406fe70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3e840097a0 tx=0x7f3e8402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89b3cd0ad020680 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:03.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.268+0000 7f3e91d9b640 1 -- 172.21.15.114:0/3886590969 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e84037070 con 0x7f3e9415d160 2024-04-28T13:08:03.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.268+0000 7f3e91d9b640 1 -- 172.21.15.114:0/3886590969 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e84032440 con 0x7f3e9415d160 2024-04-28T13:08:03.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.268+0000 7f3e91d9b640 1 -- 172.21.15.114:0/3886590969 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e84032810 con 0x7f3e9415d160 2024-04-28T13:08:03.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.269+0000 7f3e98ada640 1 -- 172.21.15.114:0/3886590969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e9415d160 msgr2=0x7f3e9406fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:03.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.269+0000 7f3e98ada640 1 --2- 172.21.15.114:0/3886590969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e9415d160 0x7f3e9406fe70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3e840097a0 tx=0x7f3e8402a1e0 comp rx=0 tx=0).stop 2024-04-28T13:08:03.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.269+0000 7f3e98ada640 1 -- 172.21.15.114:0/3886590969 shutdown_connections 2024-04-28T13:08:03.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.269+0000 7f3e98ada640 1 --2- 172.21.15.114:0/3886590969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e9415d160 0x7f3e9406fe70 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:03.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.269+0000 7f3e98ada640 1 -- 172.21.15.114:0/3886590969 >> 172.21.15.114:0/3886590969 conn(0x7f3e94072a60 msgr2=0x7f3e94072e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:03.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.269+0000 7f3e98ada640 1 -- 172.21.15.114:0/3886590969 shutdown_connections 2024-04-28T13:08:03.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.269+0000 7f3e98ada640 1 -- 172.21.15.114:0/3886590969 wait complete. 2024-04-28T13:08:03.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.270+0000 7f3e98ada640 1 Processor -- start 2024-04-28T13:08:03.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.270+0000 7f3e98ada640 1 -- start start 2024-04-28T13:08:03.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.271+0000 7f3e98ada640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e9406da70 0x7f3e941f5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:03.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.271+0000 7f3e98ada640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e940b0e90 0x7f3e940b6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:03.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.271+0000 7f3e98ada640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e9415d160 0x7f3e9414d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:03.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.271+0000 7f3e98ada640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3e940703b0 con 0x7f3e9406da70 2024-04-28T13:08:03.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.271+0000 7f3e98ada640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9415d540 con 0x7f3e9415d160 2024-04-28T13:08:03.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.271+0000 7f3e98ada640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3e94070530 con 0x7f3e940b0e90 2024-04-28T13:08:03.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.271+0000 7f3e9259c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e9406da70 0x7f3e941f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:03.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.271+0000 7f3e9259c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e9406da70 0x7f3e941f5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36400/0 (socket says 172.21.15.114:36400) 2024-04-28T13:08:03.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.271+0000 7f3e9259c640 1 -- 172.21.15.114:0/80469586 learned_addr learned my addr 172.21.15.114:0/80469586 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:03.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.271+0000 7f3e92d9d640 1 --2- 172.21.15.114:0/80469586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e9415d160 0x7f3e9414d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:03.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.271+0000 7f3e8bfff640 1 --2- 172.21.15.114:0/80469586 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e940b0e90 0x7f3e940b6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:03.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.271+0000 7f3e9259c640 1 -- 172.21.15.114:0/80469586 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e940b0e90 msgr2=0x7f3e940b6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:03.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.271+0000 7f3e9259c640 1 --2- 172.21.15.114:0/80469586 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e940b0e90 0x7f3e940b6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:03.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.271+0000 7f3e9259c640 1 -- 172.21.15.114:0/80469586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e9415d160 msgr2=0x7f3e9414d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:03.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.271+0000 7f3e9259c640 1 --2- 172.21.15.114:0/80469586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e9415d160 0x7f3e9414d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:03.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.271+0000 7f3e9259c640 1 -- 172.21.15.114:0/80469586 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e940b4fd0 con 0x7f3e9406da70 2024-04-28T13:08:03.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.271+0000 7f3e8bfff640 1 --2- 172.21.15.114:0/80469586 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e940b0e90 0x7f3e940b6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:03.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.271+0000 7f3e9259c640 1 --2- 172.21.15.114:0/80469586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e9406da70 0x7f3e941f5990 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3e84000c00 tx=0x7f3e840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:03.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.272+0000 7f3e8affd640 1 -- 172.21.15.114:0/80469586 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e84037040 con 0x7f3e9406da70 2024-04-28T13:08:03.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.272+0000 7f3e8affd640 1 -- 172.21.15.114:0/80469586 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e84042070 con 0x7f3e9406da70 2024-04-28T13:08:03.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.272+0000 7f3e98ada640 1 -- 172.21.15.114:0/80469586 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e940b5290 con 0x7f3e9406da70 2024-04-28T13:08:03.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.272+0000 7f3e8affd640 1 -- 172.21.15.114:0/80469586 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e84030940 con 0x7f3e9406da70 2024-04-28T13:08:03.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.272+0000 7f3e98ada640 1 -- 172.21.15.114:0/80469586 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e940b5b30 con 0x7f3e9406da70 2024-04-28T13:08:03.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.273+0000 7f3e98ada640 1 -- 172.21.15.114:0/80469586 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e940b5680 con 0x7f3e9406da70 2024-04-28T13:08:03.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.273+0000 7f3e8affd640 1 -- 172.21.15.114:0/80469586 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3e84030ae0 con 0x7f3e9406da70 2024-04-28T13:08:03.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.273+0000 7f3e8affd640 1 --2- 172.21.15.114:0/80469586 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3e7406c8f0 0x7f3e7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:03.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.273+0000 7f3e8affd640 1 -- 172.21.15.114:0/80469586 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3e840ac390 con 0x7f3e9406da70 2024-04-28T13:08:03.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.274+0000 7f3e8bfff640 1 --2- 172.21.15.114:0/80469586 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3e7406c8f0 0x7f3e7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:03.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.274+0000 7f3e8bfff640 1 --2- 172.21.15.114:0/80469586 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3e7406c8f0 0x7f3e7406edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3e940b4f60 tx=0x7f3e7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:03.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.278+0000 7f3e8affd640 1 -- 172.21.15.114:0/80469586 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3e8407a850 con 0x7f3e9406da70 2024-04-28T13:08:03.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.461+0000 7f3e98ada640 1 -- 172.21.15.114:0/80469586 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e9406a3d0 con 0x7f3e9406da70 2024-04-28T13:08:03.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.462+0000 7f3e8affd640 1 -- 172.21.15.114:0/80469586 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7f3e8407a150 con 0x7f3e9406da70 2024-04-28T13:08:03.463 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:03.463 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:07:27.292537+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-28T13:07:23.706359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-28T13:07:24.596188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:08:03.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.464+0000 7f3e98ada640 1 -- 172.21.15.114:0/80469586 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3e7406c8f0 msgr2=0x7f3e7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:03.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.464+0000 7f3e98ada640 1 --2- 172.21.15.114:0/80469586 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3e7406c8f0 0x7f3e7406edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3e940b4f60 tx=0x7f3e7c009040 comp rx=0 tx=0).stop 2024-04-28T13:08:03.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.464+0000 7f3e98ada640 1 -- 172.21.15.114:0/80469586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e9406da70 msgr2=0x7f3e941f5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:03.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.464+0000 7f3e98ada640 1 --2- 172.21.15.114:0/80469586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e9406da70 0x7f3e941f5990 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3e84000c00 tx=0x7f3e840046c0 comp rx=0 tx=0).stop 2024-04-28T13:08:03.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.464+0000 7f3e98ada640 1 -- 172.21.15.114:0/80469586 shutdown_connections 2024-04-28T13:08:03.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.464+0000 7f3e98ada640 1 --2- 172.21.15.114:0/80469586 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3e7406c8f0 0x7f3e7406edb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:03.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.464+0000 7f3e98ada640 1 --2- 172.21.15.114:0/80469586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e9415d160 0x7f3e9414d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:03.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.464+0000 7f3e98ada640 1 --2- 172.21.15.114:0/80469586 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e940b0e90 0x7f3e940b6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:03.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.464+0000 7f3e98ada640 1 --2- 172.21.15.114:0/80469586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e9406da70 0x7f3e941f5990 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:03.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.464+0000 7f3e98ada640 1 -- 172.21.15.114:0/80469586 >> 172.21.15.114:0/80469586 conn(0x7f3e94072a60 msgr2=0x7f3e9414c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:03.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.464+0000 7f3e98ada640 1 -- 172.21.15.114:0/80469586 shutdown_connections 2024-04-28T13:08:03.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.464+0000 7f3e98ada640 1 -- 172.21.15.114:0/80469586 wait complete. 2024-04-28T13:08:03.476 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-28T13:07:14.721860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-28T13:07:23.706359+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-28T13:07:24.596188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-28T13:08:03.476 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-28T13:08:03.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.579+0000 7f3381659640 1 Processor -- start 2024-04-28T13:08:03.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.579+0000 7f3381659640 1 -- start start 2024-04-28T13:08:03.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.579+0000 7f3381659640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f337c148600 0x7f337c162ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:03.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.579+0000 7f3381659640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f337c0d3630 0x7f337c06dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:03.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.580+0000 7f3381659640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337c163770 con 0x7f337c148b20 2024-04-28T13:08:03.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.580+0000 7f3381659640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f337c163a50 con 0x7f337c0d3630 2024-04-28T13:08:03.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.580+0000 7f3381659640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f337c163d30 con 0x7f337c148600 2024-04-28T13:08:03.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.580+0000 7f337b7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f337c0d3630 0x7f337c06dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:03.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.580+0000 7f337b7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f337c0d3630 0x7f337c06dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36410/0 (socket says 172.21.15.114:36410) 2024-04-28T13:08:03.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.580+0000 7f337b7fe640 1 -- 172.21.15.114:0/4140570109 learned_addr learned my addr 172.21.15.114:0/4140570109 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:03.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.580+0000 7f337affd640 1 --2- 172.21.15.114:0/4140570109 >> v2:172.21.15.134:3300/0 conn(0x7f337c148600 0x7f337c162ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:03.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.580+0000 7f337b7fe640 1 -- 172.21.15.114:0/4140570109 >> v2:172.21.15.134:3300/0 conn(0x7f337c148600 msgr2=0x7f337c162ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:03.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.580+0000 7f337b7fe640 1 --2- 172.21.15.114:0/4140570109 >> v2:172.21.15.134:3300/0 conn(0x7f337c148600 0x7f337c162ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:03.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.580+0000 7f337b7fe640 1 -- 172.21.15.114:0/4140570109 >> v1:172.21.15.134:6789/0 conn(0x7f337c148b20 legacy=0x7f337c0d2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:03.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.580+0000 7f337b7fe640 1 -- 172.21.15.114:0/4140570109 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f337c06d460 con 0x7f337c0d3630 2024-04-28T13:08:03.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.580+0000 7f337affd640 1 --2- 172.21.15.114:0/4140570109 >> v2:172.21.15.134:3300/0 conn(0x7f337c148600 0x7f337c162ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:03.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.581+0000 7f337b7fe640 1 --2- 172.21.15.114:0/4140570109 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c0d3630 0x7f337c06dc60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f337c070f50 tx=0x7f337402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81be8eb1841c6470 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:03.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.581+0000 7f3379ffb640 1 -- 172.21.15.114:0/4140570109 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3374036070 con 0x7f337c0d3630 2024-04-28T13:08:03.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.581+0000 7f3379ffb640 1 -- 172.21.15.114:0/4140570109 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3374031600 con 0x7f337c0d3630 2024-04-28T13:08:03.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.581+0000 7f3379ffb640 1 -- 172.21.15.114:0/4140570109 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33740319d0 con 0x7f337c0d3630 2024-04-28T13:08:03.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.582+0000 7f3381659640 1 -- 172.21.15.114:0/4140570109 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c0d3630 msgr2=0x7f337c06dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:03.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.582+0000 7f3381659640 1 --2- 172.21.15.114:0/4140570109 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c0d3630 0x7f337c06dc60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f337c070f50 tx=0x7f337402a6f0 comp rx=0 tx=0).stop 2024-04-28T13:08:03.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.582+0000 7f3381659640 1 -- 172.21.15.114:0/4140570109 shutdown_connections 2024-04-28T13:08:03.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.582+0000 7f3381659640 1 --2- 172.21.15.114:0/4140570109 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c0d3630 0x7f337c06dc60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:03.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.582+0000 7f3381659640 1 --2- 172.21.15.114:0/4140570109 >> v2:172.21.15.134:3300/0 conn(0x7f337c148600 0x7f337c162ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:03.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.582+0000 7f3381659640 1 -- 172.21.15.114:0/4140570109 >> 172.21.15.114:0/4140570109 conn(0x7f337c0b83a0 msgr2=0x7f337c0b8780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:03.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.582+0000 7f3381659640 1 -- 172.21.15.114:0/4140570109 shutdown_connections 2024-04-28T13:08:03.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.582+0000 7f3381659640 1 -- 172.21.15.114:0/4140570109 wait complete. 2024-04-28T13:08:03.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.583+0000 7f3381659640 1 Processor -- start 2024-04-28T13:08:03.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.583+0000 7f3381659640 1 -- start start 2024-04-28T13:08:03.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.584+0000 7f3381659640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f337c0d3630 0x7f337c0cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:03.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.584+0000 7f3381659640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f337c148600 0x7f337c15ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:03.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.584+0000 7f3381659640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c148b20 0x7f337c161360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:03.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.584+0000 7f3381659640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f337c0cf9e0 con 0x7f337c148b20 2024-04-28T13:08:03.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.584+0000 7f3381659640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f337c163420 con 0x7f337c0d3630 2024-04-28T13:08:03.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.584+0000 7f3381659640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f337c0cfb60 con 0x7f337c148600 2024-04-28T13:08:03.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.584+0000 7f337b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c148b20 0x7f337c161360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:03.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.584+0000 7f337b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c148b20 0x7f337c161360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36418/0 (socket says 172.21.15.114:36418) 2024-04-28T13:08:03.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.584+0000 7f337b7fe640 1 -- 172.21.15.114:0/4183274571 learned_addr learned my addr 172.21.15.114:0/4183274571 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:03.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.584+0000 7f337affd640 1 --2- 172.21.15.114:0/4183274571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f337c0d3630 0x7f337c0cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:03.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.584+0000 7f337a7fc640 1 --2- 172.21.15.114:0/4183274571 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f337c148600 0x7f337c15ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:03.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.584+0000 7f337b7fe640 1 -- 172.21.15.114:0/4183274571 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f337c148600 msgr2=0x7f337c15ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:03.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.584+0000 7f337b7fe640 1 --2- 172.21.15.114:0/4183274571 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f337c148600 0x7f337c15ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:03.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.584+0000 7f337b7fe640 1 -- 172.21.15.114:0/4183274571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f337c0d3630 msgr2=0x7f337c0cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:03.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.584+0000 7f337b7fe640 1 --2- 172.21.15.114:0/4183274571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f337c0d3630 0x7f337c0cc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:03.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.584+0000 7f337b7fe640 1 -- 172.21.15.114:0/4183274571 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f337c1f5130 con 0x7f337c148b20 2024-04-28T13:08:03.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.584+0000 7f337b7fe640 1 --2- 172.21.15.114:0/4183274571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c148b20 0x7f337c161360 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f337402ace0 tx=0x7f3374004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:03.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.584+0000 7f33637fe640 1 -- 172.21.15.114:0/4183274571 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3374036050 con 0x7f337c148b20 2024-04-28T13:08:03.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.584+0000 7f33637fe640 1 -- 172.21.15.114:0/4183274571 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3374042070 con 0x7f337c148b20 2024-04-28T13:08:03.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.585+0000 7f33637fe640 1 -- 172.21.15.114:0/4183274571 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3374009510 con 0x7f337c148b20 2024-04-28T13:08:03.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.585+0000 7f3381659640 1 -- 172.21.15.114:0/4183274571 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f337c1618a0 con 0x7f337c148b20 2024-04-28T13:08:03.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.585+0000 7f3381659640 1 -- 172.21.15.114:0/4183274571 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f337c0ccac0 con 0x7f337c148b20 2024-04-28T13:08:03.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.586+0000 7f3381659640 1 -- 172.21.15.114:0/4183274571 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f337c06a3d0 con 0x7f337c148b20 2024-04-28T13:08:03.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.586+0000 7f33637fe640 1 -- 172.21.15.114:0/4183274571 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3374007bd0 con 0x7f337c148b20 2024-04-28T13:08:03.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.586+0000 7f33637fe640 1 --2- 172.21.15.114:0/4183274571 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f336806c8f0 0x7f336806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:03.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.586+0000 7f33637fe640 1 -- 172.21.15.114:0/4183274571 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f33740acb40 con 0x7f337c148b20 2024-04-28T13:08:03.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.587+0000 7f337affd640 1 --2- 172.21.15.114:0/4183274571 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f336806c8f0 0x7f336806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:03.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.587+0000 7f337affd640 1 --2- 172.21.15.114:0/4183274571 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f336806c8f0 0x7f336806edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f336c00a990 tx=0x7f336c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:03.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.591+0000 7f33637fe640 1 -- 172.21.15.114:0/4183274571 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f337407aef0 con 0x7f337c148b20 2024-04-28T13:08:03.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.775+0000 7f3381659640 1 -- 172.21.15.114:0/4183274571 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f337c071220 con 0x7f337c148b20 2024-04-28T13:08:03.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.776+0000 7f33637fe640 1 -- 172.21.15.114:0/4183274571 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f337407a7f0 con 0x7f337c148b20 2024-04-28T13:08:03.777 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-28T13:08:03.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.778+0000 7f3381659640 1 -- 172.21.15.114:0/4183274571 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f336806c8f0 msgr2=0x7f336806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:03.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.778+0000 7f3381659640 1 --2- 172.21.15.114:0/4183274571 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f336806c8f0 0x7f336806edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f336c00a990 tx=0x7f336c008040 comp rx=0 tx=0).stop 2024-04-28T13:08:03.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.778+0000 7f3381659640 1 -- 172.21.15.114:0/4183274571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c148b20 msgr2=0x7f337c161360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:03.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.778+0000 7f3381659640 1 --2- 172.21.15.114:0/4183274571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c148b20 0x7f337c161360 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f337402ace0 tx=0x7f3374004a40 comp rx=0 tx=0).stop 2024-04-28T13:08:03.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.778+0000 7f3381659640 1 -- 172.21.15.114:0/4183274571 shutdown_connections 2024-04-28T13:08:03.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.778+0000 7f3381659640 1 --2- 172.21.15.114:0/4183274571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c148b20 0x7f337c161360 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:03.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.778+0000 7f3381659640 1 --2- 172.21.15.114:0/4183274571 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f337c148600 0x7f337c15ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:03.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.778+0000 7f3381659640 1 --2- 172.21.15.114:0/4183274571 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f336806c8f0 0x7f336806edb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:03.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.778+0000 7f3381659640 1 --2- 172.21.15.114:0/4183274571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f337c0d3630 0x7f337c0cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:03.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.778+0000 7f3381659640 1 -- 172.21.15.114:0/4183274571 >> 172.21.15.114:0/4183274571 conn(0x7f337c0b83a0 msgr2=0x7f337c146930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:03.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.778+0000 7f3381659640 1 -- 172.21.15.114:0/4183274571 shutdown_connections 2024-04-28T13:08:03.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.778+0000 7f3381659640 1 -- 172.21.15.114:0/4183274571 wait complete. 2024-04-28T13:08:03.790 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-28T13:08:03.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.890+0000 7f159e0c5640 1 Processor -- start 2024-04-28T13:08:03.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.891+0000 7f159e0c5640 1 -- start start 2024-04-28T13:08:03.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.891+0000 7f159e0c5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1598145e70 0x7f1598146a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:03.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.891+0000 7f159e0c5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f159806c350 0x7f159806c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:03.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.891+0000 7f159e0c5640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15980d1ba0 con 0x7f15980d1380 2024-04-28T13:08:03.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.891+0000 7f159e0c5640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f159806f470 con 0x7f1598145e70 2024-04-28T13:08:03.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.891+0000 7f159e0c5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f159806f750 con 0x7f159806c350 2024-04-28T13:08:03.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.891+0000 7f15977fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1598145e70 0x7f1598146a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:03.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.891+0000 7f15977fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1598145e70 0x7f1598146a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36420/0 (socket says 172.21.15.114:36420) 2024-04-28T13:08:03.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.892+0000 7f15977fe640 1 -- 172.21.15.114:0/327876189 learned_addr learned my addr 172.21.15.114:0/327876189 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:03.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.892+0000 7f1597fff640 1 --2- 172.21.15.114:0/327876189 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f159806c350 0x7f159806c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:03.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.892+0000 7f15977fe640 1 -- 172.21.15.114:0/327876189 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f159806c350 msgr2=0x7f159806c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:03.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.892+0000 7f15977fe640 1 --2- 172.21.15.114:0/327876189 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f159806c350 0x7f159806c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:03.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.892+0000 7f15977fe640 1 -- 172.21.15.114:0/327876189 >> v1:172.21.15.134:6789/0 conn(0x7f15980d1380 legacy=0x7f1598070230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:03.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.892+0000 7f15977fe640 1 -- 172.21.15.114:0/327876189 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f159806fa30 con 0x7f1598145e70 2024-04-28T13:08:03.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.892+0000 7f1597fff640 1 --2- 172.21.15.114:0/327876189 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f159806c350 0x7f159806c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:03.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.892+0000 7f15977fe640 1 --2- 172.21.15.114:0/327876189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1598145e70 0x7f1598146a30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1588009870 tx=0x7f158802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd51b4dcc948774 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:03.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.893+0000 7f15967fc640 1 -- 172.21.15.114:0/327876189 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1588037070 con 0x7f1598145e70 2024-04-28T13:08:03.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.893+0000 7f15967fc640 1 -- 172.21.15.114:0/327876189 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1588032440 con 0x7f1598145e70 2024-04-28T13:08:03.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.893+0000 7f15967fc640 1 -- 172.21.15.114:0/327876189 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1588032810 con 0x7f1598145e70 2024-04-28T13:08:03.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.893+0000 7f159e0c5640 1 -- 172.21.15.114:0/327876189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1598145e70 msgr2=0x7f1598146a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:03.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.893+0000 7f159e0c5640 1 --2- 172.21.15.114:0/327876189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1598145e70 0x7f1598146a30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1588009870 tx=0x7f158802a270 comp rx=0 tx=0).stop 2024-04-28T13:08:03.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.893+0000 7f159e0c5640 1 -- 172.21.15.114:0/327876189 shutdown_connections 2024-04-28T13:08:03.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.893+0000 7f159e0c5640 1 --2- 172.21.15.114:0/327876189 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f159806c350 0x7f159806c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:03.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.893+0000 7f159e0c5640 1 --2- 172.21.15.114:0/327876189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1598145e70 0x7f1598146a30 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:03.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.893+0000 7f159e0c5640 1 -- 172.21.15.114:0/327876189 >> 172.21.15.114:0/327876189 conn(0x7f159806d460 msgr2=0x7f159806d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:03.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.893+0000 7f159e0c5640 1 -- 172.21.15.114:0/327876189 shutdown_connections 2024-04-28T13:08:03.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.893+0000 7f159e0c5640 1 -- 172.21.15.114:0/327876189 wait complete. 2024-04-28T13:08:03.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.894+0000 7f159e0c5640 1 Processor -- start 2024-04-28T13:08:03.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.895+0000 7f159e0c5640 1 -- start start 2024-04-28T13:08:03.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.895+0000 7f159e0c5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f159806c350 0x7f15981f5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:03.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.895+0000 7f159e0c5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15980d1380 0x7f15980ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:03.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.895+0000 7f159e0c5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1598145e70 0x7f159815b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:03.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.895+0000 7f159e0c5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f15980d17f0 con 0x7f1598145e70 2024-04-28T13:08:03.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.895+0000 7f159e0c5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1598146250 con 0x7f15980d1380 2024-04-28T13:08:03.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.895+0000 7f159e0c5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f15980caa00 con 0x7f159806c350 2024-04-28T13:08:03.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.895+0000 7f1597fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1598145e70 0x7f159815b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:03.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.895+0000 7f1597fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1598145e70 0x7f159815b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36424/0 (socket says 172.21.15.114:36424) 2024-04-28T13:08:03.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.895+0000 7f1597fff640 1 -- 172.21.15.114:0/4071183777 learned_addr learned my addr 172.21.15.114:0/4071183777 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:03.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.896+0000 7f1596ffd640 1 --2- 172.21.15.114:0/4071183777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15980d1380 0x7f15980ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:03.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.896+0000 7f15977fe640 1 --2- 172.21.15.114:0/4071183777 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f159806c350 0x7f15981f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:03.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.896+0000 7f1597fff640 1 -- 172.21.15.114:0/4071183777 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f159806c350 msgr2=0x7f15981f5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:03.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.896+0000 7f1597fff640 1 --2- 172.21.15.114:0/4071183777 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f159806c350 0x7f15981f5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:03.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.896+0000 7f1597fff640 1 -- 172.21.15.114:0/4071183777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15980d1380 msgr2=0x7f15980ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:03.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.896+0000 7f1597fff640 1 --2- 172.21.15.114:0/4071183777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15980d1380 0x7f15980ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:03.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.896+0000 7f1597fff640 1 -- 172.21.15.114:0/4071183777 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15981f4e70 con 0x7f1598145e70 2024-04-28T13:08:03.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.896+0000 7f1597fff640 1 --2- 172.21.15.114:0/4071183777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1598145e70 0x7f159815b7a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1590007f20 tx=0x7f159000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:03.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.896+0000 7f157ffff640 1 -- 172.21.15.114:0/4071183777 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159001a070 con 0x7f1598145e70 2024-04-28T13:08:03.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.896+0000 7f157ffff640 1 -- 172.21.15.114:0/4071183777 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1590003b90 con 0x7f1598145e70 2024-04-28T13:08:03.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.896+0000 7f159e0c5640 1 -- 172.21.15.114:0/4071183777 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15981f5150 con 0x7f1598145e70 2024-04-28T13:08:03.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.896+0000 7f157ffff640 1 -- 172.21.15.114:0/4071183777 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1590004030 con 0x7f1598145e70 2024-04-28T13:08:03.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.896+0000 7f159e0c5640 1 -- 172.21.15.114:0/4071183777 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15981f5710 con 0x7f1598145e70 2024-04-28T13:08:03.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.897+0000 7f159e0c5640 1 -- 172.21.15.114:0/4071183777 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f159806a3d0 con 0x7f1598145e70 2024-04-28T13:08:03.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.898+0000 7f157ffff640 1 -- 172.21.15.114:0/4071183777 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f159001d070 con 0x7f1598145e70 2024-04-28T13:08:03.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.898+0000 7f157ffff640 1 --2- 172.21.15.114:0/4071183777 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f158406c8f0 0x7f158406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:03.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.898+0000 7f157ffff640 1 -- 172.21.15.114:0/4071183777 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f159008bdb0 con 0x7f1598145e70 2024-04-28T13:08:03.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.898+0000 7f15977fe640 1 --2- 172.21.15.114:0/4071183777 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f158406c8f0 0x7f158406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:03.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.899+0000 7f15977fe640 1 --2- 172.21.15.114:0/4071183777 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f158406c8f0 0x7f158406edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1588034000 tx=0x7f158802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:03.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:03.903+0000 7f157ffff640 1 -- 172.21.15.114:0/4071183777 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1590010070 con 0x7f1598145e70 2024-04-28T13:08:04.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.082+0000 7f159e0c5640 1 -- 172.21.15.114:0/4071183777 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1598144f10 con 0x7f1598145e70 2024-04-28T13:08:04.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.082+0000 7f157ffff640 1 -- 172.21.15.114:0/4071183777 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f1590059b90 con 0x7f1598145e70 2024-04-28T13:08:04.083 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-04-28T13:08:04.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.084+0000 7f159e0c5640 1 -- 172.21.15.114:0/4071183777 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f158406c8f0 msgr2=0x7f158406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:04.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.084+0000 7f159e0c5640 1 --2- 172.21.15.114:0/4071183777 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f158406c8f0 0x7f158406edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1588034000 tx=0x7f158802e000 comp rx=0 tx=0).stop 2024-04-28T13:08:04.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.084+0000 7f159e0c5640 1 -- 172.21.15.114:0/4071183777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1598145e70 msgr2=0x7f159815b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:04.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.084+0000 7f159e0c5640 1 --2- 172.21.15.114:0/4071183777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1598145e70 0x7f159815b7a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1590007f20 tx=0x7f159000d560 comp rx=0 tx=0).stop 2024-04-28T13:08:04.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.085+0000 7f159e0c5640 1 -- 172.21.15.114:0/4071183777 shutdown_connections 2024-04-28T13:08:04.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.085+0000 7f159e0c5640 1 --2- 172.21.15.114:0/4071183777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1598145e70 0x7f159815b7a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:04.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.085+0000 7f159e0c5640 1 --2- 172.21.15.114:0/4071183777 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f158406c8f0 0x7f158406edb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:04.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.085+0000 7f159e0c5640 1 --2- 172.21.15.114:0/4071183777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15980d1380 0x7f15980ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:04.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.085+0000 7f159e0c5640 1 --2- 172.21.15.114:0/4071183777 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f159806c350 0x7f15981f5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:04.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.085+0000 7f159e0c5640 1 -- 172.21.15.114:0/4071183777 >> 172.21.15.114:0/4071183777 conn(0x7f159806d460 msgr2=0x7f159806d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:04.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.085+0000 7f159e0c5640 1 -- 172.21.15.114:0/4071183777 shutdown_connections 2024-04-28T13:08:04.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.085+0000 7f159e0c5640 1 -- 172.21.15.114:0/4071183777 wait complete. 2024-04-28T13:08:04.096 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-28T13:08:04.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.195+0000 7f7851c2a640 1 Processor -- start 2024-04-28T13:08:04.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.195+0000 7f7851c2a640 1 -- start start 2024-04-28T13:08:04.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.195+0000 7f7851c2a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f784c073400 0x7f784c0b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:04.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.195+0000 7f7851c2a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f784c070280 0x7f784c1455f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:04.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.196+0000 7f7851c2a640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f784c0b6c50 con 0x7f784c0737e0 2024-04-28T13:08:04.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.196+0000 7f7851c2a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f784c0b60d0 con 0x7f784c073400 2024-04-28T13:08:04.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.196+0000 7f7851c2a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f784c0b63b0 con 0x7f784c070280 2024-04-28T13:08:04.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.196+0000 7f784bfff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f784c0737e0 0x7f784c15fd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46824/0 (socket says 172.21.15.114:46824) 2024-04-28T13:08:04.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.196+0000 7f784bfff640 1 -- 172.21.15.114:0/684603926 learned_addr learned my addr 172.21.15.114:0/684603926 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:04.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.196+0000 7f784a7fc640 1 -- 172.21.15.114:0/684603926 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4065540474 0 0) 0x7f784c0b6c50 con 0x7f784c0737e0 2024-04-28T13:08:04.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.196+0000 7f784a7fc640 1 -- 172.21.15.114:0/684603926 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7834003520 con 0x7f784c0737e0 2024-04-28T13:08:04.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.196+0000 7f784affd640 1 --2- 172.21.15.114:0/684603926 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f784c070280 0x7f784c1455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:04.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.196+0000 7f784b7fe640 1 --2- 172.21.15.114:0/684603926 >> v2:172.21.15.134:3300/0 conn(0x7f784c073400 0x7f784c0b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:04.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.196+0000 7f784a7fc640 1 -- 172.21.15.114:0/684603926 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4107235461 0 0) 0x7f7834003520 con 0x7f784c0737e0 2024-04-28T13:08:04.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.196+0000 7f784a7fc640 1 -- 172.21.15.114:0/684603926 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f784c070280 msgr2=0x7f784c1455f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:04.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.196+0000 7f784a7fc640 1 --2- 172.21.15.114:0/684603926 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f784c070280 0x7f784c1455f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:04.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.196+0000 7f784a7fc640 1 -- 172.21.15.114:0/684603926 >> v2:172.21.15.134:3300/0 conn(0x7f784c073400 msgr2=0x7f784c0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:04.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.196+0000 7f784a7fc640 1 --2- 172.21.15.114:0/684603926 >> v2:172.21.15.134:3300/0 conn(0x7f784c073400 0x7f784c0b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:04.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.196+0000 7f784a7fc640 1 -- 172.21.15.114:0/684603926 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f784c0b6690 con 0x7f784c0737e0 2024-04-28T13:08:04.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.196+0000 7f784a7fc640 1 -- 172.21.15.114:0/684603926 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f78440019f0 con 0x7f784c0737e0 2024-04-28T13:08:04.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.196+0000 7f784a7fc640 1 -- 172.21.15.114:0/684603926 >> v1:172.21.15.114:6789/0 conn(0x7f784c0737e0 legacy=0x7f784c15fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:04.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.196+0000 7f784a7fc640 1 --2- 172.21.15.114:0/684603926 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78340039b0 0x7f7834003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:04.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.196+0000 7f784a7fc640 1 --2- 172.21.15.114:0/684603926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7834004800 0x7f7834004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:04.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.196+0000 7f784a7fc640 1 --2- 172.21.15.114:0/684603926 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f784c070280 0x7f78340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:04.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.196+0000 7f784a7fc640 1 -- 172.21.15.114:0/684603926 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f784c0b60d0 con 0x7f78340039b0 2024-04-28T13:08:04.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.196+0000 7f784a7fc640 1 -- 172.21.15.114:0/684603926 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f784c0b63b0 con 0x7f7834004800 2024-04-28T13:08:04.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.196+0000 7f784a7fc640 1 -- 172.21.15.114:0/684603926 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f783400ba70 con 0x7f784c070280 2024-04-28T13:08:04.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.196+0000 7f784b7fe640 1 --2- 172.21.15.114:0/684603926 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78340039b0 0x7f7834003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:04.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.196+0000 7f784affd640 1 --2- 172.21.15.114:0/684603926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7834004800 0x7f7834004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:04.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.196+0000 7f784bfff640 1 --2- 172.21.15.114:0/684603926 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f784c070280 0x7f78340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:04.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.197+0000 7f784b7fe640 1 -- 172.21.15.114:0/684603926 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f784c070280 msgr2=0x7f78340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:04.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.197+0000 7f784b7fe640 1 --2- 172.21.15.114:0/684603926 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f784c070280 0x7f78340051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:04.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.197+0000 7f784b7fe640 1 -- 172.21.15.114:0/684603926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7834004800 msgr2=0x7f7834004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:04.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.197+0000 7f784b7fe640 1 --2- 172.21.15.114:0/684603926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7834004800 0x7f7834004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:04.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.197+0000 7f784b7fe640 1 -- 172.21.15.114:0/684603926 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7834003520 con 0x7f78340039b0 2024-04-28T13:08:04.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.197+0000 7f784affd640 1 --2- 172.21.15.114:0/684603926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7834004800 0x7f7834004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:04.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.197+0000 7f784b7fe640 1 --2- 172.21.15.114:0/684603926 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78340039b0 0x7f7834003dd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f783c00ba00 tx=0x7f7834005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd42194b481065c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:04.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.197+0000 7f784a7fc640 1 -- 172.21.15.114:0/684603926 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c030070 con 0x7f78340039b0 2024-04-28T13:08:04.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.197+0000 7f784a7fc640 1 -- 172.21.15.114:0/684603926 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f783c02adb0 con 0x7f78340039b0 2024-04-28T13:08:04.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.197+0000 7f784a7fc640 1 -- 172.21.15.114:0/684603926 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c00b600 con 0x7f78340039b0 2024-04-28T13:08:04.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.198+0000 7f7851c2a640 1 -- 172.21.15.114:0/684603926 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78340039b0 msgr2=0x7f7834003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:04.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.198+0000 7f7851c2a640 1 --2- 172.21.15.114:0/684603926 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78340039b0 0x7f7834003dd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f783c00ba00 tx=0x7f7834005830 comp rx=0 tx=0).stop 2024-04-28T13:08:04.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.198+0000 7f784bfff640 1 -- 172.21.15.114:0/684603926 reap_dead start 2024-04-28T13:08:04.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.198+0000 7f7851c2a640 1 -- 172.21.15.114:0/684603926 shutdown_connections 2024-04-28T13:08:04.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.198+0000 7f7851c2a640 1 -- 172.21.15.114:0/684603926 >> 172.21.15.114:0/684603926 conn(0x7f784c06d460 msgr2=0x7f784c06d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:04.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.198+0000 7f7851c2a640 1 -- 172.21.15.114:0/684603926 shutdown_connections 2024-04-28T13:08:04.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.198+0000 7f7851c2a640 1 -- 172.21.15.114:0/684603926 wait complete. 2024-04-28T13:08:04.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.199+0000 7f7851c2a640 1 Processor -- start 2024-04-28T13:08:04.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.199+0000 7f7851c2a640 1 -- start start 2024-04-28T13:08:04.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.200+0000 7f7851c2a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78340039b0 0x7f784c1e5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:04.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.200+0000 7f7851c2a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f784c0b0a10 0x7f784c0b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:04.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.200+0000 7f7851c2a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f784c1337a0 0x7f784c133c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:04.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.200+0000 7f7851c2a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f784c0d0b70 con 0x7f784c0b0a10 2024-04-28T13:08:04.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.200+0000 7f7851c2a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f784c0b5de0 con 0x7f784c1337a0 2024-04-28T13:08:04.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.200+0000 7f7851c2a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f784c0d0cf0 con 0x7f78340039b0 2024-04-28T13:08:04.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.200+0000 7f784affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f784c0b0a10 0x7f784c0b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:04.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.200+0000 7f784affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f784c0b0a10 0x7f784c0b0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36446/0 (socket says 172.21.15.114:36446) 2024-04-28T13:08:04.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.200+0000 7f784affd640 1 -- 172.21.15.114:0/651091433 learned_addr learned my addr 172.21.15.114:0/651091433 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:04.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.200+0000 7f784bfff640 1 --2- 172.21.15.114:0/651091433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f784c1337a0 0x7f784c133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:04.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.200+0000 7f784b7fe640 1 --2- 172.21.15.114:0/651091433 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78340039b0 0x7f784c1e5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:04.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.200+0000 7f784affd640 1 -- 172.21.15.114:0/651091433 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78340039b0 msgr2=0x7f784c1e5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:04.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.200+0000 7f784affd640 1 --2- 172.21.15.114:0/651091433 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78340039b0 0x7f784c1e5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:04.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.200+0000 7f784affd640 1 -- 172.21.15.114:0/651091433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f784c1337a0 msgr2=0x7f784c133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:04.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.201+0000 7f784affd640 1 --2- 172.21.15.114:0/651091433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f784c1337a0 0x7f784c133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:04.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.201+0000 7f784affd640 1 -- 172.21.15.114:0/651091433 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f784c134160 con 0x7f784c0b0a10 2024-04-28T13:08:04.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.201+0000 7f784affd640 1 --2- 172.21.15.114:0/651091433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f784c0b0a10 0x7f784c0b0e50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7840006a90 tx=0x7f7840004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:04.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.201+0000 7f7833fff640 1 -- 172.21.15.114:0/651091433 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7840019020 con 0x7f784c0b0a10 2024-04-28T13:08:04.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.201+0000 7f7833fff640 1 -- 172.21.15.114:0/651091433 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7840014870 con 0x7f784c0b0a10 2024-04-28T13:08:04.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.201+0000 7f7833fff640 1 -- 172.21.15.114:0/651091433 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7840014c40 con 0x7f784c0b0a10 2024-04-28T13:08:04.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.201+0000 7f7851c2a640 1 -- 172.21.15.114:0/651091433 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f784c1343d0 con 0x7f784c0b0a10 2024-04-28T13:08:04.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.201+0000 7f7851c2a640 1 -- 172.21.15.114:0/651091433 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f784c134990 con 0x7f784c0b0a10 2024-04-28T13:08:04.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.202+0000 7f7851c2a640 1 -- 172.21.15.114:0/651091433 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f784c06a3d0 con 0x7f784c0b0a10 2024-04-28T13:08:04.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.202+0000 7f7833fff640 1 -- 172.21.15.114:0/651091433 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f784001c020 con 0x7f784c0b0a10 2024-04-28T13:08:04.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.202+0000 7f7833fff640 1 --2- 172.21.15.114:0/651091433 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f783806c920 0x7f783806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:04.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.203+0000 7f7833fff640 1 -- 172.21.15.114:0/651091433 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f784008c0e0 con 0x7f784c0b0a10 2024-04-28T13:08:04.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.203+0000 7f784b7fe640 1 --2- 172.21.15.114:0/651091433 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f783806c920 0x7f783806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:04.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.203+0000 7f784b7fe640 1 --2- 172.21.15.114:0/651091433 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f783806c920 0x7f783806ede0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f78340057e0 tx=0x7f783c030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:04.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.207+0000 7f7833fff640 1 -- 172.21.15.114:0/651091433 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7840023030 con 0x7f784c0b0a10 2024-04-28T13:08:04.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.389+0000 7f7851c2a640 1 -- 172.21.15.114:0/651091433 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f784c0b1930 con 0x7f784c0b0a10 2024-04-28T13:08:04.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.389+0000 7f7833fff640 1 -- 172.21.15.114:0/651091433 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f7840025300 con 0x7f784c0b0a10 2024-04-28T13:08:04.390 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-04-28T13:08:04.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.391+0000 7f7851c2a640 1 -- 172.21.15.114:0/651091433 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f783806c920 msgr2=0x7f783806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:04.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.391+0000 7f7851c2a640 1 --2- 172.21.15.114:0/651091433 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f783806c920 0x7f783806ede0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f78340057e0 tx=0x7f783c030000 comp rx=0 tx=0).stop 2024-04-28T13:08:04.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.391+0000 7f7851c2a640 1 -- 172.21.15.114:0/651091433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f784c0b0a10 msgr2=0x7f784c0b0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:04.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.391+0000 7f7851c2a640 1 --2- 172.21.15.114:0/651091433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f784c0b0a10 0x7f784c0b0e50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7840006a90 tx=0x7f7840004610 comp rx=0 tx=0).stop 2024-04-28T13:08:04.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.391+0000 7f7851c2a640 1 -- 172.21.15.114:0/651091433 shutdown_connections 2024-04-28T13:08:04.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.391+0000 7f7851c2a640 1 --2- 172.21.15.114:0/651091433 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f783806c920 0x7f783806ede0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:04.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.391+0000 7f7851c2a640 1 --2- 172.21.15.114:0/651091433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f784c1337a0 0x7f784c133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:04.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.391+0000 7f7851c2a640 1 --2- 172.21.15.114:0/651091433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f784c0b0a10 0x7f784c0b0e50 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:04.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.391+0000 7f7851c2a640 1 --2- 172.21.15.114:0/651091433 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78340039b0 0x7f784c1e5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:04.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.391+0000 7f7851c2a640 1 -- 172.21.15.114:0/651091433 >> 172.21.15.114:0/651091433 conn(0x7f784c06d460 msgr2=0x7f784c0b3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:04.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.391+0000 7f7851c2a640 1 -- 172.21.15.114:0/651091433 shutdown_connections 2024-04-28T13:08:04.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.391+0000 7f7851c2a640 1 -- 172.21.15.114:0/651091433 wait complete. 2024-04-28T13:08:04.403 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-28T13:08:04.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.499+0000 7f438f59e640 1 Processor -- start 2024-04-28T13:08:04.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.500+0000 7f438f59e640 1 -- start start 2024-04-28T13:08:04.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.500+0000 7f438f59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4390160390 0x7f439006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:04.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.500+0000 7f438f59e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f439006c350 0x7f439006c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:04.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.501+0000 7f438f59e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4390070bc0 con 0x7f439015d4a0 2024-04-28T13:08:04.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.501+0000 7f438f59e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f4390070e60 con 0x7f4390160390 2024-04-28T13:08:04.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.501+0000 7f438f59e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f4390071140 con 0x7f439006c350 2024-04-28T13:08:04.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.501+0000 7f438e59c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4390160390 0x7f439006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:04.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.501+0000 7f438e59c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4390160390 0x7f439006ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36454/0 (socket says 172.21.15.114:36454) 2024-04-28T13:08:04.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.501+0000 7f438e59c640 1 -- 172.21.15.114:0/3233667614 learned_addr learned my addr 172.21.15.114:0/3233667614 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:04.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.501+0000 7f438dd9b640 1 --2- 172.21.15.114:0/3233667614 >> v2:172.21.15.134:3300/0 conn(0x7f439006c350 0x7f439006c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:04.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.501+0000 7f438e59c640 1 -- 172.21.15.114:0/3233667614 >> v2:172.21.15.134:3300/0 conn(0x7f439006c350 msgr2=0x7f439006c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:04.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.501+0000 7f438e59c640 1 --2- 172.21.15.114:0/3233667614 >> v2:172.21.15.134:3300/0 conn(0x7f439006c350 0x7f439006c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:04.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.501+0000 7f438e59c640 1 -- 172.21.15.114:0/3233667614 >> v1:172.21.15.134:6789/0 conn(0x7f439015d4a0 legacy=0x7f439015d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:04.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.501+0000 7f438e59c640 1 -- 172.21.15.114:0/3233667614 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4390071420 con 0x7f4390160390 2024-04-28T13:08:04.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.501+0000 7f438dd9b640 1 --2- 172.21.15.114:0/3233667614 >> v2:172.21.15.134:3300/0 conn(0x7f439006c350 0x7f439006c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:04.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.502+0000 7f438e59c640 1 --2- 172.21.15.114:0/3233667614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4390160390 0x7f439006ede0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4388009870 tx=0x7f438802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be4cfd8ce8034226 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:04.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.502+0000 7f438d59a640 1 -- 172.21.15.114:0/3233667614 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388037070 con 0x7f4390160390 2024-04-28T13:08:04.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.502+0000 7f438d59a640 1 -- 172.21.15.114:0/3233667614 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4388032440 con 0x7f4390160390 2024-04-28T13:08:04.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.502+0000 7f438d59a640 1 -- 172.21.15.114:0/3233667614 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388032810 con 0x7f4390160390 2024-04-28T13:08:04.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.503+0000 7f438f59e640 1 -- 172.21.15.114:0/3233667614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4390160390 msgr2=0x7f439006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:04.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.503+0000 7f438f59e640 1 --2- 172.21.15.114:0/3233667614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4390160390 0x7f439006ede0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4388009870 tx=0x7f438802a270 comp rx=0 tx=0).stop 2024-04-28T13:08:04.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.503+0000 7f438f59e640 1 -- 172.21.15.114:0/3233667614 shutdown_connections 2024-04-28T13:08:04.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.503+0000 7f438f59e640 1 --2- 172.21.15.114:0/3233667614 >> v2:172.21.15.134:3300/0 conn(0x7f439006c350 0x7f439006c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:04.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.503+0000 7f438f59e640 1 --2- 172.21.15.114:0/3233667614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4390160390 0x7f439006ede0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:04.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.503+0000 7f438f59e640 1 -- 172.21.15.114:0/3233667614 >> 172.21.15.114:0/3233667614 conn(0x7f43900d1d70 msgr2=0x7f43900d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:04.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.503+0000 7f438f59e640 1 -- 172.21.15.114:0/3233667614 shutdown_connections 2024-04-28T13:08:04.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.503+0000 7f438f59e640 1 -- 172.21.15.114:0/3233667614 wait complete. 2024-04-28T13:08:04.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.504+0000 7f438f59e640 1 Processor -- start 2024-04-28T13:08:04.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.504+0000 7f438f59e640 1 -- start start 2024-04-28T13:08:04.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.505+0000 7f438f59e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f439006c350 0x7f43901f68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:04.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.505+0000 7f438f59e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f439015d4a0 0x7f439014a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:04.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.505+0000 7f438f59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4390160390 0x7f43900d0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:04.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.505+0000 7f438f59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f439006f4a0 con 0x7f4390160390 2024-04-28T13:08:04.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.505+0000 7f438f59e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f439006f320 con 0x7f439015d4a0 2024-04-28T13:08:04.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.505+0000 7f438f59e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f4390074120 con 0x7f439006c350 2024-04-28T13:08:04.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.506+0000 7f438ed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4390160390 0x7f43900d0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:04.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.506+0000 7f438ed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4390160390 0x7f43900d0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36462/0 (socket says 172.21.15.114:36462) 2024-04-28T13:08:04.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.506+0000 7f438ed9d640 1 -- 172.21.15.114:0/126437583 learned_addr learned my addr 172.21.15.114:0/126437583 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:04.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.506+0000 7f438e59c640 1 --2- 172.21.15.114:0/126437583 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f439006c350 0x7f43901f68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:04.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.506+0000 7f438dd9b640 1 --2- 172.21.15.114:0/126437583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f439015d4a0 0x7f439014a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:04.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.506+0000 7f438ed9d640 1 -- 172.21.15.114:0/126437583 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f439006c350 msgr2=0x7f43901f68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:04.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.506+0000 7f438ed9d640 1 --2- 172.21.15.114:0/126437583 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f439006c350 0x7f43901f68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:04.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.506+0000 7f438ed9d640 1 -- 172.21.15.114:0/126437583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f439015d4a0 msgr2=0x7f439014a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:04.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.506+0000 7f438ed9d640 1 --2- 172.21.15.114:0/126437583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f439015d4a0 0x7f439014a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:04.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.506+0000 7f438ed9d640 1 -- 172.21.15.114:0/126437583 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43901f6e30 con 0x7f4390160390 2024-04-28T13:08:04.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.506+0000 7f438ed9d640 1 --2- 172.21.15.114:0/126437583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4390160390 0x7f43900d0320 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f438000c780 tx=0x7f438000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:04.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.506+0000 7f437effd640 1 -- 172.21.15.114:0/126437583 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4380004b60 con 0x7f4390160390 2024-04-28T13:08:04.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.506+0000 7f437effd640 1 -- 172.21.15.114:0/126437583 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4380004d00 con 0x7f4390160390 2024-04-28T13:08:04.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.506+0000 7f438f59e640 1 -- 172.21.15.114:0/126437583 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43901f2e20 con 0x7f4390160390 2024-04-28T13:08:04.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.506+0000 7f437effd640 1 -- 172.21.15.114:0/126437583 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438000aa90 con 0x7f4390160390 2024-04-28T13:08:04.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.506+0000 7f438f59e640 1 -- 172.21.15.114:0/126437583 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43901f33e0 con 0x7f4390160390 2024-04-28T13:08:04.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.508+0000 7f438f59e640 1 -- 172.21.15.114:0/126437583 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4390076810 con 0x7f4390160390 2024-04-28T13:08:04.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.508+0000 7f437effd640 1 -- 172.21.15.114:0/126437583 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f438000ac30 con 0x7f4390160390 2024-04-28T13:08:04.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.508+0000 7f437effd640 1 --2- 172.21.15.114:0/126437583 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f437006c8f0 0x7f437006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:04.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.508+0000 7f437effd640 1 -- 172.21.15.114:0/126437583 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f438008bca0 con 0x7f4390160390 2024-04-28T13:08:04.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.508+0000 7f438e59c640 1 --2- 172.21.15.114:0/126437583 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f437006c8f0 0x7f437006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:04.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.509+0000 7f438e59c640 1 --2- 172.21.15.114:0/126437583 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f437006c8f0 0x7f437006edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4388034000 tx=0x7f438802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:04.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.513+0000 7f437effd640 1 -- 172.21.15.114:0/126437583 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4380020070 con 0x7f4390160390 2024-04-28T13:08:04.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.698+0000 7f438f59e640 1 -- 172.21.15.114:0/126437583 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f439006cca0 con 0x7f4390160390 2024-04-28T13:08:04.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.699+0000 7f437effd640 1 -- 172.21.15.114:0/126437583 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f43901f6e30 con 0x7f4390160390 2024-04-28T13:08:04.699 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-04-28T13:08:04.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.701+0000 7f438f59e640 1 -- 172.21.15.114:0/126437583 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f437006c8f0 msgr2=0x7f437006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:04.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.701+0000 7f438f59e640 1 --2- 172.21.15.114:0/126437583 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f437006c8f0 0x7f437006edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4388034000 tx=0x7f438802e000 comp rx=0 tx=0).stop 2024-04-28T13:08:04.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.701+0000 7f438f59e640 1 -- 172.21.15.114:0/126437583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4390160390 msgr2=0x7f43900d0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:04.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.701+0000 7f438f59e640 1 --2- 172.21.15.114:0/126437583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4390160390 0x7f43900d0320 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f438000c780 tx=0x7f438000cc40 comp rx=0 tx=0).stop 2024-04-28T13:08:04.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.701+0000 7f438f59e640 1 -- 172.21.15.114:0/126437583 shutdown_connections 2024-04-28T13:08:04.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.701+0000 7f438f59e640 1 --2- 172.21.15.114:0/126437583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4390160390 0x7f43900d0320 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:04.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.701+0000 7f438f59e640 1 --2- 172.21.15.114:0/126437583 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f437006c8f0 0x7f437006edb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:04.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.701+0000 7f438f59e640 1 --2- 172.21.15.114:0/126437583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f439015d4a0 0x7f439014a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:04.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.701+0000 7f438f59e640 1 --2- 172.21.15.114:0/126437583 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f439006c350 0x7f43901f68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:04.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.701+0000 7f438f59e640 1 -- 172.21.15.114:0/126437583 >> 172.21.15.114:0/126437583 conn(0x7f43900d1d70 msgr2=0x7f439015e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:04.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.701+0000 7f438f59e640 1 -- 172.21.15.114:0/126437583 shutdown_connections 2024-04-28T13:08:04.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.701+0000 7f438f59e640 1 -- 172.21.15.114:0/126437583 wait complete. 2024-04-28T13:08:04.712 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-04-28T13:08:04.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:04.712 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-04-28T13:08:04.743 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2024-04-28T13:08:04.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:04.743 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-28T13:08:04.799 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-28T13:08:04.800 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-28T13:08:04.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.895+0000 7fc6ccd4e640 1 Processor -- start 2024-04-28T13:08:04.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.896+0000 7fc6ccd4e640 1 -- start start 2024-04-28T13:08:04.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.896+0000 7fc6ccd4e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc6c8153330 0x7fc6c815d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:04.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.896+0000 7fc6ccd4e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc6c80723d0 0x7fc6c8073bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:04.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.896+0000 7fc6ccd4e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6c8153710 con 0x7fc6c80740f0 2024-04-28T13:08:04.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.896+0000 7fc6ccd4e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fc6c8074500 con 0x7fc6c8153330 2024-04-28T13:08:04.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.896+0000 7fc6ccd4e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc6c80b4a60 con 0x7fc6c80723d0 2024-04-28T13:08:04.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.896+0000 7fc6c659c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc6c8153330 0x7fc6c815d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:04.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.897+0000 7fc6c659c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc6c8153330 0x7fc6c815d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36478/0 (socket says 172.21.15.114:36478) 2024-04-28T13:08:04.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.897+0000 7fc6c659c640 1 -- 172.21.15.114:0/158974220 learned_addr learned my addr 172.21.15.114:0/158974220 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:04.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.897+0000 7fc6bffff640 1 --2- 172.21.15.114:0/158974220 >> v2:172.21.15.134:3300/0 conn(0x7fc6c80723d0 0x7fc6c8073bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:04.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.897+0000 7fc6c659c640 1 -- 172.21.15.114:0/158974220 >> v2:172.21.15.134:3300/0 conn(0x7fc6c80723d0 msgr2=0x7fc6c8073bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:04.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.897+0000 7fc6c659c640 1 --2- 172.21.15.114:0/158974220 >> v2:172.21.15.134:3300/0 conn(0x7fc6c80723d0 0x7fc6c8073bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:04.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.897+0000 7fc6c659c640 1 -- 172.21.15.114:0/158974220 >> v1:172.21.15.134:6789/0 conn(0x7fc6c80740f0 legacy=0x7fc6c815fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:04.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.897+0000 7fc6c659c640 1 -- 172.21.15.114:0/158974220 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c8072990 con 0x7fc6c8153330 2024-04-28T13:08:04.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.897+0000 7fc6c659c640 1 --2- 172.21.15.114:0/158974220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6c8153330 0x7fc6c815d2e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8074790 tx=0x7fc6b802c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b8f1e1013e61b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:04.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.898+0000 7fc6c5d9b640 1 -- 172.21.15.114:0/158974220 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8032710 con 0x7fc6c8153330 2024-04-28T13:08:04.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.898+0000 7fc6c5d9b640 1 -- 172.21.15.114:0/158974220 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6b80328b0 con 0x7fc6c8153330 2024-04-28T13:08:04.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.898+0000 7fc6c5d9b640 1 -- 172.21.15.114:0/158974220 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8032ca0 con 0x7fc6c8153330 2024-04-28T13:08:04.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.898+0000 7fc6ccd4e640 1 -- 172.21.15.114:0/158974220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6c8153330 msgr2=0x7fc6c815d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:04.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.898+0000 7fc6ccd4e640 1 --2- 172.21.15.114:0/158974220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6c8153330 0x7fc6c815d2e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8074790 tx=0x7fc6b802c850 comp rx=0 tx=0).stop 2024-04-28T13:08:04.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.898+0000 7fc6ccd4e640 1 -- 172.21.15.114:0/158974220 shutdown_connections 2024-04-28T13:08:04.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.898+0000 7fc6ccd4e640 1 --2- 172.21.15.114:0/158974220 >> v2:172.21.15.134:3300/0 conn(0x7fc6c80723d0 0x7fc6c8073bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:04.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.898+0000 7fc6ccd4e640 1 --2- 172.21.15.114:0/158974220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6c8153330 0x7fc6c815d2e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:04.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.898+0000 7fc6ccd4e640 1 -- 172.21.15.114:0/158974220 >> 172.21.15.114:0/158974220 conn(0x7fc6c806c980 msgr2=0x7fc6c80b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:04.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.898+0000 7fc6ccd4e640 1 -- 172.21.15.114:0/158974220 shutdown_connections 2024-04-28T13:08:04.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.898+0000 7fc6ccd4e640 1 -- 172.21.15.114:0/158974220 wait complete. 2024-04-28T13:08:04.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.899+0000 7fc6ccd4e640 1 Processor -- start 2024-04-28T13:08:04.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.900+0000 7fc6ccd4e640 1 -- start start 2024-04-28T13:08:04.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.900+0000 7fc6ccd4e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6c80723d0 0x7fc6c80ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:04.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.900+0000 7fc6ccd4e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6c80740f0 0x7fc6c814d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:04.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.900+0000 7fc6ccd4e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6c8153330 0x7fc6c8156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:04.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.900+0000 7fc6ccd4e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c8073230 con 0x7fc6c80740f0 2024-04-28T13:08:04.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.900+0000 7fc6ccd4e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c8072f50 con 0x7fc6c8153330 2024-04-28T13:08:04.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.900+0000 7fc6ccd4e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc6c8073510 con 0x7fc6c80723d0 2024-04-28T13:08:04.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.900+0000 7fc6bffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6c80740f0 0x7fc6c814d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:04.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.900+0000 7fc6bffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6c80740f0 0x7fc6c814d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36484/0 (socket says 172.21.15.114:36484) 2024-04-28T13:08:04.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.900+0000 7fc6bffff640 1 -- 172.21.15.114:0/360242266 learned_addr learned my addr 172.21.15.114:0/360242266 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:04.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.900+0000 7fc6c6d9d640 1 --2- 172.21.15.114:0/360242266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6c8153330 0x7fc6c8156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:04.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.900+0000 7fc6c659c640 1 --2- 172.21.15.114:0/360242266 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6c80723d0 0x7fc6c80ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:04.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.901+0000 7fc6bffff640 1 -- 172.21.15.114:0/360242266 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6c80723d0 msgr2=0x7fc6c80ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:04.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.901+0000 7fc6bffff640 1 --2- 172.21.15.114:0/360242266 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6c80723d0 0x7fc6c80ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:04.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.901+0000 7fc6bffff640 1 -- 172.21.15.114:0/360242266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6c8153330 msgr2=0x7fc6c8156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:04.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.901+0000 7fc6bffff640 1 --2- 172.21.15.114:0/360242266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6c8153330 0x7fc6c8156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:04.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.901+0000 7fc6bffff640 1 -- 172.21.15.114:0/360242266 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c80aed90 con 0x7fc6c80740f0 2024-04-28T13:08:04.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.901+0000 7fc6c659c640 1 --2- 172.21.15.114:0/360242266 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6c80723d0 0x7fc6c80ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:04.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.901+0000 7fc6c6d9d640 1 --2- 172.21.15.114:0/360242266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6c8153330 0x7fc6c8156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:04.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.901+0000 7fc6bffff640 1 --2- 172.21.15.114:0/360242266 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6c80740f0 0x7fc6c814d620 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc6b000c610 tx=0x7fc6b000cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:04.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.901+0000 7fc6beffd640 1 -- 172.21.15.114:0/360242266 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0015070 con 0x7fc6c80740f0 2024-04-28T13:08:04.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.901+0000 7fc6beffd640 1 -- 172.21.15.114:0/360242266 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6b0004220 con 0x7fc6c80740f0 2024-04-28T13:08:04.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.901+0000 7fc6ccd4e640 1 -- 172.21.15.114:0/360242266 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6c814fef0 con 0x7fc6c80740f0 2024-04-28T13:08:04.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.901+0000 7fc6beffd640 1 -- 172.21.15.114:0/360242266 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0003610 con 0x7fc6c80740f0 2024-04-28T13:08:04.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.901+0000 7fc6ccd4e640 1 -- 172.21.15.114:0/360242266 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6c814e430 con 0x7fc6c80740f0 2024-04-28T13:08:04.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.902+0000 7fc6ccd4e640 1 -- 172.21.15.114:0/360242266 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6c806a3d0 con 0x7fc6c80740f0 2024-04-28T13:08:04.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.902+0000 7fc6beffd640 1 -- 172.21.15.114:0/360242266 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc6b00037d0 con 0x7fc6c80740f0 2024-04-28T13:08:04.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.903+0000 7fc6beffd640 1 --2- 172.21.15.114:0/360242266 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc6a806c8f0 0x7fc6a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:04.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.903+0000 7fc6beffd640 1 -- 172.21.15.114:0/360242266 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc6b008b9c0 con 0x7fc6c80740f0 2024-04-28T13:08:04.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.903+0000 7fc6c659c640 1 --2- 172.21.15.114:0/360242266 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc6a806c8f0 0x7fc6a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:04.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.903+0000 7fc6c659c640 1 --2- 172.21.15.114:0/360242266 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc6a806c8f0 0x7fc6a806edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8037000 tx=0x7fc6b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:04.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:04.907+0000 7fc6beffd640 1 -- 172.21.15.114:0/360242266 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc6b008de20 con 0x7fc6c80740f0 2024-04-28T13:08:05.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.115+0000 7fc6ccd4e640 1 -- 172.21.15.114:0/360242266 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6c81510e0 con 0x7fc6c80740f0 2024-04-28T13:08:05.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.116+0000 7fc6beffd640 1 -- 172.21.15.114:0/360242266 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5181 (secure 0 0 0) 0x7fc6b0059d70 con 0x7fc6c80740f0 2024-04-28T13:08:05.117 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:05.117 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2660339514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2660339514},{"type":"v1","addr":"172.21.15.114:6837","nonce":2660339514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3536977085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3536977085},{"type":"v1","addr":"172.21.15.134:6833","nonce":3536977085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/869609014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":869609014},{"type":"v1","addr":"172.21.15.134:6835","nonce":869609014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-28T13:07:25.635297+0000","modified":"2024-04-28T13:07:27.635944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/888574435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":888574435},{"type":"v1","addr":"172.21.15.114:6836","nonce":888574435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-04-28T13:08:05.117 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 6 2024-04-28T13:08:05.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.118+0000 7fc6ccd4e640 1 -- 172.21.15.114:0/360242266 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc6a806c8f0 msgr2=0x7fc6a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:05.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.118+0000 7fc6ccd4e640 1 --2- 172.21.15.114:0/360242266 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc6a806c8f0 0x7fc6a806edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8037000 tx=0x7fc6b8008040 comp rx=0 tx=0).stop 2024-04-28T13:08:05.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.118+0000 7fc6ccd4e640 1 -- 172.21.15.114:0/360242266 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6c80740f0 msgr2=0x7fc6c814d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:05.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.118+0000 7fc6ccd4e640 1 --2- 172.21.15.114:0/360242266 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6c80740f0 0x7fc6c814d620 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc6b000c610 tx=0x7fc6b000cad0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.118+0000 7fc6ccd4e640 1 -- 172.21.15.114:0/360242266 shutdown_connections 2024-04-28T13:08:05.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.118+0000 7fc6ccd4e640 1 --2- 172.21.15.114:0/360242266 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc6a806c8f0 0x7fc6a806edb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.118+0000 7fc6ccd4e640 1 --2- 172.21.15.114:0/360242266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6c8153330 0x7fc6c8156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.118+0000 7fc6ccd4e640 1 --2- 172.21.15.114:0/360242266 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6c80740f0 0x7fc6c814d620 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.118+0000 7fc6ccd4e640 1 --2- 172.21.15.114:0/360242266 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6c80723d0 0x7fc6c80ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.118+0000 7fc6ccd4e640 1 -- 172.21.15.114:0/360242266 >> 172.21.15.114:0/360242266 conn(0x7fc6c806c980 msgr2=0x7fc6c80b4ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:05.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.118+0000 7fc6ccd4e640 1 -- 172.21.15.114:0/360242266 shutdown_connections 2024-04-28T13:08:05.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.118+0000 7fc6ccd4e640 1 -- 172.21.15.114:0/360242266 wait complete. 2024-04-28T13:08:05.130 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:08:05.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.224+0000 7fc13a4f2640 1 Processor -- start 2024-04-28T13:08:05.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.225+0000 7fc13a4f2640 1 -- start start 2024-04-28T13:08:05.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.225+0000 7fc13a4f2640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc1341487f0 0x7fc134073290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:05.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.225+0000 7fc13a4f2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1340737d0 0x7fc1340b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:05.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.225+0000 7fc13a4f2640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1340b5930 0x7fc134162ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:05.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.225+0000 7fc13a4f2640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fc134074580 con 0x7fc1340737d0 2024-04-28T13:08:05.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.225+0000 7fc13a4f2640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc1340b5d40 con 0x7fc1341487f0 2024-04-28T13:08:05.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.225+0000 7fc13a4f2640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc134073ce0 con 0x7fc1340b5930 2024-04-28T13:08:05.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.225+0000 7fc1337fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1340737d0 0x7fc1340b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:05.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.225+0000 7fc1337fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1340737d0 0x7fc1340b53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36496/0 (socket says 172.21.15.114:36496) 2024-04-28T13:08:05.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.226+0000 7fc1337fe640 1 -- 172.21.15.114:0/3735842971 learned_addr learned my addr 172.21.15.114:0/3735842971 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:05.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.226+0000 7fc133fff640 1 --2- 172.21.15.114:0/3735842971 >> v2:172.21.15.134:3300/0 conn(0x7fc1341487f0 0x7fc134073290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:05.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.226+0000 7fc138a8f640 1 --2- 172.21.15.114:0/3735842971 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1340b5930 0x7fc134162ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:05.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.226+0000 7fc1337fe640 1 -- 172.21.15.114:0/3735842971 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1340b5930 msgr2=0x7fc134162ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:05.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.226+0000 7fc1337fe640 1 --2- 172.21.15.114:0/3735842971 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1340b5930 0x7fc134162ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.226+0000 7fc1337fe640 1 -- 172.21.15.114:0/3735842971 >> v2:172.21.15.134:3300/0 conn(0x7fc1341487f0 msgr2=0x7fc134073290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:05.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.226+0000 7fc1337fe640 1 --2- 172.21.15.114:0/3735842971 >> v2:172.21.15.134:3300/0 conn(0x7fc1341487f0 0x7fc134073290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.226+0000 7fc1337fe640 1 -- 172.21.15.114:0/3735842971 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc134073fc0 con 0x7fc1340737d0 2024-04-28T13:08:05.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.226+0000 7fc133fff640 1 --2- 172.21.15.114:0/3735842971 >> v2:172.21.15.134:3300/0 conn(0x7fc1341487f0 0x7fc134073290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:05.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.226+0000 7fc138a8f640 1 --2- 172.21.15.114:0/3735842971 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1340b5930 0x7fc134162ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:05.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.226+0000 7fc1337fe640 1 --2- 172.21.15.114:0/3735842971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1340737d0 0x7fc1340b53f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc13406a050 tx=0x7fc12802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e92488f91753c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:05.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.227+0000 7fc132ffd640 1 -- 172.21.15.114:0/3735842971 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128037070 con 0x7fc1340737d0 2024-04-28T13:08:05.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.227+0000 7fc132ffd640 1 -- 172.21.15.114:0/3735842971 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc128032440 con 0x7fc1340737d0 2024-04-28T13:08:05.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.227+0000 7fc132ffd640 1 -- 172.21.15.114:0/3735842971 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128032810 con 0x7fc1340737d0 2024-04-28T13:08:05.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.227+0000 7fc13a4f2640 1 -- 172.21.15.114:0/3735842971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1340737d0 msgr2=0x7fc1340b53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:05.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.227+0000 7fc13a4f2640 1 --2- 172.21.15.114:0/3735842971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1340737d0 0x7fc1340b53f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc13406a050 tx=0x7fc12802a140 comp rx=0 tx=0).stop 2024-04-28T13:08:05.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.227+0000 7fc13a4f2640 1 -- 172.21.15.114:0/3735842971 shutdown_connections 2024-04-28T13:08:05.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.227+0000 7fc13a4f2640 1 --2- 172.21.15.114:0/3735842971 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1340b5930 0x7fc134162ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.227+0000 7fc13a4f2640 1 --2- 172.21.15.114:0/3735842971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1340737d0 0x7fc1340b53f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.227+0000 7fc13a4f2640 1 --2- 172.21.15.114:0/3735842971 >> v2:172.21.15.134:3300/0 conn(0x7fc1341487f0 0x7fc134073290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.227+0000 7fc13a4f2640 1 -- 172.21.15.114:0/3735842971 >> 172.21.15.114:0/3735842971 conn(0x7fc1340b3d50 msgr2=0x7fc1340b4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:05.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.227+0000 7fc13a4f2640 1 -- 172.21.15.114:0/3735842971 shutdown_connections 2024-04-28T13:08:05.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.227+0000 7fc13a4f2640 1 -- 172.21.15.114:0/3735842971 wait complete. 2024-04-28T13:08:05.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.228+0000 7fc13a4f2640 1 Processor -- start 2024-04-28T13:08:05.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.228+0000 7fc13a4f2640 1 -- start start 2024-04-28T13:08:05.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.229+0000 7fc13a4f2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1340737d0 0x7fc13415e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:05.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.229+0000 7fc13a4f2640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1340b5930 0x7fc134135100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:05.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.229+0000 7fc13a4f2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1341487f0 0x7fc1340b1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:05.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.229+0000 7fc13a4f2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc1340ae850 con 0x7fc1340737d0 2024-04-28T13:08:05.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.229+0000 7fc13a4f2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc134070860 con 0x7fc1341487f0 2024-04-28T13:08:05.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.229+0000 7fc13a4f2640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc1340ae9d0 con 0x7fc1340b5930 2024-04-28T13:08:05.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.229+0000 7fc133fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1340737d0 0x7fc13415e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:05.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.229+0000 7fc133fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1340737d0 0x7fc13415e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36506/0 (socket says 172.21.15.114:36506) 2024-04-28T13:08:05.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.229+0000 7fc133fff640 1 -- 172.21.15.114:0/1302662067 learned_addr learned my addr 172.21.15.114:0/1302662067 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:05.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.229+0000 7fc1337fe640 1 --2- 172.21.15.114:0/1302662067 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1340b5930 0x7fc134135100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:05.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.229+0000 7fc138a8f640 1 --2- 172.21.15.114:0/1302662067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1341487f0 0x7fc1340b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:05.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.229+0000 7fc133fff640 1 -- 172.21.15.114:0/1302662067 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1340b5930 msgr2=0x7fc134135100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:05.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.229+0000 7fc133fff640 1 --2- 172.21.15.114:0/1302662067 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1340b5930 0x7fc134135100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.229+0000 7fc133fff640 1 -- 172.21.15.114:0/1302662067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1341487f0 msgr2=0x7fc1340b1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:05.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.229+0000 7fc133fff640 1 --2- 172.21.15.114:0/1302662067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1341487f0 0x7fc1340b1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.229+0000 7fc133fff640 1 -- 172.21.15.114:0/1302662067 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc134135c00 con 0x7fc1340737d0 2024-04-28T13:08:05.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.230+0000 7fc1337fe640 1 --2- 172.21.15.114:0/1302662067 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1340b5930 0x7fc134135100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:05.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.230+0000 7fc133fff640 1 --2- 172.21.15.114:0/1302662067 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1340737d0 0x7fc13415e660 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc12400c820 tx=0x7fc12400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:05.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.230+0000 7fc130ff9640 1 -- 172.21.15.114:0/1302662067 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc124015070 con 0x7fc1340737d0 2024-04-28T13:08:05.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.230+0000 7fc130ff9640 1 -- 172.21.15.114:0/1302662067 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc124007a30 con 0x7fc1340737d0 2024-04-28T13:08:05.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.230+0000 7fc13a4f2640 1 -- 172.21.15.114:0/1302662067 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc134135ee0 con 0x7fc1340737d0 2024-04-28T13:08:05.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.230+0000 7fc130ff9640 1 -- 172.21.15.114:0/1302662067 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc124007e00 con 0x7fc1340737d0 2024-04-28T13:08:05.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.230+0000 7fc13a4f2640 1 -- 172.21.15.114:0/1302662067 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc134145bf0 con 0x7fc1340737d0 2024-04-28T13:08:05.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.231+0000 7fc13a4f2640 1 -- 172.21.15.114:0/1302662067 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc13406a3d0 con 0x7fc1340737d0 2024-04-28T13:08:05.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.231+0000 7fc130ff9640 1 -- 172.21.15.114:0/1302662067 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc124018070 con 0x7fc1340737d0 2024-04-28T13:08:05.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.232+0000 7fc130ff9640 1 --2- 172.21.15.114:0/1302662067 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc12006c8f0 0x7fc12006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:05.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.232+0000 7fc1337fe640 1 --2- 172.21.15.114:0/1302662067 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc12006c8f0 0x7fc12006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:05.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.232+0000 7fc130ff9640 1 -- 172.21.15.114:0/1302662067 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc12408bb20 con 0x7fc1340737d0 2024-04-28T13:08:05.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.232+0000 7fc1337fe640 1 --2- 172.21.15.114:0/1302662067 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc12006c8f0 0x7fc12006edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc128034000 tx=0x7fc12802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:05.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.236+0000 7fc130ff9640 1 -- 172.21.15.114:0/1302662067 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc124059f50 con 0x7fc1340737d0 2024-04-28T13:08:05.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.417+0000 7fc13a4f2640 1 -- 172.21.15.114:0/1302662067 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc1340b4840 con 0x7fc1340737d0 2024-04-28T13:08:05.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.418+0000 7fc130ff9640 1 -- 172.21.15.114:0/1302662067 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16902 (secure 0 0 0) 0x7fc124059850 con 0x7fc1340737d0 2024-04-28T13:08:05.419 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:05.419 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":22,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:08:05.402539+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-28T13:07:23.706359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-28T13:07:24.596188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:08:05.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.420+0000 7fc13a4f2640 1 -- 172.21.15.114:0/1302662067 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc12006c8f0 msgr2=0x7fc12006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:05.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.420+0000 7fc13a4f2640 1 --2- 172.21.15.114:0/1302662067 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc12006c8f0 0x7fc12006edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc128034000 tx=0x7fc12802e000 comp rx=0 tx=0).stop 2024-04-28T13:08:05.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.420+0000 7fc13a4f2640 1 -- 172.21.15.114:0/1302662067 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1340737d0 msgr2=0x7fc13415e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:05.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.420+0000 7fc13a4f2640 1 --2- 172.21.15.114:0/1302662067 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1340737d0 0x7fc13415e660 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc12400c820 tx=0x7fc12400cc20 comp rx=0 tx=0).stop 2024-04-28T13:08:05.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.420+0000 7fc13a4f2640 1 -- 172.21.15.114:0/1302662067 shutdown_connections 2024-04-28T13:08:05.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.420+0000 7fc13a4f2640 1 --2- 172.21.15.114:0/1302662067 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc12006c8f0 0x7fc12006edb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.420+0000 7fc13a4f2640 1 --2- 172.21.15.114:0/1302662067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1341487f0 0x7fc1340b1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.420+0000 7fc13a4f2640 1 --2- 172.21.15.114:0/1302662067 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1340b5930 0x7fc134135100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.420+0000 7fc13a4f2640 1 --2- 172.21.15.114:0/1302662067 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1340737d0 0x7fc13415e660 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.420+0000 7fc13a4f2640 1 -- 172.21.15.114:0/1302662067 >> 172.21.15.114:0/1302662067 conn(0x7fc1340b3d50 msgr2=0x7fc1340b4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:05.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.421+0000 7fc13a4f2640 1 -- 172.21.15.114:0/1302662067 shutdown_connections 2024-04-28T13:08:05.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.421+0000 7fc13a4f2640 1 -- 172.21.15.114:0/1302662067 wait complete. 2024-04-28T13:08:05.432 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-28T13:07:14.721860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-28T13:07:23.706359+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-28T13:07:24.596188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-28T13:08:05.433 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-28T13:08:05.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.531+0000 7f8b1311b640 1 Processor -- start 2024-04-28T13:08:05.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.531+0000 7f8b1311b640 1 -- start start 2024-04-28T13:08:05.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.532+0000 7f8b1311b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8b0c15f660 0x7f8b0c0d2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:05.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.532+0000 7f8b1311b640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c0d3400 con 0x7f8b0c0d55a0 2024-04-28T13:08:05.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.532+0000 7f8b1311b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c0d36e0 con 0x7f8b0c0d0ac0 2024-04-28T13:08:05.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.532+0000 7f8b1311b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f8b0c15fa40 con 0x7f8b0c15f660 2024-04-28T13:08:05.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.532+0000 7f8b116b8640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8b0c0d55a0 0x7f8b0c0b4c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46832/0 (socket says 172.21.15.114:46832) 2024-04-28T13:08:05.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.532+0000 7f8b116b8640 1 -- 172.21.15.114:0/2947661627 learned_addr learned my addr 172.21.15.114:0/2947661627 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:05.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.533+0000 7f8b10eb7640 1 --2- 172.21.15.114:0/2947661627 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8b0c15f660 0x7f8b0c0d2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:05.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.533+0000 7f8b0b7fe640 1 -- 172.21.15.114:0/2947661627 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 702801071 0 0) 0x7f8b0c0d3400 con 0x7f8b0c0d55a0 2024-04-28T13:08:05.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.533+0000 7f8b0b7fe640 1 -- 172.21.15.114:0/2947661627 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8af4003520 con 0x7f8b0c0d55a0 2024-04-28T13:08:05.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.533+0000 7f8b0b7fe640 1 -- 172.21.15.114:0/2947661627 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 410077572 0 0) 0x7f8af4003520 con 0x7f8b0c0d55a0 2024-04-28T13:08:05.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.533+0000 7f8b0b7fe640 1 -- 172.21.15.114:0/2947661627 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8b0c15f660 msgr2=0x7f8b0c0d2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:05.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.533+0000 7f8b0b7fe640 1 --2- 172.21.15.114:0/2947661627 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8b0c15f660 0x7f8b0c0d2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.533+0000 7f8b0b7fe640 1 -- 172.21.15.114:0/2947661627 >> v1:172.21.15.134:6789/0 conn(0x7f8b0c0d0ac0 legacy=0x7f8b0c0d4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:05.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.533+0000 7f8b0b7fe640 1 -- 172.21.15.114:0/2947661627 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b0c0d39c0 con 0x7f8b0c0d55a0 2024-04-28T13:08:05.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.533+0000 7f8b0b7fe640 1 -- 172.21.15.114:0/2947661627 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f8b040019f0 con 0x7f8b0c0d55a0 2024-04-28T13:08:05.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.533+0000 7f8b0b7fe640 1 -- 172.21.15.114:0/2947661627 >> v1:172.21.15.114:6789/0 conn(0x7f8b0c0d55a0 legacy=0x7f8b0c0b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:05.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.533+0000 7f8b0b7fe640 1 --2- 172.21.15.114:0/2947661627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8af40039e0 0x7f8af4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:05.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.533+0000 7f8b0b7fe640 1 --2- 172.21.15.114:0/2947661627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8af4004800 0x7f8af4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:05.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.533+0000 7f8b0b7fe640 1 --2- 172.21.15.114:0/2947661627 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8b0c15f660 0x7f8af4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:05.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.533+0000 7f8b0b7fe640 1 -- 172.21.15.114:0/2947661627 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0c15fa40 con 0x7f8af40039e0 2024-04-28T13:08:05.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.533+0000 7f8b0b7fe640 1 -- 172.21.15.114:0/2947661627 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8af400baf0 con 0x7f8af4004800 2024-04-28T13:08:05.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.533+0000 7f8b0b7fe640 1 -- 172.21.15.114:0/2947661627 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f8af400bcf0 con 0x7f8b0c15f660 2024-04-28T13:08:05.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.533+0000 7f8b10eb7640 1 --2- 172.21.15.114:0/2947661627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8af40039e0 0x7f8af4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:05.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.533+0000 7f8b0bfff640 1 --2- 172.21.15.114:0/2947661627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8af4004800 0x7f8af4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:05.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.533+0000 7f8b116b8640 1 --2- 172.21.15.114:0/2947661627 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8b0c15f660 0x7f8af4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:05.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.533+0000 7f8b10eb7640 1 -- 172.21.15.114:0/2947661627 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8b0c15f660 msgr2=0x7f8af4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:05.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.533+0000 7f8b10eb7640 1 --2- 172.21.15.114:0/2947661627 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8b0c15f660 0x7f8af4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.533+0000 7f8b10eb7640 1 -- 172.21.15.114:0/2947661627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8af4004800 msgr2=0x7f8af4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:05.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.533+0000 7f8b10eb7640 1 --2- 172.21.15.114:0/2947661627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8af4004800 0x7f8af4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.533+0000 7f8b10eb7640 1 -- 172.21.15.114:0/2947661627 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af4003520 con 0x7f8af40039e0 2024-04-28T13:08:05.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.533+0000 7f8b116b8640 1 --2- 172.21.15.114:0/2947661627 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8b0c15f660 0x7f8af4005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:05.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.534+0000 7f8b10eb7640 1 --2- 172.21.15.114:0/2947661627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8af40039e0 0x7f8af4003e00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8afc009ac0 tx=0x7f8af4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c5946edc11b5e10 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:05.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.534+0000 7f8b0b7fe640 1 -- 172.21.15.114:0/2947661627 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8afc036070 con 0x7f8af40039e0 2024-04-28T13:08:05.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.534+0000 7f8b0b7fe640 1 -- 172.21.15.114:0/2947661627 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8afc031400 con 0x7f8af40039e0 2024-04-28T13:08:05.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.534+0000 7f8b0b7fe640 1 -- 172.21.15.114:0/2947661627 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8afc009690 con 0x7f8af40039e0 2024-04-28T13:08:05.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.535+0000 7f8b1311b640 1 -- 172.21.15.114:0/2947661627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8af40039e0 msgr2=0x7f8af4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:05.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.535+0000 7f8b1311b640 1 --2- 172.21.15.114:0/2947661627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8af40039e0 0x7f8af4003e00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8afc009ac0 tx=0x7f8af4005830 comp rx=0 tx=0).stop 2024-04-28T13:08:05.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.535+0000 7f8b116b8640 1 -- 172.21.15.114:0/2947661627 reap_dead start 2024-04-28T13:08:05.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.535+0000 7f8b1311b640 1 -- 172.21.15.114:0/2947661627 shutdown_connections 2024-04-28T13:08:05.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.535+0000 7f8b1311b640 1 -- 172.21.15.114:0/2947661627 >> 172.21.15.114:0/2947661627 conn(0x7f8b0c08ec10 msgr2=0x7f8b0c09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:05.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.535+0000 7f8b1311b640 1 -- 172.21.15.114:0/2947661627 shutdown_connections 2024-04-28T13:08:05.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.535+0000 7f8b1311b640 1 -- 172.21.15.114:0/2947661627 wait complete. 2024-04-28T13:08:05.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.536+0000 7f8b1311b640 1 Processor -- start 2024-04-28T13:08:05.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.536+0000 7f8b1311b640 1 -- start start 2024-04-28T13:08:05.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.537+0000 7f8b1311b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8af40039e0 0x7f8b0c153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:05.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.537+0000 7f8b1311b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b0c15fbc0 0x7f8b0c0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:05.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.537+0000 7f8b1311b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8b0c0b3640 0x7f8b0c0b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:05.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.537+0000 7f8b1311b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0c0d0f40 con 0x7f8af40039e0 2024-04-28T13:08:05.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.537+0000 7f8b1311b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0c0d10c0 con 0x7f8b0c15fbc0 2024-04-28T13:08:05.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.537+0000 7f8b1311b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f8b0c0d2e20 con 0x7f8b0c0b3640 2024-04-28T13:08:05.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.537+0000 7f8b10eb7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8af40039e0 0x7f8b0c153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:05.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.537+0000 7f8b10eb7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8af40039e0 0x7f8b0c153a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36532/0 (socket says 172.21.15.114:36532) 2024-04-28T13:08:05.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.537+0000 7f8b10eb7640 1 -- 172.21.15.114:0/1246640236 learned_addr learned my addr 172.21.15.114:0/1246640236 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:05.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.537+0000 7f8b116b8640 1 --2- 172.21.15.114:0/1246640236 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8b0c0b3640 0x7f8b0c0b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:05.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.537+0000 7f8b0bfff640 1 --2- 172.21.15.114:0/1246640236 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b0c15fbc0 0x7f8b0c0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:05.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.537+0000 7f8b10eb7640 1 -- 172.21.15.114:0/1246640236 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8b0c0b3640 msgr2=0x7f8b0c0b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:05.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.537+0000 7f8b10eb7640 1 --2- 172.21.15.114:0/1246640236 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8b0c0b3640 0x7f8b0c0b3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.537+0000 7f8b10eb7640 1 -- 172.21.15.114:0/1246640236 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b0c15fbc0 msgr2=0x7f8b0c0cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:05.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.537+0000 7f8b10eb7640 1 --2- 172.21.15.114:0/1246640236 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b0c15fbc0 0x7f8b0c0cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.537+0000 7f8b10eb7640 1 -- 172.21.15.114:0/1246640236 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b0c160130 con 0x7f8af40039e0 2024-04-28T13:08:05.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.537+0000 7f8b10eb7640 1 --2- 172.21.15.114:0/1246640236 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8af40039e0 0x7f8b0c153a60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8afc009ac0 tx=0x7f8afc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:05.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.537+0000 7f8b097fa640 1 -- 172.21.15.114:0/1246640236 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8afc036050 con 0x7f8af40039e0 2024-04-28T13:08:05.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.538+0000 7f8b097fa640 1 -- 172.21.15.114:0/1246640236 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8afc042070 con 0x7f8af40039e0 2024-04-28T13:08:05.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.538+0000 7f8b1311b640 1 -- 172.21.15.114:0/1246640236 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b0c160410 con 0x7f8af40039e0 2024-04-28T13:08:05.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.538+0000 7f8b097fa640 1 -- 172.21.15.114:0/1246640236 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8afc0044e0 con 0x7f8af40039e0 2024-04-28T13:08:05.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.538+0000 7f8b1311b640 1 -- 172.21.15.114:0/1246640236 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b0c1609d0 con 0x7f8af40039e0 2024-04-28T13:08:05.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.538+0000 7f8b1311b640 1 -- 172.21.15.114:0/1246640236 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b0c0b6910 con 0x7f8af40039e0 2024-04-28T13:08:05.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.539+0000 7f8b097fa640 1 -- 172.21.15.114:0/1246640236 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8afc047460 con 0x7f8af40039e0 2024-04-28T13:08:05.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.539+0000 7f8b097fa640 1 --2- 172.21.15.114:0/1246640236 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f8af806c920 0x7f8af806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:05.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.539+0000 7f8b0bfff640 1 --2- 172.21.15.114:0/1246640236 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f8af806c920 0x7f8af806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:05.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.539+0000 7f8b097fa640 1 -- 172.21.15.114:0/1246640236 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f8afc0ac490 con 0x7f8af40039e0 2024-04-28T13:08:05.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.540+0000 7f8b0bfff640 1 --2- 172.21.15.114:0/1246640236 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f8af806c920 0x7f8af806ede0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c0b4390 tx=0x7f8b00009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:05.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.544+0000 7f8b097fa640 1 -- 172.21.15.114:0/1246640236 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8afc07a8d0 con 0x7f8af40039e0 2024-04-28T13:08:05.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.725+0000 7f8b1311b640 1 -- 172.21.15.114:0/1246640236 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8b0c0b6630 con 0x7f8af40039e0 2024-04-28T13:08:05.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.725+0000 7f8b097fa640 1 -- 172.21.15.114:0/1246640236 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f8afc07a1d0 con 0x7f8af40039e0 2024-04-28T13:08:05.726 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-28T13:08:05.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.727+0000 7f8b1311b640 1 -- 172.21.15.114:0/1246640236 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f8af806c920 msgr2=0x7f8af806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:05.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.727+0000 7f8b1311b640 1 --2- 172.21.15.114:0/1246640236 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f8af806c920 0x7f8af806ede0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c0b4390 tx=0x7f8b00009040 comp rx=0 tx=0).stop 2024-04-28T13:08:05.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.727+0000 7f8b1311b640 1 -- 172.21.15.114:0/1246640236 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8af40039e0 msgr2=0x7f8b0c153a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:05.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.727+0000 7f8b1311b640 1 --2- 172.21.15.114:0/1246640236 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8af40039e0 0x7f8b0c153a60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8afc009ac0 tx=0x7f8afc004730 comp rx=0 tx=0).stop 2024-04-28T13:08:05.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.727+0000 7f8b1311b640 1 -- 172.21.15.114:0/1246640236 shutdown_connections 2024-04-28T13:08:05.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.727+0000 7f8b1311b640 1 --2- 172.21.15.114:0/1246640236 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8b0c0b3640 0x7f8b0c0b3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.727+0000 7f8b1311b640 1 --2- 172.21.15.114:0/1246640236 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f8af806c920 0x7f8af806ede0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.727+0000 7f8b1311b640 1 --2- 172.21.15.114:0/1246640236 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b0c15fbc0 0x7f8b0c0cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.727+0000 7f8b1311b640 1 --2- 172.21.15.114:0/1246640236 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8af40039e0 0x7f8b0c153a60 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.727+0000 7f8b1311b640 1 -- 172.21.15.114:0/1246640236 >> 172.21.15.114:0/1246640236 conn(0x7f8b0c08ec10 msgr2=0x7f8b0c0d1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:05.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.727+0000 7f8b1311b640 1 -- 172.21.15.114:0/1246640236 shutdown_connections 2024-04-28T13:08:05.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.727+0000 7f8b1311b640 1 -- 172.21.15.114:0/1246640236 wait complete. 2024-04-28T13:08:05.739 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-28T13:08:05.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.836+0000 7fb959dbf640 1 Processor -- start 2024-04-28T13:08:05.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.836+0000 7fb959dbf640 1 -- start start 2024-04-28T13:08:05.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.837+0000 7fb959dbf640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb954073400 0x7fb9540b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:05.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.837+0000 7fb959dbf640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb954070280 0x7fb9541455f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:05.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.837+0000 7fb959dbf640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb9540737e0 0x7fb954145b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:05.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.837+0000 7fb959dbf640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fb9540b6c50 con 0x7fb9540737e0 2024-04-28T13:08:05.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.837+0000 7fb959dbf640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb9540b60d0 con 0x7fb954070280 2024-04-28T13:08:05.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.837+0000 7fb959dbf640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb9540b63b0 con 0x7fb954073400 2024-04-28T13:08:05.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.837+0000 7fb953fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb9540737e0 0x7fb954145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:05.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.837+0000 7fb953fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb9540737e0 0x7fb954145b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36538/0 (socket says 172.21.15.114:36538) 2024-04-28T13:08:05.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.837+0000 7fb953fff640 1 -- 172.21.15.114:0/3629919142 learned_addr learned my addr 172.21.15.114:0/3629919142 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:05.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.838+0000 7fb9537fe640 1 --2- 172.21.15.114:0/3629919142 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb954073400 0x7fb9540b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:05.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.838+0000 7fb94affd640 1 --2- 172.21.15.114:0/3629919142 >> v2:172.21.15.134:3300/0 conn(0x7fb954070280 0x7fb9541455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:05.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.838+0000 7fb953fff640 1 -- 172.21.15.114:0/3629919142 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb954073400 msgr2=0x7fb9540b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:05.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.838+0000 7fb953fff640 1 --2- 172.21.15.114:0/3629919142 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb954073400 0x7fb9540b58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.838+0000 7fb953fff640 1 -- 172.21.15.114:0/3629919142 >> v2:172.21.15.134:3300/0 conn(0x7fb954070280 msgr2=0x7fb9541455f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:05.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.838+0000 7fb953fff640 1 --2- 172.21.15.114:0/3629919142 >> v2:172.21.15.134:3300/0 conn(0x7fb954070280 0x7fb9541455f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.838+0000 7fb953fff640 1 -- 172.21.15.114:0/3629919142 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9540b6690 con 0x7fb9540737e0 2024-04-28T13:08:05.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.838+0000 7fb953fff640 1 --2- 172.21.15.114:0/3629919142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9540737e0 0x7fb954145b30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb9540741a0 tx=0x7fb94c02c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f461e8123e1259a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:05.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.838+0000 7fb952ffd640 1 -- 172.21.15.114:0/3629919142 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c00b2e0 con 0x7fb9540737e0 2024-04-28T13:08:05.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.839+0000 7fb952ffd640 1 -- 172.21.15.114:0/3629919142 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb94c009600 con 0x7fb9540737e0 2024-04-28T13:08:05.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.839+0000 7fb952ffd640 1 -- 172.21.15.114:0/3629919142 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c00b480 con 0x7fb9540737e0 2024-04-28T13:08:05.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.839+0000 7fb959dbf640 1 -- 172.21.15.114:0/3629919142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9540737e0 msgr2=0x7fb954145b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:05.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.839+0000 7fb959dbf640 1 --2- 172.21.15.114:0/3629919142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9540737e0 0x7fb954145b30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb9540741a0 tx=0x7fb94c02c8a0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.839+0000 7fb959dbf640 1 -- 172.21.15.114:0/3629919142 shutdown_connections 2024-04-28T13:08:05.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.839+0000 7fb959dbf640 1 --2- 172.21.15.114:0/3629919142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9540737e0 0x7fb954145b30 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.839+0000 7fb959dbf640 1 --2- 172.21.15.114:0/3629919142 >> v2:172.21.15.134:3300/0 conn(0x7fb954070280 0x7fb9541455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.839+0000 7fb959dbf640 1 --2- 172.21.15.114:0/3629919142 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb954073400 0x7fb9540b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.839+0000 7fb959dbf640 1 -- 172.21.15.114:0/3629919142 >> 172.21.15.114:0/3629919142 conn(0x7fb95406d460 msgr2=0x7fb95406d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:05.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.839+0000 7fb959dbf640 1 -- 172.21.15.114:0/3629919142 shutdown_connections 2024-04-28T13:08:05.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.839+0000 7fb959dbf640 1 -- 172.21.15.114:0/3629919142 wait complete. 2024-04-28T13:08:05.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.840+0000 7fb959dbf640 1 Processor -- start 2024-04-28T13:08:05.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.840+0000 7fb959dbf640 1 -- start start 2024-04-28T13:08:05.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.841+0000 7fb959dbf640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb954070280 0x7fb95415d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:05.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.841+0000 7fb959dbf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb954073400 0x7fb95415e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:05.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.841+0000 7fb959dbf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9540737e0 0x7fb95415eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:05.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.841+0000 7fb959dbf640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb95415fd80 con 0x7fb954073400 2024-04-28T13:08:05.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.841+0000 7fb959dbf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9540b5de0 con 0x7fb9540737e0 2024-04-28T13:08:05.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.841+0000 7fb959dbf640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb95415ff00 con 0x7fb954070280 2024-04-28T13:08:05.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.841+0000 7fb94affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb954073400 0x7fb95415e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:05.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.841+0000 7fb94affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb954073400 0x7fb95415e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36554/0 (socket says 172.21.15.114:36554) 2024-04-28T13:08:05.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.841+0000 7fb94affd640 1 -- 172.21.15.114:0/3931865479 learned_addr learned my addr 172.21.15.114:0/3931865479 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:05.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.841+0000 7fb953fff640 1 --2- 172.21.15.114:0/3931865479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9540737e0 0x7fb95415eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:05.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.841+0000 7fb9537fe640 1 --2- 172.21.15.114:0/3931865479 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb954070280 0x7fb95415d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:05.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.841+0000 7fb94affd640 1 -- 172.21.15.114:0/3931865479 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb954070280 msgr2=0x7fb95415d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:05.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.841+0000 7fb94affd640 1 --2- 172.21.15.114:0/3931865479 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb954070280 0x7fb95415d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.841+0000 7fb94affd640 1 -- 172.21.15.114:0/3931865479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9540737e0 msgr2=0x7fb95415eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:05.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.842+0000 7fb94affd640 1 --2- 172.21.15.114:0/3931865479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9540737e0 0x7fb95415eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:05.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.842+0000 7fb94affd640 1 -- 172.21.15.114:0/3931865479 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb95415dc50 con 0x7fb954073400 2024-04-28T13:08:05.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.842+0000 7fb94affd640 1 --2- 172.21.15.114:0/3931865479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb954073400 0x7fb95415e760 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb93c00c7f0 tx=0x7fb93c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:05.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.842+0000 7fb950ff9640 1 -- 172.21.15.114:0/3931865479 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93c015070 con 0x7fb954073400 2024-04-28T13:08:05.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.842+0000 7fb950ff9640 1 -- 172.21.15.114:0/3931865479 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb93c004220 con 0x7fb954073400 2024-04-28T13:08:05.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.842+0000 7fb950ff9640 1 -- 172.21.15.114:0/3931865479 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93c007620 con 0x7fb954073400 2024-04-28T13:08:05.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.842+0000 7fb959dbf640 1 -- 172.21.15.114:0/3931865479 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9540ae8f0 con 0x7fb954073400 2024-04-28T13:08:05.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.842+0000 7fb959dbf640 1 -- 172.21.15.114:0/3931865479 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb95415df30 con 0x7fb954073400 2024-04-28T13:08:05.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.843+0000 7fb959dbf640 1 -- 172.21.15.114:0/3931865479 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9540693f0 con 0x7fb954073400 2024-04-28T13:08:05.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.843+0000 7fb950ff9640 1 -- 172.21.15.114:0/3931865479 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb93c0079d0 con 0x7fb954073400 2024-04-28T13:08:05.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.844+0000 7fb950ff9640 1 --2- 172.21.15.114:0/3931865479 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb93406c8f0 0x7fb93406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:05.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.844+0000 7fb950ff9640 1 -- 172.21.15.114:0/3931865479 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fb93c08bc30 con 0x7fb954073400 2024-04-28T13:08:05.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.844+0000 7fb9537fe640 1 --2- 172.21.15.114:0/3931865479 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb93406c8f0 0x7fb93406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:05.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.844+0000 7fb9537fe640 1 --2- 172.21.15.114:0/3931865479 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb93406c8f0 0x7fb93406edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb94400aac0 tx=0x7fb944008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:05.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:05.848+0000 7fb950ff9640 1 -- 172.21.15.114:0/3931865479 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb9540693f0 con 0x7fb954073400 2024-04-28T13:08:06.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.021+0000 7fb959dbf640 1 -- 172.21.15.114:0/3931865479 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb95406a3d0 con 0x7fb954073400 2024-04-28T13:08:06.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.022+0000 7fb950ff9640 1 -- 172.21.15.114:0/3931865479 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7fb93c059900 con 0x7fb954073400 2024-04-28T13:08:06.023 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-04-28T13:08:06.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.024+0000 7fb959dbf640 1 -- 172.21.15.114:0/3931865479 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb93406c8f0 msgr2=0x7fb93406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:06.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.024+0000 7fb959dbf640 1 --2- 172.21.15.114:0/3931865479 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb93406c8f0 0x7fb93406edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb94400aac0 tx=0x7fb944008040 comp rx=0 tx=0).stop 2024-04-28T13:08:06.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.024+0000 7fb959dbf640 1 -- 172.21.15.114:0/3931865479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb954073400 msgr2=0x7fb95415e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:06.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.024+0000 7fb959dbf640 1 --2- 172.21.15.114:0/3931865479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb954073400 0x7fb95415e760 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb93c00c7f0 tx=0x7fb93c00ccb0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.024+0000 7fb959dbf640 1 -- 172.21.15.114:0/3931865479 shutdown_connections 2024-04-28T13:08:06.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.024+0000 7fb959dbf640 1 --2- 172.21.15.114:0/3931865479 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb93406c8f0 0x7fb93406edb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.024+0000 7fb959dbf640 1 --2- 172.21.15.114:0/3931865479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9540737e0 0x7fb95415eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.024+0000 7fb959dbf640 1 --2- 172.21.15.114:0/3931865479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb954073400 0x7fb95415e760 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.024+0000 7fb959dbf640 1 --2- 172.21.15.114:0/3931865479 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb954070280 0x7fb95415d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.024+0000 7fb959dbf640 1 -- 172.21.15.114:0/3931865479 >> 172.21.15.114:0/3931865479 conn(0x7fb95406d460 msgr2=0x7fb95406c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:06.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.024+0000 7fb959dbf640 1 -- 172.21.15.114:0/3931865479 shutdown_connections 2024-04-28T13:08:06.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.024+0000 7fb959dbf640 1 -- 172.21.15.114:0/3931865479 wait complete. 2024-04-28T13:08:06.035 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-28T13:08:06.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.133+0000 7f347a119640 1 Processor -- start 2024-04-28T13:08:06.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.133+0000 7f347a119640 1 -- start start 2024-04-28T13:08:06.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.134+0000 7f347a119640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f347415d510 0x7f34740b5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:06.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.134+0000 7f347a119640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34740d1070 con 0x7f34740d0c30 2024-04-28T13:08:06.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.134+0000 7f347a119640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34740b24f0 con 0x7f34740d1970 2024-04-28T13:08:06.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.134+0000 7f347a119640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f34740cecd0 con 0x7f347415d510 2024-04-28T13:08:06.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.134+0000 7f34737fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f347415d510 0x7f34740b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:06.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.134+0000 7f3472ffd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f34740d0c30 0x7f34740d1260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46848/0 (socket says 172.21.15.114:46848) 2024-04-28T13:08:06.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.134+0000 7f3472ffd640 1 -- 172.21.15.114:0/1222133900 learned_addr learned my addr 172.21.15.114:0/1222133900 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:06.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.135+0000 7f34737fe640 1 -- 172.21.15.114:0/1222133900 >> v1:172.21.15.134:6789/0 conn(0x7f34740d1970 legacy=0x7f34740703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:06.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.135+0000 7f34737fe640 1 -- 172.21.15.114:0/1222133900 >> v1:172.21.15.114:6789/0 conn(0x7f34740d0c30 legacy=0x7f34740d1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:06.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.135+0000 7f34737fe640 1 -- 172.21.15.114:0/1222133900 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34740b2790 con 0x7f347415d510 2024-04-28T13:08:06.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.135+0000 7f34727fc640 1 -- 172.21.15.114:0/1222133900 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3474012263 0 0) 0x7f34740d1070 con 0x7f34740d0c30 2024-04-28T13:08:06.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.135+0000 7f34737fe640 1 --2- 172.21.15.114:0/1222133900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f347415d510 0x7f34740b5670 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f347406cf30 tx=0x7f346402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b5561ca77ed400 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:06.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.135+0000 7f34727fc640 1 -- 172.21.15.114:0/1222133900 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3464037070 con 0x7f347415d510 2024-04-28T13:08:06.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.136+0000 7f34727fc640 1 -- 172.21.15.114:0/1222133900 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f346402ae40 con 0x7f347415d510 2024-04-28T13:08:06.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.136+0000 7f34727fc640 1 -- 172.21.15.114:0/1222133900 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3464032660 con 0x7f347415d510 2024-04-28T13:08:06.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.136+0000 7f347a119640 1 -- 172.21.15.114:0/1222133900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f347415d510 msgr2=0x7f34740b5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:06.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.136+0000 7f347a119640 1 --2- 172.21.15.114:0/1222133900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f347415d510 0x7f34740b5670 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f347406cf30 tx=0x7f346402a130 comp rx=0 tx=0).stop 2024-04-28T13:08:06.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.136+0000 7f347a119640 1 -- 172.21.15.114:0/1222133900 shutdown_connections 2024-04-28T13:08:06.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.136+0000 7f347a119640 1 --2- 172.21.15.114:0/1222133900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f347415d510 0x7f34740b5670 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.136+0000 7f347a119640 1 -- 172.21.15.114:0/1222133900 >> 172.21.15.114:0/1222133900 conn(0x7f34740b4b50 msgr2=0x7f34740b4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:06.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.136+0000 7f347a119640 1 -- 172.21.15.114:0/1222133900 shutdown_connections 2024-04-28T13:08:06.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.136+0000 7f347a119640 1 -- 172.21.15.114:0/1222133900 wait complete. 2024-04-28T13:08:06.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.137+0000 7f347a119640 1 Processor -- start 2024-04-28T13:08:06.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.137+0000 7f347a119640 1 -- start start 2024-04-28T13:08:06.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.138+0000 7f347a119640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34740d0c30 0x7f347415c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:06.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.138+0000 7f347a119640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34740d1970 0x7f34740cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:06.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.138+0000 7f347a119640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f347415d510 0x7f34740cb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:06.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.138+0000 7f347a119640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3474070ab0 con 0x7f347415d510 2024-04-28T13:08:06.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.138+0000 7f347a119640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f34740ce960 con 0x7f34740d0c30 2024-04-28T13:08:06.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.138+0000 7f347a119640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3474070c30 con 0x7f34740d1970 2024-04-28T13:08:06.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.138+0000 7f3473fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f347415d510 0x7f34740cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:06.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.138+0000 7f3473fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f347415d510 0x7f34740cb210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36578/0 (socket says 172.21.15.114:36578) 2024-04-28T13:08:06.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.138+0000 7f3473fff640 1 -- 172.21.15.114:0/3739500434 learned_addr learned my addr 172.21.15.114:0/3739500434 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:06.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.138+0000 7f3472ffd640 1 --2- 172.21.15.114:0/3739500434 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34740d1970 0x7f34740cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:06.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.138+0000 7f34737fe640 1 --2- 172.21.15.114:0/3739500434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34740d0c30 0x7f347415c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:06.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.139+0000 7f3473fff640 1 -- 172.21.15.114:0/3739500434 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34740d1970 msgr2=0x7f34740cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:06.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.139+0000 7f3473fff640 1 --2- 172.21.15.114:0/3739500434 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34740d1970 0x7f34740cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.139+0000 7f3473fff640 1 -- 172.21.15.114:0/3739500434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34740d0c30 msgr2=0x7f347415c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:06.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.139+0000 7f3473fff640 1 --2- 172.21.15.114:0/3739500434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34740d0c30 0x7f347415c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.139+0000 7f3473fff640 1 -- 172.21.15.114:0/3739500434 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f347406e150 con 0x7f347415d510 2024-04-28T13:08:06.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.139+0000 7f34737fe640 1 --2- 172.21.15.114:0/3739500434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34740d0c30 0x7f347415c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:06.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.139+0000 7f3473fff640 1 --2- 172.21.15.114:0/3739500434 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f347415d510 0x7f34740cb210 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f346c00c780 tx=0x7f346c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:06.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.139+0000 7f345bfff640 1 -- 172.21.15.114:0/3739500434 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c017070 con 0x7f347415d510 2024-04-28T13:08:06.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.139+0000 7f345bfff640 1 -- 172.21.15.114:0/3739500434 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f346c003da0 con 0x7f347415d510 2024-04-28T13:08:06.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.139+0000 7f347a119640 1 -- 172.21.15.114:0/3739500434 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f347406e430 con 0x7f347415d510 2024-04-28T13:08:06.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.139+0000 7f345bfff640 1 -- 172.21.15.114:0/3739500434 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c0052b0 con 0x7f347415d510 2024-04-28T13:08:06.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.139+0000 7f347a119640 1 -- 172.21.15.114:0/3739500434 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f347406e9f0 con 0x7f347415d510 2024-04-28T13:08:06.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.140+0000 7f347a119640 1 -- 172.21.15.114:0/3739500434 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34740ca920 con 0x7f347415d510 2024-04-28T13:08:06.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.140+0000 7f345bfff640 1 -- 172.21.15.114:0/3739500434 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f346c01a070 con 0x7f347415d510 2024-04-28T13:08:06.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.141+0000 7f345bfff640 1 --2- 172.21.15.114:0/3739500434 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f346006c8f0 0x7f346006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:06.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.141+0000 7f345bfff640 1 -- 172.21.15.114:0/3739500434 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f346c08b1a0 con 0x7f347415d510 2024-04-28T13:08:06.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.141+0000 7f34737fe640 1 --2- 172.21.15.114:0/3739500434 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f346006c8f0 0x7f346006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:06.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.141+0000 7f34737fe640 1 --2- 172.21.15.114:0/3739500434 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f346006c8f0 0x7f346006edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3464034000 tx=0x7f346402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:06.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.145+0000 7f345bfff640 1 -- 172.21.15.114:0/3739500434 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f346c058f00 con 0x7f347415d510 2024-04-28T13:08:06.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.322+0000 7f347a119640 1 -- 172.21.15.114:0/3739500434 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f347415c680 con 0x7f347415d510 2024-04-28T13:08:06.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.322+0000 7f345bfff640 1 -- 172.21.15.114:0/3739500434 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f346c05d200 con 0x7f347415d510 2024-04-28T13:08:06.323 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-04-28T13:08:06.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.324+0000 7f347a119640 1 -- 172.21.15.114:0/3739500434 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f346006c8f0 msgr2=0x7f346006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:06.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.324+0000 7f347a119640 1 --2- 172.21.15.114:0/3739500434 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f346006c8f0 0x7f346006edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3464034000 tx=0x7f346402e000 comp rx=0 tx=0).stop 2024-04-28T13:08:06.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.324+0000 7f347a119640 1 -- 172.21.15.114:0/3739500434 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f347415d510 msgr2=0x7f34740cb210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:06.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.324+0000 7f347a119640 1 --2- 172.21.15.114:0/3739500434 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f347415d510 0x7f34740cb210 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f346c00c780 tx=0x7f346c00cc40 comp rx=0 tx=0).stop 2024-04-28T13:08:06.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.324+0000 7f347a119640 1 -- 172.21.15.114:0/3739500434 shutdown_connections 2024-04-28T13:08:06.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.324+0000 7f347a119640 1 --2- 172.21.15.114:0/3739500434 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f347415d510 0x7f34740cb210 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.324+0000 7f347a119640 1 --2- 172.21.15.114:0/3739500434 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34740d1970 0x7f34740cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.324+0000 7f347a119640 1 --2- 172.21.15.114:0/3739500434 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f346006c8f0 0x7f346006edb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.324+0000 7f347a119640 1 --2- 172.21.15.114:0/3739500434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34740d0c30 0x7f347415c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.324+0000 7f347a119640 1 -- 172.21.15.114:0/3739500434 >> 172.21.15.114:0/3739500434 conn(0x7f34740b4b50 msgr2=0x7f34740cf370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:06.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.324+0000 7f347a119640 1 -- 172.21.15.114:0/3739500434 shutdown_connections 2024-04-28T13:08:06.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.324+0000 7f347a119640 1 -- 172.21.15.114:0/3739500434 wait complete. 2024-04-28T13:08:06.335 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-28T13:08:06.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.435+0000 7f3296064640 1 Processor -- start 2024-04-28T13:08:06.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.435+0000 7f3296064640 1 -- start start 2024-04-28T13:08:06.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.435+0000 7f3296064640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f32900b5370 0x7f329006d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:06.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.435+0000 7f3296064640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f329006dbb0 0x7f329015ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:06.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.435+0000 7f3296064640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f329006ec20 con 0x7f3290148cd0 2024-04-28T13:08:06.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.435+0000 7f3296064640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f32901490b0 con 0x7f32900b5370 2024-04-28T13:08:06.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.435+0000 7f3296064640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f329015fb10 con 0x7f329006dbb0 2024-04-28T13:08:06.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.436+0000 7f328effd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f32900b5370 0x7f329006d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:06.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.436+0000 7f328effd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f32900b5370 0x7f329006d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36590/0 (socket says 172.21.15.114:36590) 2024-04-28T13:08:06.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.436+0000 7f328effd640 1 -- 172.21.15.114:0/3634810408 learned_addr learned my addr 172.21.15.114:0/3634810408 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:06.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.436+0000 7f328ffff640 1 --2- 172.21.15.114:0/3634810408 >> v2:172.21.15.134:3300/0 conn(0x7f329006dbb0 0x7f329015ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:06.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.436+0000 7f328effd640 1 -- 172.21.15.114:0/3634810408 >> v2:172.21.15.134:3300/0 conn(0x7f329006dbb0 msgr2=0x7f329015ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:06.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.436+0000 7f328effd640 1 --2- 172.21.15.114:0/3634810408 >> v2:172.21.15.134:3300/0 conn(0x7f329006dbb0 0x7f329015ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.436+0000 7f328effd640 1 -- 172.21.15.114:0/3634810408 >> v1:172.21.15.134:6789/0 conn(0x7f3290148cd0 legacy=0x7f32900b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:06.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.436+0000 7f328effd640 1 -- 172.21.15.114:0/3634810408 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f329006e380 con 0x7f32900b5370 2024-04-28T13:08:06.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.436+0000 7f328ffff640 1 --2- 172.21.15.114:0/3634810408 >> v2:172.21.15.134:3300/0 conn(0x7f329006dbb0 0x7f329015ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:06.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.437+0000 7f328effd640 1 --2- 172.21.15.114:0/3634810408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32900b5370 0x7f329006d670 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3284009870 tx=0x7f328402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d2aa5ba4123bd93 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:06.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.437+0000 7f328e7fc640 1 -- 172.21.15.114:0/3634810408 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3284037070 con 0x7f32900b5370 2024-04-28T13:08:06.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.437+0000 7f328e7fc640 1 -- 172.21.15.114:0/3634810408 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3284032440 con 0x7f32900b5370 2024-04-28T13:08:06.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.437+0000 7f328e7fc640 1 -- 172.21.15.114:0/3634810408 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3284032810 con 0x7f32900b5370 2024-04-28T13:08:06.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.437+0000 7f3296064640 1 -- 172.21.15.114:0/3634810408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32900b5370 msgr2=0x7f329006d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:06.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.437+0000 7f3296064640 1 --2- 172.21.15.114:0/3634810408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32900b5370 0x7f329006d670 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3284009870 tx=0x7f328402a1c0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.437+0000 7f3296064640 1 -- 172.21.15.114:0/3634810408 shutdown_connections 2024-04-28T13:08:06.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.437+0000 7f3296064640 1 --2- 172.21.15.114:0/3634810408 >> v2:172.21.15.134:3300/0 conn(0x7f329006dbb0 0x7f329015ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.437+0000 7f3296064640 1 --2- 172.21.15.114:0/3634810408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32900b5370 0x7f329006d670 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.437+0000 7f3296064640 1 -- 172.21.15.114:0/3634810408 >> 172.21.15.114:0/3634810408 conn(0x7f3290062d70 msgr2=0x7f3290063150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:06.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.437+0000 7f3296064640 1 -- 172.21.15.114:0/3634810408 shutdown_connections 2024-04-28T13:08:06.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.437+0000 7f3296064640 1 -- 172.21.15.114:0/3634810408 wait complete. 2024-04-28T13:08:06.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.438+0000 7f3296064640 1 Processor -- start 2024-04-28T13:08:06.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.439+0000 7f3296064640 1 -- start start 2024-04-28T13:08:06.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.439+0000 7f3296064640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f329006dbb0 0x7f3290144520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:06.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.439+0000 7f3296064640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32900b5370 0x7f32900d36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:06.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.439+0000 7f3296064640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3290148cd0 0x7f32901408e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:06.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.439+0000 7f3296064640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f329006dfe0 con 0x7f3290148cd0 2024-04-28T13:08:06.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.439+0000 7f3296064640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f329006e940 con 0x7f32900b5370 2024-04-28T13:08:06.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.439+0000 7f3296064640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f329006e160 con 0x7f329006dbb0 2024-04-28T13:08:06.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.439+0000 7f328ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3290148cd0 0x7f32901408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:06.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.439+0000 7f328ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3290148cd0 0x7f32901408e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36602/0 (socket says 172.21.15.114:36602) 2024-04-28T13:08:06.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.439+0000 7f328ffff640 1 -- 172.21.15.114:0/880162504 learned_addr learned my addr 172.21.15.114:0/880162504 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:06.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.439+0000 7f328f7fe640 1 --2- 172.21.15.114:0/880162504 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f329006dbb0 0x7f3290144520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:06.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.439+0000 7f328effd640 1 --2- 172.21.15.114:0/880162504 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32900b5370 0x7f32900d36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:06.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.440+0000 7f328ffff640 1 -- 172.21.15.114:0/880162504 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f329006dbb0 msgr2=0x7f3290144520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:06.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.440+0000 7f328ffff640 1 --2- 172.21.15.114:0/880162504 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f329006dbb0 0x7f3290144520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.440+0000 7f328ffff640 1 -- 172.21.15.114:0/880162504 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32900b5370 msgr2=0x7f32900d36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:06.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.440+0000 7f328ffff640 1 --2- 172.21.15.114:0/880162504 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32900b5370 0x7f32900d36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.440+0000 7f328ffff640 1 -- 172.21.15.114:0/880162504 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3290145120 con 0x7f3290148cd0 2024-04-28T13:08:06.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.440+0000 7f328ffff640 1 --2- 172.21.15.114:0/880162504 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3290148cd0 0x7f32901408e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f328800cf20 tx=0x7f328800a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:06.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.440+0000 7f3277fff640 1 -- 172.21.15.114:0/880162504 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328801a070 con 0x7f3290148cd0 2024-04-28T13:08:06.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.440+0000 7f3277fff640 1 -- 172.21.15.114:0/880162504 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f328800d840 con 0x7f3290148cd0 2024-04-28T13:08:06.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.440+0000 7f3296064640 1 -- 172.21.15.114:0/880162504 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3290145400 con 0x7f3290148cd0 2024-04-28T13:08:06.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.440+0000 7f3277fff640 1 -- 172.21.15.114:0/880162504 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328800dc30 con 0x7f3290148cd0 2024-04-28T13:08:06.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.440+0000 7f3296064640 1 -- 172.21.15.114:0/880162504 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32901459c0 con 0x7f3290148cd0 2024-04-28T13:08:06.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.441+0000 7f3296064640 1 -- 172.21.15.114:0/880162504 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f329006a3d0 con 0x7f3290148cd0 2024-04-28T13:08:06.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.441+0000 7f3277fff640 1 -- 172.21.15.114:0/880162504 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f328801d070 con 0x7f3290148cd0 2024-04-28T13:08:06.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.442+0000 7f3277fff640 1 --2- 172.21.15.114:0/880162504 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f327c06c8f0 0x7f327c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:06.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.442+0000 7f3277fff640 1 -- 172.21.15.114:0/880162504 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f328808c470 con 0x7f3290148cd0 2024-04-28T13:08:06.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.442+0000 7f328f7fe640 1 --2- 172.21.15.114:0/880162504 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f327c06c8f0 0x7f327c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:06.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.442+0000 7f328f7fe640 1 --2- 172.21.15.114:0/880162504 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f327c06c8f0 0x7f327c06edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3280006fd0 tx=0x7f3280008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:06.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.446+0000 7f3277fff640 1 -- 172.21.15.114:0/880162504 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f328805a8b0 con 0x7f3290148cd0 2024-04-28T13:08:06.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.661+0000 7f3296064640 1 -- 172.21.15.114:0/880162504 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32900b3ac0 con 0x7f3290148cd0 2024-04-28T13:08:06.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.662+0000 7f3277fff640 1 -- 172.21.15.114:0/880162504 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5181 (secure 0 0 0) 0x7f328805a1b0 con 0x7f3290148cd0 2024-04-28T13:08:06.663 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:06.663 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2660339514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2660339514},{"type":"v1","addr":"172.21.15.114:6837","nonce":2660339514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3536977085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3536977085},{"type":"v1","addr":"172.21.15.134:6833","nonce":3536977085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/869609014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":869609014},{"type":"v1","addr":"172.21.15.134:6835","nonce":869609014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-28T13:07:25.635297+0000","modified":"2024-04-28T13:07:27.635944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/888574435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":888574435},{"type":"v1","addr":"172.21.15.114:6836","nonce":888574435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-04-28T13:08:06.663 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 6 2024-04-28T13:08:06.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.664+0000 7f3296064640 1 -- 172.21.15.114:0/880162504 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f327c06c8f0 msgr2=0x7f327c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:06.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.664+0000 7f3296064640 1 --2- 172.21.15.114:0/880162504 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f327c06c8f0 0x7f327c06edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3280006fd0 tx=0x7f3280008040 comp rx=0 tx=0).stop 2024-04-28T13:08:06.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.664+0000 7f3296064640 1 -- 172.21.15.114:0/880162504 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3290148cd0 msgr2=0x7f32901408e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:06.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.664+0000 7f3296064640 1 --2- 172.21.15.114:0/880162504 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3290148cd0 0x7f32901408e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f328800cf20 tx=0x7f328800a7d0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.664+0000 7f3296064640 1 -- 172.21.15.114:0/880162504 shutdown_connections 2024-04-28T13:08:06.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.664+0000 7f3296064640 1 --2- 172.21.15.114:0/880162504 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3290148cd0 0x7f32901408e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.664+0000 7f3296064640 1 --2- 172.21.15.114:0/880162504 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f327c06c8f0 0x7f327c06edb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.664+0000 7f3296064640 1 --2- 172.21.15.114:0/880162504 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32900b5370 0x7f32900d36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.664+0000 7f3296064640 1 --2- 172.21.15.114:0/880162504 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f329006dbb0 0x7f3290144520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.664+0000 7f3296064640 1 -- 172.21.15.114:0/880162504 >> 172.21.15.114:0/880162504 conn(0x7f3290062d70 msgr2=0x7f329015f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:06.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.664+0000 7f3296064640 1 -- 172.21.15.114:0/880162504 shutdown_connections 2024-04-28T13:08:06.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.664+0000 7f3296064640 1 -- 172.21.15.114:0/880162504 wait complete. 2024-04-28T13:08:06.675 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:08:06.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.771+0000 7f4b560bd640 1 Processor -- start 2024-04-28T13:08:06.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.771+0000 7f4b560bd640 1 -- start start 2024-04-28T13:08:06.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.772+0000 7f4b560bd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4b501595c0 0x7f4b500cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:06.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.772+0000 7f4b560bd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b5015bf30 0x7f4b5015c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:06.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.772+0000 7f4b560bd640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b501599a0 con 0x7f4b500cd890 2024-04-28T13:08:06.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.772+0000 7f4b560bd640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f4b5015cf80 con 0x7f4b501595c0 2024-04-28T13:08:06.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.772+0000 7f4b560bd640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f4b5015c9c0 con 0x7f4b5015bf30 2024-04-28T13:08:06.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.772+0000 7f4b4f7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4b501595c0 0x7f4b500cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:06.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.772+0000 7f4b4ffff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f4b500cd890 0x7f4b5006e5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46864/0 (socket says 172.21.15.114:46864) 2024-04-28T13:08:06.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.772+0000 7f4b4ffff640 1 -- 172.21.15.114:0/165193902 learned_addr learned my addr 172.21.15.114:0/165193902 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:06.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.772+0000 7f4b4effd640 1 --2- 172.21.15.114:0/165193902 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b5015bf30 0x7f4b5015c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:06.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.773+0000 7f4b4f7fe640 1 -- 172.21.15.114:0/165193902 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b5015bf30 msgr2=0x7f4b5015c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:06.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.773+0000 7f4b4f7fe640 1 --2- 172.21.15.114:0/165193902 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b5015bf30 0x7f4b5015c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.773+0000 7f4b4f7fe640 1 -- 172.21.15.114:0/165193902 >> v1:172.21.15.114:6789/0 conn(0x7f4b500cd890 legacy=0x7f4b5006e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:06.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.773+0000 7f4b4f7fe640 1 -- 172.21.15.114:0/165193902 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b5015cca0 con 0x7f4b501595c0 2024-04-28T13:08:06.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.773+0000 7f4b4e7fc640 1 -- 172.21.15.114:0/165193902 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2454923853 0 0) 0x7f4b501599a0 con 0x7f4b500cd890 2024-04-28T13:08:06.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.773+0000 7f4b4f7fe640 1 --2- 172.21.15.114:0/165193902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b501595c0 0x7f4b500cf690 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4b400097a0 tx=0x7f4b4002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87e74fa926a2d8cc server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:06.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.773+0000 7f4b4e7fc640 1 -- 172.21.15.114:0/165193902 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b40037070 con 0x7f4b501595c0 2024-04-28T13:08:06.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.774+0000 7f4b4e7fc640 1 -- 172.21.15.114:0/165193902 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b4002ae50 con 0x7f4b501595c0 2024-04-28T13:08:06.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.774+0000 7f4b4e7fc640 1 -- 172.21.15.114:0/165193902 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b40032660 con 0x7f4b501595c0 2024-04-28T13:08:06.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.774+0000 7f4b560bd640 1 -- 172.21.15.114:0/165193902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b501595c0 msgr2=0x7f4b500cf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:06.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.774+0000 7f4b560bd640 1 --2- 172.21.15.114:0/165193902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b501595c0 0x7f4b500cf690 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4b400097a0 tx=0x7f4b4002a100 comp rx=0 tx=0).stop 2024-04-28T13:08:06.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.774+0000 7f4b560bd640 1 -- 172.21.15.114:0/165193902 shutdown_connections 2024-04-28T13:08:06.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.774+0000 7f4b560bd640 1 --2- 172.21.15.114:0/165193902 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b5015bf30 0x7f4b5015c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.774+0000 7f4b560bd640 1 --2- 172.21.15.114:0/165193902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b501595c0 0x7f4b500cf690 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.774+0000 7f4b560bd640 1 -- 172.21.15.114:0/165193902 >> 172.21.15.114:0/165193902 conn(0x7f4b5006c980 msgr2=0x7f4b500b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:06.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.774+0000 7f4b560bd640 1 -- 172.21.15.114:0/165193902 shutdown_connections 2024-04-28T13:08:06.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.774+0000 7f4b560bd640 1 -- 172.21.15.114:0/165193902 wait complete. 2024-04-28T13:08:06.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.775+0000 7f4b560bd640 1 Processor -- start 2024-04-28T13:08:06.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.775+0000 7f4b560bd640 1 -- start start 2024-04-28T13:08:06.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.776+0000 7f4b560bd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b500cd890 0x7f4b5014aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:06.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.776+0000 7f4b560bd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b501595c0 0x7f4b501537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:06.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.776+0000 7f4b560bd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b5015bf30 0x7f4b50151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:06.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.776+0000 7f4b560bd640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4b500b6150 con 0x7f4b501595c0 2024-04-28T13:08:06.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.776+0000 7f4b560bd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4b500cf170 con 0x7f4b500cd890 2024-04-28T13:08:06.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.776+0000 7f4b560bd640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f4b500b62d0 con 0x7f4b5015bf30 2024-04-28T13:08:06.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.776+0000 7f4b4effd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b501595c0 0x7f4b501537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:06.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.776+0000 7f4b4effd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b501595c0 0x7f4b501537c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36614/0 (socket says 172.21.15.114:36614) 2024-04-28T13:08:06.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.776+0000 7f4b4effd640 1 -- 172.21.15.114:0/1308404217 learned_addr learned my addr 172.21.15.114:0/1308404217 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:06.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.776+0000 7f4b4f7fe640 1 --2- 172.21.15.114:0/1308404217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b500cd890 0x7f4b5014aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:06.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.776+0000 7f4b4ffff640 1 --2- 172.21.15.114:0/1308404217 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b5015bf30 0x7f4b50151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:06.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.776+0000 7f4b4effd640 1 -- 172.21.15.114:0/1308404217 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b5015bf30 msgr2=0x7f4b50151dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:06.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.776+0000 7f4b4effd640 1 --2- 172.21.15.114:0/1308404217 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b5015bf30 0x7f4b50151dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.776+0000 7f4b4effd640 1 -- 172.21.15.114:0/1308404217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b500cd890 msgr2=0x7f4b5014aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:06.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.777+0000 7f4b4effd640 1 --2- 172.21.15.114:0/1308404217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b500cd890 0x7f4b5014aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.777+0000 7f4b4effd640 1 -- 172.21.15.114:0/1308404217 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b50153fc0 con 0x7f4b501595c0 2024-04-28T13:08:06.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.777+0000 7f4b4effd640 1 --2- 172.21.15.114:0/1308404217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b501595c0 0x7f4b501537c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4b4400e870 tx=0x7f4b4400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:06.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.777+0000 7f4b37fff640 1 -- 172.21.15.114:0/1308404217 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b44017020 con 0x7f4b501595c0 2024-04-28T13:08:06.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.777+0000 7f4b37fff640 1 -- 172.21.15.114:0/1308404217 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b44004240 con 0x7f4b501595c0 2024-04-28T13:08:06.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.777+0000 7f4b37fff640 1 -- 172.21.15.114:0/1308404217 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4400c730 con 0x7f4b501595c0 2024-04-28T13:08:06.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.777+0000 7f4b560bd640 1 -- 172.21.15.114:0/1308404217 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b5014f320 con 0x7f4b501595c0 2024-04-28T13:08:06.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.777+0000 7f4b560bd640 1 -- 172.21.15.114:0/1308404217 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b50152310 con 0x7f4b501595c0 2024-04-28T13:08:06.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.778+0000 7f4b560bd640 1 -- 172.21.15.114:0/1308404217 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b5006a3d0 con 0x7f4b501595c0 2024-04-28T13:08:06.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.778+0000 7f4b37fff640 1 -- 172.21.15.114:0/1308404217 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4b4401a020 con 0x7f4b501595c0 2024-04-28T13:08:06.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.779+0000 7f4b37fff640 1 --2- 172.21.15.114:0/1308404217 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f4b3c06c8f0 0x7f4b3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:06.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.779+0000 7f4b37fff640 1 -- 172.21.15.114:0/1308404217 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f4b4408bb10 con 0x7f4b501595c0 2024-04-28T13:08:06.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.779+0000 7f4b4f7fe640 1 --2- 172.21.15.114:0/1308404217 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f4b3c06c8f0 0x7f4b3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:06.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.779+0000 7f4b4f7fe640 1 --2- 172.21.15.114:0/1308404217 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f4b3c06c8f0 0x7f4b3c06edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4b40034000 tx=0x7f4b4002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:06.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.783+0000 7f4b37fff640 1 -- 172.21.15.114:0/1308404217 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4b44021030 con 0x7f4b501595c0 2024-04-28T13:08:06.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.963+0000 7f4b560bd640 1 -- 172.21.15.114:0/1308404217 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4b501544c0 con 0x7f4b501595c0 2024-04-28T13:08:06.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.964+0000 7f4b37fff640 1 -- 172.21.15.114:0/1308404217 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16902 (secure 0 0 0) 0x7f4b44059900 con 0x7f4b501595c0 2024-04-28T13:08:06.965 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:06.965 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":23,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:08:06.409631+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-28T13:07:23.706359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-28T13:07:24.596188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:08:06.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.966+0000 7f4b560bd640 1 -- 172.21.15.114:0/1308404217 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f4b3c06c8f0 msgr2=0x7f4b3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:06.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.966+0000 7f4b560bd640 1 --2- 172.21.15.114:0/1308404217 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f4b3c06c8f0 0x7f4b3c06edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4b40034000 tx=0x7f4b4002e000 comp rx=0 tx=0).stop 2024-04-28T13:08:06.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.966+0000 7f4b560bd640 1 -- 172.21.15.114:0/1308404217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b501595c0 msgr2=0x7f4b501537c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:06.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.966+0000 7f4b560bd640 1 --2- 172.21.15.114:0/1308404217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b501595c0 0x7f4b501537c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4b4400e870 tx=0x7f4b4400ed30 comp rx=0 tx=0).stop 2024-04-28T13:08:06.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.966+0000 7f4b560bd640 1 -- 172.21.15.114:0/1308404217 shutdown_connections 2024-04-28T13:08:06.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.966+0000 7f4b560bd640 1 --2- 172.21.15.114:0/1308404217 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b5015bf30 0x7f4b50151dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.966+0000 7f4b560bd640 1 --2- 172.21.15.114:0/1308404217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b501595c0 0x7f4b501537c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.966+0000 7f4b560bd640 1 --2- 172.21.15.114:0/1308404217 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f4b3c06c8f0 0x7f4b3c06edb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.966+0000 7f4b560bd640 1 --2- 172.21.15.114:0/1308404217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b500cd890 0x7f4b5014aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:06.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.966+0000 7f4b560bd640 1 -- 172.21.15.114:0/1308404217 >> 172.21.15.114:0/1308404217 conn(0x7f4b5006c980 msgr2=0x7f4b5006f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:06.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.966+0000 7f4b560bd640 1 -- 172.21.15.114:0/1308404217 shutdown_connections 2024-04-28T13:08:06.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:06.966+0000 7f4b560bd640 1 -- 172.21.15.114:0/1308404217 wait complete. 2024-04-28T13:08:06.978 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-28T13:08:06.978 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-28T13:08:07.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.074+0000 7f7409009640 1 Processor -- start 2024-04-28T13:08:07.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.075+0000 7f7409009640 1 -- start start 2024-04-28T13:08:07.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.075+0000 7f7409009640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f740406d360 0x7f740406e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:07.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.075+0000 7f7409009640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f740406d740 0x7f740415f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:07.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.075+0000 7f7409009640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7404070950 con 0x7f7404162de0 2024-04-28T13:08:07.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.075+0000 7f7409009640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f74040af6b0 con 0x7f740406d360 2024-04-28T13:08:07.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.075+0000 7f7409009640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f740406eed0 con 0x7f740406d740 2024-04-28T13:08:07.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.075+0000 7f740359e640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f7404162de0 0x7f7404163250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46876/0 (socket says 172.21.15.114:46876) 2024-04-28T13:08:07.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.075+0000 7f7402d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f740406d360 0x7f740406e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:07.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.075+0000 7f740359e640 1 -- 172.21.15.114:0/1712241309 learned_addr learned my addr 172.21.15.114:0/1712241309 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:07.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.076+0000 7f740259c640 1 --2- 172.21.15.114:0/1712241309 >> v2:172.21.15.134:3300/0 conn(0x7f740406d740 0x7f740415f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:07.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.076+0000 7f7402d9d640 1 -- 172.21.15.114:0/1712241309 >> v2:172.21.15.134:3300/0 conn(0x7f740406d740 msgr2=0x7f740415f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:07.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.076+0000 7f7402d9d640 1 --2- 172.21.15.114:0/1712241309 >> v2:172.21.15.134:3300/0 conn(0x7f740406d740 0x7f740415f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:07.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.076+0000 7f7402d9d640 1 -- 172.21.15.114:0/1712241309 >> v1:172.21.15.114:6789/0 conn(0x7f7404162de0 legacy=0x7f7404163250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:07.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.076+0000 7f7402d9d640 1 -- 172.21.15.114:0/1712241309 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f740406fc80 con 0x7f740406d360 2024-04-28T13:08:07.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.076+0000 7f740259c640 1 --2- 172.21.15.114:0/1712241309 >> v2:172.21.15.134:3300/0 conn(0x7f740406d740 0x7f740415f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:07.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.076+0000 7f7402d9d640 1 --2- 172.21.15.114:0/1712241309 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f740406d360 0x7f740406e990 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f74040b6cd0 tx=0x7f73ec02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79ed85ddca56eb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:07.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.077+0000 7f7401d9b640 1 -- 172.21.15.114:0/1712241309 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec037070 con 0x7f740406d360 2024-04-28T13:08:07.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.077+0000 7f7401d9b640 1 -- 172.21.15.114:0/1712241309 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73ec032440 con 0x7f740406d360 2024-04-28T13:08:07.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.077+0000 7f7401d9b640 1 -- 172.21.15.114:0/1712241309 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec032810 con 0x7f740406d360 2024-04-28T13:08:07.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.077+0000 7f7409009640 1 -- 172.21.15.114:0/1712241309 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f740406d360 msgr2=0x7f740406e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:07.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.077+0000 7f7409009640 1 --2- 172.21.15.114:0/1712241309 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f740406d360 0x7f740406e990 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f74040b6cd0 tx=0x7f73ec02a1a0 comp rx=0 tx=0).stop 2024-04-28T13:08:07.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.077+0000 7f7409009640 1 -- 172.21.15.114:0/1712241309 shutdown_connections 2024-04-28T13:08:07.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.077+0000 7f7409009640 1 --2- 172.21.15.114:0/1712241309 >> v2:172.21.15.134:3300/0 conn(0x7f740406d740 0x7f740415f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:07.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.077+0000 7f7409009640 1 --2- 172.21.15.114:0/1712241309 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f740406d360 0x7f740406e990 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:07.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.077+0000 7f7409009640 1 -- 172.21.15.114:0/1712241309 >> 172.21.15.114:0/1712241309 conn(0x7f7404072a60 msgr2=0x7f7404072e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:07.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.077+0000 7f7409009640 1 -- 172.21.15.114:0/1712241309 shutdown_connections 2024-04-28T13:08:07.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.077+0000 7f7409009640 1 -- 172.21.15.114:0/1712241309 wait complete. 2024-04-28T13:08:07.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.079+0000 7f7409009640 1 Processor -- start 2024-04-28T13:08:07.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.079+0000 7f7409009640 1 -- start start 2024-04-28T13:08:07.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.079+0000 7f7409009640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f740406d360 0x7f740414e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:07.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.079+0000 7f7409009640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f740406d740 0x7f740415f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:07.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.079+0000 7f7409009640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7404162de0 0x7f7404161b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:07.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.079+0000 7f7409009640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f740406f6c0 con 0x7f740406d740 2024-04-28T13:08:07.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.079+0000 7f7409009640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f740406f3e0 con 0x7f7404162de0 2024-04-28T13:08:07.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.079+0000 7f7409009640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f740406f9a0 con 0x7f740406d360 2024-04-28T13:08:07.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.079+0000 7f740259c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f740406d740 0x7f740415f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:07.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.079+0000 7f740259c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f740406d740 0x7f740415f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36642/0 (socket says 172.21.15.114:36642) 2024-04-28T13:08:07.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.079+0000 7f740259c640 1 -- 172.21.15.114:0/230554920 learned_addr learned my addr 172.21.15.114:0/230554920 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:07.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.080+0000 7f740359e640 1 --2- 172.21.15.114:0/230554920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7404162de0 0x7f7404161b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:07.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.080+0000 7f740259c640 1 -- 172.21.15.114:0/230554920 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f740406d360 msgr2=0x7f740414e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:07.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.080+0000 7f740259c640 1 --2- 172.21.15.114:0/230554920 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f740406d360 0x7f740414e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:07.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.080+0000 7f740259c640 1 -- 172.21.15.114:0/230554920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7404162de0 msgr2=0x7f7404161b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:07.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.080+0000 7f740259c640 1 --2- 172.21.15.114:0/230554920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7404162de0 0x7f7404161b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:07.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.080+0000 7f740259c640 1 -- 172.21.15.114:0/230554920 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f740414f850 con 0x7f740406d740 2024-04-28T13:08:07.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.080+0000 7f740259c640 1 --2- 172.21.15.114:0/230554920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f740406d740 0x7f740415f4a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f73f400c7f0 tx=0x7f73f400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:07.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.080+0000 7f73fb7fe640 1 -- 172.21.15.114:0/230554920 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f4015070 con 0x7f740406d740 2024-04-28T13:08:07.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.080+0000 7f73fb7fe640 1 -- 172.21.15.114:0/230554920 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73f4007a30 con 0x7f740406d740 2024-04-28T13:08:07.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.080+0000 7f7409009640 1 -- 172.21.15.114:0/230554920 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f740415ff20 con 0x7f740406d740 2024-04-28T13:08:07.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.080+0000 7f73fb7fe640 1 -- 172.21.15.114:0/230554920 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f4007e00 con 0x7f740406d740 2024-04-28T13:08:07.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.080+0000 7f7409009640 1 -- 172.21.15.114:0/230554920 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74041604e0 con 0x7f740406d740 2024-04-28T13:08:07.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.081+0000 7f7409009640 1 -- 172.21.15.114:0/230554920 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f740406a3d0 con 0x7f740406d740 2024-04-28T13:08:07.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.081+0000 7f73fb7fe640 1 -- 172.21.15.114:0/230554920 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f73f4018070 con 0x7f740406d740 2024-04-28T13:08:07.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.082+0000 7f73fb7fe640 1 --2- 172.21.15.114:0/230554920 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f73e406c920 0x7f73e406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:07.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.082+0000 7f73fb7fe640 1 -- 172.21.15.114:0/230554920 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f73f408bab0 con 0x7f740406d740 2024-04-28T13:08:07.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.082+0000 7f7402d9d640 1 --2- 172.21.15.114:0/230554920 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f73e406c920 0x7f73e406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:07.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.082+0000 7f7402d9d640 1 --2- 172.21.15.114:0/230554920 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f73e406c920 0x7f73e406ede0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f73ec034000 tx=0x7f73ec02c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:07.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.086+0000 7f73fb7fe640 1 -- 172.21.15.114:0/230554920 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f73f4059ef0 con 0x7f740406d740 2024-04-28T13:08:07.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.299+0000 7f7409009640 1 -- 172.21.15.114:0/230554920 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f74040b0870 con 0x7f740406d740 2024-04-28T13:08:07.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.299+0000 7f73fb7fe640 1 -- 172.21.15.114:0/230554920 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5181 (secure 0 0 0) 0x7f73f40597f0 con 0x7f740406d740 2024-04-28T13:08:07.300 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:07.300 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2660339514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2660339514},{"type":"v1","addr":"172.21.15.114:6837","nonce":2660339514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3536977085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3536977085},{"type":"v1","addr":"172.21.15.134:6833","nonce":3536977085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/869609014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":869609014},{"type":"v1","addr":"172.21.15.134:6835","nonce":869609014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-28T13:07:25.635297+0000","modified":"2024-04-28T13:07:27.635944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/888574435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":888574435},{"type":"v1","addr":"172.21.15.114:6836","nonce":888574435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-04-28T13:08:07.300 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 6 2024-04-28T13:08:07.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.301+0000 7f7409009640 1 -- 172.21.15.114:0/230554920 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f73e406c920 msgr2=0x7f73e406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:07.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.301+0000 7f7409009640 1 --2- 172.21.15.114:0/230554920 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f73e406c920 0x7f73e406ede0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f73ec034000 tx=0x7f73ec02c000 comp rx=0 tx=0).stop 2024-04-28T13:08:07.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.301+0000 7f7409009640 1 -- 172.21.15.114:0/230554920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f740406d740 msgr2=0x7f740415f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:07.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.301+0000 7f7409009640 1 --2- 172.21.15.114:0/230554920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f740406d740 0x7f740415f4a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f73f400c7f0 tx=0x7f73f400cbf0 comp rx=0 tx=0).stop 2024-04-28T13:08:07.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.301+0000 7f7409009640 1 -- 172.21.15.114:0/230554920 shutdown_connections 2024-04-28T13:08:07.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.301+0000 7f7409009640 1 --2- 172.21.15.114:0/230554920 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f73e406c920 0x7f73e406ede0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:07.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.301+0000 7f7409009640 1 --2- 172.21.15.114:0/230554920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7404162de0 0x7f7404161b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:07.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.301+0000 7f7409009640 1 --2- 172.21.15.114:0/230554920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f740406d740 0x7f740415f4a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:07.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.301+0000 7f7409009640 1 --2- 172.21.15.114:0/230554920 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f740406d360 0x7f740414e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:07.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.301+0000 7f7409009640 1 -- 172.21.15.114:0/230554920 >> 172.21.15.114:0/230554920 conn(0x7f7404072a60 msgr2=0x7f740415e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:07.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.301+0000 7f7409009640 1 -- 172.21.15.114:0/230554920 shutdown_connections 2024-04-28T13:08:07.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.301+0000 7f7409009640 1 -- 172.21.15.114:0/230554920 wait complete. 2024-04-28T13:08:07.313 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-28T13:08:07.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.408+0000 7f276026b640 1 Processor -- start 2024-04-28T13:08:07.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.408+0000 7f276026b640 1 -- start start 2024-04-28T13:08:07.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.409+0000 7f276026b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f275815d060 0x7f2758071090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:07.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.409+0000 7f276026b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f27580b7550 0x7f2758160cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:07.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.409+0000 7f276026b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2758161bd0 con 0x7f27580b4c50 2024-04-28T13:08:07.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.409+0000 7f276026b640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f27580cdee0 con 0x7f275815d060 2024-04-28T13:08:07.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.409+0000 7f276026b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f2758161910 con 0x7f27580b7550 2024-04-28T13:08:07.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.410+0000 7f275e007640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f275815d060 0x7f2758071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:07.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.410+0000 7f275e007640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f275815d060 0x7f2758071090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36652/0 (socket says 172.21.15.114:36652) 2024-04-28T13:08:07.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.410+0000 7f275e007640 1 -- 172.21.15.114:0/258385809 learned_addr learned my addr 172.21.15.114:0/258385809 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:07.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.410+0000 7f275d806640 1 --2- 172.21.15.114:0/258385809 >> v2:172.21.15.134:3300/0 conn(0x7f27580b7550 0x7f2758160cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:07.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.410+0000 7f275e007640 1 -- 172.21.15.114:0/258385809 >> v2:172.21.15.134:3300/0 conn(0x7f27580b7550 msgr2=0x7f2758160cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:07.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.410+0000 7f275e007640 1 --2- 172.21.15.114:0/258385809 >> v2:172.21.15.134:3300/0 conn(0x7f27580b7550 0x7f2758160cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:07.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.410+0000 7f275e007640 1 -- 172.21.15.114:0/258385809 >> v1:172.21.15.134:6789/0 conn(0x7f27580b4c50 legacy=0x7f2758161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:07.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.410+0000 7f275e007640 1 -- 172.21.15.114:0/258385809 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27580cd920 con 0x7f275815d060 2024-04-28T13:08:07.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.411+0000 7f275e007640 1 --2- 172.21.15.114:0/258385809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f275815d060 0x7f2758071090 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2758072a30 tx=0x7f275002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d61ea80894dc5814 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:07.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.411+0000 7f275d005640 1 -- 172.21.15.114:0/258385809 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2750036070 con 0x7f275815d060 2024-04-28T13:08:07.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.411+0000 7f275d005640 1 -- 172.21.15.114:0/258385809 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2750031600 con 0x7f275815d060 2024-04-28T13:08:07.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.411+0000 7f275d005640 1 -- 172.21.15.114:0/258385809 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27500319d0 con 0x7f275815d060 2024-04-28T13:08:07.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.411+0000 7f276026b640 1 -- 172.21.15.114:0/258385809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f275815d060 msgr2=0x7f2758071090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:07.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.411+0000 7f276026b640 1 --2- 172.21.15.114:0/258385809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f275815d060 0x7f2758071090 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2758072a30 tx=0x7f275002a730 comp rx=0 tx=0).stop 2024-04-28T13:08:07.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.411+0000 7f276026b640 1 -- 172.21.15.114:0/258385809 shutdown_connections 2024-04-28T13:08:07.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.411+0000 7f276026b640 1 --2- 172.21.15.114:0/258385809 >> v2:172.21.15.134:3300/0 conn(0x7f27580b7550 0x7f2758160cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:07.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.411+0000 7f276026b640 1 --2- 172.21.15.114:0/258385809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f275815d060 0x7f2758071090 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:07.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.411+0000 7f276026b640 1 -- 172.21.15.114:0/258385809 >> 172.21.15.114:0/258385809 conn(0x7f27580ce100 msgr2=0x7f27580ce4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:07.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.411+0000 7f276026b640 1 -- 172.21.15.114:0/258385809 shutdown_connections 2024-04-28T13:08:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.411+0000 7f276026b640 1 -- 172.21.15.114:0/258385809 wait complete. 2024-04-28T13:08:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.412+0000 7f276026b640 1 Processor -- start 2024-04-28T13:08:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.412+0000 7f276026b640 1 -- start start 2024-04-28T13:08:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.413+0000 7f276026b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27580b4c50 0x7f275813c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.413+0000 7f276026b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27580b7550 0x7f275813f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.413+0000 7f276026b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f275815d060 0x7f27581587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.413+0000 7f276026b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f275815d440 con 0x7f27580b4c50 2024-04-28T13:08:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.413+0000 7f276026b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f27580b4730 con 0x7f27580b7550 2024-04-28T13:08:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.413+0000 7f276026b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f275815d5c0 con 0x7f275815d060 2024-04-28T13:08:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.413+0000 7f275e007640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27580b4c50 0x7f275813c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.413+0000 7f275e007640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27580b4c50 0x7f275813c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36664/0 (socket says 172.21.15.114:36664) 2024-04-28T13:08:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.413+0000 7f275e007640 1 -- 172.21.15.114:0/1893210442 learned_addr learned my addr 172.21.15.114:0/1893210442 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:07.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.413+0000 7f275e808640 1 --2- 172.21.15.114:0/1893210442 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f275815d060 0x7f27581587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:07.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.413+0000 7f275d806640 1 --2- 172.21.15.114:0/1893210442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27580b7550 0x7f275813f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:07.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.414+0000 7f275e007640 1 -- 172.21.15.114:0/1893210442 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f275815d060 msgr2=0x7f27581587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:07.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.414+0000 7f275e007640 1 --2- 172.21.15.114:0/1893210442 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f275815d060 0x7f27581587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:07.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.414+0000 7f275e007640 1 -- 172.21.15.114:0/1893210442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27580b7550 msgr2=0x7f275813f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:07.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.414+0000 7f275e007640 1 --2- 172.21.15.114:0/1893210442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27580b7550 0x7f275813f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:07.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.414+0000 7f275e007640 1 -- 172.21.15.114:0/1893210442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f275813fee0 con 0x7f27580b4c50 2024-04-28T13:08:07.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.414+0000 7f275e808640 1 --2- 172.21.15.114:0/1893210442 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f275815d060 0x7f27581587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:07.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.414+0000 7f275e007640 1 --2- 172.21.15.114:0/1893210442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27580b4c50 0x7f275813c640 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2750009f40 tx=0x7f2750004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:07.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.414+0000 7f2756ffd640 1 -- 172.21.15.114:0/1893210442 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275003f020 con 0x7f27580b4c50 2024-04-28T13:08:07.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.414+0000 7f276026b640 1 -- 172.21.15.114:0/1893210442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f275815a550 con 0x7f27580b4c50 2024-04-28T13:08:07.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.414+0000 7f276026b640 1 -- 172.21.15.114:0/1893210442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f275815ab10 con 0x7f27580b4c50 2024-04-28T13:08:07.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.415+0000 7f276026b640 1 -- 172.21.15.114:0/1893210442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f275806a3d0 con 0x7f27580b4c50 2024-04-28T13:08:07.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.416+0000 7f2756ffd640 1 -- 172.21.15.114:0/1893210442 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2750037040 con 0x7f27580b4c50 2024-04-28T13:08:07.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.416+0000 7f2756ffd640 1 -- 172.21.15.114:0/1893210442 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2750036070 con 0x7f27580b4c50 2024-04-28T13:08:07.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.417+0000 7f2756ffd640 1 -- 172.21.15.114:0/1893210442 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2750042020 con 0x7f27580b4c50 2024-04-28T13:08:07.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.417+0000 7f2756ffd640 1 --2- 172.21.15.114:0/1893210442 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f274406c8f0 0x7f274406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:07.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.417+0000 7f2756ffd640 1 -- 172.21.15.114:0/1893210442 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f27500ac520 con 0x7f27580b4c50 2024-04-28T13:08:07.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.417+0000 7f275d806640 1 --2- 172.21.15.114:0/1893210442 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f274406c8f0 0x7f274406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:07.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.418+0000 7f275d806640 1 --2- 172.21.15.114:0/1893210442 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f274406c8f0 0x7f274406edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f275813d1c0 tx=0x7f274c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:07.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.421+0000 7f2756ffd640 1 -- 172.21.15.114:0/1893210442 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2750049030 con 0x7f27580b4c50 2024-04-28T13:08:07.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.630+0000 7f276026b640 1 -- 172.21.15.114:0/1893210442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27580b1720 con 0x7f27580b4c50 2024-04-28T13:08:07.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.631+0000 7f2756ffd640 1 -- 172.21.15.114:0/1893210442 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5181 (secure 0 0 0) 0x7f275007a840 con 0x7f27580b4c50 2024-04-28T13:08:07.632 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:07.632 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2660339514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2660339514},{"type":"v1","addr":"172.21.15.114:6837","nonce":2660339514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3536977085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3536977085},{"type":"v1","addr":"172.21.15.134:6833","nonce":3536977085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/869609014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":869609014},{"type":"v1","addr":"172.21.15.134:6835","nonce":869609014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-28T13:07:25.635297+0000","modified":"2024-04-28T13:07:27.635944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/888574435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":888574435},{"type":"v1","addr":"172.21.15.114:6836","nonce":888574435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-04-28T13:08:07.632 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 6 2024-04-28T13:08:07.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.633+0000 7f276026b640 1 -- 172.21.15.114:0/1893210442 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f274406c8f0 msgr2=0x7f274406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:07.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.633+0000 7f276026b640 1 --2- 172.21.15.114:0/1893210442 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f274406c8f0 0x7f274406edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f275813d1c0 tx=0x7f274c008040 comp rx=0 tx=0).stop 2024-04-28T13:08:07.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.633+0000 7f276026b640 1 -- 172.21.15.114:0/1893210442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27580b4c50 msgr2=0x7f275813c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:07.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.633+0000 7f276026b640 1 --2- 172.21.15.114:0/1893210442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27580b4c50 0x7f275813c640 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2750009f40 tx=0x7f2750004a40 comp rx=0 tx=0).stop 2024-04-28T13:08:07.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.633+0000 7f276026b640 1 -- 172.21.15.114:0/1893210442 shutdown_connections 2024-04-28T13:08:07.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.633+0000 7f276026b640 1 --2- 172.21.15.114:0/1893210442 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f275815d060 0x7f27581587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:07.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.633+0000 7f276026b640 1 --2- 172.21.15.114:0/1893210442 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f274406c8f0 0x7f274406edb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:07.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.633+0000 7f276026b640 1 --2- 172.21.15.114:0/1893210442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27580b7550 0x7f275813f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:07.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.633+0000 7f276026b640 1 --2- 172.21.15.114:0/1893210442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27580b4c50 0x7f275813c640 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:07.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.633+0000 7f276026b640 1 -- 172.21.15.114:0/1893210442 >> 172.21.15.114:0/1893210442 conn(0x7f27580ce100 msgr2=0x7f275806ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:07.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.633+0000 7f276026b640 1 -- 172.21.15.114:0/1893210442 shutdown_connections 2024-04-28T13:08:07.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.633+0000 7f276026b640 1 -- 172.21.15.114:0/1893210442 wait complete. 2024-04-28T13:08:07.644 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:08:07.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.740+0000 7f34c29ac640 1 Processor -- start 2024-04-28T13:08:07.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.740+0000 7f34c29ac640 1 -- start start 2024-04-28T13:08:07.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.741+0000 7f34c29ac640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f34bc0cda00 0x7f34bc0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:07.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.741+0000 7f34c29ac640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34bc0d2be0 con 0x7f34bc1601d0 2024-04-28T13:08:07.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.741+0000 7f34c29ac640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34bc160980 con 0x7f34bc0d07b0 2024-04-28T13:08:07.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.741+0000 7f34c29ac640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f34bc1606a0 con 0x7f34bc0cda00 2024-04-28T13:08:07.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.741+0000 7f34bbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f34bc0cda00 0x7f34bc0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:07.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.741+0000 7f34c0f49640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f34bc1601d0 0x7f34bc155fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46880/0 (socket says 172.21.15.114:46880) 2024-04-28T13:08:07.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.741+0000 7f34c0f49640 1 -- 172.21.15.114:0/2708664376 learned_addr learned my addr 172.21.15.114:0/2708664376 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:07.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.741+0000 7f34bbfff640 1 -- 172.21.15.114:0/2708664376 >> v1:172.21.15.134:6789/0 conn(0x7f34bc0d07b0 legacy=0x7f34bc15fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:07.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.741+0000 7f34bbfff640 1 -- 172.21.15.114:0/2708664376 >> v1:172.21.15.114:6789/0 conn(0x7f34bc1601d0 legacy=0x7f34bc155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:07.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.741+0000 7f34bbfff640 1 -- 172.21.15.114:0/2708664376 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34bc0cf7b0 con 0x7f34bc0cda00 2024-04-28T13:08:07.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.741+0000 7f34baffd640 1 -- 172.21.15.114:0/2708664376 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 31855555 0 0) 0x7f34bc0d2be0 con 0x7f34bc1601d0 2024-04-28T13:08:07.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.742+0000 7f34bbfff640 1 --2- 172.21.15.114:0/2708664376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34bc0cda00 0x7f34bc0d0270 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f34ac0097a0 tx=0x7f34ac02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=610be389a2e0ce09 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:07.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.742+0000 7f34baffd640 1 -- 172.21.15.114:0/2708664376 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ac037070 con 0x7f34bc0cda00 2024-04-28T13:08:07.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.742+0000 7f34baffd640 1 -- 172.21.15.114:0/2708664376 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34ac032440 con 0x7f34bc0cda00 2024-04-28T13:08:07.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.742+0000 7f34baffd640 1 -- 172.21.15.114:0/2708664376 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ac032810 con 0x7f34bc0cda00 2024-04-28T13:08:07.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.743+0000 7f34c29ac640 1 -- 172.21.15.114:0/2708664376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34bc0cda00 msgr2=0x7f34bc0d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:07.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.743+0000 7f34c29ac640 1 --2- 172.21.15.114:0/2708664376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34bc0cda00 0x7f34bc0d0270 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f34ac0097a0 tx=0x7f34ac02a230 comp rx=0 tx=0).stop 2024-04-28T13:08:07.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.743+0000 7f34c29ac640 1 -- 172.21.15.114:0/2708664376 shutdown_connections 2024-04-28T13:08:07.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.743+0000 7f34c29ac640 1 --2- 172.21.15.114:0/2708664376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34bc0cda00 0x7f34bc0d0270 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:07.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.743+0000 7f34c29ac640 1 -- 172.21.15.114:0/2708664376 >> 172.21.15.114:0/2708664376 conn(0x7f34bc0706f0 msgr2=0x7f34bc070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:07.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.743+0000 7f34c29ac640 1 -- 172.21.15.114:0/2708664376 shutdown_connections 2024-04-28T13:08:07.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.743+0000 7f34c29ac640 1 -- 172.21.15.114:0/2708664376 wait complete. 2024-04-28T13:08:07.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.744+0000 7f34c29ac640 1 Processor -- start 2024-04-28T13:08:07.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.744+0000 7f34c29ac640 1 -- start start 2024-04-28T13:08:07.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.745+0000 7f34c29ac640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34bc0cda00 0x7f34bc151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:07.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.745+0000 7f34c29ac640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34bc0d07b0 0x7f34bc0b68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:07.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.745+0000 7f34c29ac640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34bc1601d0 0x7f34bc0b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:07.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.745+0000 7f34c29ac640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f34bc1566d0 con 0x7f34bc0cda00 2024-04-28T13:08:07.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.745+0000 7f34c29ac640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f34bc0cfd70 con 0x7f34bc0d07b0 2024-04-28T13:08:07.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.745+0000 7f34c29ac640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f34bc156850 con 0x7f34bc1601d0 2024-04-28T13:08:07.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.745+0000 7f34bbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34bc0cda00 0x7f34bc151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:07.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.745+0000 7f34bbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34bc0cda00 0x7f34bc151170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36672/0 (socket says 172.21.15.114:36672) 2024-04-28T13:08:07.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.745+0000 7f34bbfff640 1 -- 172.21.15.114:0/2125225854 learned_addr learned my addr 172.21.15.114:0/2125225854 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:07.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.745+0000 7f34c0f49640 1 --2- 172.21.15.114:0/2125225854 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34bc1601d0 0x7f34bc0b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:07.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.745+0000 7f34bb7fe640 1 --2- 172.21.15.114:0/2125225854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34bc0d07b0 0x7f34bc0b68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:07.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.745+0000 7f34bbfff640 1 -- 172.21.15.114:0/2125225854 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34bc1601d0 msgr2=0x7f34bc0b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:07.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.745+0000 7f34bbfff640 1 --2- 172.21.15.114:0/2125225854 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34bc1601d0 0x7f34bc0b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:07.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.745+0000 7f34bbfff640 1 -- 172.21.15.114:0/2125225854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34bc0d07b0 msgr2=0x7f34bc0b68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:07.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.745+0000 7f34bbfff640 1 --2- 172.21.15.114:0/2125225854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34bc0d07b0 0x7f34bc0b68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:07.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.745+0000 7f34bbfff640 1 -- 172.21.15.114:0/2125225854 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34bc157010 con 0x7f34bc0cda00 2024-04-28T13:08:07.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.745+0000 7f34bbfff640 1 --2- 172.21.15.114:0/2125225854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34bc0cda00 0x7f34bc151170 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f34ac035040 tx=0x7f34ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:07.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.745+0000 7f34b8ff9640 1 -- 172.21.15.114:0/2125225854 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ac037040 con 0x7f34bc0cda00 2024-04-28T13:08:07.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.745+0000 7f34b8ff9640 1 -- 172.21.15.114:0/2125225854 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34ac004250 con 0x7f34bc0cda00 2024-04-28T13:08:07.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.745+0000 7f34c29ac640 1 -- 172.21.15.114:0/2125225854 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34bc1572f0 con 0x7f34bc0cda00 2024-04-28T13:08:07.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.745+0000 7f34b8ff9640 1 -- 172.21.15.114:0/2125225854 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ac032e40 con 0x7f34bc0cda00 2024-04-28T13:08:07.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.745+0000 7f34c29ac640 1 -- 172.21.15.114:0/2125225854 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34bc1578b0 con 0x7f34bc0cda00 2024-04-28T13:08:07.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.746+0000 7f34c29ac640 1 -- 172.21.15.114:0/2125225854 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34bc0b31b0 con 0x7f34bc0cda00 2024-04-28T13:08:07.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.747+0000 7f34b8ff9640 1 -- 172.21.15.114:0/2125225854 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f34ac0306f0 con 0x7f34bc0cda00 2024-04-28T13:08:07.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.747+0000 7f34b8ff9640 1 --2- 172.21.15.114:0/2125225854 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f34a806c8f0 0x7f34a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:07.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.747+0000 7f34bb7fe640 1 --2- 172.21.15.114:0/2125225854 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f34a806c8f0 0x7f34a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:07.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.748+0000 7f34b8ff9640 1 -- 172.21.15.114:0/2125225854 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f34ac0ace50 con 0x7f34bc0cda00 2024-04-28T13:08:07.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.748+0000 7f34bb7fe640 1 --2- 172.21.15.114:0/2125225854 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f34a806c8f0 0x7f34a806edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f34bc151c90 tx=0x7f34b0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:07.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.752+0000 7f34b8ff9640 1 -- 172.21.15.114:0/2125225854 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f34bc0b31b0 con 0x7f34bc0cda00 2024-04-28T13:08:07.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.927+0000 7f34c29ac640 1 -- 172.21.15.114:0/2125225854 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f34bc06a3d0 con 0x7f34bc0cda00 2024-04-28T13:08:07.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.928+0000 7f34b8ff9640 1 -- 172.21.15.114:0/2125225854 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16902 (secure 0 0 0) 0x7f34ac07b320 con 0x7f34bc0cda00 2024-04-28T13:08:07.929 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:07.929 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":23,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:08:06.409631+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-28T13:07:23.706359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-28T13:07:24.596188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:08:07.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.930+0000 7f34c29ac640 1 -- 172.21.15.114:0/2125225854 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f34a806c8f0 msgr2=0x7f34a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:07.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.930+0000 7f34c29ac640 1 --2- 172.21.15.114:0/2125225854 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f34a806c8f0 0x7f34a806edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f34bc151c90 tx=0x7f34b0009040 comp rx=0 tx=0).stop 2024-04-28T13:08:07.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.930+0000 7f34c29ac640 1 -- 172.21.15.114:0/2125225854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34bc0cda00 msgr2=0x7f34bc151170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:07.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.930+0000 7f34c29ac640 1 --2- 172.21.15.114:0/2125225854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34bc0cda00 0x7f34bc151170 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f34ac035040 tx=0x7f34ac0046c0 comp rx=0 tx=0).stop 2024-04-28T13:08:07.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.930+0000 7f34c29ac640 1 -- 172.21.15.114:0/2125225854 shutdown_connections 2024-04-28T13:08:07.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.930+0000 7f34c29ac640 1 --2- 172.21.15.114:0/2125225854 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34bc1601d0 0x7f34bc0b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:07.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.930+0000 7f34c29ac640 1 --2- 172.21.15.114:0/2125225854 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f34a806c8f0 0x7f34a806edb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:07.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.930+0000 7f34c29ac640 1 --2- 172.21.15.114:0/2125225854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34bc0d07b0 0x7f34bc0b68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:07.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.930+0000 7f34c29ac640 1 --2- 172.21.15.114:0/2125225854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34bc0cda00 0x7f34bc151170 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:07.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.930+0000 7f34c29ac640 1 -- 172.21.15.114:0/2125225854 >> 172.21.15.114:0/2125225854 conn(0x7f34bc0706f0 msgr2=0x7f34bc0d30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:07.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.930+0000 7f34c29ac640 1 -- 172.21.15.114:0/2125225854 shutdown_connections 2024-04-28T13:08:07.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:07.930+0000 7f34c29ac640 1 -- 172.21.15.114:0/2125225854 wait complete. 2024-04-28T13:08:07.942 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-28T13:08:08.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.039+0000 7f9c5d22a640 1 Processor -- start 2024-04-28T13:08:08.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.039+0000 7f9c5d22a640 1 -- start start 2024-04-28T13:08:08.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.040+0000 7f9c5d22a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9c58160590 0x7f9c58166f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:08.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.040+0000 7f9c5d22a640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c58072d10 con 0x7f9c5815d010 2024-04-28T13:08:08.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.040+0000 7f9c5d22a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c58072ff0 con 0x7f9c580d1490 2024-04-28T13:08:08.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.040+0000 7f9c5d22a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f9c58072ac0 con 0x7f9c58160590 2024-04-28T13:08:08.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.040+0000 7f9c56d9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9c5815d010 0x7f9c580d0d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46886/0 (socket says 172.21.15.114:46886) 2024-04-28T13:08:08.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.040+0000 7f9c56d9d640 1 -- 172.21.15.114:0/2722884696 learned_addr learned my addr 172.21.15.114:0/2722884696 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:08.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.041+0000 7f9c5759e640 1 --2- 172.21.15.114:0/2722884696 >> v2:172.21.15.134:3300/0 conn(0x7f9c58160590 0x7f9c58166f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:08.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.041+0000 7f9c55d9b640 1 -- 172.21.15.114:0/2722884696 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1829559611 0 0) 0x7f9c58072d10 con 0x7f9c5815d010 2024-04-28T13:08:08.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.041+0000 7f9c55d9b640 1 -- 172.21.15.114:0/2722884696 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c40003520 con 0x7f9c5815d010 2024-04-28T13:08:08.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.041+0000 7f9c55d9b640 1 -- 172.21.15.114:0/2722884696 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3786166988 0 0) 0x7f9c40003520 con 0x7f9c5815d010 2024-04-28T13:08:08.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.041+0000 7f9c55d9b640 1 -- 172.21.15.114:0/2722884696 >> v2:172.21.15.134:3300/0 conn(0x7f9c58160590 msgr2=0x7f9c58166f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:08.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.041+0000 7f9c55d9b640 1 --2- 172.21.15.114:0/2722884696 >> v2:172.21.15.134:3300/0 conn(0x7f9c58160590 0x7f9c58166f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:08.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.041+0000 7f9c55d9b640 1 -- 172.21.15.114:0/2722884696 >> v1:172.21.15.134:6789/0 conn(0x7f9c580d1490 legacy=0x7f9c5815fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:08.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.041+0000 7f9c55d9b640 1 -- 172.21.15.114:0/2722884696 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c580732d0 con 0x7f9c5815d010 2024-04-28T13:08:08.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.041+0000 7f9c55d9b640 1 -- 172.21.15.114:0/2722884696 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f9c4c001670 con 0x7f9c5815d010 2024-04-28T13:08:08.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.041+0000 7f9c55d9b640 1 -- 172.21.15.114:0/2722884696 >> v1:172.21.15.114:6789/0 conn(0x7f9c5815d010 legacy=0x7f9c580d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:08.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.041+0000 7f9c55d9b640 1 --2- 172.21.15.114:0/2722884696 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9c400039b0 0x7f9c40003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:08.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.041+0000 7f9c55d9b640 1 --2- 172.21.15.114:0/2722884696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c40004800 0x7f9c40004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:08.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.041+0000 7f9c55d9b640 1 --2- 172.21.15.114:0/2722884696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c40005210 0x7f9c4000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:08.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.041+0000 7f9c55d9b640 1 -- 172.21.15.114:0/2722884696 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9c58072ac0 con 0x7f9c40004800 2024-04-28T13:08:08.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.041+0000 7f9c55d9b640 1 -- 172.21.15.114:0/2722884696 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4000c140 con 0x7f9c40005210 2024-04-28T13:08:08.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.041+0000 7f9c55d9b640 1 -- 172.21.15.114:0/2722884696 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f9c4000c340 con 0x7f9c400039b0 2024-04-28T13:08:08.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.041+0000 7f9c5659c640 1 --2- 172.21.15.114:0/2722884696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c40004800 0x7f9c40004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:08.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.041+0000 7f9c5759e640 1 --2- 172.21.15.114:0/2722884696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c40005210 0x7f9c4000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:08.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.041+0000 7f9c56d9d640 1 --2- 172.21.15.114:0/2722884696 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9c400039b0 0x7f9c40003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:08.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.041+0000 7f9c5659c640 1 -- 172.21.15.114:0/2722884696 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9c400039b0 msgr2=0x7f9c40003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:08.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.041+0000 7f9c5659c640 1 --2- 172.21.15.114:0/2722884696 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9c400039b0 0x7f9c40003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:08.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.041+0000 7f9c5659c640 1 -- 172.21.15.114:0/2722884696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c40005210 msgr2=0x7f9c4000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:08.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.041+0000 7f9c5659c640 1 --2- 172.21.15.114:0/2722884696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c40005210 0x7f9c4000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:08.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.041+0000 7f9c5759e640 1 -- 172.21.15.114:0/2722884696 reap_dead start 2024-04-28T13:08:08.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.041+0000 7f9c5659c640 1 -- 172.21.15.114:0/2722884696 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c40003520 con 0x7f9c40004800 2024-04-28T13:08:08.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.042+0000 7f9c5659c640 1 --2- 172.21.15.114:0/2722884696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c40004800 0x7f9c40004c80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9c580726b0 tx=0x7f9c40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fce22b2cd585514 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:08.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.042+0000 7f9c55d9b640 1 -- 172.21.15.114:0/2722884696 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c48001370 con 0x7f9c40004800 2024-04-28T13:08:08.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.042+0000 7f9c55d9b640 1 -- 172.21.15.114:0/2722884696 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c480052d0 con 0x7f9c40004800 2024-04-28T13:08:08.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.042+0000 7f9c55d9b640 1 -- 172.21.15.114:0/2722884696 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4802ab70 con 0x7f9c40004800 2024-04-28T13:08:08.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.043+0000 7f9c5d22a640 1 -- 172.21.15.114:0/2722884696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c40004800 msgr2=0x7f9c40004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:08.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.043+0000 7f9c5d22a640 1 --2- 172.21.15.114:0/2722884696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c40004800 0x7f9c40004c80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9c580726b0 tx=0x7f9c40005830 comp rx=0 tx=0).stop 2024-04-28T13:08:08.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.043+0000 7f9c5d22a640 1 -- 172.21.15.114:0/2722884696 shutdown_connections 2024-04-28T13:08:08.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.043+0000 7f9c5d22a640 1 --2- 172.21.15.114:0/2722884696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c40004800 0x7f9c40004c80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:08.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.043+0000 7f9c5d22a640 1 -- 172.21.15.114:0/2722884696 >> 172.21.15.114:0/2722884696 conn(0x7f9c580cd8b0 msgr2=0x7f9c580cdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:08.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.043+0000 7f9c5d22a640 1 -- 172.21.15.114:0/2722884696 shutdown_connections 2024-04-28T13:08:08.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.043+0000 7f9c5d22a640 1 -- 172.21.15.114:0/2722884696 wait complete. 2024-04-28T13:08:08.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.044+0000 7f9c5d22a640 1 Processor -- start 2024-04-28T13:08:08.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.044+0000 7f9c5d22a640 1 -- start start 2024-04-28T13:08:08.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.045+0000 7f9c5d22a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c40004800 0x7f9c5815b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:08.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.045+0000 7f9c5d22a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c5814d3d0 0x7f9c5814d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:08.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.045+0000 7f9c5d22a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9c5815d6f0 0x7f9c5815db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:08.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.045+0000 7f9c5d22a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5815d3f0 con 0x7f9c40004800 2024-04-28T13:08:08.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.045+0000 7f9c5d22a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9c58073ad0 con 0x7f9c5814d3d0 2024-04-28T13:08:08.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.045+0000 7f9c5d22a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f9c5815d570 con 0x7f9c5815d6f0 2024-04-28T13:08:08.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.045+0000 7f9c56d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c40004800 0x7f9c5815b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:08.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.045+0000 7f9c56d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c40004800 0x7f9c5815b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36704/0 (socket says 172.21.15.114:36704) 2024-04-28T13:08:08.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.045+0000 7f9c56d9d640 1 -- 172.21.15.114:0/3718943141 learned_addr learned my addr 172.21.15.114:0/3718943141 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:08.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.045+0000 7f9c5659c640 1 --2- 172.21.15.114:0/3718943141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c5814d3d0 0x7f9c5814d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:08.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.045+0000 7f9c5759e640 1 --2- 172.21.15.114:0/3718943141 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9c5815d6f0 0x7f9c5815db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:08.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.045+0000 7f9c56d9d640 1 -- 172.21.15.114:0/3718943141 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9c5815d6f0 msgr2=0x7f9c5815db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:08.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.045+0000 7f9c56d9d640 1 --2- 172.21.15.114:0/3718943141 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9c5815d6f0 0x7f9c5815db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:08.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.045+0000 7f9c56d9d640 1 -- 172.21.15.114:0/3718943141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c5814d3d0 msgr2=0x7f9c5814d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:08.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.045+0000 7f9c56d9d640 1 --2- 172.21.15.114:0/3718943141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c5814d3d0 0x7f9c5814d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:08.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.045+0000 7f9c56d9d640 1 -- 172.21.15.114:0/3718943141 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c5814e140 con 0x7f9c40004800 2024-04-28T13:08:08.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.045+0000 7f9c5659c640 1 --2- 172.21.15.114:0/3718943141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c5814d3d0 0x7f9c5814d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:08.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.045+0000 7f9c5759e640 1 --2- 172.21.15.114:0/3718943141 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9c5815d6f0 0x7f9c5815db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:08.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.046+0000 7f9c56d9d640 1 --2- 172.21.15.114:0/3718943141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c40004800 0x7f9c5815b2a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c001050 tx=0x7f9c4c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:08.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.046+0000 7f9c3f7fe640 1 -- 172.21.15.114:0/3718943141 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c00ee70 con 0x7f9c40004800 2024-04-28T13:08:08.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.046+0000 7f9c3f7fe640 1 -- 172.21.15.114:0/3718943141 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c4c018070 con 0x7f9c40004800 2024-04-28T13:08:08.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.046+0000 7f9c5d22a640 1 -- 172.21.15.114:0/3718943141 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c5814e480 con 0x7f9c40004800 2024-04-28T13:08:08.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.046+0000 7f9c3f7fe640 1 -- 172.21.15.114:0/3718943141 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c00cad0 con 0x7f9c40004800 2024-04-28T13:08:08.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.046+0000 7f9c5d22a640 1 -- 172.21.15.114:0/3718943141 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c5814ecc0 con 0x7f9c40004800 2024-04-28T13:08:08.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.047+0000 7f9c5d22a640 1 -- 172.21.15.114:0/3718943141 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c5806a3d0 con 0x7f9c40004800 2024-04-28T13:08:08.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.047+0000 7f9c3f7fe640 1 -- 172.21.15.114:0/3718943141 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9c4c00cc70 con 0x7f9c40004800 2024-04-28T13:08:08.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.048+0000 7f9c3f7fe640 1 --2- 172.21.15.114:0/3718943141 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9c4406c8f0 0x7f9c4406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:08.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.048+0000 7f9c3f7fe640 1 -- 172.21.15.114:0/3718943141 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f9c4c08ba50 con 0x7f9c40004800 2024-04-28T13:08:08.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.048+0000 7f9c5659c640 1 --2- 172.21.15.114:0/3718943141 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9c4406c8f0 0x7f9c4406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:08.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.048+0000 7f9c5659c640 1 --2- 172.21.15.114:0/3718943141 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9c4406c8f0 0x7f9c4406edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9c48032000 tx=0x7f9c4802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:08.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.052+0000 7f9c3f7fe640 1 -- 172.21.15.114:0/3718943141 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9c5814e480 con 0x7f9c40004800 2024-04-28T13:08:08.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.262+0000 7f9c5d22a640 1 -- 172.21.15.114:0/3718943141 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f9c580cf410 con 0x7f9c40004800 2024-04-28T13:08:08.264 INFO:tasks.ceph.mon.a.smithi114.stderr:2024-04-28T13:08:08.263+0000 7fb8b63d7640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-28T13:08:08.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.264+0000 7f9c3f7fe640 1 -- 172.21.15.114:0/3718943141 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) ==== 161+0+0 (secure 0 0 0) 0x7f9c4c059e00 con 0x7f9c40004800 2024-04-28T13:08:08.265 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-28T13:08:08.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.267+0000 7f9c5d22a640 1 -- 172.21.15.114:0/3718943141 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9c4406c8f0 msgr2=0x7f9c4406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:08.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.267+0000 7f9c5d22a640 1 --2- 172.21.15.114:0/3718943141 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9c4406c8f0 0x7f9c4406edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9c48032000 tx=0x7f9c4802e000 comp rx=0 tx=0).stop 2024-04-28T13:08:08.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.267+0000 7f9c5d22a640 1 -- 172.21.15.114:0/3718943141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c40004800 msgr2=0x7f9c5815b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:08.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.267+0000 7f9c5d22a640 1 --2- 172.21.15.114:0/3718943141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c40004800 0x7f9c5815b2a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c001050 tx=0x7f9c4c00ec80 comp rx=0 tx=0).stop 2024-04-28T13:08:08.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.267+0000 7f9c5d22a640 1 -- 172.21.15.114:0/3718943141 shutdown_connections 2024-04-28T13:08:08.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.267+0000 7f9c5d22a640 1 --2- 172.21.15.114:0/3718943141 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9c5815d6f0 0x7f9c5815db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:08.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.267+0000 7f9c5d22a640 1 --2- 172.21.15.114:0/3718943141 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9c4406c8f0 0x7f9c4406edb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:08.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.267+0000 7f9c5d22a640 1 --2- 172.21.15.114:0/3718943141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c5814d3d0 0x7f9c5814d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:08.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.267+0000 7f9c5d22a640 1 --2- 172.21.15.114:0/3718943141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c40004800 0x7f9c5815b2a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:08.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.267+0000 7f9c5d22a640 1 -- 172.21.15.114:0/3718943141 >> 172.21.15.114:0/3718943141 conn(0x7f9c580cd8b0 msgr2=0x7f9c580cdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:08.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.267+0000 7f9c5d22a640 1 -- 172.21.15.114:0/3718943141 shutdown_connections 2024-04-28T13:08:08.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.267+0000 7f9c5d22a640 1 -- 172.21.15.114:0/3718943141 wait complete. 2024-04-28T13:08:08.271 INFO:tasks.ceph.mds.a.smithi114.stderr: -7467> 2024-04-28T13:07:29.265+0000 7f066aeb3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-28T13:08:08.280 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-28T13:08:08.303 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-04-28T13:08:08.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.380+0000 7f3ed852c640 1 Processor -- start 2024-04-28T13:08:08.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.380+0000 7f3ed852c640 1 -- start start 2024-04-28T13:08:08.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.381+0000 7f3ed852c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3ed0160d70 0x7f3ed0161220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:08.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.381+0000 7f3ed852c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ed006c350 0x7f3ed006c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:08.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.381+0000 7f3ed852c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ed01618e0 con 0x7f3ed0146b10 2024-04-28T13:08:08.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.381+0000 7f3ed852c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f3ed0161bc0 con 0x7f3ed0160d70 2024-04-28T13:08:08.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.381+0000 7f3ed852c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3ed00d0ba0 con 0x7f3ed006c350 2024-04-28T13:08:08.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.381+0000 7f3ed5ac7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3ed0160d70 0x7f3ed0161220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:08.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.381+0000 7f3ed5ac7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3ed0160d70 0x7f3ed0161220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36722/0 (socket says 172.21.15.114:36722) 2024-04-28T13:08:08.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.381+0000 7f3ed5ac7640 1 -- 172.21.15.114:0/2791000857 learned_addr learned my addr 172.21.15.114:0/2791000857 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:08.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.381+0000 7f3ed5ac7640 1 -- 172.21.15.114:0/2791000857 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ed006c350 msgr2=0x7f3ed006c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:08.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.381+0000 7f3ed6ac9640 1 --2- 172.21.15.114:0/2791000857 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ed006c350 0x7f3ed006c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:08.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.381+0000 7f3ed5ac7640 1 --2- 172.21.15.114:0/2791000857 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ed006c350 0x7f3ed006c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:08.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.381+0000 7f3ed5ac7640 1 -- 172.21.15.114:0/2791000857 >> v1:172.21.15.134:6789/0 conn(0x7f3ed0146b10 legacy=0x7f3ed00d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:08.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.381+0000 7f3ed5ac7640 1 -- 172.21.15.114:0/2791000857 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed00d0e80 con 0x7f3ed0160d70 2024-04-28T13:08:08.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.381+0000 7f3ed6ac9640 1 --2- 172.21.15.114:0/2791000857 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ed006c350 0x7f3ed006c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:08.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.382+0000 7f3ed5ac7640 1 --2- 172.21.15.114:0/2791000857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ed0160d70 0x7f3ed0161220 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009870 tx=0x7f3ec002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9cda9d7335fceb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:08.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.382+0000 7f3ed52c6640 1 -- 172.21.15.114:0/2791000857 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0037070 con 0x7f3ed0160d70 2024-04-28T13:08:08.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.382+0000 7f3ed52c6640 1 -- 172.21.15.114:0/2791000857 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ec0032440 con 0x7f3ed0160d70 2024-04-28T13:08:08.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.382+0000 7f3ed52c6640 1 -- 172.21.15.114:0/2791000857 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0032810 con 0x7f3ed0160d70 2024-04-28T13:08:08.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.382+0000 7f3ed852c640 1 -- 172.21.15.114:0/2791000857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ed0160d70 msgr2=0x7f3ed0161220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:08.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.382+0000 7f3ed852c640 1 --2- 172.21.15.114:0/2791000857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ed0160d70 0x7f3ed0161220 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009870 tx=0x7f3ec002a210 comp rx=0 tx=0).stop 2024-04-28T13:08:08.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.382+0000 7f3ed852c640 1 -- 172.21.15.114:0/2791000857 shutdown_connections 2024-04-28T13:08:08.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.382+0000 7f3ed852c640 1 --2- 172.21.15.114:0/2791000857 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ed006c350 0x7f3ed006c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:08.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.382+0000 7f3ed852c640 1 --2- 172.21.15.114:0/2791000857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ed0160d70 0x7f3ed0161220 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:08.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.382+0000 7f3ed852c640 1 -- 172.21.15.114:0/2791000857 >> 172.21.15.114:0/2791000857 conn(0x7f3ed006f4f0 msgr2=0x7f3ed006f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:08.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.383+0000 7f3ed852c640 1 -- 172.21.15.114:0/2791000857 shutdown_connections 2024-04-28T13:08:08.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.383+0000 7f3ed852c640 1 -- 172.21.15.114:0/2791000857 wait complete. 2024-04-28T13:08:08.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.384+0000 7f3ed852c640 1 Processor -- start 2024-04-28T13:08:08.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.384+0000 7f3ed852c640 1 -- start start 2024-04-28T13:08:08.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.384+0000 7f3ed852c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ed006c350 0x7f3ed015cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:08.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.384+0000 7f3ed852c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ed0146b10 0x7f3ed015f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:08.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.384+0000 7f3ed852c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ed0160d70 0x7f3ed015f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:08.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.384+0000 7f3ed852c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed0070770 con 0x7f3ed0146b10 2024-04-28T13:08:08.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.384+0000 7f3ed852c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed0073ee0 con 0x7f3ed0160d70 2024-04-28T13:08:08.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.384+0000 7f3ed852c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3ed00708f0 con 0x7f3ed006c350 2024-04-28T13:08:08.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.384+0000 7f3ed5ac7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ed0146b10 0x7f3ed015f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:08.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.384+0000 7f3ed5ac7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ed0146b10 0x7f3ed015f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36738/0 (socket says 172.21.15.114:36738) 2024-04-28T13:08:08.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.384+0000 7f3ed5ac7640 1 -- 172.21.15.114:0/620382721 learned_addr learned my addr 172.21.15.114:0/620382721 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:08.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.385+0000 7f3ed6ac9640 1 --2- 172.21.15.114:0/620382721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ed0160d70 0x7f3ed015f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:08.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.385+0000 7f3ed62c8640 1 --2- 172.21.15.114:0/620382721 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ed006c350 0x7f3ed015cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:08.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.385+0000 7f3ed5ac7640 1 -- 172.21.15.114:0/620382721 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ed006c350 msgr2=0x7f3ed015cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:08.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.385+0000 7f3ed5ac7640 1 --2- 172.21.15.114:0/620382721 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ed006c350 0x7f3ed015cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:08.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.385+0000 7f3ed5ac7640 1 -- 172.21.15.114:0/620382721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ed0160d70 msgr2=0x7f3ed015f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:08.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.385+0000 7f3ed5ac7640 1 --2- 172.21.15.114:0/620382721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ed0160d70 0x7f3ed015f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:08.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.385+0000 7f3ed5ac7640 1 -- 172.21.15.114:0/620382721 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed00b1970 con 0x7f3ed0146b10 2024-04-28T13:08:08.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.385+0000 7f3ed6ac9640 1 --2- 172.21.15.114:0/620382721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ed0160d70 0x7f3ed015f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:08.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.385+0000 7f3ed62c8640 1 --2- 172.21.15.114:0/620382721 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ed006c350 0x7f3ed015cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:08.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.385+0000 7f3ed5ac7640 1 --2- 172.21.15.114:0/620382721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ed0146b10 0x7f3ed015f320 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3ec002a250 tx=0x7f3ec00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:08.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.385+0000 7f3ec6ffd640 1 -- 172.21.15.114:0/620382721 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0037040 con 0x7f3ed0146b10 2024-04-28T13:08:08.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.385+0000 7f3ec6ffd640 1 -- 172.21.15.114:0/620382721 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ec0042070 con 0x7f3ed0146b10 2024-04-28T13:08:08.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.385+0000 7f3ed852c640 1 -- 172.21.15.114:0/620382721 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ed00b1c10 con 0x7f3ed0146b10 2024-04-28T13:08:08.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.385+0000 7f3ec6ffd640 1 -- 172.21.15.114:0/620382721 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0030bb0 con 0x7f3ed0146b10 2024-04-28T13:08:08.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.385+0000 7f3ed852c640 1 -- 172.21.15.114:0/620382721 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ed00b21d0 con 0x7f3ed0146b10 2024-04-28T13:08:08.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.386+0000 7f3ed852c640 1 -- 172.21.15.114:0/620382721 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ed006a3d0 con 0x7f3ed0146b10 2024-04-28T13:08:08.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.387+0000 7f3ec6ffd640 1 -- 172.21.15.114:0/620382721 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3ec0047460 con 0x7f3ed0146b10 2024-04-28T13:08:08.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.387+0000 7f3ec6ffd640 1 --2- 172.21.15.114:0/620382721 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3eb406c8f0 0x7f3eb406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:08.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.387+0000 7f3ec6ffd640 1 -- 172.21.15.114:0/620382721 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5911+0+0 (secure 0 0 0) 0x7f3ec00ac7e0 con 0x7f3ed0146b10 2024-04-28T13:08:08.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.387+0000 7f3ed62c8640 1 --2- 172.21.15.114:0/620382721 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3eb406c8f0 0x7f3eb406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:08.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.387+0000 7f3ed62c8640 1 --2- 172.21.15.114:0/620382721 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3eb406c8f0 0x7f3eb406edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc003eb0 tx=0x7f3ecc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:08.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.391+0000 7f3ec6ffd640 1 -- 172.21.15.114:0/620382721 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3ec0045360 con 0x7f3ed0146b10 2024-04-28T13:08:08.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:08.603+0000 7f3ed852c640 1 -- 172.21.15.114:0/620382721 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3ed006e470 con 0x7f3ed0146b10 2024-04-28T13:08:09.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.266+0000 7f3ec6ffd640 1 -- 172.21.15.114:0/620382721 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) ==== 104+0+0 (secure 0 0 0) 0x7f3ec007abd0 con 0x7f3ed0146b10 2024-04-28T13:08:09.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.268+0000 7f3ed852c640 1 -- 172.21.15.114:0/620382721 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3eb406c8f0 msgr2=0x7f3eb406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:09.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.268+0000 7f3ed852c640 1 --2- 172.21.15.114:0/620382721 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3eb406c8f0 0x7f3eb406edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc003eb0 tx=0x7f3ecc009040 comp rx=0 tx=0).stop 2024-04-28T13:08:09.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.268+0000 7f3ed852c640 1 -- 172.21.15.114:0/620382721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ed0146b10 msgr2=0x7f3ed015f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:09.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.268+0000 7f3ed852c640 1 --2- 172.21.15.114:0/620382721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ed0146b10 0x7f3ed015f320 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3ec002a250 tx=0x7f3ec00046c0 comp rx=0 tx=0).stop 2024-04-28T13:08:09.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.268+0000 7f3ed852c640 1 -- 172.21.15.114:0/620382721 shutdown_connections 2024-04-28T13:08:09.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.268+0000 7f3ed852c640 1 --2- 172.21.15.114:0/620382721 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3eb406c8f0 0x7f3eb406edb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:09.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.268+0000 7f3ed852c640 1 --2- 172.21.15.114:0/620382721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ed0160d70 0x7f3ed015f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:09.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.268+0000 7f3ed852c640 1 --2- 172.21.15.114:0/620382721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ed0146b10 0x7f3ed015f320 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:09.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.268+0000 7f3ed852c640 1 --2- 172.21.15.114:0/620382721 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ed006c350 0x7f3ed015cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:09.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.268+0000 7f3ed852c640 1 -- 172.21.15.114:0/620382721 >> 172.21.15.114:0/620382721 conn(0x7f3ed006f4f0 msgr2=0x7f3ed0145c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:09.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.268+0000 7f3ed852c640 1 -- 172.21.15.114:0/620382721 shutdown_connections 2024-04-28T13:08:09.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.269+0000 7f3ed852c640 1 -- 172.21.15.114:0/620382721 wait complete. 2024-04-28T13:08:09.281 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-28T13:08:09.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.424+0000 7f6b8ad89640 1 Processor -- start 2024-04-28T13:08:09.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.424+0000 7f6b8ad89640 1 -- start start 2024-04-28T13:08:09.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.425+0000 7f6b8ad89640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6b8415f4c0 0x7f6b840d3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:09.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.425+0000 7f6b8ad89640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6b840d4cb0 0x7f6b840bacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:09.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.425+0000 7f6b8ad89640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b840b6c30 0x7f6b840b7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:09.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.425+0000 7f6b8ad89640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f6b840b7580 con 0x7f6b8415f4c0 2024-04-28T13:08:09.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.425+0000 7f6b8ad89640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f6b840d3c10 con 0x7f6b840d4cb0 2024-04-28T13:08:09.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.425+0000 7f6b8ad89640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f6b840d3ef0 con 0x7f6b840b6c30 2024-04-28T13:08:09.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.425+0000 7f6b88b25640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6b8415f4c0 0x7f6b840d3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:09.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.425+0000 7f6b88b25640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6b8415f4c0 0x7f6b840d3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36746/0 (socket says 172.21.15.114:36746) 2024-04-28T13:08:09.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.425+0000 7f6b88b25640 1 -- 172.21.15.114:0/1550580825 learned_addr learned my addr 172.21.15.114:0/1550580825 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:09.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.425+0000 7f6b83fff640 1 --2- 172.21.15.114:0/1550580825 >> v2:172.21.15.134:3300/0 conn(0x7f6b840d4cb0 0x7f6b840bacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:09.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.425+0000 7f6b89326640 1 --2- 172.21.15.114:0/1550580825 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b840b6c30 0x7f6b840b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:09.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.426+0000 7f6b88b25640 1 -- 172.21.15.114:0/1550580825 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b840b6c30 msgr2=0x7f6b840b7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:09.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.426+0000 7f6b88b25640 1 --2- 172.21.15.114:0/1550580825 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b840b6c30 0x7f6b840b7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:09.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.426+0000 7f6b88b25640 1 -- 172.21.15.114:0/1550580825 >> v2:172.21.15.134:3300/0 conn(0x7f6b840d4cb0 msgr2=0x7f6b840bacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:09.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.426+0000 7f6b88b25640 1 --2- 172.21.15.114:0/1550580825 >> v2:172.21.15.134:3300/0 conn(0x7f6b840d4cb0 0x7f6b840bacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:09.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.426+0000 7f6b88b25640 1 -- 172.21.15.114:0/1550580825 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b840d41d0 con 0x7f6b8415f4c0 2024-04-28T13:08:09.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.426+0000 7f6b88b25640 1 --2- 172.21.15.114:0/1550580825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b8415f4c0 0x7f6b840d3510 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6b840d1b70 tx=0x7f6b7802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29132d7aafd18257 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:09.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.428+0000 7f6b837fe640 1 -- 172.21.15.114:0/1550580825 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b78037070 con 0x7f6b8415f4c0 2024-04-28T13:08:09.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.428+0000 7f6b837fe640 1 -- 172.21.15.114:0/1550580825 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b78032440 con 0x7f6b8415f4c0 2024-04-28T13:08:09.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.428+0000 7f6b837fe640 1 -- 172.21.15.114:0/1550580825 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b78032810 con 0x7f6b8415f4c0 2024-04-28T13:08:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.429+0000 7f6b8ad89640 1 -- 172.21.15.114:0/1550580825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b8415f4c0 msgr2=0x7f6b840d3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.429+0000 7f6b8ad89640 1 --2- 172.21.15.114:0/1550580825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b8415f4c0 0x7f6b840d3510 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6b840d1b70 tx=0x7f6b7802a270 comp rx=0 tx=0).stop 2024-04-28T13:08:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.429+0000 7f6b8ad89640 1 -- 172.21.15.114:0/1550580825 shutdown_connections 2024-04-28T13:08:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.429+0000 7f6b8ad89640 1 --2- 172.21.15.114:0/1550580825 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b840b6c30 0x7f6b840b7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.429+0000 7f6b8ad89640 1 --2- 172.21.15.114:0/1550580825 >> v2:172.21.15.134:3300/0 conn(0x7f6b840d4cb0 0x7f6b840bacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.429+0000 7f6b8ad89640 1 --2- 172.21.15.114:0/1550580825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b8415f4c0 0x7f6b840d3510 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.429+0000 7f6b8ad89640 1 -- 172.21.15.114:0/1550580825 >> 172.21.15.114:0/1550580825 conn(0x7f6b840633a0 msgr2=0x7f6b840d1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.429+0000 7f6b8ad89640 1 -- 172.21.15.114:0/1550580825 shutdown_connections 2024-04-28T13:08:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.429+0000 7f6b8ad89640 1 -- 172.21.15.114:0/1550580825 wait complete. 2024-04-28T13:08:09.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.430+0000 7f6b8ad89640 1 Processor -- start 2024-04-28T13:08:09.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.430+0000 7f6b8ad89640 1 -- start start 2024-04-28T13:08:09.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.431+0000 7f6b8ad89640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b840b6c30 0x7f6b8415f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:09.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.431+0000 7f6b8ad89640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b840d4cb0 0x7f6b840cb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:09.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.431+0000 7f6b8ad89640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b8415f4c0 0x7f6b841f50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:09.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.431+0000 7f6b8ad89640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8406d350 con 0x7f6b840b6c30 2024-04-28T13:08:09.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.431+0000 7f6b8ad89640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6b840d4790 con 0x7f6b840d4cb0 2024-04-28T13:08:09.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.431+0000 7f6b8ad89640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f6b8406d4d0 con 0x7f6b8415f4c0 2024-04-28T13:08:09.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.431+0000 7f6b88b25640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b840b6c30 0x7f6b8415f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:09.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.431+0000 7f6b88b25640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b840b6c30 0x7f6b8415f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36752/0 (socket says 172.21.15.114:36752) 2024-04-28T13:08:09.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.431+0000 7f6b88b25640 1 -- 172.21.15.114:0/1556124810 learned_addr learned my addr 172.21.15.114:0/1556124810 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:09.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.431+0000 7f6b83fff640 1 --2- 172.21.15.114:0/1556124810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b840d4cb0 0x7f6b840cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:09.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.431+0000 7f6b89326640 1 --2- 172.21.15.114:0/1556124810 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b8415f4c0 0x7f6b841f50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:09.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.431+0000 7f6b88b25640 1 -- 172.21.15.114:0/1556124810 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b8415f4c0 msgr2=0x7f6b841f50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:09.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.431+0000 7f6b88b25640 1 --2- 172.21.15.114:0/1556124810 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b8415f4c0 0x7f6b841f50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:09.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.431+0000 7f6b88b25640 1 -- 172.21.15.114:0/1556124810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b840d4cb0 msgr2=0x7f6b840cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:09.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.431+0000 7f6b88b25640 1 --2- 172.21.15.114:0/1556124810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b840d4cb0 0x7f6b840cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:09.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.431+0000 7f6b88b25640 1 -- 172.21.15.114:0/1556124810 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b840cd780 con 0x7f6b840b6c30 2024-04-28T13:08:09.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.431+0000 7f6b88b25640 1 --2- 172.21.15.114:0/1556124810 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b840b6c30 0x7f6b8415f8a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6b78000c00 tx=0x7f6b780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:09.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.431+0000 7f6b817fa640 1 -- 172.21.15.114:0/1556124810 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b78041020 con 0x7f6b840b6c30 2024-04-28T13:08:09.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.431+0000 7f6b817fa640 1 -- 172.21.15.114:0/1556124810 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b7803d620 con 0x7f6b840b6c30 2024-04-28T13:08:09.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.431+0000 7f6b8ad89640 1 -- 172.21.15.114:0/1556124810 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b840cda60 con 0x7f6b840b6c30 2024-04-28T13:08:09.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.431+0000 7f6b817fa640 1 -- 172.21.15.114:0/1556124810 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b78037040 con 0x7f6b840b6c30 2024-04-28T13:08:09.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.431+0000 7f6b8ad89640 1 -- 172.21.15.114:0/1556124810 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b840ce020 con 0x7f6b840b6c30 2024-04-28T13:08:09.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.433+0000 7f6b8ad89640 1 -- 172.21.15.114:0/1556124810 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b8406a440 con 0x7f6b840b6c30 2024-04-28T13:08:09.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.433+0000 7f6b817fa640 1 -- 172.21.15.114:0/1556124810 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6b78044020 con 0x7f6b840b6c30 2024-04-28T13:08:09.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.433+0000 7f6b817fa640 1 --2- 172.21.15.114:0/1556124810 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6b6806c8f0 0x7f6b6806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:09.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.433+0000 7f6b817fa640 1 -- 172.21.15.114:0/1556124810 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5911+0+0 (secure 0 0 0) 0x7f6b780ac170 con 0x7f6b840b6c30 2024-04-28T13:08:09.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.433+0000 7f6b83fff640 1 --2- 172.21.15.114:0/1556124810 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6b6806c8f0 0x7f6b6806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:09.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.434+0000 7f6b83fff640 1 --2- 172.21.15.114:0/1556124810 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6b6806c8f0 0x7f6b6806edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6b8415e440 tx=0x7f6b70009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:09.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.438+0000 7f6b817fa640 1 -- 172.21.15.114:0/1556124810 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6b7804b030 con 0x7f6b840b6c30 2024-04-28T13:08:09.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:09.613+0000 7f6b8ad89640 1 -- 172.21.15.114:0/1556124810 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6b840b7b60 con 0x7f6b840b6c30 2024-04-28T13:08:10.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.431+0000 7f6b817fa640 1 -- 172.21.15.114:0/1556124810 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) ==== 181+0+0 (secure 0 0 0) 0x7f6b78079e80 con 0x7f6b840b6c30 2024-04-28T13:08:10.432 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' removed 2024-04-28T13:08:10.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.434+0000 7f6b8ad89640 1 -- 172.21.15.114:0/1556124810 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6b6806c8f0 msgr2=0x7f6b6806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:10.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.435+0000 7f6b8ad89640 1 --2- 172.21.15.114:0/1556124810 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6b6806c8f0 0x7f6b6806edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6b8415e440 tx=0x7f6b70009190 comp rx=0 tx=0).stop 2024-04-28T13:08:10.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.435+0000 7f6b8ad89640 1 -- 172.21.15.114:0/1556124810 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b840b6c30 msgr2=0x7f6b8415f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:10.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.435+0000 7f6b8ad89640 1 --2- 172.21.15.114:0/1556124810 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b840b6c30 0x7f6b8415f8a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6b78000c00 tx=0x7f6b780046c0 comp rx=0 tx=0).stop 2024-04-28T13:08:10.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.435+0000 7f6b8ad89640 1 -- 172.21.15.114:0/1556124810 shutdown_connections 2024-04-28T13:08:10.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.435+0000 7f6b8ad89640 1 --2- 172.21.15.114:0/1556124810 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b8415f4c0 0x7f6b841f50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:10.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.435+0000 7f6b8ad89640 1 --2- 172.21.15.114:0/1556124810 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6b6806c8f0 0x7f6b6806edb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:10.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.435+0000 7f6b8ad89640 1 --2- 172.21.15.114:0/1556124810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b840d4cb0 0x7f6b840cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:10.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.435+0000 7f6b8ad89640 1 --2- 172.21.15.114:0/1556124810 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b840b6c30 0x7f6b8415f8a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:10.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.435+0000 7f6b8ad89640 1 -- 172.21.15.114:0/1556124810 >> 172.21.15.114:0/1556124810 conn(0x7f6b840633a0 msgr2=0x7f6b840d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:10.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.435+0000 7f6b8ad89640 1 -- 172.21.15.114:0/1556124810 shutdown_connections 2024-04-28T13:08:10.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.435+0000 7f6b8ad89640 1 -- 172.21.15.114:0/1556124810 wait complete. 2024-04-28T13:08:10.449 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-28T13:08:10.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.555+0000 7f72b9351640 1 Processor -- start 2024-04-28T13:08:10.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.555+0000 7f72b9351640 1 -- start start 2024-04-28T13:08:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.556+0000 7f72b9351640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f72b4146ab0 0x7f72b415e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.556+0000 7f72b9351640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72b40b3d50 0x7f72b40b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.556+0000 7f72b9351640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72b4146e90 con 0x7f72b40cf900 2024-04-28T13:08:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.556+0000 7f72b9351640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f72b40b4700 con 0x7f72b4146ab0 2024-04-28T13:08:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.556+0000 7f72b9351640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f72b4161d20 con 0x7f72b40b3d50 2024-04-28T13:08:10.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.557+0000 7f72b37fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72b40b3d50 0x7f72b40b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:10.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.557+0000 7f72b2ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f72b4146ab0 0x7f72b415e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:10.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.557+0000 7f72b27fc640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f72b40cf900 0x7f72b4160d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:49450/0 (socket says 172.21.15.114:49450) 2024-04-28T13:08:10.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.557+0000 7f72b27fc640 1 -- 172.21.15.114:0/3211911448 learned_addr learned my addr 172.21.15.114:0/3211911448 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:10.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.557+0000 7f72b37fe640 1 -- 172.21.15.114:0/3211911448 >> v2:172.21.15.134:3300/0 conn(0x7f72b4146ab0 msgr2=0x7f72b415e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:10.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.557+0000 7f72b37fe640 1 --2- 172.21.15.114:0/3211911448 >> v2:172.21.15.134:3300/0 conn(0x7f72b4146ab0 0x7f72b415e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:10.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.557+0000 7f72b37fe640 1 -- 172.21.15.114:0/3211911448 >> v1:172.21.15.134:6789/0 conn(0x7f72b40cf900 legacy=0x7f72b4160d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:10.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.557+0000 7f72b37fe640 1 -- 172.21.15.114:0/3211911448 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b4161490 con 0x7f72b40b3d50 2024-04-28T13:08:10.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.557+0000 7f72b2ffd640 1 --2- 172.21.15.114:0/3211911448 >> v2:172.21.15.134:3300/0 conn(0x7f72b4146ab0 0x7f72b415e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:08:10.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.558+0000 7f72b37fe640 1 --2- 172.21.15.114:0/3211911448 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72b40b3d50 0x7f72b40b41c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f72ac0097a0 tx=0x7f72ac02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e04437ba3c4001f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:10.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.558+0000 7f72b1ffb640 1 -- 172.21.15.114:0/3211911448 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ac037070 con 0x7f72b40b3d50 2024-04-28T13:08:10.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.558+0000 7f72b1ffb640 1 -- 172.21.15.114:0/3211911448 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72ac032440 con 0x7f72b40b3d50 2024-04-28T13:08:10.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.558+0000 7f72b1ffb640 1 -- 172.21.15.114:0/3211911448 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ac032810 con 0x7f72b40b3d50 2024-04-28T13:08:10.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.559+0000 7f72b9351640 1 -- 172.21.15.114:0/3211911448 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72b40b3d50 msgr2=0x7f72b40b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:10.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.559+0000 7f72b9351640 1 --2- 172.21.15.114:0/3211911448 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72b40b3d50 0x7f72b40b41c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f72ac0097a0 tx=0x7f72ac02a180 comp rx=0 tx=0).stop 2024-04-28T13:08:10.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.559+0000 7f72b9351640 1 -- 172.21.15.114:0/3211911448 shutdown_connections 2024-04-28T13:08:10.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.559+0000 7f72b9351640 1 --2- 172.21.15.114:0/3211911448 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72b40b3d50 0x7f72b40b41c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:10.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.559+0000 7f72b9351640 1 --2- 172.21.15.114:0/3211911448 >> v2:172.21.15.134:3300/0 conn(0x7f72b4146ab0 0x7f72b415e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:10.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.559+0000 7f72b9351640 1 -- 172.21.15.114:0/3211911448 >> 172.21.15.114:0/3211911448 conn(0x7f72b406d460 msgr2=0x7f72b406d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:10.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.559+0000 7f72b9351640 1 -- 172.21.15.114:0/3211911448 shutdown_connections 2024-04-28T13:08:10.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.559+0000 7f72b9351640 1 -- 172.21.15.114:0/3211911448 wait complete. 2024-04-28T13:08:10.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.560+0000 7f72b9351640 1 Processor -- start 2024-04-28T13:08:10.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.560+0000 7f72b9351640 1 -- start start 2024-04-28T13:08:10.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.561+0000 7f72b9351640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72b40b3d50 0x7f72b4140b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:10.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.561+0000 7f72b9351640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72b40cf900 0x7f72b41f8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:10.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.561+0000 7f72b9351640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72b4146ab0 0x7f72b413c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:10.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.561+0000 7f72b9351640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f72b415d9a0 con 0x7f72b4146ab0 2024-04-28T13:08:10.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.561+0000 7f72b9351640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f72b4161a40 con 0x7f72b40b3d50 2024-04-28T13:08:10.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.561+0000 7f72b9351640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f72b415dc80 con 0x7f72b40cf900 2024-04-28T13:08:10.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.561+0000 7f72b37fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72b4146ab0 0x7f72b413c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:10.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.561+0000 7f72b37fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72b4146ab0 0x7f72b413c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52678/0 (socket says 172.21.15.114:52678) 2024-04-28T13:08:10.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.561+0000 7f72b37fe640 1 -- 172.21.15.114:0/464494643 learned_addr learned my addr 172.21.15.114:0/464494643 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:10.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.561+0000 7f72b27fc640 1 --2- 172.21.15.114:0/464494643 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72b40cf900 0x7f72b41f8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:10.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.561+0000 7f72b2ffd640 1 --2- 172.21.15.114:0/464494643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72b40b3d50 0x7f72b4140b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:10.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.561+0000 7f72b37fe640 1 -- 172.21.15.114:0/464494643 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72b40cf900 msgr2=0x7f72b41f8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:10.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.561+0000 7f72b37fe640 1 --2- 172.21.15.114:0/464494643 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72b40cf900 0x7f72b41f8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:10.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.561+0000 7f72b37fe640 1 -- 172.21.15.114:0/464494643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72b40b3d50 msgr2=0x7f72b4140b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:10.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.561+0000 7f72b37fe640 1 --2- 172.21.15.114:0/464494643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72b40b3d50 0x7f72b4140b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:10.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.561+0000 7f72b37fe640 1 -- 172.21.15.114:0/464494643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b41f9500 con 0x7f72b4146ab0 2024-04-28T13:08:10.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.561+0000 7f72b37fe640 1 --2- 172.21.15.114:0/464494643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72b4146ab0 0x7f72b413c810 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f72ac0098c0 tx=0x7f72ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:10.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.561+0000 7f729b7fe640 1 -- 172.21.15.114:0/464494643 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ac037040 con 0x7f72b4146ab0 2024-04-28T13:08:10.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.561+0000 7f729b7fe640 1 -- 172.21.15.114:0/464494643 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72ac042070 con 0x7f72b4146ab0 2024-04-28T13:08:10.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.561+0000 7f72b9351640 1 -- 172.21.15.114:0/464494643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72b41f97e0 con 0x7f72b4146ab0 2024-04-28T13:08:10.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.561+0000 7f729b7fe640 1 -- 172.21.15.114:0/464494643 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ac0308a0 con 0x7f72b4146ab0 2024-04-28T13:08:10.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.562+0000 7f72b9351640 1 -- 172.21.15.114:0/464494643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72b40b0160 con 0x7f72b4146ab0 2024-04-28T13:08:10.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.562+0000 7f72b9351640 1 -- 172.21.15.114:0/464494643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72b406a440 con 0x7f72b4146ab0 2024-04-28T13:08:10.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.563+0000 7f729b7fe640 1 -- 172.21.15.114:0/464494643 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f72ac030a40 con 0x7f72b4146ab0 2024-04-28T13:08:10.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.563+0000 7f729b7fe640 1 --2- 172.21.15.114:0/464494643 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f72a006c8f0 0x7f72a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:10.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.563+0000 7f729b7fe640 1 -- 172.21.15.114:0/464494643 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5473+0+0 (secure 0 0 0) 0x7f72ac0ac310 con 0x7f72b4146ab0 2024-04-28T13:08:10.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.563+0000 7f72b2ffd640 1 --2- 172.21.15.114:0/464494643 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f72a006c8f0 0x7f72a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:10.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.564+0000 7f72b2ffd640 1 --2- 172.21.15.114:0/464494643 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f72a006c8f0 0x7f72a006edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f72a4007440 tx=0x7f72a400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:10.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.568+0000 7f729b7fe640 1 -- 172.21.15.114:0/464494643 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f72ac07a8b0 con 0x7f72b4146ab0 2024-04-28T13:08:10.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:10.748+0000 7f72b9351640 1 -- 172.21.15.114:0/464494643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f72b4143d60 con 0x7f72b4146ab0 2024-04-28T13:08:11.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.438+0000 7f729b7fe640 1 -- 172.21.15.114:0/464494643 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) ==== 169+0+0 (secure 0 0 0) 0x7f72ac07a1b0 con 0x7f72b4146ab0 2024-04-28T13:08:11.439 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' removed 2024-04-28T13:08:11.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.440+0000 7f72b9351640 1 -- 172.21.15.114:0/464494643 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f72a006c8f0 msgr2=0x7f72a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:11.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.440+0000 7f72b9351640 1 --2- 172.21.15.114:0/464494643 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f72a006c8f0 0x7f72a006edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f72a4007440 tx=0x7f72a400b040 comp rx=0 tx=0).stop 2024-04-28T13:08:11.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.440+0000 7f72b9351640 1 -- 172.21.15.114:0/464494643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72b4146ab0 msgr2=0x7f72b413c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:11.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.440+0000 7f72b9351640 1 --2- 172.21.15.114:0/464494643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72b4146ab0 0x7f72b413c810 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f72ac0098c0 tx=0x7f72ac0046c0 comp rx=0 tx=0).stop 2024-04-28T13:08:11.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.440+0000 7f72b9351640 1 -- 172.21.15.114:0/464494643 shutdown_connections 2024-04-28T13:08:11.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.440+0000 7f72b9351640 1 --2- 172.21.15.114:0/464494643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72b4146ab0 0x7f72b413c810 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:11.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.440+0000 7f72b9351640 1 --2- 172.21.15.114:0/464494643 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72b40cf900 0x7f72b41f8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:11.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.440+0000 7f72b9351640 1 --2- 172.21.15.114:0/464494643 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f72a006c8f0 0x7f72a006edb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:11.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.440+0000 7f72b9351640 1 --2- 172.21.15.114:0/464494643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72b40b3d50 0x7f72b4140b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:11.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.440+0000 7f72b9351640 1 -- 172.21.15.114:0/464494643 >> 172.21.15.114:0/464494643 conn(0x7f72b406d460 msgr2=0x7f72b415b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:11.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.440+0000 7f72b9351640 1 -- 172.21.15.114:0/464494643 shutdown_connections 2024-04-28T13:08:11.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.440+0000 7f72b9351640 1 -- 172.21.15.114:0/464494643 wait complete. 2024-04-28T13:08:11.455 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-28T13:08:11.455 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-28T13:08:11.456 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-28T13:08:11.456 INFO:teuthology.orchestra.run:waiting for 300 2024-04-28T13:08:11.456 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-28T13:08:11.456 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-28T13:08:11.456 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-28T13:08:11.456 INFO:teuthology.orchestra.run:waiting for 300 2024-04-28T13:08:11.456 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-28T13:08:11.456 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-28T13:08:11.457 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-28T13:08:11.457 INFO:teuthology.orchestra.run:waiting for 300 2024-04-28T13:08:11.457 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-28T13:08:11.457 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-28T13:08:11.457 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-28T13:08:11.457 INFO:teuthology.orchestra.run:waiting for 300 2024-04-28T13:08:11.465 INFO:tasks.ceph.mds.c:Stopped 2024-04-28T13:08:11.466 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-28T13:08:11.466 INFO:tasks.ceph.mds.a:Stopped 2024-04-28T13:08:11.466 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-28T13:08:11.468 INFO:tasks.ceph.mds.b:Stopped 2024-04-28T13:08:11.468 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-28T13:08:11.469 INFO:tasks.ceph.mds.d:Stopped 2024-04-28T13:08:11.469 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-28T13:08:11.508 INFO:tasks.ceph.mds.c:Started 2024-04-28T13:08:11.508 DEBUG:teuthology.parallel:result is None 2024-04-28T13:08:11.509 INFO:tasks.ceph.mds.a:Started 2024-04-28T13:08:11.510 DEBUG:teuthology.parallel:result is None 2024-04-28T13:08:11.510 INFO:tasks.ceph.mds.b:Started 2024-04-28T13:08:11.511 DEBUG:teuthology.parallel:result is None 2024-04-28T13:08:11.511 INFO:tasks.ceph.mds.d:Started 2024-04-28T13:08:11.511 DEBUG:teuthology.parallel:result is None 2024-04-28T13:08:11.511 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-28T13:08:11.581 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-04-28T13:08:11.582 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-04-28T13:08:11.589 INFO:tasks.ceph.mds.b.smithi134.stdout:starting mds.b at 2024-04-28T13:08:11.589 INFO:tasks.ceph.mds.d.smithi134.stdout:starting mds.d at 2024-04-28T13:08:11.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.612+0000 7fd5d1b51640 1 Processor -- start 2024-04-28T13:08:11.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.612+0000 7fd5d1b51640 1 -- start start 2024-04-28T13:08:11.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.613+0000 7fd5d1b51640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd5cc1608b0 0x7fd5cc0709d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:11.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.613+0000 7fd5d1b51640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5cc15c7d0 con 0x7fd5cc070480 2024-04-28T13:08:11.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.613+0000 7fd5d1b51640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5cc071770 con 0x7fd5cc15c3f0 2024-04-28T13:08:11.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.613+0000 7fd5d1b51640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fd5cc0aff80 con 0x7fd5cc1608b0 2024-04-28T13:08:11.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.613+0000 7fd5caffd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd5cc070480 0x7fd5cc0b0d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:32834/0 (socket says 172.21.15.114:32834) 2024-04-28T13:08:11.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.613+0000 7fd5caffd640 1 -- 172.21.15.114:0/1794510895 learned_addr learned my addr 172.21.15.114:0/1794510895 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:11.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.613+0000 7fd5cbfff640 1 --2- 172.21.15.114:0/1794510895 >> v2:172.21.15.134:3300/0 conn(0x7fd5cc1608b0 0x7fd5cc0709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:11.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.613+0000 7fd5ca7fc640 1 -- 172.21.15.114:0/1794510895 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1877497631 0 0) 0x7fd5cc15c7d0 con 0x7fd5cc070480 2024-04-28T13:08:11.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.613+0000 7fd5ca7fc640 1 -- 172.21.15.114:0/1794510895 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5b4003520 con 0x7fd5cc070480 2024-04-28T13:08:11.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.613+0000 7fd5ca7fc640 1 -- 172.21.15.114:0/1794510895 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2003244214 0 0) 0x7fd5cc071770 con 0x7fd5cc15c3f0 2024-04-28T13:08:11.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.613+0000 7fd5ca7fc640 1 -- 172.21.15.114:0/1794510895 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5cc15c7d0 con 0x7fd5cc15c3f0 2024-04-28T13:08:11.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.613+0000 7fd5ca7fc640 1 -- 172.21.15.114:0/1794510895 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2897922280 0 0) 0x7fd5b4003520 con 0x7fd5cc070480 2024-04-28T13:08:11.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.613+0000 7fd5cbfff640 1 -- 172.21.15.114:0/1794510895 >> v1:172.21.15.134:6789/0 conn(0x7fd5cc15c3f0 legacy=0x7fd5cc0b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:11.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.614+0000 7fd5cbfff640 1 -- 172.21.15.114:0/1794510895 >> v1:172.21.15.114:6789/0 conn(0x7fd5cc070480 legacy=0x7fd5cc0b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:11.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.614+0000 7fd5cbfff640 1 -- 172.21.15.114:0/1794510895 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5cc0b0260 con 0x7fd5cc1608b0 2024-04-28T13:08:11.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.614+0000 7fd5cbfff640 1 --2- 172.21.15.114:0/1794510895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5cc1608b0 0x7fd5cc0709d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc071940 tx=0x7fd5c402a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8e9da129e338d5c server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:11.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.614+0000 7fd5ca7fc640 1 -- 172.21.15.114:0/1794510895 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0001670 con 0x7fd5cc1608b0 2024-04-28T13:08:11.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.614+0000 7fd5ca7fc640 1 -- 172.21.15.114:0/1794510895 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5c4007540 con 0x7fd5cc1608b0 2024-04-28T13:08:11.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.614+0000 7fd5ca7fc640 1 -- 172.21.15.114:0/1794510895 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4007910 con 0x7fd5cc1608b0 2024-04-28T13:08:11.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.615+0000 7fd5d1b51640 1 -- 172.21.15.114:0/1794510895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5cc1608b0 msgr2=0x7fd5cc0709d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:11.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.615+0000 7fd5d1b51640 1 --2- 172.21.15.114:0/1794510895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5cc1608b0 0x7fd5cc0709d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc071940 tx=0x7fd5c402a5f0 comp rx=0 tx=0).stop 2024-04-28T13:08:11.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.615+0000 7fd5d1b51640 1 -- 172.21.15.114:0/1794510895 shutdown_connections 2024-04-28T13:08:11.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.615+0000 7fd5d1b51640 1 --2- 172.21.15.114:0/1794510895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5cc1608b0 0x7fd5cc0709d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:11.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.615+0000 7fd5d1b51640 1 -- 172.21.15.114:0/1794510895 >> 172.21.15.114:0/1794510895 conn(0x7fd5cc06d460 msgr2=0x7fd5cc06d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:11.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.615+0000 7fd5d1b51640 1 -- 172.21.15.114:0/1794510895 shutdown_connections 2024-04-28T13:08:11.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.615+0000 7fd5d1b51640 1 -- 172.21.15.114:0/1794510895 wait complete. 2024-04-28T13:08:11.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.616+0000 7fd5d1b51640 1 Processor -- start 2024-04-28T13:08:11.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.616+0000 7fd5d1b51640 1 -- start start 2024-04-28T13:08:11.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.617+0000 7fd5d1b51640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5cc070480 0x7fd5cc13f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:11.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.617+0000 7fd5d1b51640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5cc15c3f0 0x7fd5cc13dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:11.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.617+0000 7fd5d1b51640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd5cc1608b0 0x7fd5cc13e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:11.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.617+0000 7fd5d1b51640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd5cc0b5450 con 0x7fd5cc15c3f0 2024-04-28T13:08:11.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.617+0000 7fd5d1b51640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd5cc0afc30 con 0x7fd5cc070480 2024-04-28T13:08:11.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.617+0000 7fd5d1b51640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fd5cc13ec70 con 0x7fd5cc1608b0 2024-04-28T13:08:11.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.617+0000 7fd5caffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5cc15c3f0 0x7fd5cc13dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:11.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.617+0000 7fd5caffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5cc15c3f0 0x7fd5cc13dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52708/0 (socket says 172.21.15.114:52708) 2024-04-28T13:08:11.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.617+0000 7fd5caffd640 1 -- 172.21.15.114:0/3719777719 learned_addr learned my addr 172.21.15.114:0/3719777719 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:11.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.617+0000 7fd5cbfff640 1 --2- 172.21.15.114:0/3719777719 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd5cc1608b0 0x7fd5cc13e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:11.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.617+0000 7fd5cb7fe640 1 --2- 172.21.15.114:0/3719777719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5cc070480 0x7fd5cc13f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:11.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.618+0000 7fd5caffd640 1 -- 172.21.15.114:0/3719777719 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd5cc1608b0 msgr2=0x7fd5cc13e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:11.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.618+0000 7fd5caffd640 1 --2- 172.21.15.114:0/3719777719 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd5cc1608b0 0x7fd5cc13e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:11.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.618+0000 7fd5caffd640 1 -- 172.21.15.114:0/3719777719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5cc070480 msgr2=0x7fd5cc13f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:11.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.618+0000 7fd5caffd640 1 --2- 172.21.15.114:0/3719777719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5cc070480 0x7fd5cc13f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:11.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.618+0000 7fd5caffd640 1 -- 172.21.15.114:0/3719777719 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5cc13f100 con 0x7fd5cc15c3f0 2024-04-28T13:08:11.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.618+0000 7fd5cb7fe640 1 --2- 172.21.15.114:0/3719777719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5cc070480 0x7fd5cc13f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:11.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.618+0000 7fd5caffd640 1 --2- 172.21.15.114:0/3719777719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5cc15c3f0 0x7fd5cc13dea0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd5c000c750 tx=0x7fd5c000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:11.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.618+0000 7fd5b3fff640 1 -- 172.21.15.114:0/3719777719 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0017070 con 0x7fd5cc15c3f0 2024-04-28T13:08:11.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.618+0000 7fd5b3fff640 1 -- 172.21.15.114:0/3719777719 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5c0005ad0 con 0x7fd5cc15c3f0 2024-04-28T13:08:11.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.618+0000 7fd5b3fff640 1 -- 172.21.15.114:0/3719777719 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0007070 con 0x7fd5cc15c3f0 2024-04-28T13:08:11.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.618+0000 7fd5d1b51640 1 -- 172.21.15.114:0/3719777719 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5cc13e920 con 0x7fd5cc15c3f0 2024-04-28T13:08:11.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.618+0000 7fd5d1b51640 1 -- 172.21.15.114:0/3719777719 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5cc14c2d0 con 0x7fd5cc15c3f0 2024-04-28T13:08:11.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.619+0000 7fd5d1b51640 1 -- 172.21.15.114:0/3719777719 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5cc072ce0 con 0x7fd5cc15c3f0 2024-04-28T13:08:11.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.619+0000 7fd5b3fff640 1 -- 172.21.15.114:0/3719777719 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd5c001a070 con 0x7fd5cc15c3f0 2024-04-28T13:08:11.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.620+0000 7fd5b3fff640 1 --2- 172.21.15.114:0/3719777719 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd5b806c8f0 0x7fd5b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:11.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.620+0000 7fd5b3fff640 1 -- 172.21.15.114:0/3719777719 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 4943+0+0 (secure 0 0 0) 0x7fd5c008ab80 con 0x7fd5cc15c3f0 2024-04-28T13:08:11.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.620+0000 7fd5cb7fe640 1 --2- 172.21.15.114:0/3719777719 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd5b806c8f0 0x7fd5b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:11.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.620+0000 7fd5cb7fe640 1 --2- 172.21.15.114:0/3719777719 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd5b806c8f0 0x7fd5b806edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc0011e0 tx=0x7fd5bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:11.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.624+0000 7fd5b3fff640 1 -- 172.21.15.114:0/3719777719 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd5cc072ce0 con 0x7fd5cc15c3f0 2024-04-28T13:08:11.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:11.815+0000 7fd5d1b51640 1 -- 172.21.15.114:0/3719777719 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fd5cc06a3d0 con 0x7fd5cc15c3f0 2024-04-28T13:08:12.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.453+0000 7fd5b3fff640 1 -- 172.21.15.114:0/3719777719 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) ==== 97+0+0 (secure 0 0 0) 0x7fd5cc13f100 con 0x7fd5cc15c3f0 2024-04-28T13:08:12.454 INFO:teuthology.orchestra.run.smithi114.stderr: removed all blocklist entries 2024-04-28T13:08:12.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.455+0000 7fd5d1b51640 1 -- 172.21.15.114:0/3719777719 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd5b806c8f0 msgr2=0x7fd5b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:12.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.455+0000 7fd5d1b51640 1 --2- 172.21.15.114:0/3719777719 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd5b806c8f0 0x7fd5b806edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc0011e0 tx=0x7fd5bc009040 comp rx=0 tx=0).stop 2024-04-28T13:08:12.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.455+0000 7fd5d1b51640 1 -- 172.21.15.114:0/3719777719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5cc15c3f0 msgr2=0x7fd5cc13dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:12.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.455+0000 7fd5d1b51640 1 --2- 172.21.15.114:0/3719777719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5cc15c3f0 0x7fd5cc13dea0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd5c000c750 tx=0x7fd5c000cc10 comp rx=0 tx=0).stop 2024-04-28T13:08:12.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.456+0000 7fd5d1b51640 1 -- 172.21.15.114:0/3719777719 shutdown_connections 2024-04-28T13:08:12.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.456+0000 7fd5d1b51640 1 --2- 172.21.15.114:0/3719777719 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd5cc1608b0 0x7fd5cc13e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:12.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.456+0000 7fd5d1b51640 1 --2- 172.21.15.114:0/3719777719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5cc15c3f0 0x7fd5cc13dea0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:12.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.456+0000 7fd5d1b51640 1 --2- 172.21.15.114:0/3719777719 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd5b806c8f0 0x7fd5b806edb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:12.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.456+0000 7fd5d1b51640 1 --2- 172.21.15.114:0/3719777719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5cc070480 0x7fd5cc13f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:12.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.456+0000 7fd5d1b51640 1 -- 172.21.15.114:0/3719777719 >> 172.21.15.114:0/3719777719 conn(0x7fd5cc06d460 msgr2=0x7fd5cc0b5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:12.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.456+0000 7fd5d1b51640 1 -- 172.21.15.114:0/3719777719 shutdown_connections 2024-04-28T13:08:12.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.456+0000 7fd5d1b51640 1 -- 172.21.15.114:0/3719777719 wait complete. 2024-04-28T13:08:12.468 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-28T13:08:12.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.565+0000 7f0f62a45640 1 Processor -- start 2024-04-28T13:08:12.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.565+0000 7f0f62a45640 1 -- start start 2024-04-28T13:08:12.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.565+0000 7f0f62a45640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0f5c15f410 0x7f0f5c0baaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:12.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.565+0000 7f0f62a45640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f5c0b4380 0x7f0f5c0b8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:12.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.565+0000 7f0f62a45640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0f5c0cff60 0x7f0f5c0d03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:12.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.565+0000 7f0f62a45640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f0f5c0d3f10 con 0x7f0f5c0cff60 2024-04-28T13:08:12.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.565+0000 7f0f62a45640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f0f5c0b8840 con 0x7f0f5c15f410 2024-04-28T13:08:12.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.565+0000 7f0f62a45640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f0f5c0d3650 con 0x7f0f5c0b4380 2024-04-28T13:08:12.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.565+0000 7f0f60fe2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0f5c0cff60 0x7f0f5c0d03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:12.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.566+0000 7f0f60fe2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0f5c0cff60 0x7f0f5c0d03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52722/0 (socket says 172.21.15.114:52722) 2024-04-28T13:08:12.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.566+0000 7f0f60fe2640 1 -- 172.21.15.114:0/4010477653 learned_addr learned my addr 172.21.15.114:0/4010477653 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:12.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.566+0000 7f0f5bfff640 1 --2- 172.21.15.114:0/4010477653 >> v2:172.21.15.134:3300/0 conn(0x7f0f5c15f410 0x7f0f5c0baaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:12.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.566+0000 7f0f60fe2640 1 -- 172.21.15.114:0/4010477653 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f5c0b4380 msgr2=0x7f0f5c0b8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:12.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.566+0000 7f0f5b7fe640 1 --2- 172.21.15.114:0/4010477653 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f5c0b4380 0x7f0f5c0b8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:12.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.566+0000 7f0f60fe2640 1 --2- 172.21.15.114:0/4010477653 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f5c0b4380 0x7f0f5c0b8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:12.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.566+0000 7f0f60fe2640 1 -- 172.21.15.114:0/4010477653 >> v2:172.21.15.134:3300/0 conn(0x7f0f5c15f410 msgr2=0x7f0f5c0baaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:12.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.566+0000 7f0f60fe2640 1 --2- 172.21.15.114:0/4010477653 >> v2:172.21.15.134:3300/0 conn(0x7f0f5c15f410 0x7f0f5c0baaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:12.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.566+0000 7f0f60fe2640 1 -- 172.21.15.114:0/4010477653 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5c15f7f0 con 0x7f0f5c0cff60 2024-04-28T13:08:12.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.566+0000 7f0f5b7fe640 1 --2- 172.21.15.114:0/4010477653 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f5c0b4380 0x7f0f5c0b8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:12.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.567+0000 7f0f60fe2640 1 --2- 172.21.15.114:0/4010477653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f5c0cff60 0x7f0f5c0d03f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0d3580 tx=0x7f0f5402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9802205707615ae server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:12.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.567+0000 7f0f5affd640 1 -- 172.21.15.114:0/4010477653 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f54036070 con 0x7f0f5c0cff60 2024-04-28T13:08:12.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.567+0000 7f0f5affd640 1 -- 172.21.15.114:0/4010477653 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f54031600 con 0x7f0f5c0cff60 2024-04-28T13:08:12.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.567+0000 7f0f5affd640 1 -- 172.21.15.114:0/4010477653 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f540319d0 con 0x7f0f5c0cff60 2024-04-28T13:08:12.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.567+0000 7f0f62a45640 1 -- 172.21.15.114:0/4010477653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f5c0cff60 msgr2=0x7f0f5c0d03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:12.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.567+0000 7f0f62a45640 1 --2- 172.21.15.114:0/4010477653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f5c0cff60 0x7f0f5c0d03f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0d3580 tx=0x7f0f5402a730 comp rx=0 tx=0).stop 2024-04-28T13:08:12.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.567+0000 7f0f62a45640 1 -- 172.21.15.114:0/4010477653 shutdown_connections 2024-04-28T13:08:12.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.567+0000 7f0f62a45640 1 --2- 172.21.15.114:0/4010477653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f5c0cff60 0x7f0f5c0d03f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:12.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.567+0000 7f0f62a45640 1 --2- 172.21.15.114:0/4010477653 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f5c0b4380 0x7f0f5c0b8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:12.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.567+0000 7f0f62a45640 1 --2- 172.21.15.114:0/4010477653 >> v2:172.21.15.134:3300/0 conn(0x7f0f5c15f410 0x7f0f5c0baaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:12.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.567+0000 7f0f62a45640 1 -- 172.21.15.114:0/4010477653 >> 172.21.15.114:0/4010477653 conn(0x7f0f5c0633a0 msgr2=0x7f0f5c0d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:12.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.567+0000 7f0f62a45640 1 -- 172.21.15.114:0/4010477653 shutdown_connections 2024-04-28T13:08:12.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.567+0000 7f0f62a45640 1 -- 172.21.15.114:0/4010477653 wait complete. 2024-04-28T13:08:12.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.568+0000 7f0f62a45640 1 Processor -- start 2024-04-28T13:08:12.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.569+0000 7f0f62a45640 1 -- start start 2024-04-28T13:08:12.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.569+0000 7f0f62a45640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f5c0b4380 0x7f0f5c1507e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:12.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.569+0000 7f0f62a45640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f5c0cff60 0x7f0f5c0ceef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:12.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.569+0000 7f0f62a45640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f5c15f410 0x7f0f5c0cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:12.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.569+0000 7f0f62a45640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c0d38c0 con 0x7f0f5c15f410 2024-04-28T13:08:12.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.569+0000 7f0f62a45640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c0d2570 con 0x7f0f5c0b4380 2024-04-28T13:08:12.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.569+0000 7f0f62a45640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f0f5c0d3ba0 con 0x7f0f5c0cff60 2024-04-28T13:08:12.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.569+0000 7f0f60fe2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f5c15f410 0x7f0f5c0cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:12.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.569+0000 7f0f60fe2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f5c15f410 0x7f0f5c0cf430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52728/0 (socket says 172.21.15.114:52728) 2024-04-28T13:08:12.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.569+0000 7f0f60fe2640 1 -- 172.21.15.114:0/179920057 learned_addr learned my addr 172.21.15.114:0/179920057 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:12.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.569+0000 7f0f5bfff640 1 --2- 172.21.15.114:0/179920057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f5c0b4380 0x7f0f5c1507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:12.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.570+0000 7f0f5b7fe640 1 --2- 172.21.15.114:0/179920057 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f5c0cff60 0x7f0f5c0ceef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:12.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.570+0000 7f0f60fe2640 1 -- 172.21.15.114:0/179920057 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f5c0cff60 msgr2=0x7f0f5c0ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:12.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.570+0000 7f0f60fe2640 1 --2- 172.21.15.114:0/179920057 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f5c0cff60 0x7f0f5c0ceef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:12.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.570+0000 7f0f60fe2640 1 -- 172.21.15.114:0/179920057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f5c0b4380 msgr2=0x7f0f5c1507e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:12.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.570+0000 7f0f60fe2640 1 --2- 172.21.15.114:0/179920057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f5c0b4380 0x7f0f5c1507e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:12.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.570+0000 7f0f60fe2640 1 -- 172.21.15.114:0/179920057 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5c0aca70 con 0x7f0f5c15f410 2024-04-28T13:08:12.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.570+0000 7f0f60fe2640 1 --2- 172.21.15.114:0/179920057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f5c15f410 0x7f0f5c0cf430 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0f54009f40 tx=0x7f0f54004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:12.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.570+0000 7f0f58ff9640 1 -- 172.21.15.114:0/179920057 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f54036050 con 0x7f0f5c15f410 2024-04-28T13:08:12.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.570+0000 7f0f58ff9640 1 -- 172.21.15.114:0/179920057 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f54042070 con 0x7f0f5c15f410 2024-04-28T13:08:12.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.570+0000 7f0f58ff9640 1 -- 172.21.15.114:0/179920057 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f54009510 con 0x7f0f5c15f410 2024-04-28T13:08:12.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.570+0000 7f0f62a45640 1 -- 172.21.15.114:0/179920057 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f5c0acd50 con 0x7f0f5c15f410 2024-04-28T13:08:12.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.570+0000 7f0f62a45640 1 -- 172.21.15.114:0/179920057 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f5c0ad310 con 0x7f0f5c15f410 2024-04-28T13:08:12.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.571+0000 7f0f62a45640 1 -- 172.21.15.114:0/179920057 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f5c06a3d0 con 0x7f0f5c15f410 2024-04-28T13:08:12.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.571+0000 7f0f58ff9640 1 -- 172.21.15.114:0/179920057 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0f54007bf0 con 0x7f0f5c15f410 2024-04-28T13:08:12.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.572+0000 7f0f58ff9640 1 --2- 172.21.15.114:0/179920057 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f0f4806c8f0 0x7f0f4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:12.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.572+0000 7f0f5bfff640 1 --2- 172.21.15.114:0/179920057 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f0f4806c8f0 0x7f0f4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:12.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.572+0000 7f0f58ff9640 1 -- 172.21.15.114:0/179920057 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f0f540ac410 con 0x7f0f5c15f410 2024-04-28T13:08:12.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.572+0000 7f0f5bfff640 1 --2- 172.21.15.114:0/179920057 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f0f4806c8f0 0x7f0f4806edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c006fd0 tx=0x7f0f4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:12.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.576+0000 7f0f58ff9640 1 -- 172.21.15.114:0/179920057 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0f5407a5d0 con 0x7f0f5c15f410 2024-04-28T13:08:12.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.817+0000 7f0f62a45640 1 -- 172.21.15.114:0/179920057 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f0f5c0d58b0 con 0x7f0f5c15f410 2024-04-28T13:08:12.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.817+0000 7f0f58ff9640 1 -- 172.21.15.114:0/179920057 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7f0f5407e8d0 con 0x7f0f5c15f410 2024-04-28T13:08:12.818 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:12.818 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-04-28T13:08:12.818 INFO:teuthology.orchestra.run.smithi114.stdout: "auth_dump": [ 2024-04-28T13:08:12.818 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:12.819 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.a", 2024-04-28T13:08:12.819 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDOSS5meB+bEBAArawFLsKWVvZZpyhjaeozhg==", 2024-04-28T13:08:12.819 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:12.819 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-04-28T13:08:12.819 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-04-28T13:08:12.819 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-04-28T13:08:12.819 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-28T13:08:12.819 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:12.819 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:12.819 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:12.819 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.b", 2024-04-28T13:08:12.819 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDOSS5mb4njGxAAx3fJpA7jCiyGvEXLNcpSaQ==", 2024-04-28T13:08:12.819 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:12.819 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-04-28T13:08:12.820 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-04-28T13:08:12.820 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-04-28T13:08:12.820 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-28T13:08:12.820 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:12.820 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:12.820 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:12.820 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.c", 2024-04-28T13:08:12.820 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDOSS5muFVyFxAADP42j0wWV/Qb4wajs6Vm7w==", 2024-04-28T13:08:12.820 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:12.820 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-04-28T13:08:12.820 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-04-28T13:08:12.820 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-04-28T13:08:12.820 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-28T13:08:12.820 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:12.820 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:12.821 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:12.821 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.d", 2024-04-28T13:08:12.821 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDOSS5mN0qbIhAA9S6kThv7lpqtwmFDcki8Lg==", 2024-04-28T13:08:12.821 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:12.821 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-04-28T13:08:12.821 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-04-28T13:08:12.821 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-04-28T13:08:12.821 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-28T13:08:12.821 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:12.821 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:12.821 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:12.821 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.0", 2024-04-28T13:08:12.821 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDSSS5memG6ABAADdmTdP17zXCzkrIjMXoFWA==", 2024-04-28T13:08:12.821 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:12.821 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-04-28T13:08:12.821 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-04-28T13:08:12.822 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-28T13:08:12.822 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:12.822 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:12.822 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:12.822 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.1", 2024-04-28T13:08:12.822 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDUSS5mk4xZOxAAqn4QV8CSUcVM1eA5mpIEzQ==", 2024-04-28T13:08:12.822 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:12.822 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-04-28T13:08:12.822 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-04-28T13:08:12.822 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-28T13:08:12.822 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:12.822 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:12.822 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:12.823 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.2", 2024-04-28T13:08:12.823 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDXSS5mvz9LORAAkJgWHQWyCG5kJlOyhd6j1Q==", 2024-04-28T13:08:12.823 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:12.823 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-04-28T13:08:12.823 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-04-28T13:08:12.823 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-28T13:08:12.823 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:12.823 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:12.823 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:12.823 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.3", 2024-04-28T13:08:12.823 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDaSS5mPr44NxAAj+Isl9uyJTcqe/8FiMqHQg==", 2024-04-28T13:08:12.823 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:12.823 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-04-28T13:08:12.824 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-04-28T13:08:12.824 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-28T13:08:12.824 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:12.824 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:12.824 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:12.824 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.4", 2024-04-28T13:08:12.824 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDgSS5m2hWeOBAAIC4TiBY229V/ZZpx6LT2hg==", 2024-04-28T13:08:12.824 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:12.824 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-04-28T13:08:12.824 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-04-28T13:08:12.825 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-28T13:08:12.825 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:12.825 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:12.825 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:12.825 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.5", 2024-04-28T13:08:12.825 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDjSS5mkNcSNxAAint1u9W5rXiim5A0VSNttw==", 2024-04-28T13:08:12.825 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:12.825 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-04-28T13:08:12.825 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-04-28T13:08:12.825 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-28T13:08:12.825 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:12.825 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:12.825 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:12.826 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.6", 2024-04-28T13:08:12.826 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDmSS5mc/zZNBAAE3US5p+6A4Rh2d+5agGruw==", 2024-04-28T13:08:12.826 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:12.826 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-04-28T13:08:12.826 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-04-28T13:08:12.826 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-28T13:08:12.826 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:12.826 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:12.826 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:12.826 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.7", 2024-04-28T13:08:12.826 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDpSS5m6BiJMhAArOmge/xKpTqoM3UyHjv1+Q==", 2024-04-28T13:08:12.826 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:12.826 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-04-28T13:08:12.827 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-04-28T13:08:12.827 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-28T13:08:12.827 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:12.827 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:12.827 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:12.827 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.0", 2024-04-28T13:08:12.827 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDOSS5mzotvJhAAlis8wXdOL4WCzxzUL8L3qw==", 2024-04-28T13:08:12.827 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:12.827 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-04-28T13:08:12.827 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-04-28T13:08:12.827 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-04-28T13:08:12.827 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-04-28T13:08:12.827 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:12.827 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:12.828 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:12.828 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.1", 2024-04-28T13:08:12.828 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDOSS5m1XLQLhAAKfchd9USFncmg1umNNZYlQ==", 2024-04-28T13:08:12.828 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:12.828 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-04-28T13:08:12.828 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-04-28T13:08:12.828 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-04-28T13:08:12.828 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-04-28T13:08:12.828 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:12.828 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:12.828 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:12.828 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.2", 2024-04-28T13:08:12.828 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDOSS5meMfOKxAA+cOkQCX3HK4IBlDG2+chig==", 2024-04-28T13:08:12.828 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:12.828 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-04-28T13:08:12.828 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-04-28T13:08:12.829 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-04-28T13:08:12.829 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-04-28T13:08:12.829 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:12.829 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:12.829 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:12.829 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.3", 2024-04-28T13:08:12.829 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDOSS5mmLkyNBAAzOEmmOcyB9EP6I4TkYKNWA==", 2024-04-28T13:08:12.829 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:12.829 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-04-28T13:08:12.829 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-04-28T13:08:12.829 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-04-28T13:08:12.829 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-04-28T13:08:12.829 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:12.829 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:12.829 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:12.829 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.admin", 2024-04-28T13:08:12.830 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDNSS5mtoIQKBAA/3lGRHIKtKq5wMYqUkgvgw==", 2024-04-28T13:08:12.830 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:12.830 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-04-28T13:08:12.830 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-04-28T13:08:12.830 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-04-28T13:08:12.830 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-28T13:08:12.830 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:12.830 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:12.830 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:12.830 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-mds", 2024-04-28T13:08:12.830 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQD0SS5m6cdKJRAAmI4TFhuzHM2Kzve0Xz9XLg==", 2024-04-28T13:08:12.830 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:12.831 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-mds" 2024-04-28T13:08:12.831 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:12.831 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:12.831 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:12.831 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-mgr", 2024-04-28T13:08:12.831 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQD0SS5mLdBKJRAAyAlJczE4aobtygpNHbeIqA==", 2024-04-28T13:08:12.831 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:12.831 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-28T13:08:12.831 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:12.831 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:12.831 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:12.831 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-osd", 2024-04-28T13:08:12.831 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQD0SS5mydhKJRAA2pi0wGO5fEqJpk7jBKeABg==", 2024-04-28T13:08:12.831 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:12.831 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-osd" 2024-04-28T13:08:12.831 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:12.832 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:12.832 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:12.832 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-rbd", 2024-04-28T13:08:12.832 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQD0SS5mReBKJRAA+j8pq7H1TE/CMQcv1Ruwig==", 2024-04-28T13:08:12.832 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:12.832 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-28T13:08:12.832 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:12.832 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:12.832 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:12.832 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-28T13:08:12.832 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQD0SS5mVedKJRAAWZHGqnYR7D/TtXPHnUUKPA==", 2024-04-28T13:08:12.832 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:12.832 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-28T13:08:12.833 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:12.833 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:12.833 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:12.833 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-rgw", 2024-04-28T13:08:12.833 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQD0SS5mufJKJRAAvFFPB1f0NCerh6GvSu1Sfg==", 2024-04-28T13:08:12.833 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:12.833 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-28T13:08:12.833 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:12.833 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:12.833 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:12.833 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.x", 2024-04-28T13:08:12.833 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDOSS5m+YaTDRAAXHg0ngbju2RVDFYmXabVSg==", 2024-04-28T13:08:12.833 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:12.833 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-04-28T13:08:12.833 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-04-28T13:08:12.833 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-28T13:08:12.833 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:12.834 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:12.834 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:12.834 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.y", 2024-04-28T13:08:12.834 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDOSS5mWiliChAAq5hGUK1snRJRChZ09HDyhA==", 2024-04-28T13:08:12.834 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:12.834 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-04-28T13:08:12.834 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-04-28T13:08:12.834 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-28T13:08:12.834 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:12.834 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:12.834 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-04-28T13:08:12.834 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-04-28T13:08:12.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.819+0000 7f0f62a45640 1 -- 172.21.15.114:0/179920057 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f0f4806c8f0 msgr2=0x7f0f4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:12.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.819+0000 7f0f62a45640 1 --2- 172.21.15.114:0/179920057 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f0f4806c8f0 0x7f0f4806edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c006fd0 tx=0x7f0f4c008040 comp rx=0 tx=0).stop 2024-04-28T13:08:12.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.819+0000 7f0f62a45640 1 -- 172.21.15.114:0/179920057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f5c15f410 msgr2=0x7f0f5c0cf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:12.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.819+0000 7f0f62a45640 1 --2- 172.21.15.114:0/179920057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f5c15f410 0x7f0f5c0cf430 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0f54009f40 tx=0x7f0f54004a40 comp rx=0 tx=0).stop 2024-04-28T13:08:12.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.819+0000 7f0f62a45640 1 -- 172.21.15.114:0/179920057 shutdown_connections 2024-04-28T13:08:12.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.819+0000 7f0f62a45640 1 --2- 172.21.15.114:0/179920057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f5c15f410 0x7f0f5c0cf430 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:12.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.819+0000 7f0f62a45640 1 --2- 172.21.15.114:0/179920057 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f5c0cff60 0x7f0f5c0ceef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:12.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.819+0000 7f0f62a45640 1 --2- 172.21.15.114:0/179920057 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f0f4806c8f0 0x7f0f4806edb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:12.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.819+0000 7f0f62a45640 1 --2- 172.21.15.114:0/179920057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f5c0b4380 0x7f0f5c1507e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:12.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.819+0000 7f0f62a45640 1 -- 172.21.15.114:0/179920057 >> 172.21.15.114:0/179920057 conn(0x7f0f5c0633a0 msgr2=0x7f0f5c0b5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:12.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.819+0000 7f0f62a45640 1 -- 172.21.15.114:0/179920057 shutdown_connections 2024-04-28T13:08:12.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.819+0000 7f0f62a45640 1 -- 172.21.15.114:0/179920057 wait complete. 2024-04-28T13:08:12.837 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-28T13:08:12.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.934+0000 7f82c3852640 1 Processor -- start 2024-04-28T13:08:12.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.934+0000 7f82c3852640 1 -- start start 2024-04-28T13:08:12.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.935+0000 7f82c3852640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82bc15ec60 0x7f82bc06f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:12.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.935+0000 7f82c3852640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f82bc0b4240 0x7f82bc0729f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:12.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.935+0000 7f82c3852640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82bc15f040 con 0x7f82bc06e3a0 2024-04-28T13:08:12.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.935+0000 7f82c3852640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f82bc0d0bc0 con 0x7f82bc0b4240 2024-04-28T13:08:12.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.935+0000 7f82c3852640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f82bc06fa10 con 0x7f82bc15ec60 2024-04-28T13:08:12.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.935+0000 7f82c1def640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f82bc06e3a0 0x7f82bc15f2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:32842/0 (socket says 172.21.15.114:32842) 2024-04-28T13:08:12.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.935+0000 7f82c1def640 1 -- 172.21.15.114:0/2825039031 learned_addr learned my addr 172.21.15.114:0/2825039031 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:12.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.935+0000 7f82c15ee640 1 --2- 172.21.15.114:0/2825039031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82bc15ec60 0x7f82bc06f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:12.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.935+0000 7f82c0ded640 1 --2- 172.21.15.114:0/2825039031 >> v2:172.21.15.134:3300/0 conn(0x7f82bc0b4240 0x7f82bc0729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:12.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.936+0000 7f82b3fff640 1 -- 172.21.15.114:0/2825039031 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3696396816 0 0) 0x7f82bc15f040 con 0x7f82bc06e3a0 2024-04-28T13:08:12.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.936+0000 7f82b3fff640 1 -- 172.21.15.114:0/2825039031 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82a8003520 con 0x7f82bc06e3a0 2024-04-28T13:08:12.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.936+0000 7f82b3fff640 1 -- 172.21.15.114:0/2825039031 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 598156801 0 0) 0x7f82a8003520 con 0x7f82bc06e3a0 2024-04-28T13:08:12.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.936+0000 7f82b3fff640 1 -- 172.21.15.114:0/2825039031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82bc15ec60 msgr2=0x7f82bc06f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:12.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.936+0000 7f82b3fff640 1 --2- 172.21.15.114:0/2825039031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82bc15ec60 0x7f82bc06f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:12.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.936+0000 7f82b3fff640 1 -- 172.21.15.114:0/2825039031 >> v2:172.21.15.134:3300/0 conn(0x7f82bc0b4240 msgr2=0x7f82bc0729f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:12.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.936+0000 7f82b3fff640 1 --2- 172.21.15.114:0/2825039031 >> v2:172.21.15.134:3300/0 conn(0x7f82bc0b4240 0x7f82bc0729f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:12.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.936+0000 7f82b3fff640 1 -- 172.21.15.114:0/2825039031 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82bc06fcf0 con 0x7f82bc06e3a0 2024-04-28T13:08:12.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.936+0000 7f82b3fff640 1 -- 172.21.15.114:0/2825039031 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f82b4001670 con 0x7f82bc06e3a0 2024-04-28T13:08:12.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.936+0000 7f82c15ee640 1 --2- 172.21.15.114:0/2825039031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82bc15ec60 0x7f82bc06f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:08:12.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.936+0000 7f82c0ded640 1 --2- 172.21.15.114:0/2825039031 >> v2:172.21.15.134:3300/0 conn(0x7f82bc0b4240 0x7f82bc0729f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:08:12.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.936+0000 7f82b3fff640 1 -- 172.21.15.114:0/2825039031 >> v1:172.21.15.114:6789/0 conn(0x7f82bc06e3a0 legacy=0x7f82bc15f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:12.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.936+0000 7f82b3fff640 1 --2- 172.21.15.114:0/2825039031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82bc15ec60 0x7f82a80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:12.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.936+0000 7f82b3fff640 1 --2- 172.21.15.114:0/2825039031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82a8003ef0 0x7f82a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:12.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.936+0000 7f82b3fff640 1 --2- 172.21.15.114:0/2825039031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82a8004d40 0x7f82a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:12.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.936+0000 7f82b3fff640 1 -- 172.21.15.114:0/2825039031 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc06fa10 con 0x7f82a8003ef0 2024-04-28T13:08:12.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.936+0000 7f82b3fff640 1 -- 172.21.15.114:0/2825039031 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f82a800b9c0 con 0x7f82a8004d40 2024-04-28T13:08:12.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.936+0000 7f82b3fff640 1 -- 172.21.15.114:0/2825039031 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f82a800bb40 con 0x7f82bc15ec60 2024-04-28T13:08:12.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.936+0000 7f82c0ded640 1 --2- 172.21.15.114:0/2825039031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82a8003ef0 0x7f82a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:12.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.936+0000 7f82c15ee640 1 --2- 172.21.15.114:0/2825039031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82bc15ec60 0x7f82a80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:12.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.936+0000 7f82c1def640 1 --2- 172.21.15.114:0/2825039031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82a8004d40 0x7f82a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:12.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.936+0000 7f82c0ded640 1 -- 172.21.15.114:0/2825039031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82bc15ec60 msgr2=0x7f82a80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:12.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.936+0000 7f82c0ded640 1 --2- 172.21.15.114:0/2825039031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82bc15ec60 0x7f82a80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:12.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.936+0000 7f82c0ded640 1 -- 172.21.15.114:0/2825039031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82a8004d40 msgr2=0x7f82a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:12.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.936+0000 7f82c0ded640 1 --2- 172.21.15.114:0/2825039031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82a8004d40 0x7f82a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:12.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.936+0000 7f82c0ded640 1 -- 172.21.15.114:0/2825039031 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82a8003520 con 0x7f82a8003ef0 2024-04-28T13:08:12.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.936+0000 7f82c1def640 1 --2- 172.21.15.114:0/2825039031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82a8004d40 0x7f82a80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:12.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.937+0000 7f82c0ded640 1 --2- 172.21.15.114:0/2825039031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82a8003ef0 0x7f82a8004800 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009c60 tx=0x7f82a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d75372b471d4f309 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:12.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.937+0000 7f82b3fff640 1 -- 172.21.15.114:0/2825039031 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ac036070 con 0x7f82a8003ef0 2024-04-28T13:08:12.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.937+0000 7f82b3fff640 1 -- 172.21.15.114:0/2825039031 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82ac031400 con 0x7f82a8003ef0 2024-04-28T13:08:12.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.937+0000 7f82b3fff640 1 -- 172.21.15.114:0/2825039031 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ac009860 con 0x7f82a8003ef0 2024-04-28T13:08:12.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.938+0000 7f82c3852640 1 -- 172.21.15.114:0/2825039031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82a8003ef0 msgr2=0x7f82a8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:12.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.938+0000 7f82c3852640 1 --2- 172.21.15.114:0/2825039031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82a8003ef0 0x7f82a8004800 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009c60 tx=0x7f82a8005830 comp rx=0 tx=0).stop 2024-04-28T13:08:12.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.938+0000 7f82c1def640 1 -- 172.21.15.114:0/2825039031 reap_dead start 2024-04-28T13:08:12.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.938+0000 7f82c3852640 1 -- 172.21.15.114:0/2825039031 shutdown_connections 2024-04-28T13:08:12.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.938+0000 7f82c3852640 1 -- 172.21.15.114:0/2825039031 >> 172.21.15.114:0/2825039031 conn(0x7f82bc0cd8b0 msgr2=0x7f82bc0cdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:12.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.938+0000 7f82c3852640 1 -- 172.21.15.114:0/2825039031 shutdown_connections 2024-04-28T13:08:12.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.938+0000 7f82c3852640 1 -- 172.21.15.114:0/2825039031 wait complete. 2024-04-28T13:08:12.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.939+0000 7f82c3852640 1 Processor -- start 2024-04-28T13:08:12.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.939+0000 7f82c3852640 1 -- start start 2024-04-28T13:08:12.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.940+0000 7f82c3852640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82a8003ef0 0x7f82bc15de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:12.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.940+0000 7f82c3852640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82bc1568e0 0x7f82bc15bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:12.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.940+0000 7f82c3852640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82bc0b5060 0x7f82bc0b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:12.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.940+0000 7f82c3852640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc0cf690 con 0x7f82a8003ef0 2024-04-28T13:08:12.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.940+0000 7f82c3852640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc0cf3b0 con 0x7f82bc0b5060 2024-04-28T13:08:12.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.940+0000 7f82c3852640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f82bc072f30 con 0x7f82bc1568e0 2024-04-28T13:08:12.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.940+0000 7f82c15ee640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82a8003ef0 0x7f82bc15de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:12.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.940+0000 7f82c15ee640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82a8003ef0 0x7f82bc15de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52752/0 (socket says 172.21.15.114:52752) 2024-04-28T13:08:12.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.940+0000 7f82c15ee640 1 -- 172.21.15.114:0/4124544969 learned_addr learned my addr 172.21.15.114:0/4124544969 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:12.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.940+0000 7f82c0ded640 1 --2- 172.21.15.114:0/4124544969 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82bc1568e0 0x7f82bc15bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:12.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.940+0000 7f82c1def640 1 --2- 172.21.15.114:0/4124544969 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82bc0b5060 0x7f82bc0b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:12.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.940+0000 7f82c15ee640 1 -- 172.21.15.114:0/4124544969 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82bc1568e0 msgr2=0x7f82bc15bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:12.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.940+0000 7f82c15ee640 1 --2- 172.21.15.114:0/4124544969 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82bc1568e0 0x7f82bc15bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:12.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.940+0000 7f82c15ee640 1 -- 172.21.15.114:0/4124544969 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82bc0b5060 msgr2=0x7f82bc0b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:12.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.940+0000 7f82c15ee640 1 --2- 172.21.15.114:0/4124544969 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82bc0b5060 0x7f82bc0b54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:12.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.940+0000 7f82c15ee640 1 -- 172.21.15.114:0/4124544969 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82bc15e3b0 con 0x7f82a8003ef0 2024-04-28T13:08:12.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.940+0000 7f82c1def640 1 --2- 172.21.15.114:0/4124544969 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82bc0b5060 0x7f82bc0b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:12.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.940+0000 7f82c15ee640 1 --2- 172.21.15.114:0/4124544969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82a8003ef0 0x7f82bc15de70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f82b8011e00 tx=0x7f82b800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:12.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.940+0000 7f82b1ffb640 1 -- 172.21.15.114:0/4124544969 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b8003b90 con 0x7f82a8003ef0 2024-04-28T13:08:12.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.940+0000 7f82b1ffb640 1 -- 172.21.15.114:0/4124544969 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82b8003d30 con 0x7f82a8003ef0 2024-04-28T13:08:12.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.940+0000 7f82b1ffb640 1 -- 172.21.15.114:0/4124544969 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b8004250 con 0x7f82a8003ef0 2024-04-28T13:08:12.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.940+0000 7f82c3852640 1 -- 172.21.15.114:0/4124544969 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82bc15c460 con 0x7f82a8003ef0 2024-04-28T13:08:12.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.940+0000 7f82c3852640 1 -- 172.21.15.114:0/4124544969 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82bc15ca20 con 0x7f82a8003ef0 2024-04-28T13:08:12.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.941+0000 7f82c3852640 1 -- 172.21.15.114:0/4124544969 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82bc06a3d0 con 0x7f82a8003ef0 2024-04-28T13:08:12.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.942+0000 7f82b1ffb640 1 -- 172.21.15.114:0/4124544969 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f82b80043f0 con 0x7f82a8003ef0 2024-04-28T13:08:12.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.942+0000 7f82b1ffb640 1 --2- 172.21.15.114:0/4124544969 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f82a006c8f0 0x7f82a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:12.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.942+0000 7f82b1ffb640 1 -- 172.21.15.114:0/4124544969 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f82b808c590 con 0x7f82a8003ef0 2024-04-28T13:08:12.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.942+0000 7f82c0ded640 1 --2- 172.21.15.114:0/4124544969 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f82a006c8f0 0x7f82a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:12.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.943+0000 7f82c0ded640 1 --2- 172.21.15.114:0/4124544969 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f82a006c8f0 0x7f82a006edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f82ac033000 tx=0x7f82ac008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:12.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:12.947+0000 7f82b1ffb640 1 -- 172.21.15.114:0/4124544969 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f82b8019070 con 0x7f82a8003ef0 2024-04-28T13:08:13.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.188+0000 7f82c3852640 1 -- 172.21.15.114:0/4124544969 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f82bc073c10 con 0x7f82a8003ef0 2024-04-28T13:08:13.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.190+0000 7f82b1ffb640 1 -- 172.21.15.114:0/4124544969 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f82b8010040 con 0x7f82a8003ef0 2024-04-28T13:08:13.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.193+0000 7f82c3852640 1 -- 172.21.15.114:0/4124544969 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f82a006c8f0 msgr2=0x7f82a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:13.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.193+0000 7f82c3852640 1 --2- 172.21.15.114:0/4124544969 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f82a006c8f0 0x7f82a006edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f82ac033000 tx=0x7f82ac008030 comp rx=0 tx=0).stop 2024-04-28T13:08:13.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.193+0000 7f82c3852640 1 -- 172.21.15.114:0/4124544969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82a8003ef0 msgr2=0x7f82bc15de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:13.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.193+0000 7f82c3852640 1 --2- 172.21.15.114:0/4124544969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82a8003ef0 0x7f82bc15de70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f82b8011e00 tx=0x7f82b800f580 comp rx=0 tx=0).stop 2024-04-28T13:08:13.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.193+0000 7f82c3852640 1 -- 172.21.15.114:0/4124544969 shutdown_connections 2024-04-28T13:08:13.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.193+0000 7f82c3852640 1 --2- 172.21.15.114:0/4124544969 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f82a006c8f0 0x7f82a006edb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:13.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.193+0000 7f82c3852640 1 --2- 172.21.15.114:0/4124544969 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82bc0b5060 0x7f82bc0b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:13.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.193+0000 7f82c3852640 1 --2- 172.21.15.114:0/4124544969 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82bc1568e0 0x7f82bc15bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:13.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.193+0000 7f82c3852640 1 --2- 172.21.15.114:0/4124544969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82a8003ef0 0x7f82bc15de70 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:13.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.193+0000 7f82c3852640 1 -- 172.21.15.114:0/4124544969 >> 172.21.15.114:0/4124544969 conn(0x7f82bc0cd8b0 msgr2=0x7f82bc0b4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:13.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.193+0000 7f82c3852640 1 -- 172.21.15.114:0/4124544969 shutdown_connections 2024-04-28T13:08:13.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.193+0000 7f82c3852640 1 -- 172.21.15.114:0/4124544969 wait complete. 2024-04-28T13:08:13.206 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-28T13:08:13.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.303+0000 7fbad8dbf640 1 Processor -- start 2024-04-28T13:08:13.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.303+0000 7fbad8dbf640 1 -- start start 2024-04-28T13:08:13.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.303+0000 7fbad8dbf640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbad415f230 0x7fbad40bac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:13.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.304+0000 7fbad8dbf640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbad415f610 0x7fbad40d1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:13.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.304+0000 7fbad8dbf640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbad40d20d0 0x7fbad40d3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:13.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.304+0000 7fbad8dbf640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fbad40d2540 con 0x7fbad415f610 2024-04-28T13:08:13.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.304+0000 7fbad8dbf640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fbad40ba670 con 0x7fbad415f230 2024-04-28T13:08:13.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.304+0000 7fbad8dbf640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fbad40b9af0 con 0x7fbad40d20d0 2024-04-28T13:08:13.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.304+0000 7fbad1d9b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbad415f610 0x7fbad40d1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:13.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.304+0000 7fbad1d9b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbad415f610 0x7fbad40d1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52758/0 (socket says 172.21.15.114:52758) 2024-04-28T13:08:13.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.304+0000 7fbad1d9b640 1 -- 172.21.15.114:0/419504362 learned_addr learned my addr 172.21.15.114:0/419504362 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:13.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.304+0000 7fbad1d9b640 1 -- 172.21.15.114:0/419504362 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbad40d20d0 msgr2=0x7fbad40d3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:13.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.304+0000 7fbad1d9b640 1 --2- 172.21.15.114:0/419504362 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbad40d20d0 0x7fbad40d3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:13.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.304+0000 7fbad1d9b640 1 -- 172.21.15.114:0/419504362 >> v2:172.21.15.134:3300/0 conn(0x7fbad415f230 msgr2=0x7fbad40bac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:13.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.304+0000 7fbad1d9b640 1 --2- 172.21.15.114:0/419504362 >> v2:172.21.15.134:3300/0 conn(0x7fbad415f230 0x7fbad40bac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:13.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.304+0000 7fbad1d9b640 1 -- 172.21.15.114:0/419504362 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad40b9dd0 con 0x7fbad415f610 2024-04-28T13:08:13.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.305+0000 7fbad1d9b640 1 --2- 172.21.15.114:0/419504362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbad415f610 0x7fbad40d1b90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fbad408e090 tx=0x7fbac802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bddef33378e87756 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:13.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.305+0000 7fbad159a640 1 -- 172.21.15.114:0/419504362 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac8037070 con 0x7fbad415f610 2024-04-28T13:08:13.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.305+0000 7fbad159a640 1 -- 172.21.15.114:0/419504362 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac8032440 con 0x7fbad415f610 2024-04-28T13:08:13.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.305+0000 7fbad159a640 1 -- 172.21.15.114:0/419504362 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac8032810 con 0x7fbad415f610 2024-04-28T13:08:13.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.305+0000 7fbad8dbf640 1 -- 172.21.15.114:0/419504362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbad415f610 msgr2=0x7fbad40d1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:13.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.305+0000 7fbad8dbf640 1 --2- 172.21.15.114:0/419504362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbad415f610 0x7fbad40d1b90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fbad408e090 tx=0x7fbac802a1e0 comp rx=0 tx=0).stop 2024-04-28T13:08:13.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.305+0000 7fbad8dbf640 1 -- 172.21.15.114:0/419504362 shutdown_connections 2024-04-28T13:08:13.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.305+0000 7fbad8dbf640 1 --2- 172.21.15.114:0/419504362 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbad40d20d0 0x7fbad40d3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:13.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.305+0000 7fbad8dbf640 1 --2- 172.21.15.114:0/419504362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbad415f610 0x7fbad40d1b90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:13.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.305+0000 7fbad8dbf640 1 --2- 172.21.15.114:0/419504362 >> v2:172.21.15.134:3300/0 conn(0x7fbad415f230 0x7fbad40bac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:13.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.305+0000 7fbad8dbf640 1 -- 172.21.15.114:0/419504362 >> 172.21.15.114:0/419504362 conn(0x7fbad4063190 msgr2=0x7fbad40635a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:13.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.305+0000 7fbad8dbf640 1 -- 172.21.15.114:0/419504362 shutdown_connections 2024-04-28T13:08:13.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.305+0000 7fbad8dbf640 1 -- 172.21.15.114:0/419504362 wait complete. 2024-04-28T13:08:13.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.307+0000 7fbad8dbf640 1 Processor -- start 2024-04-28T13:08:13.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.307+0000 7fbad8dbf640 1 -- start start 2024-04-28T13:08:13.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.307+0000 7fbad8dbf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbad40d20d0 0x7fbad40cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:13.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.307+0000 7fbad8dbf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbad415f230 0x7fbad40cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:13.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.307+0000 7fbad8dbf640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbad415f610 0x7fbad40cb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:13.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.307+0000 7fbad8dbf640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbad40d3ac0 con 0x7fbad415f230 2024-04-28T13:08:13.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.307+0000 7fbad8dbf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbad40ba390 con 0x7fbad40d20d0 2024-04-28T13:08:13.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.307+0000 7fbad8dbf640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fbad40d3c40 con 0x7fbad415f610 2024-04-28T13:08:13.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.308+0000 7fbad1d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbad415f230 0x7fbad40cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:13.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.308+0000 7fbad1d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbad415f230 0x7fbad40cabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52772/0 (socket says 172.21.15.114:52772) 2024-04-28T13:08:13.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.308+0000 7fbad1d9b640 1 -- 172.21.15.114:0/1216234371 learned_addr learned my addr 172.21.15.114:0/1216234371 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:13.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.308+0000 7fbad2d9d640 1 --2- 172.21.15.114:0/1216234371 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbad415f610 0x7fbad40cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:13.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.308+0000 7fbad259c640 1 --2- 172.21.15.114:0/1216234371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbad40d20d0 0x7fbad40cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:13.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.308+0000 7fbad1d9b640 1 -- 172.21.15.114:0/1216234371 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbad415f610 msgr2=0x7fbad40cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:13.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.308+0000 7fbad1d9b640 1 --2- 172.21.15.114:0/1216234371 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbad415f610 0x7fbad40cb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:13.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.308+0000 7fbad1d9b640 1 -- 172.21.15.114:0/1216234371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbad40d20d0 msgr2=0x7fbad40cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:13.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.308+0000 7fbad1d9b640 1 --2- 172.21.15.114:0/1216234371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbad40d20d0 0x7fbad40cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:13.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.308+0000 7fbad1d9b640 1 -- 172.21.15.114:0/1216234371 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad41f6250 con 0x7fbad415f230 2024-04-28T13:08:13.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.308+0000 7fbad2d9d640 1 --2- 172.21.15.114:0/1216234371 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbad415f610 0x7fbad40cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:13.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.308+0000 7fbad1d9b640 1 --2- 172.21.15.114:0/1216234371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbad415f230 0x7fbad40cabc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbac8000c00 tx=0x7fbac80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:13.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.308+0000 7fbac2ffd640 1 -- 172.21.15.114:0/1216234371 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac8041070 con 0x7fbad415f230 2024-04-28T13:08:13.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.308+0000 7fbac2ffd640 1 -- 172.21.15.114:0/1216234371 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac803c870 con 0x7fbad415f230 2024-04-28T13:08:13.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.308+0000 7fbad8dbf640 1 -- 172.21.15.114:0/1216234371 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbad41f64f0 con 0x7fbad415f230 2024-04-28T13:08:13.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.308+0000 7fbac2ffd640 1 -- 172.21.15.114:0/1216234371 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac8037040 con 0x7fbad415f230 2024-04-28T13:08:13.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.308+0000 7fbad8dbf640 1 -- 172.21.15.114:0/1216234371 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbad41f6ab0 con 0x7fbad415f230 2024-04-28T13:08:13.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.309+0000 7fbad8dbf640 1 -- 172.21.15.114:0/1216234371 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbad4075c40 con 0x7fbad415f230 2024-04-28T13:08:13.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.310+0000 7fbac2ffd640 1 -- 172.21.15.114:0/1216234371 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbac8044070 con 0x7fbad415f230 2024-04-28T13:08:13.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.310+0000 7fbac2ffd640 1 --2- 172.21.15.114:0/1216234371 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbab406c920 0x7fbab406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:13.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.310+0000 7fbac2ffd640 1 -- 172.21.15.114:0/1216234371 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fbac80ac270 con 0x7fbad415f230 2024-04-28T13:08:13.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.310+0000 7fbad259c640 1 --2- 172.21.15.114:0/1216234371 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbab406c920 0x7fbab406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:13.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.310+0000 7fbad259c640 1 --2- 172.21.15.114:0/1216234371 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbab406c920 0x7fbab406ede0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbad40b7f50 tx=0x7fbac4009110 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:13.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.314+0000 7fbac2ffd640 1 -- 172.21.15.114:0/1216234371 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbac807aa80 con 0x7fbad415f230 2024-04-28T13:08:13.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.561+0000 7fbad8dbf640 1 -- 172.21.15.114:0/1216234371 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fbad406a3d0 con 0x7fbad415f230 2024-04-28T13:08:13.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.563+0000 7fbac2ffd640 1 -- 172.21.15.114:0/1216234371 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7fbac807a380 con 0x7fbad415f230 2024-04-28T13:08:13.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.565+0000 7fbad8dbf640 1 -- 172.21.15.114:0/1216234371 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbab406c920 msgr2=0x7fbab406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:13.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.565+0000 7fbad8dbf640 1 --2- 172.21.15.114:0/1216234371 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbab406c920 0x7fbab406ede0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbad40b7f50 tx=0x7fbac4009110 comp rx=0 tx=0).stop 2024-04-28T13:08:13.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.565+0000 7fbad8dbf640 1 -- 172.21.15.114:0/1216234371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbad415f230 msgr2=0x7fbad40cabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:13.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.565+0000 7fbad8dbf640 1 --2- 172.21.15.114:0/1216234371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbad415f230 0x7fbad40cabc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbac8000c00 tx=0x7fbac80046c0 comp rx=0 tx=0).stop 2024-04-28T13:08:13.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.565+0000 7fbad8dbf640 1 -- 172.21.15.114:0/1216234371 shutdown_connections 2024-04-28T13:08:13.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.565+0000 7fbad8dbf640 1 --2- 172.21.15.114:0/1216234371 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbad415f610 0x7fbad40cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:13.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.565+0000 7fbad8dbf640 1 --2- 172.21.15.114:0/1216234371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbad415f230 0x7fbad40cabc0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:13.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.565+0000 7fbad8dbf640 1 --2- 172.21.15.114:0/1216234371 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbab406c920 0x7fbab406ede0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:13.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.565+0000 7fbad8dbf640 1 --2- 172.21.15.114:0/1216234371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbad40d20d0 0x7fbad40cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:13.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.565+0000 7fbad8dbf640 1 -- 172.21.15.114:0/1216234371 >> 172.21.15.114:0/1216234371 conn(0x7fbad4063190 msgr2=0x7fbad415cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:13.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.565+0000 7fbad8dbf640 1 -- 172.21.15.114:0/1216234371 shutdown_connections 2024-04-28T13:08:13.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.565+0000 7fbad8dbf640 1 -- 172.21.15.114:0/1216234371 wait complete. 2024-04-28T13:08:13.577 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-28T13:08:13.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.675+0000 7fcaba27b640 1 Processor -- start 2024-04-28T13:08:13.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.675+0000 7fcaba27b640 1 -- start start 2024-04-28T13:08:13.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.675+0000 7fcaba27b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcab415f230 0x7fcab40bac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:13.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.675+0000 7fcaba27b640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcab40ba670 con 0x7fcab40d22a0 2024-04-28T13:08:13.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.675+0000 7fcaba27b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcab40b9af0 con 0x7fcab415f610 2024-04-28T13:08:13.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.675+0000 7fcaba27b640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fcab40b9dd0 con 0x7fcab415f230 2024-04-28T13:08:13.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.675+0000 7fcab3fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcab415f230 0x7fcab40bac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:13.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.675+0000 7fcab3fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcab415f230 0x7fcab40bac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52786/0 (socket says 172.21.15.114:52786) 2024-04-28T13:08:13.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.675+0000 7fcab3fff640 1 -- 172.21.15.114:0/3673920982 learned_addr learned my addr 172.21.15.114:0/3673920982 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:13.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.675+0000 7fcab8818640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fcab40d22a0 0x7fcab40b82e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:32846/0 (socket says 172.21.15.114:32846) 2024-04-28T13:08:13.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.676+0000 7fcab3fff640 1 -- 172.21.15.114:0/3673920982 >> v1:172.21.15.134:6789/0 conn(0x7fcab415f610 legacy=0x7fcab40d1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:13.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.676+0000 7fcab3fff640 1 -- 172.21.15.114:0/3673920982 >> v1:172.21.15.114:6789/0 conn(0x7fcab40d22a0 legacy=0x7fcab40b82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:13.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.676+0000 7fcab3fff640 1 -- 172.21.15.114:0/3673920982 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcab40ba0b0 con 0x7fcab415f230 2024-04-28T13:08:13.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.676+0000 7fcab2ffd640 1 -- 172.21.15.114:0/3673920982 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 822342211 0 0) 0x7fcab40ba670 con 0x7fcab40d22a0 2024-04-28T13:08:13.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.676+0000 7fcab3fff640 1 --2- 172.21.15.114:0/3673920982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcab415f230 0x7fcab40bac90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8009870 tx=0x7fcaa802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3392c9eb061a8f server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:13.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.677+0000 7fcab2ffd640 1 -- 172.21.15.114:0/3673920982 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa8037070 con 0x7fcab415f230 2024-04-28T13:08:13.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.677+0000 7fcab2ffd640 1 -- 172.21.15.114:0/3673920982 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaa8032440 con 0x7fcab415f230 2024-04-28T13:08:13.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.677+0000 7fcab2ffd640 1 -- 172.21.15.114:0/3673920982 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa8032810 con 0x7fcab415f230 2024-04-28T13:08:13.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.677+0000 7fcaba27b640 1 -- 172.21.15.114:0/3673920982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcab415f230 msgr2=0x7fcab40bac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:13.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.677+0000 7fcaba27b640 1 --2- 172.21.15.114:0/3673920982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcab415f230 0x7fcab40bac90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8009870 tx=0x7fcaa802a2a0 comp rx=0 tx=0).stop 2024-04-28T13:08:13.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.677+0000 7fcaba27b640 1 -- 172.21.15.114:0/3673920982 shutdown_connections 2024-04-28T13:08:13.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.677+0000 7fcaba27b640 1 --2- 172.21.15.114:0/3673920982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcab415f230 0x7fcab40bac90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:13.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.677+0000 7fcaba27b640 1 -- 172.21.15.114:0/3673920982 >> 172.21.15.114:0/3673920982 conn(0x7fcab4063190 msgr2=0x7fcab40635a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:13.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.677+0000 7fcaba27b640 1 -- 172.21.15.114:0/3673920982 shutdown_connections 2024-04-28T13:08:13.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.677+0000 7fcaba27b640 1 -- 172.21.15.114:0/3673920982 wait complete. 2024-04-28T13:08:13.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.678+0000 7fcaba27b640 1 Processor -- start 2024-04-28T13:08:13.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.678+0000 7fcaba27b640 1 -- start start 2024-04-28T13:08:13.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.679+0000 7fcaba27b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcab40d22a0 0x7fcab40ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:13.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.679+0000 7fcaba27b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcab415f230 0x7fcab40c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:13.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.679+0000 7fcaba27b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcab415f610 0x7fcab40c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:13.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.679+0000 7fcaba27b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcab40d4710 con 0x7fcab40d22a0 2024-04-28T13:08:13.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.679+0000 7fcaba27b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcab40d4590 con 0x7fcab415f610 2024-04-28T13:08:13.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.679+0000 7fcaba27b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fcab40d4890 con 0x7fcab415f230 2024-04-28T13:08:13.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.679+0000 7fcab3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcab40d22a0 0x7fcab40ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:13.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.679+0000 7fcab3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcab40d22a0 0x7fcab40ce1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52800/0 (socket says 172.21.15.114:52800) 2024-04-28T13:08:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.679+0000 7fcab3fff640 1 -- 172.21.15.114:0/72940614 learned_addr learned my addr 172.21.15.114:0/72940614 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.679+0000 7fcab8818640 1 --2- 172.21.15.114:0/72940614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcab415f610 0x7fcab40c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.679+0000 7fcab3fff640 1 -- 172.21.15.114:0/72940614 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcab415f230 msgr2=0x7fcab40c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.679+0000 7fcab37fe640 1 --2- 172.21.15.114:0/72940614 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcab415f230 0x7fcab40c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.680+0000 7fcab3fff640 1 --2- 172.21.15.114:0/72940614 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcab415f230 0x7fcab40c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.680+0000 7fcab3fff640 1 -- 172.21.15.114:0/72940614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcab415f610 msgr2=0x7fcab40c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.680+0000 7fcab3fff640 1 --2- 172.21.15.114:0/72940614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcab415f610 0x7fcab40c91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.680+0000 7fcab3fff640 1 -- 172.21.15.114:0/72940614 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcab40c85e0 con 0x7fcab40d22a0 2024-04-28T13:08:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.680+0000 7fcab8818640 1 --2- 172.21.15.114:0/72940614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcab415f610 0x7fcab40c91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.680+0000 7fcab37fe640 1 --2- 172.21.15.114:0/72940614 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcab415f230 0x7fcab40c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.680+0000 7fcab3fff640 1 --2- 172.21.15.114:0/72940614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcab40d22a0 0x7fcab40ce1e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8000c00 tx=0x7fcaa80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.680+0000 7fcab0ff9640 1 -- 172.21.15.114:0/72940614 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa8041070 con 0x7fcab40d22a0 2024-04-28T13:08:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.680+0000 7fcab0ff9640 1 -- 172.21.15.114:0/72940614 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaa803c870 con 0x7fcab40d22a0 2024-04-28T13:08:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.680+0000 7fcaba27b640 1 -- 172.21.15.114:0/72940614 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcab40cec40 con 0x7fcab40d22a0 2024-04-28T13:08:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.680+0000 7fcab0ff9640 1 -- 172.21.15.114:0/72940614 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa8037040 con 0x7fcab40d22a0 2024-04-28T13:08:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.680+0000 7fcaba27b640 1 -- 172.21.15.114:0/72940614 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcab40cb9e0 con 0x7fcab40d22a0 2024-04-28T13:08:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.681+0000 7fcaba27b640 1 -- 172.21.15.114:0/72940614 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcab4075c40 con 0x7fcab40d22a0 2024-04-28T13:08:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.681+0000 7fcab0ff9640 1 -- 172.21.15.114:0/72940614 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcaa8044070 con 0x7fcab40d22a0 2024-04-28T13:08:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.682+0000 7fcab0ff9640 1 --2- 172.21.15.114:0/72940614 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fcaa006c8f0 0x7fcaa006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.682+0000 7fcab0ff9640 1 -- 172.21.15.114:0/72940614 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fcaa80ac3e0 con 0x7fcab40d22a0 2024-04-28T13:08:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.682+0000 7fcab37fe640 1 --2- 172.21.15.114:0/72940614 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fcaa006c8f0 0x7fcaa006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.682+0000 7fcab37fe640 1 --2- 172.21.15.114:0/72940614 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fcaa006c8f0 0x7fcaa006edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcab415da70 tx=0x7fcaa4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:13.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.686+0000 7fcab0ff9640 1 -- 172.21.15.114:0/72940614 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fcaa807aac0 con 0x7fcab40d22a0 2024-04-28T13:08:13.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.928+0000 7fcaba27b640 1 -- 172.21.15.114:0/72940614 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fcab406a3d0 con 0x7fcab40d22a0 2024-04-28T13:08:13.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.930+0000 7fcab0ff9640 1 -- 172.21.15.114:0/72940614 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7fcaa807a3c0 con 0x7fcab40d22a0 2024-04-28T13:08:13.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.932+0000 7fcaba27b640 1 -- 172.21.15.114:0/72940614 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fcaa006c8f0 msgr2=0x7fcaa006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:13.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.932+0000 7fcaba27b640 1 --2- 172.21.15.114:0/72940614 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fcaa006c8f0 0x7fcaa006edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcab415da70 tx=0x7fcaa4009040 comp rx=0 tx=0).stop 2024-04-28T13:08:13.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.932+0000 7fcaba27b640 1 -- 172.21.15.114:0/72940614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcab40d22a0 msgr2=0x7fcab40ce1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:13.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.932+0000 7fcaba27b640 1 --2- 172.21.15.114:0/72940614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcab40d22a0 0x7fcab40ce1e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8000c00 tx=0x7fcaa80046c0 comp rx=0 tx=0).stop 2024-04-28T13:08:13.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.932+0000 7fcaba27b640 1 -- 172.21.15.114:0/72940614 shutdown_connections 2024-04-28T13:08:13.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.932+0000 7fcaba27b640 1 --2- 172.21.15.114:0/72940614 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fcaa006c8f0 0x7fcaa006edb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:13.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.932+0000 7fcaba27b640 1 --2- 172.21.15.114:0/72940614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcab415f610 0x7fcab40c91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:13.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.932+0000 7fcaba27b640 1 --2- 172.21.15.114:0/72940614 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcab415f230 0x7fcab40c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:13.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.932+0000 7fcaba27b640 1 --2- 172.21.15.114:0/72940614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcab40d22a0 0x7fcab40ce1e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:13.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.932+0000 7fcaba27b640 1 -- 172.21.15.114:0/72940614 >> 172.21.15.114:0/72940614 conn(0x7fcab4063190 msgr2=0x7fcab40d4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:13.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.932+0000 7fcaba27b640 1 -- 172.21.15.114:0/72940614 shutdown_connections 2024-04-28T13:08:13.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:13.932+0000 7fcaba27b640 1 -- 172.21.15.114:0/72940614 wait complete. 2024-04-28T13:08:13.944 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-28T13:08:14.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.043+0000 7f601814e640 1 Processor -- start 2024-04-28T13:08:14.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.043+0000 7f601814e640 1 -- start start 2024-04-28T13:08:14.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.044+0000 7f601814e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f601015d010 0x7f60100d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:14.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.044+0000 7f601814e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6010160590 0x7f60100cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:14.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.044+0000 7f601814e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6010072d10 con 0x7f60100d12c0 2024-04-28T13:08:14.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.044+0000 7f601814e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f6010072ac0 con 0x7f601015d010 2024-04-28T13:08:14.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.044+0000 7f601814e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f6010072ff0 con 0x7f6010160590 2024-04-28T13:08:14.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.045+0000 7f60166eb640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6010160590 0x7f60100cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:14.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.045+0000 7f6015eea640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f601015d010 0x7f60100d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:14.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.045+0000 7f60166eb640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6010160590 0x7f60100cf630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:58346/0 (socket says 172.21.15.114:58346) 2024-04-28T13:08:14.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.045+0000 7f60166eb640 1 -- 172.21.15.114:0/3501355612 learned_addr learned my addr 172.21.15.114:0/3501355612 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:14.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.045+0000 7f6015eea640 1 -- 172.21.15.114:0/3501355612 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6010160590 msgr2=0x7f60100cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:14.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.045+0000 7f6015eea640 1 --2- 172.21.15.114:0/3501355612 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6010160590 0x7f60100cf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:14.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.045+0000 7f6015eea640 1 -- 172.21.15.114:0/3501355612 >> v1:172.21.15.134:6789/0 conn(0x7f60100d12c0 legacy=0x7f601015fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:14.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.045+0000 7f6015eea640 1 -- 172.21.15.114:0/3501355612 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60100732d0 con 0x7f601015d010 2024-04-28T13:08:14.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.045+0000 7f60166eb640 1 --2- 172.21.15.114:0/3501355612 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6010160590 0x7f60100cf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:08:14.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.046+0000 7f6015eea640 1 --2- 172.21.15.114:0/3501355612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f601015d010 0x7f60100d0d80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f600c0097a0 tx=0x7f600c02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa9233529e88c980 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:14.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.046+0000 7f6014ee8640 1 -- 172.21.15.114:0/3501355612 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c037070 con 0x7f601015d010 2024-04-28T13:08:14.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.046+0000 7f6014ee8640 1 -- 172.21.15.114:0/3501355612 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f600c02ae50 con 0x7f601015d010 2024-04-28T13:08:14.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.046+0000 7f6014ee8640 1 -- 172.21.15.114:0/3501355612 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c032660 con 0x7f601015d010 2024-04-28T13:08:14.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.046+0000 7f601814e640 1 -- 172.21.15.114:0/3501355612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f601015d010 msgr2=0x7f60100d0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:14.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.046+0000 7f601814e640 1 --2- 172.21.15.114:0/3501355612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f601015d010 0x7f60100d0d80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f600c0097a0 tx=0x7f600c02a100 comp rx=0 tx=0).stop 2024-04-28T13:08:14.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.046+0000 7f601814e640 1 -- 172.21.15.114:0/3501355612 shutdown_connections 2024-04-28T13:08:14.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.046+0000 7f601814e640 1 --2- 172.21.15.114:0/3501355612 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6010160590 0x7f60100cf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:14.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.046+0000 7f601814e640 1 --2- 172.21.15.114:0/3501355612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f601015d010 0x7f60100d0d80 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:14.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.046+0000 7f601814e640 1 -- 172.21.15.114:0/3501355612 >> 172.21.15.114:0/3501355612 conn(0x7f60100cd8b0 msgr2=0x7f60100cdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:14.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.047+0000 7f601814e640 1 -- 172.21.15.114:0/3501355612 shutdown_connections 2024-04-28T13:08:14.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.047+0000 7f601814e640 1 -- 172.21.15.114:0/3501355612 wait complete. 2024-04-28T13:08:14.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.048+0000 7f601814e640 1 Processor -- start 2024-04-28T13:08:14.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.048+0000 7f601814e640 1 -- start start 2024-04-28T13:08:14.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.048+0000 7f601814e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60100d12c0 0x7f60101f5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:14.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.048+0000 7f601814e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f601015d010 0x7f601014fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:14.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.048+0000 7f601814e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6010160590 0x7f60100b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:14.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.048+0000 7f601814e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f601015d3f0 con 0x7f6010160590 2024-04-28T13:08:14.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.048+0000 7f601814e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6010073ad0 con 0x7f601015d010 2024-04-28T13:08:14.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.048+0000 7f601814e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f601015d570 con 0x7f60100d12c0 2024-04-28T13:08:14.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.049+0000 7f60166eb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6010160590 0x7f60100b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:14.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.049+0000 7f60166eb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6010160590 0x7f60100b51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52802/0 (socket says 172.21.15.114:52802) 2024-04-28T13:08:14.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.049+0000 7f60166eb640 1 -- 172.21.15.114:0/3741765735 learned_addr learned my addr 172.21.15.114:0/3741765735 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:14.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.049+0000 7f6015eea640 1 --2- 172.21.15.114:0/3741765735 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60100d12c0 0x7f60101f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:14.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.049+0000 7f60156e9640 1 --2- 172.21.15.114:0/3741765735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f601015d010 0x7f601014fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:14.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.049+0000 7f60166eb640 1 -- 172.21.15.114:0/3741765735 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60100d12c0 msgr2=0x7f60101f5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:14.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.049+0000 7f60166eb640 1 --2- 172.21.15.114:0/3741765735 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60100d12c0 0x7f60101f5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:14.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.049+0000 7f60166eb640 1 -- 172.21.15.114:0/3741765735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f601015d010 msgr2=0x7f601014fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:14.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.049+0000 7f60166eb640 1 --2- 172.21.15.114:0/3741765735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f601015d010 0x7f601014fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:14.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.049+0000 7f60166eb640 1 -- 172.21.15.114:0/3741765735 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60101f5ed0 con 0x7f6010160590 2024-04-28T13:08:14.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.049+0000 7f60166eb640 1 --2- 172.21.15.114:0/3741765735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6010160590 0x7f60100b51c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f600800efc0 tx=0x7f600800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:14.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.049+0000 7f60067fc640 1 -- 172.21.15.114:0/3741765735 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600800cbe0 con 0x7f6010160590 2024-04-28T13:08:14.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.049+0000 7f60067fc640 1 -- 172.21.15.114:0/3741765735 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f600800cd80 con 0x7f6010160590 2024-04-28T13:08:14.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.049+0000 7f601814e640 1 -- 172.21.15.114:0/3741765735 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f601015dcb0 con 0x7f6010160590 2024-04-28T13:08:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.049+0000 7f60067fc640 1 -- 172.21.15.114:0/3741765735 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6008003bb0 con 0x7f6010160590 2024-04-28T13:08:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.049+0000 7f601814e640 1 -- 172.21.15.114:0/3741765735 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f601015e270 con 0x7f6010160590 2024-04-28T13:08:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.050+0000 7f601814e640 1 -- 172.21.15.114:0/3741765735 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f601006a3d0 con 0x7f6010160590 2024-04-28T13:08:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.050+0000 7f60067fc640 1 -- 172.21.15.114:0/3741765735 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f600801b030 con 0x7f6010160590 2024-04-28T13:08:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.051+0000 7f60067fc640 1 --2- 172.21.15.114:0/3741765735 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5ff406c8f0 0x7f5ff406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.051+0000 7f60067fc640 1 -- 172.21.15.114:0/3741765735 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f600808bb80 con 0x7f6010160590 2024-04-28T13:08:14.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.051+0000 7f6015eea640 1 --2- 172.21.15.114:0/3741765735 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5ff406c8f0 0x7f5ff406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:14.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.051+0000 7f6015eea640 1 --2- 172.21.15.114:0/3741765735 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5ff406c8f0 0x7f5ff406edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f600c034000 tx=0x7f600c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:14.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.055+0000 7f60067fc640 1 -- 172.21.15.114:0/3741765735 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6008022020 con 0x7f6010160590 2024-04-28T13:08:14.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.298+0000 7f601814e640 1 -- 172.21.15.114:0/3741765735 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f60100ce010 con 0x7f6010160590 2024-04-28T13:08:14.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.300+0000 7f60067fc640 1 -- 172.21.15.114:0/3741765735 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f60101f5ed0 con 0x7f6010160590 2024-04-28T13:08:14.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.302+0000 7f601814e640 1 -- 172.21.15.114:0/3741765735 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5ff406c8f0 msgr2=0x7f5ff406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:14.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.302+0000 7f601814e640 1 --2- 172.21.15.114:0/3741765735 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5ff406c8f0 0x7f5ff406edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f600c034000 tx=0x7f600c02e000 comp rx=0 tx=0).stop 2024-04-28T13:08:14.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.302+0000 7f601814e640 1 -- 172.21.15.114:0/3741765735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6010160590 msgr2=0x7f60100b51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:14.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.302+0000 7f601814e640 1 --2- 172.21.15.114:0/3741765735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6010160590 0x7f60100b51c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f600800efc0 tx=0x7f600800c490 comp rx=0 tx=0).stop 2024-04-28T13:08:14.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.302+0000 7f601814e640 1 -- 172.21.15.114:0/3741765735 shutdown_connections 2024-04-28T13:08:14.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.302+0000 7f601814e640 1 --2- 172.21.15.114:0/3741765735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6010160590 0x7f60100b51c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:14.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.302+0000 7f601814e640 1 --2- 172.21.15.114:0/3741765735 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5ff406c8f0 0x7f5ff406edb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:14.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.302+0000 7f601814e640 1 --2- 172.21.15.114:0/3741765735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f601015d010 0x7f601014fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:14.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.302+0000 7f601814e640 1 --2- 172.21.15.114:0/3741765735 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60100d12c0 0x7f60101f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:14.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.302+0000 7f601814e640 1 -- 172.21.15.114:0/3741765735 >> 172.21.15.114:0/3741765735 conn(0x7f60100cd8b0 msgr2=0x7f601006e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:14.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.302+0000 7f601814e640 1 -- 172.21.15.114:0/3741765735 shutdown_connections 2024-04-28T13:08:14.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.302+0000 7f601814e640 1 -- 172.21.15.114:0/3741765735 wait complete. 2024-04-28T13:08:14.314 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-28T13:08:14.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.411+0000 7f6012f33640 1 Processor -- start 2024-04-28T13:08:14.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.411+0000 7f6012f33640 1 -- start start 2024-04-28T13:08:14.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.411+0000 7f6012f33640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f600c0d18e0 0x7f600c0d1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:14.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.411+0000 7f6012f33640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f600c0cdd50 0x7f600c09b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:14.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.411+0000 7f6012f33640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f600c0cf7d0 con 0x7f600c0ce190 2024-04-28T13:08:14.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.411+0000 7f6012f33640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f600c0ce730 con 0x7f600c0cdd50 2024-04-28T13:08:14.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.411+0000 7f6012f33640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f600c0cea10 con 0x7f600c0d18e0 2024-04-28T13:08:14.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.412+0000 7f600bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f600c0cdd50 0x7f600c09b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:14.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.412+0000 7f600bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f600c0cdd50 0x7f600c09b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52808/0 (socket says 172.21.15.114:52808) 2024-04-28T13:08:14.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.412+0000 7f600bfff640 1 -- 172.21.15.114:0/3894383544 learned_addr learned my addr 172.21.15.114:0/3894383544 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:14.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.412+0000 7f6010ccf640 1 --2- 172.21.15.114:0/3894383544 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f600c0d18e0 0x7f600c0d1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:14.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.412+0000 7f600bfff640 1 -- 172.21.15.114:0/3894383544 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f600c0d18e0 msgr2=0x7f600c0d1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:14.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.412+0000 7f600bfff640 1 --2- 172.21.15.114:0/3894383544 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f600c0d18e0 0x7f600c0d1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:14.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.412+0000 7f600bfff640 1 -- 172.21.15.114:0/3894383544 >> v1:172.21.15.134:6789/0 conn(0x7f600c0ce190 legacy=0x7f600c1611a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:14.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.412+0000 7f600bfff640 1 -- 172.21.15.114:0/3894383544 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f600c0cecf0 con 0x7f600c0cdd50 2024-04-28T13:08:14.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.412+0000 7f6010ccf640 1 --2- 172.21.15.114:0/3894383544 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f600c0d18e0 0x7f600c0d1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:14.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.413+0000 7f600bfff640 1 --2- 172.21.15.114:0/3894383544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f600c0cdd50 0x7f600c09b9e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8009870 tx=0x7f5ff802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff6045101540b08 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:14.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.413+0000 7f600b7fe640 1 -- 172.21.15.114:0/3894383544 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8037070 con 0x7f600c0cdd50 2024-04-28T13:08:14.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.413+0000 7f600b7fe640 1 -- 172.21.15.114:0/3894383544 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ff8032440 con 0x7f600c0cdd50 2024-04-28T13:08:14.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.413+0000 7f600b7fe640 1 -- 172.21.15.114:0/3894383544 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8032810 con 0x7f600c0cdd50 2024-04-28T13:08:14.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.413+0000 7f6012f33640 1 -- 172.21.15.114:0/3894383544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f600c0cdd50 msgr2=0x7f600c09b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:14.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.413+0000 7f6012f33640 1 --2- 172.21.15.114:0/3894383544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f600c0cdd50 0x7f600c09b9e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8009870 tx=0x7f5ff802a180 comp rx=0 tx=0).stop 2024-04-28T13:08:14.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.413+0000 7f6012f33640 1 -- 172.21.15.114:0/3894383544 shutdown_connections 2024-04-28T13:08:14.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.413+0000 7f6012f33640 1 --2- 172.21.15.114:0/3894383544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f600c0cdd50 0x7f600c09b9e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:14.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.413+0000 7f6012f33640 1 --2- 172.21.15.114:0/3894383544 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f600c0d18e0 0x7f600c0d1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:14.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.413+0000 7f6012f33640 1 -- 172.21.15.114:0/3894383544 >> 172.21.15.114:0/3894383544 conn(0x7f600c0b4a50 msgr2=0x7f600c0b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:14.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.413+0000 7f6012f33640 1 -- 172.21.15.114:0/3894383544 shutdown_connections 2024-04-28T13:08:14.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.413+0000 7f6012f33640 1 -- 172.21.15.114:0/3894383544 wait complete. 2024-04-28T13:08:14.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.414+0000 7f6012f33640 1 Processor -- start 2024-04-28T13:08:14.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.414+0000 7f6012f33640 1 -- start start 2024-04-28T13:08:14.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.415+0000 7f6012f33640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f600c0cdd50 0x7f600c0cca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:14.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.415+0000 7f6012f33640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f600c0ce190 0x7f600c14cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:14.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.415+0000 7f6012f33640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f600c0d18e0 0x7f600c1f8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:14.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.415+0000 7f6012f33640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f600c09bf20 con 0x7f600c0ce190 2024-04-28T13:08:14.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.415+0000 7f6012f33640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f600c0712a0 con 0x7f600c0cdd50 2024-04-28T13:08:14.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.415+0000 7f6012f33640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f600c09c0a0 con 0x7f600c0d18e0 2024-04-28T13:08:14.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.415+0000 7f600bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f600c0ce190 0x7f600c14cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:14.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.415+0000 7f600bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f600c0ce190 0x7f600c14cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52816/0 (socket says 172.21.15.114:52816) 2024-04-28T13:08:14.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.415+0000 7f600bfff640 1 -- 172.21.15.114:0/913690314 learned_addr learned my addr 172.21.15.114:0/913690314 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:14.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.416+0000 7f60114d0640 1 --2- 172.21.15.114:0/913690314 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f600c0d18e0 0x7f600c1f8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:14.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.416+0000 7f6010ccf640 1 --2- 172.21.15.114:0/913690314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f600c0cdd50 0x7f600c0cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:14.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.416+0000 7f600bfff640 1 -- 172.21.15.114:0/913690314 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f600c0d18e0 msgr2=0x7f600c1f8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:14.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.416+0000 7f600bfff640 1 --2- 172.21.15.114:0/913690314 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f600c0d18e0 0x7f600c1f8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:14.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.416+0000 7f600bfff640 1 -- 172.21.15.114:0/913690314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f600c0cdd50 msgr2=0x7f600c0cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:14.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.416+0000 7f600bfff640 1 --2- 172.21.15.114:0/913690314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f600c0cdd50 0x7f600c0cca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:14.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.416+0000 7f600bfff640 1 -- 172.21.15.114:0/913690314 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f600c0c9ce0 con 0x7f600c0ce190 2024-04-28T13:08:14.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.416+0000 7f600bfff640 1 --2- 172.21.15.114:0/913690314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f600c0ce190 0x7f600c14cd20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8000c00 tx=0x7f5ff80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:14.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.416+0000 7f60097fa640 1 -- 172.21.15.114:0/913690314 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8037040 con 0x7f600c0ce190 2024-04-28T13:08:14.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.416+0000 7f60097fa640 1 -- 172.21.15.114:0/913690314 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ff8042070 con 0x7f600c0ce190 2024-04-28T13:08:14.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.416+0000 7f6012f33640 1 -- 172.21.15.114:0/913690314 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f600c0c8f20 con 0x7f600c0ce190 2024-04-28T13:08:14.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.416+0000 7f60097fa640 1 -- 172.21.15.114:0/913690314 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8030bd0 con 0x7f600c0ce190 2024-04-28T13:08:14.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.416+0000 7f6012f33640 1 -- 172.21.15.114:0/913690314 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f600c0c94e0 con 0x7f600c0ce190 2024-04-28T13:08:14.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.417+0000 7f6012f33640 1 -- 172.21.15.114:0/913690314 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f600c06a3d0 con 0x7f600c0ce190 2024-04-28T13:08:14.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.417+0000 7f60097fa640 1 -- 172.21.15.114:0/913690314 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5ff8047460 con 0x7f600c0ce190 2024-04-28T13:08:14.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.418+0000 7f60097fa640 1 --2- 172.21.15.114:0/913690314 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5ff006c8f0 0x7f5ff006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:14.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.418+0000 7f60097fa640 1 -- 172.21.15.114:0/913690314 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f5ff80ac3d0 con 0x7f600c0ce190 2024-04-28T13:08:14.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.418+0000 7f6010ccf640 1 --2- 172.21.15.114:0/913690314 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5ff006c8f0 0x7f5ff006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:14.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.418+0000 7f6010ccf640 1 --2- 172.21.15.114:0/913690314 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5ff006c8f0 0x7f5ff006edb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f600000a950 tx=0x7f6000008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:14.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.422+0000 7f60097fa640 1 -- 172.21.15.114:0/913690314 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5ff8045360 con 0x7f600c0ce190 2024-04-28T13:08:14.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.671+0000 7f6012f33640 1 -- 172.21.15.114:0/913690314 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f600c06fc50 con 0x7f600c0ce190 2024-04-28T13:08:14.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.673+0000 7f60097fa640 1 -- 172.21.15.114:0/913690314 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7f5ff807ab50 con 0x7f600c0ce190 2024-04-28T13:08:14.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.675+0000 7f6012f33640 1 -- 172.21.15.114:0/913690314 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5ff006c8f0 msgr2=0x7f5ff006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:14.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.675+0000 7f6012f33640 1 --2- 172.21.15.114:0/913690314 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5ff006c8f0 0x7f5ff006edb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f600000a950 tx=0x7f6000008040 comp rx=0 tx=0).stop 2024-04-28T13:08:14.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.675+0000 7f6012f33640 1 -- 172.21.15.114:0/913690314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f600c0ce190 msgr2=0x7f600c14cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:14.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.675+0000 7f6012f33640 1 --2- 172.21.15.114:0/913690314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f600c0ce190 0x7f600c14cd20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8000c00 tx=0x7f5ff80046c0 comp rx=0 tx=0).stop 2024-04-28T13:08:14.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.675+0000 7f6012f33640 1 -- 172.21.15.114:0/913690314 shutdown_connections 2024-04-28T13:08:14.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.675+0000 7f6012f33640 1 --2- 172.21.15.114:0/913690314 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f600c0d18e0 0x7f600c1f8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:14.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.675+0000 7f6012f33640 1 --2- 172.21.15.114:0/913690314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f600c0ce190 0x7f600c14cd20 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:14.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.675+0000 7f6012f33640 1 --2- 172.21.15.114:0/913690314 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5ff006c8f0 0x7f5ff006edb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:14.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.675+0000 7f6012f33640 1 --2- 172.21.15.114:0/913690314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f600c0cdd50 0x7f600c0cca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:14.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.675+0000 7f6012f33640 1 -- 172.21.15.114:0/913690314 >> 172.21.15.114:0/913690314 conn(0x7f600c0b4a50 msgr2=0x7f600c160510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:14.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.675+0000 7f6012f33640 1 -- 172.21.15.114:0/913690314 shutdown_connections 2024-04-28T13:08:14.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.675+0000 7f6012f33640 1 -- 172.21.15.114:0/913690314 wait complete. 2024-04-28T13:08:14.686 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-28T13:08:14.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.783+0000 7f64f3566640 1 Processor -- start 2024-04-28T13:08:14.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.783+0000 7f64f3566640 1 -- start start 2024-04-28T13:08:14.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.784+0000 7f64f3566640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f64ec15ac50 0x7f64ec0b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:14.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.784+0000 7f64f3566640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64ec15e390 0x7f64ec0d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:14.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.784+0000 7f64f3566640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64ec160c60 con 0x7f64ec0d12c0 2024-04-28T13:08:14.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.784+0000 7f64f3566640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f64ec0d1710 con 0x7f64ec15ac50 2024-04-28T13:08:14.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.784+0000 7f64f3566640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f64ec160f40 con 0x7f64ec15e390 2024-04-28T13:08:14.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.784+0000 7f64f1302640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f64ec15ac50 0x7f64ec0b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:14.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.784+0000 7f64f0b01640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64ec15e390 0x7f64ec0d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:14.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.784+0000 7f64f1b03640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f64ec0d12c0 0x7f64ec145f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:49502/0 (socket says 172.21.15.114:49502) 2024-04-28T13:08:14.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.784+0000 7f64f1b03640 1 -- 172.21.15.114:0/2306780557 learned_addr learned my addr 172.21.15.114:0/2306780557 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:14.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.785+0000 7f64f0b01640 1 -- 172.21.15.114:0/2306780557 >> v2:172.21.15.134:3300/0 conn(0x7f64ec15ac50 msgr2=0x7f64ec0b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:14.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.785+0000 7f64f0b01640 1 --2- 172.21.15.114:0/2306780557 >> v2:172.21.15.134:3300/0 conn(0x7f64ec15ac50 0x7f64ec0b3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:14.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.785+0000 7f64f0b01640 1 -- 172.21.15.114:0/2306780557 >> v1:172.21.15.134:6789/0 conn(0x7f64ec0d12c0 legacy=0x7f64ec145f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:14.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.785+0000 7f64e3fff640 1 -- 172.21.15.114:0/2306780557 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1318066855 0 0) 0x7f64ec160c60 con 0x7f64ec0d12c0 2024-04-28T13:08:14.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.785+0000 7f64f0b01640 1 -- 172.21.15.114:0/2306780557 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ec161220 con 0x7f64ec15e390 2024-04-28T13:08:14.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.785+0000 7f64f1302640 1 --2- 172.21.15.114:0/2306780557 >> v2:172.21.15.134:3300/0 conn(0x7f64ec15ac50 0x7f64ec0b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:08:14.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.786+0000 7f64f0b01640 1 --2- 172.21.15.114:0/2306780557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64ec15e390 0x7f64ec0d0d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f64dc0097a0 tx=0x7f64dc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bca65e0aaa399ee1 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:14.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.786+0000 7f64e3fff640 1 -- 172.21.15.114:0/2306780557 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64dc037070 con 0x7f64ec15e390 2024-04-28T13:08:14.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.786+0000 7f64e3fff640 1 -- 172.21.15.114:0/2306780557 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64dc032440 con 0x7f64ec15e390 2024-04-28T13:08:14.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.786+0000 7f64e3fff640 1 -- 172.21.15.114:0/2306780557 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64dc032810 con 0x7f64ec15e390 2024-04-28T13:08:14.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.786+0000 7f64f3566640 1 -- 172.21.15.114:0/2306780557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64ec15e390 msgr2=0x7f64ec0d0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:14.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.786+0000 7f64f3566640 1 --2- 172.21.15.114:0/2306780557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64ec15e390 0x7f64ec0d0d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f64dc0097a0 tx=0x7f64dc02a180 comp rx=0 tx=0).stop 2024-04-28T13:08:14.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.786+0000 7f64f3566640 1 -- 172.21.15.114:0/2306780557 shutdown_connections 2024-04-28T13:08:14.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.786+0000 7f64f3566640 1 --2- 172.21.15.114:0/2306780557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64ec15e390 0x7f64ec0d0d80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:14.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.786+0000 7f64f3566640 1 --2- 172.21.15.114:0/2306780557 >> v2:172.21.15.134:3300/0 conn(0x7f64ec15ac50 0x7f64ec0b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:14.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.786+0000 7f64f3566640 1 -- 172.21.15.114:0/2306780557 >> 172.21.15.114:0/2306780557 conn(0x7f64ec0cd8b0 msgr2=0x7f64ec0cdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:14.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.786+0000 7f64f3566640 1 -- 172.21.15.114:0/2306780557 shutdown_connections 2024-04-28T13:08:14.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.786+0000 7f64f3566640 1 -- 172.21.15.114:0/2306780557 wait complete. 2024-04-28T13:08:14.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.787+0000 7f64f3566640 1 Processor -- start 2024-04-28T13:08:14.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.788+0000 7f64f3566640 1 -- start start 2024-04-28T13:08:14.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.788+0000 7f64f3566640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64ec0d12c0 0x7f64ec145860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:14.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.788+0000 7f64f3566640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64ec15ac50 0x7f64ec155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:14.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.788+0000 7f64f3566640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64ec15e390 0x7f64ec15fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:14.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.788+0000 7f64f3566640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f64ec15b030 con 0x7f64ec15ac50 2024-04-28T13:08:14.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.788+0000 7f64f3566640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f64ec1617e0 con 0x7f64ec15e390 2024-04-28T13:08:14.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.788+0000 7f64f3566640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f64ec0b43a0 con 0x7f64ec0d12c0 2024-04-28T13:08:14.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.788+0000 7f64f0b01640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64ec15ac50 0x7f64ec155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:14.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.788+0000 7f64f0b01640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64ec15ac50 0x7f64ec155630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52832/0 (socket says 172.21.15.114:52832) 2024-04-28T13:08:14.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.788+0000 7f64f0b01640 1 -- 172.21.15.114:0/2880468306 learned_addr learned my addr 172.21.15.114:0/2880468306 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:14.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.788+0000 7f64f1302640 1 --2- 172.21.15.114:0/2880468306 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64ec0d12c0 0x7f64ec145860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:14.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.788+0000 7f64f1b03640 1 --2- 172.21.15.114:0/2880468306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64ec15e390 0x7f64ec15fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:14.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.789+0000 7f64f0b01640 1 -- 172.21.15.114:0/2880468306 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64ec0d12c0 msgr2=0x7f64ec145860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:14.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.789+0000 7f64f0b01640 1 --2- 172.21.15.114:0/2880468306 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64ec0d12c0 0x7f64ec145860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:14.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.789+0000 7f64f0b01640 1 -- 172.21.15.114:0/2880468306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64ec15e390 msgr2=0x7f64ec15fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:14.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.789+0000 7f64f0b01640 1 --2- 172.21.15.114:0/2880468306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64ec15e390 0x7f64ec15fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:14.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.789+0000 7f64f0b01640 1 -- 172.21.15.114:0/2880468306 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ec155f10 con 0x7f64ec15ac50 2024-04-28T13:08:14.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.789+0000 7f64f1b03640 1 --2- 172.21.15.114:0/2880468306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64ec15e390 0x7f64ec15fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:14.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.789+0000 7f64f0b01640 1 --2- 172.21.15.114:0/2880468306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64ec15ac50 0x7f64ec155630 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f64dc0097a0 tx=0x7f64dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:14.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.789+0000 7f64e1ffb640 1 -- 172.21.15.114:0/2880468306 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64dc037050 con 0x7f64ec15ac50 2024-04-28T13:08:14.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.789+0000 7f64e1ffb640 1 -- 172.21.15.114:0/2880468306 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64dc038040 con 0x7f64ec15ac50 2024-04-28T13:08:14.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.789+0000 7f64f3566640 1 -- 172.21.15.114:0/2880468306 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64ec1561f0 con 0x7f64ec15ac50 2024-04-28T13:08:14.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.789+0000 7f64e1ffb640 1 -- 172.21.15.114:0/2880468306 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64dc004490 con 0x7f64ec15ac50 2024-04-28T13:08:14.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.789+0000 7f64f3566640 1 -- 172.21.15.114:0/2880468306 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64ec155b70 con 0x7f64ec15ac50 2024-04-28T13:08:14.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.790+0000 7f64f3566640 1 -- 172.21.15.114:0/2880468306 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64ec0734d0 con 0x7f64ec15ac50 2024-04-28T13:08:14.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.790+0000 7f64e1ffb640 1 -- 172.21.15.114:0/2880468306 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f64dc03c6d0 con 0x7f64ec15ac50 2024-04-28T13:08:14.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.791+0000 7f64e1ffb640 1 --2- 172.21.15.114:0/2880468306 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f64d006c8f0 0x7f64d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:14.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.791+0000 7f64e1ffb640 1 -- 172.21.15.114:0/2880468306 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f64dc0ac120 con 0x7f64ec15ac50 2024-04-28T13:08:14.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.791+0000 7f64f1302640 1 --2- 172.21.15.114:0/2880468306 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f64d006c8f0 0x7f64d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:14.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.791+0000 7f64f1302640 1 --2- 172.21.15.114:0/2880468306 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f64d006c8f0 0x7f64d006edb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f64e8009bd0 tx=0x7f64e800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:14.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:14.795+0000 7f64e1ffb640 1 -- 172.21.15.114:0/2880468306 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f64ec0734d0 con 0x7f64ec15ac50 2024-04-28T13:08:15.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.038+0000 7f64f3566640 1 -- 172.21.15.114:0/2880468306 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f64ec06a3d0 con 0x7f64ec15ac50 2024-04-28T13:08:15.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.040+0000 7f64e1ffb640 1 -- 172.21.15.114:0/2880468306 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f64dc07a930 con 0x7f64ec15ac50 2024-04-28T13:08:15.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.042+0000 7f64f3566640 1 -- 172.21.15.114:0/2880468306 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f64d006c8f0 msgr2=0x7f64d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:15.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.042+0000 7f64f3566640 1 --2- 172.21.15.114:0/2880468306 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f64d006c8f0 0x7f64d006edb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f64e8009bd0 tx=0x7f64e800b040 comp rx=0 tx=0).stop 2024-04-28T13:08:15.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.042+0000 7f64f3566640 1 -- 172.21.15.114:0/2880468306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64ec15ac50 msgr2=0x7f64ec155630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:15.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.042+0000 7f64f3566640 1 --2- 172.21.15.114:0/2880468306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64ec15ac50 0x7f64ec155630 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f64dc0097a0 tx=0x7f64dc0046c0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.042+0000 7f64f3566640 1 -- 172.21.15.114:0/2880468306 shutdown_connections 2024-04-28T13:08:15.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.042+0000 7f64f3566640 1 --2- 172.21.15.114:0/2880468306 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f64d006c8f0 0x7f64d006edb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.042+0000 7f64f3566640 1 --2- 172.21.15.114:0/2880468306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64ec15e390 0x7f64ec15fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.042+0000 7f64f3566640 1 --2- 172.21.15.114:0/2880468306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64ec15ac50 0x7f64ec155630 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.042+0000 7f64f3566640 1 --2- 172.21.15.114:0/2880468306 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64ec0d12c0 0x7f64ec145860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.042+0000 7f64f3566640 1 -- 172.21.15.114:0/2880468306 >> 172.21.15.114:0/2880468306 conn(0x7f64ec0cd8b0 msgr2=0x7f64ec06eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:15.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.042+0000 7f64f3566640 1 -- 172.21.15.114:0/2880468306 shutdown_connections 2024-04-28T13:08:15.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.042+0000 7f64f3566640 1 -- 172.21.15.114:0/2880468306 wait complete. 2024-04-28T13:08:15.054 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:08:15.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.148+0000 7feccecea640 1 Processor -- start 2024-04-28T13:08:15.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.149+0000 7feccecea640 1 -- start start 2024-04-28T13:08:15.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.149+0000 7feccecea640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecc80b0b30 0x7fecc816a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:15.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.149+0000 7feccecea640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecc8070950 con 0x7fecc806d360 2024-04-28T13:08:15.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.149+0000 7feccecea640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecc806fc80 con 0x7fecc806e990 2024-04-28T13:08:15.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.149+0000 7feccecea640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fecc80af6b0 con 0x7fecc80b0b30 2024-04-28T13:08:15.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.149+0000 7feccca86640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fecc806d360 0x7fecc806d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:32858/0 (socket says 172.21.15.114:32858) 2024-04-28T13:08:15.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.149+0000 7feccca86640 1 -- 172.21.15.114:0/848181696 learned_addr learned my addr 172.21.15.114:0/848181696 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:15.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.150+0000 7feccd287640 1 --2- 172.21.15.114:0/848181696 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecc80b0b30 0x7fecc816a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:15.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.150+0000 7fecc77fe640 1 -- 172.21.15.114:0/848181696 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3526777071 0 0) 0x7fecc8070950 con 0x7fecc806d360 2024-04-28T13:08:15.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.150+0000 7fecc77fe640 1 -- 172.21.15.114:0/848181696 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecb8003520 con 0x7fecc806d360 2024-04-28T13:08:15.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.150+0000 7fecc77fe640 1 -- 172.21.15.114:0/848181696 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3412044992 0 0) 0x7fecc806fc80 con 0x7fecc806e990 2024-04-28T13:08:15.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.150+0000 7fecc77fe640 1 -- 172.21.15.114:0/848181696 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecc8070950 con 0x7fecc806e990 2024-04-28T13:08:15.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.150+0000 7fecc77fe640 1 -- 172.21.15.114:0/848181696 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3832779303 0 0) 0x7fecb8003520 con 0x7fecc806d360 2024-04-28T13:08:15.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.150+0000 7feccd287640 1 -- 172.21.15.114:0/848181696 >> v1:172.21.15.134:6789/0 conn(0x7fecc806e990 legacy=0x7fecc815f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:15.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.150+0000 7feccd287640 1 -- 172.21.15.114:0/848181696 >> v1:172.21.15.114:6789/0 conn(0x7fecc806d360 legacy=0x7fecc806d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:15.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.150+0000 7feccd287640 1 -- 172.21.15.114:0/848181696 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc806f100 con 0x7fecc80b0b30 2024-04-28T13:08:15.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.151+0000 7feccd287640 1 --2- 172.21.15.114:0/848181696 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecc80b0b30 0x7fecc816a170 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fecc0009dc0 tx=0x7fecc002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d63ff92aab2c83 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:15.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.151+0000 7fecc77fe640 1 -- 172.21.15.114:0/848181696 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc001670 con 0x7fecc80b0b30 2024-04-28T13:08:15.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.151+0000 7fecc77fe640 1 -- 172.21.15.114:0/848181696 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecc0007540 con 0x7fecc80b0b30 2024-04-28T13:08:15.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.151+0000 7fecc77fe640 1 -- 172.21.15.114:0/848181696 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc0007910 con 0x7fecc80b0b30 2024-04-28T13:08:15.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.152+0000 7feccecea640 1 -- 172.21.15.114:0/848181696 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecc80b0b30 msgr2=0x7fecc816a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:15.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.152+0000 7feccecea640 1 --2- 172.21.15.114:0/848181696 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecc80b0b30 0x7fecc816a170 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fecc0009dc0 tx=0x7fecc002a660 comp rx=0 tx=0).stop 2024-04-28T13:08:15.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.152+0000 7feccecea640 1 -- 172.21.15.114:0/848181696 shutdown_connections 2024-04-28T13:08:15.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.152+0000 7feccecea640 1 --2- 172.21.15.114:0/848181696 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecc80b0b30 0x7fecc816a170 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.152+0000 7feccecea640 1 -- 172.21.15.114:0/848181696 >> 172.21.15.114:0/848181696 conn(0x7fecc8072a60 msgr2=0x7fecc8072e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:15.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.152+0000 7feccecea640 1 -- 172.21.15.114:0/848181696 shutdown_connections 2024-04-28T13:08:15.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.152+0000 7feccecea640 1 -- 172.21.15.114:0/848181696 wait complete. 2024-04-28T13:08:15.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.153+0000 7feccecea640 1 Processor -- start 2024-04-28T13:08:15.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.153+0000 7feccecea640 1 -- start start 2024-04-28T13:08:15.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.154+0000 7feccecea640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc806d360 0x7fecc81eab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:15.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.154+0000 7feccecea640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecc806e990 0x7fecc81eb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:15.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.154+0000 7feccecea640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecc80b0b30 0x7fecc81eb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:15.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.154+0000 7feccecea640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fecc806f6c0 con 0x7fecc80b0b30 2024-04-28T13:08:15.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.154+0000 7feccecea640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fecc806f9a0 con 0x7fecc806d360 2024-04-28T13:08:15.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.154+0000 7feccecea640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fecc806ee10 con 0x7fecc806e990 2024-04-28T13:08:15.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.154+0000 7feccd287640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecc80b0b30 0x7fecc81eb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:15.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.154+0000 7feccd287640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecc80b0b30 0x7fecc81eb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52842/0 (socket says 172.21.15.114:52842) 2024-04-28T13:08:15.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.154+0000 7feccd287640 1 -- 172.21.15.114:0/2522861817 learned_addr learned my addr 172.21.15.114:0/2522861817 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:15.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.154+0000 7feccca86640 1 --2- 172.21.15.114:0/2522861817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc806d360 0x7fecc81eab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:15.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.154+0000 7fecc7fff640 1 --2- 172.21.15.114:0/2522861817 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecc806e990 0x7fecc81eb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:15.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.154+0000 7feccd287640 1 -- 172.21.15.114:0/2522861817 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecc806e990 msgr2=0x7fecc81eb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:15.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.154+0000 7feccd287640 1 --2- 172.21.15.114:0/2522861817 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecc806e990 0x7fecc81eb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.154+0000 7feccd287640 1 -- 172.21.15.114:0/2522861817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc806d360 msgr2=0x7fecc81eab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:15.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.154+0000 7feccd287640 1 --2- 172.21.15.114:0/2522861817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc806d360 0x7fecc81eab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.154+0000 7feccd287640 1 -- 172.21.15.114:0/2522861817 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc80cebd0 con 0x7fecc80b0b30 2024-04-28T13:08:15.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.154+0000 7feccca86640 1 --2- 172.21.15.114:0/2522861817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc806d360 0x7fecc81eab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:15.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.154+0000 7feccd287640 1 --2- 172.21.15.114:0/2522861817 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecc80b0b30 0x7fecc81eb690 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fecc002ac50 tx=0x7fecc0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:15.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.154+0000 7fecc57fa640 1 -- 172.21.15.114:0/2522861817 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc003f070 con 0x7fecc80b0b30 2024-04-28T13:08:15.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.154+0000 7fecc57fa640 1 -- 172.21.15.114:0/2522861817 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecc0031bc0 con 0x7fecc80b0b30 2024-04-28T13:08:15.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.154+0000 7feccecea640 1 -- 172.21.15.114:0/2522861817 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecc80ceeb0 con 0x7fecc80b0b30 2024-04-28T13:08:15.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.155+0000 7fecc57fa640 1 -- 172.21.15.114:0/2522861817 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc0009450 con 0x7fecc80b0b30 2024-04-28T13:08:15.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.155+0000 7feccecea640 1 -- 172.21.15.114:0/2522861817 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecc80cf470 con 0x7fecc80b0b30 2024-04-28T13:08:15.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.156+0000 7feccecea640 1 -- 172.21.15.114:0/2522861817 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecc806a3d0 con 0x7fecc80b0b30 2024-04-28T13:08:15.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.156+0000 7fecc57fa640 1 -- 172.21.15.114:0/2522861817 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fecc0044460 con 0x7fecc80b0b30 2024-04-28T13:08:15.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.156+0000 7fecc57fa640 1 --2- 172.21.15.114:0/2522861817 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fecac06c8f0 0x7fecac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:15.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.156+0000 7fecc57fa640 1 -- 172.21.15.114:0/2522861817 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fecc00acec0 con 0x7fecc80b0b30 2024-04-28T13:08:15.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.156+0000 7feccca86640 1 --2- 172.21.15.114:0/2522861817 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fecac06c8f0 0x7fecac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:15.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.157+0000 7feccca86640 1 --2- 172.21.15.114:0/2522861817 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fecac06c8f0 0x7fecac06edb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fecbc0011e0 tx=0x7fecbc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:15.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.161+0000 7fecc57fa640 1 -- 172.21.15.114:0/2522861817 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fecc007b5c0 con 0x7fecc80b0b30 2024-04-28T13:08:15.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.336+0000 7feccecea640 1 -- 172.21.15.114:0/2522861817 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fecc8073790 con 0x7fecc80b0b30 2024-04-28T13:08:15.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.337+0000 7fecc57fa640 1 -- 172.21.15.114:0/2522861817 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+12939 (secure 0 0 0) 0x7fecc007aec0 con 0x7fecc80b0b30 2024-04-28T13:08:15.338 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:15.338 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":30,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:08:12.467662+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:08:15.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.339+0000 7feccecea640 1 -- 172.21.15.114:0/2522861817 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fecac06c8f0 msgr2=0x7fecac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:15.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.339+0000 7feccecea640 1 --2- 172.21.15.114:0/2522861817 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fecac06c8f0 0x7fecac06edb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fecbc0011e0 tx=0x7fecbc009040 comp rx=0 tx=0).stop 2024-04-28T13:08:15.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.339+0000 7feccecea640 1 -- 172.21.15.114:0/2522861817 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecc80b0b30 msgr2=0x7fecc81eb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:15.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.339+0000 7feccecea640 1 --2- 172.21.15.114:0/2522861817 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecc80b0b30 0x7fecc81eb690 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fecc002ac50 tx=0x7fecc0004a40 comp rx=0 tx=0).stop 2024-04-28T13:08:15.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.339+0000 7feccecea640 1 -- 172.21.15.114:0/2522861817 shutdown_connections 2024-04-28T13:08:15.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.339+0000 7feccecea640 1 --2- 172.21.15.114:0/2522861817 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecc80b0b30 0x7fecc81eb690 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.339+0000 7feccecea640 1 --2- 172.21.15.114:0/2522861817 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecc806e990 0x7fecc81eb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.339+0000 7feccecea640 1 --2- 172.21.15.114:0/2522861817 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fecac06c8f0 0x7fecac06edb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.339+0000 7feccecea640 1 --2- 172.21.15.114:0/2522861817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc806d360 0x7fecc81eab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.339+0000 7feccecea640 1 -- 172.21.15.114:0/2522861817 >> 172.21.15.114:0/2522861817 conn(0x7fecc8072a60 msgr2=0x7fecc80afb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:15.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.339+0000 7feccecea640 1 -- 172.21.15.114:0/2522861817 shutdown_connections 2024-04-28T13:08:15.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.339+0000 7feccecea640 1 -- 172.21.15.114:0/2522861817 wait complete. 2024-04-28T13:08:15.352 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-28T13:07:14.721860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-28T13:08:15.352 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-28T13:08:15.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.452+0000 7f487cea9640 1 Processor -- start 2024-04-28T13:08:15.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.452+0000 7f487cea9640 1 -- start start 2024-04-28T13:08:15.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.453+0000 7f487cea9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f487806c350 0x7f48780b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:15.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.453+0000 7f487cea9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f48780ce9a0 0x7f4878162f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:15.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.453+0000 7f487cea9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f487806c730 0x7f4878070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:15.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.453+0000 7f487cea9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f4878163ea0 con 0x7f48780ce9a0 2024-04-28T13:08:15.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.453+0000 7f487cea9640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f4878163600 con 0x7f487806c350 2024-04-28T13:08:15.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.453+0000 7f487cea9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f48781638e0 con 0x7f487806c730 2024-04-28T13:08:15.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.453+0000 7f4875d9b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f48780ce9a0 0x7f4878162f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:15.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.453+0000 7f4875d9b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f48780ce9a0 0x7f4878162f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52850/0 (socket says 172.21.15.114:52850) 2024-04-28T13:08:15.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.453+0000 7f4875d9b640 1 -- 172.21.15.114:0/1635887775 learned_addr learned my addr 172.21.15.114:0/1635887775 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:15.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.453+0000 7f487659c640 1 --2- 172.21.15.114:0/1635887775 >> v2:172.21.15.134:3300/0 conn(0x7f487806c350 0x7f48780b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:15.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.453+0000 7f4876d9d640 1 --2- 172.21.15.114:0/1635887775 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f487806c730 0x7f4878070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:15.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.453+0000 7f4875d9b640 1 -- 172.21.15.114:0/1635887775 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f487806c730 msgr2=0x7f4878070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:15.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.453+0000 7f4875d9b640 1 --2- 172.21.15.114:0/1635887775 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f487806c730 0x7f4878070e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.453+0000 7f4875d9b640 1 -- 172.21.15.114:0/1635887775 >> v2:172.21.15.134:3300/0 conn(0x7f487806c350 msgr2=0x7f48780b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:15.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.453+0000 7f4875d9b640 1 --2- 172.21.15.114:0/1635887775 >> v2:172.21.15.134:3300/0 conn(0x7f487806c350 0x7f48780b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.453+0000 7f4875d9b640 1 -- 172.21.15.114:0/1635887775 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4878163bc0 con 0x7f48780ce9a0 2024-04-28T13:08:15.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.453+0000 7f487659c640 1 --2- 172.21.15.114:0/1635887775 >> v2:172.21.15.134:3300/0 conn(0x7f487806c350 0x7f48780b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:15.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.453+0000 7f4876d9d640 1 --2- 172.21.15.114:0/1635887775 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f487806c730 0x7f4878070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:15.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.454+0000 7f4875d9b640 1 --2- 172.21.15.114:0/1635887775 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48780ce9a0 0x7f4878162f00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4878073390 tx=0x7f486c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f65e9ad5a0a0892 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:15.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.454+0000 7f487559a640 1 -- 172.21.15.114:0/1635887775 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486c037070 con 0x7f48780ce9a0 2024-04-28T13:08:15.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.454+0000 7f487559a640 1 -- 172.21.15.114:0/1635887775 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f486c032440 con 0x7f48780ce9a0 2024-04-28T13:08:15.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.454+0000 7f487559a640 1 -- 172.21.15.114:0/1635887775 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486c032810 con 0x7f48780ce9a0 2024-04-28T13:08:15.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.454+0000 7f487cea9640 1 -- 172.21.15.114:0/1635887775 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48780ce9a0 msgr2=0x7f4878162f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:15.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.454+0000 7f487cea9640 1 --2- 172.21.15.114:0/1635887775 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48780ce9a0 0x7f4878162f00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4878073390 tx=0x7f486c02a140 comp rx=0 tx=0).stop 2024-04-28T13:08:15.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.455+0000 7f487cea9640 1 -- 172.21.15.114:0/1635887775 shutdown_connections 2024-04-28T13:08:15.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.455+0000 7f487cea9640 1 --2- 172.21.15.114:0/1635887775 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f487806c730 0x7f4878070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.455+0000 7f487cea9640 1 --2- 172.21.15.114:0/1635887775 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48780ce9a0 0x7f4878162f00 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.455+0000 7f487cea9640 1 --2- 172.21.15.114:0/1635887775 >> v2:172.21.15.134:3300/0 conn(0x7f487806c350 0x7f48780b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.455+0000 7f487cea9640 1 -- 172.21.15.114:0/1635887775 >> 172.21.15.114:0/1635887775 conn(0x7f487806f4f0 msgr2=0x7f487806f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:15.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.455+0000 7f487cea9640 1 -- 172.21.15.114:0/1635887775 shutdown_connections 2024-04-28T13:08:15.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.455+0000 7f487cea9640 1 -- 172.21.15.114:0/1635887775 wait complete. 2024-04-28T13:08:15.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.456+0000 7f487cea9640 1 Processor -- start 2024-04-28T13:08:15.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.456+0000 7f487cea9640 1 -- start start 2024-04-28T13:08:15.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.457+0000 7f487cea9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f487806c350 0x7f487815ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:15.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.457+0000 7f487cea9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f487806c730 0x7f48780b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:15.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.457+0000 7f487cea9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48780ce9a0 0x7f48780b2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:15.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.457+0000 7f487cea9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4878148f40 con 0x7f487806c730 2024-04-28T13:08:15.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.457+0000 7f487cea9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4878148dc0 con 0x7f48780ce9a0 2024-04-28T13:08:15.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.457+0000 7f487cea9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f4878071370 con 0x7f487806c350 2024-04-28T13:08:15.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.457+0000 7f4875d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f487806c730 0x7f48780b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:15.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.457+0000 7f4875d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f487806c730 0x7f48780b1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52860/0 (socket says 172.21.15.114:52860) 2024-04-28T13:08:15.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.457+0000 7f4875d9b640 1 -- 172.21.15.114:0/4164516434 learned_addr learned my addr 172.21.15.114:0/4164516434 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:15.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.457+0000 7f487659c640 1 --2- 172.21.15.114:0/4164516434 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f487806c350 0x7f487815ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:15.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.457+0000 7f4876d9d640 1 --2- 172.21.15.114:0/4164516434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48780ce9a0 0x7f48780b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:15.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.457+0000 7f4875d9b640 1 -- 172.21.15.114:0/4164516434 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f487806c350 msgr2=0x7f487815ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:15.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.457+0000 7f4875d9b640 1 --2- 172.21.15.114:0/4164516434 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f487806c350 0x7f487815ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.457+0000 7f4875d9b640 1 -- 172.21.15.114:0/4164516434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48780ce9a0 msgr2=0x7f48780b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:15.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.457+0000 7f4875d9b640 1 --2- 172.21.15.114:0/4164516434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48780ce9a0 0x7f48780b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.457+0000 7f4875d9b640 1 -- 172.21.15.114:0/4164516434 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4878144210 con 0x7f487806c730 2024-04-28T13:08:15.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.457+0000 7f4875d9b640 1 --2- 172.21.15.114:0/4164516434 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f487806c730 0x7f48780b1c10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f486c02a180 tx=0x7f486c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:15.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.458+0000 7f4866ffd640 1 -- 172.21.15.114:0/4164516434 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486c037040 con 0x7f487806c730 2024-04-28T13:08:15.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.458+0000 7f4866ffd640 1 -- 172.21.15.114:0/4164516434 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f486c042070 con 0x7f487806c730 2024-04-28T13:08:15.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.458+0000 7f487cea9640 1 -- 172.21.15.114:0/4164516434 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48780b2780 con 0x7f487806c730 2024-04-28T13:08:15.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.458+0000 7f4866ffd640 1 -- 172.21.15.114:0/4164516434 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486c030bb0 con 0x7f487806c730 2024-04-28T13:08:15.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.458+0000 7f487cea9640 1 -- 172.21.15.114:0/4164516434 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48780b2d40 con 0x7f487806c730 2024-04-28T13:08:15.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.459+0000 7f487cea9640 1 -- 172.21.15.114:0/4164516434 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f487806a3d0 con 0x7f487806c730 2024-04-28T13:08:15.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.459+0000 7f4866ffd640 1 -- 172.21.15.114:0/4164516434 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f486c047460 con 0x7f487806c730 2024-04-28T13:08:15.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.460+0000 7f4866ffd640 1 --2- 172.21.15.114:0/4164516434 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f485806c8f0 0x7f485806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:15.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.460+0000 7f487659c640 1 --2- 172.21.15.114:0/4164516434 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f485806c8f0 0x7f485806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:15.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.460+0000 7f4866ffd640 1 -- 172.21.15.114:0/4164516434 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f486c0ac250 con 0x7f487806c730 2024-04-28T13:08:15.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.460+0000 7f487659c640 1 --2- 172.21.15.114:0/4164516434 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f485806c8f0 0x7f485806edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4868006b10 tx=0x7f4868008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:15.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.464+0000 7f4866ffd640 1 -- 172.21.15.114:0/4164516434 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f486c07a410 con 0x7f487806c730 2024-04-28T13:08:15.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.641+0000 7f487cea9640 1 -- 172.21.15.114:0/4164516434 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4878070fe0 con 0x7f487806c730 2024-04-28T13:08:15.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.642+0000 7f4866ffd640 1 -- 172.21.15.114:0/4164516434 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) ==== 93+0+10 (secure 0 0 0) 0x7f486c07e710 con 0x7f487806c730 2024-04-28T13:08:15.643 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-28T13:08:15.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.644+0000 7f487cea9640 1 -- 172.21.15.114:0/4164516434 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f485806c8f0 msgr2=0x7f485806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:15.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.644+0000 7f487cea9640 1 --2- 172.21.15.114:0/4164516434 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f485806c8f0 0x7f485806edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4868006b10 tx=0x7f4868008040 comp rx=0 tx=0).stop 2024-04-28T13:08:15.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.644+0000 7f487cea9640 1 -- 172.21.15.114:0/4164516434 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f487806c730 msgr2=0x7f48780b1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:15.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.644+0000 7f487cea9640 1 --2- 172.21.15.114:0/4164516434 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f487806c730 0x7f48780b1c10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f486c02a180 tx=0x7f486c0046c0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.644+0000 7f487cea9640 1 -- 172.21.15.114:0/4164516434 shutdown_connections 2024-04-28T13:08:15.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.644+0000 7f487cea9640 1 --2- 172.21.15.114:0/4164516434 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f485806c8f0 0x7f485806edb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.644+0000 7f487cea9640 1 --2- 172.21.15.114:0/4164516434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48780ce9a0 0x7f48780b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.644+0000 7f487cea9640 1 --2- 172.21.15.114:0/4164516434 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f487806c730 0x7f48780b1c10 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.644+0000 7f487cea9640 1 --2- 172.21.15.114:0/4164516434 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f487806c350 0x7f487815ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.644+0000 7f487cea9640 1 -- 172.21.15.114:0/4164516434 >> 172.21.15.114:0/4164516434 conn(0x7f487806f4f0 msgr2=0x7f48780d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:15.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.644+0000 7f487cea9640 1 -- 172.21.15.114:0/4164516434 shutdown_connections 2024-04-28T13:08:15.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.644+0000 7f487cea9640 1 -- 172.21.15.114:0/4164516434 wait complete. 2024-04-28T13:08:15.656 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-28T13:08:15.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.752+0000 7f2fe5e47640 1 Processor -- start 2024-04-28T13:08:15.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.752+0000 7f2fe5e47640 1 -- start start 2024-04-28T13:08:15.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.753+0000 7f2fe5e47640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2fe0153330 0x7f2fe015d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:15.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.753+0000 7f2fe5e47640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2fe00723d0 0x7f2fe0073bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:15.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.753+0000 7f2fe5e47640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fe0153710 con 0x7f2fe00740f0 2024-04-28T13:08:15.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.753+0000 7f2fe5e47640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f2fe0074560 con 0x7f2fe0153330 2024-04-28T13:08:15.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.753+0000 7f2fe5e47640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe00b4a60 con 0x7f2fe00723d0 2024-04-28T13:08:15.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.753+0000 7f2fdf7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2fe0153330 0x7f2fe015d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:15.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.753+0000 7f2fdf7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2fe0153330 0x7f2fe015d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52868/0 (socket says 172.21.15.114:52868) 2024-04-28T13:08:15.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.753+0000 7f2fdf7fe640 1 -- 172.21.15.114:0/3142058944 learned_addr learned my addr 172.21.15.114:0/3142058944 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:15.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.753+0000 7f2fdeffd640 1 --2- 172.21.15.114:0/3142058944 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2fe00723d0 0x7f2fe0073bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:15.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.753+0000 7f2fdf7fe640 1 -- 172.21.15.114:0/3142058944 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2fe00723d0 msgr2=0x7f2fe0073bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:15.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.753+0000 7f2fdf7fe640 1 --2- 172.21.15.114:0/3142058944 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2fe00723d0 0x7f2fe0073bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.753+0000 7f2fdf7fe640 1 -- 172.21.15.114:0/3142058944 >> v1:172.21.15.134:6789/0 conn(0x7f2fe00740f0 legacy=0x7f2fe015fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:15.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.753+0000 7f2fdf7fe640 1 -- 172.21.15.114:0/3142058944 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe0072990 con 0x7f2fe0153330 2024-04-28T13:08:15.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.753+0000 7f2fdeffd640 1 --2- 172.21.15.114:0/3142058944 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2fe00723d0 0x7f2fe0073bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:15.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.754+0000 7f2fdf7fe640 1 --2- 172.21.15.114:0/3142058944 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fe0153330 0x7f2fe015d2e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2fd000bb10 tx=0x7f2fd002c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc08a37e662c5fd8 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:15.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.754+0000 7f2fde7fc640 1 -- 172.21.15.114:0/3142058944 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0032790 con 0x7f2fe0153330 2024-04-28T13:08:15.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.754+0000 7f2fde7fc640 1 -- 172.21.15.114:0/3142058944 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd0038070 con 0x7f2fe0153330 2024-04-28T13:08:15.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.754+0000 7f2fde7fc640 1 -- 172.21.15.114:0/3142058944 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0032b50 con 0x7f2fe0153330 2024-04-28T13:08:15.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.755+0000 7f2fe5e47640 1 -- 172.21.15.114:0/3142058944 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fe0153330 msgr2=0x7f2fe015d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:15.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.755+0000 7f2fe5e47640 1 --2- 172.21.15.114:0/3142058944 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fe0153330 0x7f2fe015d2e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2fd000bb10 tx=0x7f2fd002c8d0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.755+0000 7f2fe5e47640 1 -- 172.21.15.114:0/3142058944 shutdown_connections 2024-04-28T13:08:15.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.755+0000 7f2fe5e47640 1 --2- 172.21.15.114:0/3142058944 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2fe00723d0 0x7f2fe0073bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.755+0000 7f2fe5e47640 1 --2- 172.21.15.114:0/3142058944 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fe0153330 0x7f2fe015d2e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.755+0000 7f2fe5e47640 1 -- 172.21.15.114:0/3142058944 >> 172.21.15.114:0/3142058944 conn(0x7f2fe006c980 msgr2=0x7f2fe00b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:15.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.755+0000 7f2fe5e47640 1 -- 172.21.15.114:0/3142058944 shutdown_connections 2024-04-28T13:08:15.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.755+0000 7f2fe5e47640 1 -- 172.21.15.114:0/3142058944 wait complete. 2024-04-28T13:08:15.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.756+0000 7f2fe5e47640 1 Processor -- start 2024-04-28T13:08:15.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.756+0000 7f2fe5e47640 1 -- start start 2024-04-28T13:08:15.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.757+0000 7f2fe5e47640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fe00723d0 0x7f2fe014da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:15.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.757+0000 7f2fe5e47640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2fe00740f0 0x7f2fe00cf740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:15.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.757+0000 7f2fe5e47640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fe0153330 0x7f2fe015d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:15.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.757+0000 7f2fe5e47640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe0073230 con 0x7f2fe0153330 2024-04-28T13:08:15.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.757+0000 7f2fe5e47640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe0072f50 con 0x7f2fe00723d0 2024-04-28T13:08:15.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.757+0000 7f2fe5e47640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe0073510 con 0x7f2fe00740f0 2024-04-28T13:08:15.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.757+0000 7f2fdffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fe0153330 0x7f2fe015d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:15.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.757+0000 7f2fdffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fe0153330 0x7f2fe015d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52872/0 (socket says 172.21.15.114:52872) 2024-04-28T13:08:15.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.757+0000 7f2fdffff640 1 -- 172.21.15.114:0/2535861746 learned_addr learned my addr 172.21.15.114:0/2535861746 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:15.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.757+0000 7f2fdf7fe640 1 --2- 172.21.15.114:0/2535861746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fe00723d0 0x7f2fe014da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:15.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.757+0000 7f2fdeffd640 1 --2- 172.21.15.114:0/2535861746 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2fe00740f0 0x7f2fe00cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:15.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.757+0000 7f2fdffff640 1 -- 172.21.15.114:0/2535861746 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2fe00740f0 msgr2=0x7f2fe00cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:15.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.757+0000 7f2fdffff640 1 --2- 172.21.15.114:0/2535861746 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2fe00740f0 0x7f2fe00cf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.757+0000 7f2fdffff640 1 -- 172.21.15.114:0/2535861746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fe00723d0 msgr2=0x7f2fe014da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:15.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.757+0000 7f2fdffff640 1 --2- 172.21.15.114:0/2535861746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fe00723d0 0x7f2fe014da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.757+0000 7f2fdffff640 1 -- 172.21.15.114:0/2535861746 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe0157630 con 0x7f2fe0153330 2024-04-28T13:08:15.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.757+0000 7f2fdeffd640 1 --2- 172.21.15.114:0/2535861746 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2fe00740f0 0x7f2fe00cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:15.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.757+0000 7f2fdffff640 1 --2- 172.21.15.114:0/2535861746 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fe0153330 0x7f2fe015d730 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2fd800c780 tx=0x7f2fd800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:15.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.757+0000 7f2fc7fff640 1 -- 172.21.15.114:0/2535861746 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd8004b60 con 0x7f2fe0153330 2024-04-28T13:08:15.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.757+0000 7f2fc7fff640 1 -- 172.21.15.114:0/2535861746 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd8004d00 con 0x7f2fe0153330 2024-04-28T13:08:15.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.758+0000 7f2fc7fff640 1 -- 172.21.15.114:0/2535861746 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd800aa30 con 0x7f2fe0153330 2024-04-28T13:08:15.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.758+0000 7f2fe5e47640 1 -- 172.21.15.114:0/2535861746 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe015e410 con 0x7f2fe0153330 2024-04-28T13:08:15.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.758+0000 7f2fe5e47640 1 -- 172.21.15.114:0/2535861746 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe00d01c0 con 0x7f2fe0153330 2024-04-28T13:08:15.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.758+0000 7f2fe5e47640 1 -- 172.21.15.114:0/2535861746 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fe006a3d0 con 0x7f2fe0153330 2024-04-28T13:08:15.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.759+0000 7f2fc7fff640 1 -- 172.21.15.114:0/2535861746 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2fd800abd0 con 0x7f2fe0153330 2024-04-28T13:08:15.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.759+0000 7f2fc7fff640 1 --2- 172.21.15.114:0/2535861746 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2fcc06c8f0 0x7f2fcc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:15.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.759+0000 7f2fc7fff640 1 -- 172.21.15.114:0/2535861746 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f2fd808ba80 con 0x7f2fe0153330 2024-04-28T13:08:15.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.759+0000 7f2fdf7fe640 1 --2- 172.21.15.114:0/2535861746 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2fcc06c8f0 0x7f2fcc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:15.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.760+0000 7f2fdf7fe640 1 --2- 172.21.15.114:0/2535861746 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2fcc06c8f0 0x7f2fcc06edb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0037000 tx=0x7f2fd003e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:15.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.764+0000 7f2fc7fff640 1 -- 172.21.15.114:0/2535861746 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2fd8020070 con 0x7f2fe0153330 2024-04-28T13:08:15.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.941+0000 7f2fe5e47640 1 -- 172.21.15.114:0/2535861746 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f2fe015fbc0 con 0x7f2fe0153330 2024-04-28T13:08:15.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.941+0000 7f2fc7fff640 1 -- 172.21.15.114:0/2535861746 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) ==== 84+0+65 (secure 0 0 0) 0x7f2fd805a200 con 0x7f2fe0153330 2024-04-28T13:08:15.942 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:15.942 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-04-28T13:08:15.942 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:15.943 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2024-04-28T13:08:15.943 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2024-04-28T13:08:15.943 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:15.943 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-04-28T13:08:15.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.944+0000 7f2fe5e47640 1 -- 172.21.15.114:0/2535861746 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2fcc06c8f0 msgr2=0x7f2fcc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:15.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.944+0000 7f2fe5e47640 1 --2- 172.21.15.114:0/2535861746 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2fcc06c8f0 0x7f2fcc06edb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0037000 tx=0x7f2fd003e040 comp rx=0 tx=0).stop 2024-04-28T13:08:15.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.944+0000 7f2fe5e47640 1 -- 172.21.15.114:0/2535861746 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fe0153330 msgr2=0x7f2fe015d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:15.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.944+0000 7f2fe5e47640 1 --2- 172.21.15.114:0/2535861746 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fe0153330 0x7f2fe015d730 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2fd800c780 tx=0x7f2fd800cc40 comp rx=0 tx=0).stop 2024-04-28T13:08:15.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.944+0000 7f2fe5e47640 1 -- 172.21.15.114:0/2535861746 shutdown_connections 2024-04-28T13:08:15.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.944+0000 7f2fe5e47640 1 --2- 172.21.15.114:0/2535861746 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fe0153330 0x7f2fe015d730 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.944+0000 7f2fe5e47640 1 --2- 172.21.15.114:0/2535861746 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2fe00740f0 0x7f2fe00cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.944+0000 7f2fe5e47640 1 --2- 172.21.15.114:0/2535861746 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2fcc06c8f0 0x7f2fcc06edb0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.944+0000 7f2fe5e47640 1 --2- 172.21.15.114:0/2535861746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fe00723d0 0x7f2fe014da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:15.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.944+0000 7f2fe5e47640 1 -- 172.21.15.114:0/2535861746 >> 172.21.15.114:0/2535861746 conn(0x7f2fe006c980 msgr2=0x7f2fe0150e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:15.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.944+0000 7f2fe5e47640 1 -- 172.21.15.114:0/2535861746 shutdown_connections 2024-04-28T13:08:15.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:15.944+0000 7f2fe5e47640 1 -- 172.21.15.114:0/2535861746 wait complete. 2024-04-28T13:08:15.955 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-28T13:08:15.955 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-28T13:08:16.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.054+0000 7fd44bf80640 1 Processor -- start 2024-04-28T13:08:16.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.055+0000 7fd44bf80640 1 -- start start 2024-04-28T13:08:16.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.055+0000 7fd44bf80640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd444070f70 0x7fd4440b6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:16.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.055+0000 7fd44bf80640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd444163530 0x7fd4440afb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:16.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.055+0000 7fd44bf80640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4440b5860 con 0x7fd4440af6b0 2024-04-28T13:08:16.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.055+0000 7fd44bf80640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fd4440b5b40 con 0x7fd444163530 2024-04-28T13:08:16.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.055+0000 7fd44bf80640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fd4440b5e20 con 0x7fd444070f70 2024-04-28T13:08:16.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.056+0000 7fd44a51d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd444163530 0x7fd4440afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:16.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.056+0000 7fd44a51d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd444163530 0x7fd4440afb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52886/0 (socket says 172.21.15.114:52886) 2024-04-28T13:08:16.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.056+0000 7fd44a51d640 1 -- 172.21.15.114:0/3393279347 learned_addr learned my addr 172.21.15.114:0/3393279347 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:16.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.056+0000 7fd44a51d640 1 -- 172.21.15.114:0/3393279347 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd444070f70 msgr2=0x7fd4440b6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:16.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.056+0000 7fd449d1c640 1 --2- 172.21.15.114:0/3393279347 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd444070f70 0x7fd4440b6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:16.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.056+0000 7fd44a51d640 1 --2- 172.21.15.114:0/3393279347 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd444070f70 0x7fd4440b6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:16.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.056+0000 7fd44a51d640 1 -- 172.21.15.114:0/3393279347 >> v1:172.21.15.134:6789/0 conn(0x7fd4440af6b0 legacy=0x7fd444162e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:16.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.056+0000 7fd44a51d640 1 -- 172.21.15.114:0/3393279347 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4440b6100 con 0x7fd444163530 2024-04-28T13:08:16.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.057+0000 7fd44a51d640 1 --2- 172.21.15.114:0/3393279347 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd444163530 0x7fd4440afb10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd440009870 tx=0x7fd44002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=641652fd5aed230a server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:16.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.057+0000 7fd448d1a640 1 -- 172.21.15.114:0/3393279347 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd440037070 con 0x7fd444163530 2024-04-28T13:08:16.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.057+0000 7fd448d1a640 1 -- 172.21.15.114:0/3393279347 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd440032440 con 0x7fd444163530 2024-04-28T13:08:16.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.057+0000 7fd448d1a640 1 -- 172.21.15.114:0/3393279347 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd440032810 con 0x7fd444163530 2024-04-28T13:08:16.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.057+0000 7fd44bf80640 1 -- 172.21.15.114:0/3393279347 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd444163530 msgr2=0x7fd4440afb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:16.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.057+0000 7fd44bf80640 1 --2- 172.21.15.114:0/3393279347 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd444163530 0x7fd4440afb10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd440009870 tx=0x7fd44002a210 comp rx=0 tx=0).stop 2024-04-28T13:08:16.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.057+0000 7fd44bf80640 1 -- 172.21.15.114:0/3393279347 shutdown_connections 2024-04-28T13:08:16.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.057+0000 7fd44bf80640 1 --2- 172.21.15.114:0/3393279347 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd444163530 0x7fd4440afb10 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:16.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.057+0000 7fd44bf80640 1 --2- 172.21.15.114:0/3393279347 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd444070f70 0x7fd4440b6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:16.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.057+0000 7fd44bf80640 1 -- 172.21.15.114:0/3393279347 >> 172.21.15.114:0/3393279347 conn(0x7fd4440d18d0 msgr2=0x7fd4440d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:16.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.057+0000 7fd44bf80640 1 -- 172.21.15.114:0/3393279347 shutdown_connections 2024-04-28T13:08:16.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.057+0000 7fd44bf80640 1 -- 172.21.15.114:0/3393279347 wait complete. 2024-04-28T13:08:16.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.058+0000 7fd44bf80640 1 Processor -- start 2024-04-28T13:08:16.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.059+0000 7fd44bf80640 1 -- start start 2024-04-28T13:08:16.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.059+0000 7fd44bf80640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd444070f70 0x7fd444141030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:16.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.059+0000 7fd44bf80640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd4440af6b0 0x7fd444154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:16.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.059+0000 7fd44bf80640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd444163530 0x7fd44415e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:16.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.059+0000 7fd44bf80640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd4440b54a0 con 0x7fd444163530 2024-04-28T13:08:16.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.059+0000 7fd44bf80640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd444071350 con 0x7fd444070f70 2024-04-28T13:08:16.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.059+0000 7fd44bf80640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fd4440b5620 con 0x7fd4440af6b0 2024-04-28T13:08:16.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.059+0000 7fd44a51d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd444163530 0x7fd44415e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:16.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.059+0000 7fd44a51d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd444163530 0x7fd44415e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52894/0 (socket says 172.21.15.114:52894) 2024-04-28T13:08:16.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.059+0000 7fd44a51d640 1 -- 172.21.15.114:0/473354990 learned_addr learned my addr 172.21.15.114:0/473354990 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:16.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.059+0000 7fd44951b640 1 --2- 172.21.15.114:0/473354990 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd4440af6b0 0x7fd444154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:16.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.059+0000 7fd449d1c640 1 --2- 172.21.15.114:0/473354990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd444070f70 0x7fd444141030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:16.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.060+0000 7fd44a51d640 1 -- 172.21.15.114:0/473354990 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd4440af6b0 msgr2=0x7fd444154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:16.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.060+0000 7fd44a51d640 1 --2- 172.21.15.114:0/473354990 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd4440af6b0 0x7fd444154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:16.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.060+0000 7fd44a51d640 1 -- 172.21.15.114:0/473354990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd444070f70 msgr2=0x7fd444141030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:16.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.060+0000 7fd44a51d640 1 --2- 172.21.15.114:0/473354990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd444070f70 0x7fd444141030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:16.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.060+0000 7fd44a51d640 1 -- 172.21.15.114:0/473354990 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4441417b0 con 0x7fd444163530 2024-04-28T13:08:16.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.060+0000 7fd44951b640 1 --2- 172.21.15.114:0/473354990 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd4440af6b0 0x7fd444154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:16.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.060+0000 7fd44a51d640 1 --2- 172.21.15.114:0/473354990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd444163530 0x7fd44415e170 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd44002a250 tx=0x7fd4400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:16.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.060+0000 7fd43a7fc640 1 -- 172.21.15.114:0/473354990 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd440041020 con 0x7fd444163530 2024-04-28T13:08:16.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.060+0000 7fd43a7fc640 1 -- 172.21.15.114:0/473354990 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd440032e50 con 0x7fd444163530 2024-04-28T13:08:16.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.060+0000 7fd43a7fc640 1 -- 172.21.15.114:0/473354990 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd440037040 con 0x7fd444163530 2024-04-28T13:08:16.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.060+0000 7fd44bf80640 1 -- 172.21.15.114:0/473354990 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4441e8de0 con 0x7fd444163530 2024-04-28T13:08:16.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.060+0000 7fd44bf80640 1 -- 172.21.15.114:0/473354990 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd444154fa0 con 0x7fd444163530 2024-04-28T13:08:16.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.061+0000 7fd44bf80640 1 -- 172.21.15.114:0/473354990 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd44406a440 con 0x7fd444163530 2024-04-28T13:08:16.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.061+0000 7fd43a7fc640 1 -- 172.21.15.114:0/473354990 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd440044020 con 0x7fd444163530 2024-04-28T13:08:16.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.062+0000 7fd43a7fc640 1 --2- 172.21.15.114:0/473354990 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd42806c8f0 0x7fd42806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:16.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.062+0000 7fd43a7fc640 1 -- 172.21.15.114:0/473354990 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fd4400ac1a0 con 0x7fd444163530 2024-04-28T13:08:16.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.062+0000 7fd449d1c640 1 --2- 172.21.15.114:0/473354990 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd42806c8f0 0x7fd42806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:16.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.062+0000 7fd449d1c640 1 --2- 172.21.15.114:0/473354990 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd42806c8f0 0x7fd42806edb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00f510 tx=0x7fd43c0077b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:16.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.066+0000 7fd43a7fc640 1 -- 172.21.15.114:0/473354990 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd44004b030 con 0x7fd444163530 2024-04-28T13:08:16.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.240+0000 7fd44bf80640 1 -- 172.21.15.114:0/473354990 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd4440d14d0 con 0x7fd444163530 2024-04-28T13:08:16.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.676+0000 7fd43a7fc640 1 -- 172.21.15.114:0/473354990 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) ==== 138+0+0 (secure 0 0 0) 0x7fd44007a920 con 0x7fd444163530 2024-04-28T13:08:16.677 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2024-04-28T13:08:16.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.678+0000 7fd44bf80640 1 -- 172.21.15.114:0/473354990 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd42806c8f0 msgr2=0x7fd42806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:16.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.678+0000 7fd44bf80640 1 --2- 172.21.15.114:0/473354990 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd42806c8f0 0x7fd42806edb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00f510 tx=0x7fd43c0077b0 comp rx=0 tx=0).stop 2024-04-28T13:08:16.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.678+0000 7fd44bf80640 1 -- 172.21.15.114:0/473354990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd444163530 msgr2=0x7fd44415e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:16.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.678+0000 7fd44bf80640 1 --2- 172.21.15.114:0/473354990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd444163530 0x7fd44415e170 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd44002a250 tx=0x7fd4400046c0 comp rx=0 tx=0).stop 2024-04-28T13:08:16.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.678+0000 7fd44bf80640 1 -- 172.21.15.114:0/473354990 shutdown_connections 2024-04-28T13:08:16.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.678+0000 7fd44bf80640 1 --2- 172.21.15.114:0/473354990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd444163530 0x7fd44415e170 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:16.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.678+0000 7fd44bf80640 1 --2- 172.21.15.114:0/473354990 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd4440af6b0 0x7fd444154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:16.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.678+0000 7fd44bf80640 1 --2- 172.21.15.114:0/473354990 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd42806c8f0 0x7fd42806edb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:16.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.678+0000 7fd44bf80640 1 --2- 172.21.15.114:0/473354990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd444070f70 0x7fd444141030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:16.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.678+0000 7fd44bf80640 1 -- 172.21.15.114:0/473354990 >> 172.21.15.114:0/473354990 conn(0x7fd4440d18d0 msgr2=0x7fd44415f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:16.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.678+0000 7fd44bf80640 1 -- 172.21.15.114:0/473354990 shutdown_connections 2024-04-28T13:08:16.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.678+0000 7fd44bf80640 1 -- 172.21.15.114:0/473354990 wait complete. 2024-04-28T13:08:16.694 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-28T13:08:16.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.799+0000 7fb43a607640 1 Processor -- start 2024-04-28T13:08:16.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.799+0000 7fb43a607640 1 -- start start 2024-04-28T13:08:16.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.800+0000 7fb43a607640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb4340baf40 0x7fb4340d5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:16.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.800+0000 7fb43a607640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4340d56a0 0x7fb4340d3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:16.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.800+0000 7fb43a607640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4340d2a40 con 0x7fb43415f430 2024-04-28T13:08:16.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.800+0000 7fb43a607640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb43415f810 con 0x7fb4340baf40 2024-04-28T13:08:16.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.800+0000 7fb43a607640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb4340d36d0 con 0x7fb4340d56a0 2024-04-28T13:08:16.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.800+0000 7fb433fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb43415f430 0x7fb4340d1a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:32864/0 (socket says 172.21.15.114:32864) 2024-04-28T13:08:16.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.800+0000 7fb433fff640 1 -- 172.21.15.114:0/4184383555 learned_addr learned my addr 172.21.15.114:0/4184383555 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:16.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.801+0000 7fb432ffd640 1 -- 172.21.15.114:0/4184383555 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2181492520 0 0) 0x7fb4340d2a40 con 0x7fb43415f430 2024-04-28T13:08:16.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.801+0000 7fb438ba4640 1 --2- 172.21.15.114:0/4184383555 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4340d56a0 0x7fb4340d3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:16.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.801+0000 7fb4337fe640 1 --2- 172.21.15.114:0/4184383555 >> v2:172.21.15.134:3300/0 conn(0x7fb4340baf40 0x7fb4340d5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:16.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.801+0000 7fb432ffd640 1 -- 172.21.15.114:0/4184383555 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb41c003520 con 0x7fb43415f430 2024-04-28T13:08:16.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.801+0000 7fb432ffd640 1 -- 172.21.15.114:0/4184383555 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4234494182 0 0) 0x7fb41c003520 con 0x7fb43415f430 2024-04-28T13:08:16.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.801+0000 7fb432ffd640 1 -- 172.21.15.114:0/4184383555 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4340d56a0 msgr2=0x7fb4340d3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:16.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.801+0000 7fb432ffd640 1 --2- 172.21.15.114:0/4184383555 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4340d56a0 0x7fb4340d3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:16.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.801+0000 7fb432ffd640 1 -- 172.21.15.114:0/4184383555 >> v2:172.21.15.134:3300/0 conn(0x7fb4340baf40 msgr2=0x7fb4340d5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:16.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.801+0000 7fb432ffd640 1 --2- 172.21.15.114:0/4184383555 >> v2:172.21.15.134:3300/0 conn(0x7fb4340baf40 0x7fb4340d5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:16.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.801+0000 7fb432ffd640 1 -- 172.21.15.114:0/4184383555 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4340d2480 con 0x7fb43415f430 2024-04-28T13:08:16.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.801+0000 7fb432ffd640 1 -- 172.21.15.114:0/4184383555 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7fb424001670 con 0x7fb43415f430 2024-04-28T13:08:16.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.801+0000 7fb432ffd640 1 -- 172.21.15.114:0/4184383555 >> v1:172.21.15.114:6789/0 conn(0x7fb43415f430 legacy=0x7fb4340d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:16.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.801+0000 7fb432ffd640 1 --2- 172.21.15.114:0/4184383555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb41c0039b0 0x7fb41c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:16.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.801+0000 7fb432ffd640 1 --2- 172.21.15.114:0/4184383555 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4340d56a0 0x7fb41c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:16.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.801+0000 7fb432ffd640 1 --2- 172.21.15.114:0/4184383555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb41c004d40 0x7fb41c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:16.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.801+0000 7fb432ffd640 1 -- 172.21.15.114:0/4184383555 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb4340d36d0 con 0x7fb41c0039b0 2024-04-28T13:08:16.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.801+0000 7fb432ffd640 1 -- 172.21.15.114:0/4184383555 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb41c00b9c0 con 0x7fb41c004d40 2024-04-28T13:08:16.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.801+0000 7fb432ffd640 1 -- 172.21.15.114:0/4184383555 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb41c00bb40 con 0x7fb4340d56a0 2024-04-28T13:08:16.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.801+0000 7fb433fff640 1 --2- 172.21.15.114:0/4184383555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb41c0039b0 0x7fb41c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:16.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.801+0000 7fb4337fe640 1 --2- 172.21.15.114:0/4184383555 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4340d56a0 0x7fb41c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:16.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.801+0000 7fb438ba4640 1 --2- 172.21.15.114:0/4184383555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb41c004d40 0x7fb41c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:16.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.801+0000 7fb433fff640 1 -- 172.21.15.114:0/4184383555 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4340d56a0 msgr2=0x7fb41c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:16.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.801+0000 7fb433fff640 1 --2- 172.21.15.114:0/4184383555 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4340d56a0 0x7fb41c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:16.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.801+0000 7fb433fff640 1 -- 172.21.15.114:0/4184383555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb41c004d40 msgr2=0x7fb41c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:16.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.801+0000 7fb433fff640 1 --2- 172.21.15.114:0/4184383555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb41c004d40 0x7fb41c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:16.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.801+0000 7fb433fff640 1 -- 172.21.15.114:0/4184383555 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb41c003520 con 0x7fb41c0039b0 2024-04-28T13:08:16.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.802+0000 7fb433fff640 1 --2- 172.21.15.114:0/4184383555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb41c0039b0 0x7fb41c003dd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb424001050 tx=0x7fb41c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d170de93cc897a1b server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:16.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.802+0000 7fb432ffd640 1 -- 172.21.15.114:0/4184383555 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42402e070 con 0x7fb41c0039b0 2024-04-28T13:08:16.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.802+0000 7fb432ffd640 1 -- 172.21.15.114:0/4184383555 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb424005af0 con 0x7fb41c0039b0 2024-04-28T13:08:16.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.802+0000 7fb432ffd640 1 -- 172.21.15.114:0/4184383555 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb424007d70 con 0x7fb41c0039b0 2024-04-28T13:08:16.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.803+0000 7fb43a607640 1 -- 172.21.15.114:0/4184383555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb41c0039b0 msgr2=0x7fb41c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:16.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.803+0000 7fb43a607640 1 --2- 172.21.15.114:0/4184383555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb41c0039b0 0x7fb41c003dd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb424001050 tx=0x7fb41c005830 comp rx=0 tx=0).stop 2024-04-28T13:08:16.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.803+0000 7fb438ba4640 1 -- 172.21.15.114:0/4184383555 reap_dead start 2024-04-28T13:08:16.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.803+0000 7fb43a607640 1 -- 172.21.15.114:0/4184383555 shutdown_connections 2024-04-28T13:08:16.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.803+0000 7fb43a607640 1 -- 172.21.15.114:0/4184383555 >> 172.21.15.114:0/4184383555 conn(0x7fb4340633a0 msgr2=0x7fb43406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:16.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.803+0000 7fb43a607640 1 -- 172.21.15.114:0/4184383555 shutdown_connections 2024-04-28T13:08:16.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.803+0000 7fb43a607640 1 -- 172.21.15.114:0/4184383555 wait complete. 2024-04-28T13:08:16.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.804+0000 7fb43a607640 1 Processor -- start 2024-04-28T13:08:16.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.804+0000 7fb43a607640 1 -- start start 2024-04-28T13:08:16.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.805+0000 7fb43a607640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb41c0039b0 0x7fb4340cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:16.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.805+0000 7fb43a607640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4341556f0 0x7fb434145360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:16.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.805+0000 7fb43a607640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb434157980 0x7fb4341f85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:16.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.805+0000 7fb43a607640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb4340d2190 con 0x7fb4341556f0 2024-04-28T13:08:16.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.805+0000 7fb43a607640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb4340d3360 con 0x7fb434157980 2024-04-28T13:08:16.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.805+0000 7fb43a607640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb4340d3b60 con 0x7fb41c0039b0 2024-04-28T13:08:16.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.805+0000 7fb4337fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4341556f0 0x7fb434145360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:16.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.805+0000 7fb4337fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4341556f0 0x7fb434145360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52910/0 (socket says 172.21.15.114:52910) 2024-04-28T13:08:16.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.805+0000 7fb4337fe640 1 -- 172.21.15.114:0/2043792389 learned_addr learned my addr 172.21.15.114:0/2043792389 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:16.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.805+0000 7fb438ba4640 1 --2- 172.21.15.114:0/2043792389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb434157980 0x7fb4341f85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:16.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.805+0000 7fb433fff640 1 --2- 172.21.15.114:0/2043792389 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb41c0039b0 0x7fb4340cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:16.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.805+0000 7fb4337fe640 1 -- 172.21.15.114:0/2043792389 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb41c0039b0 msgr2=0x7fb4340cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:16.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.805+0000 7fb4337fe640 1 --2- 172.21.15.114:0/2043792389 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb41c0039b0 0x7fb4340cb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:16.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.805+0000 7fb4337fe640 1 -- 172.21.15.114:0/2043792389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb434157980 msgr2=0x7fb4341f85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:16.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.805+0000 7fb4337fe640 1 --2- 172.21.15.114:0/2043792389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb434157980 0x7fb4341f85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:16.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.805+0000 7fb4337fe640 1 -- 172.21.15.114:0/2043792389 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4340ccf10 con 0x7fb4341556f0 2024-04-28T13:08:16.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.805+0000 7fb433fff640 1 --2- 172.21.15.114:0/2043792389 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb41c0039b0 0x7fb4340cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:16.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.805+0000 7fb4337fe640 1 --2- 172.21.15.114:0/2043792389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4341556f0 0x7fb434145360 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb428011910 tx=0x7fb428011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:16.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.805+0000 7fb430ff9640 1 -- 172.21.15.114:0/2043792389 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb428019070 con 0x7fb4341556f0 2024-04-28T13:08:16.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.805+0000 7fb430ff9640 1 -- 172.21.15.114:0/2043792389 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb428004240 con 0x7fb4341556f0 2024-04-28T13:08:16.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.805+0000 7fb430ff9640 1 -- 172.21.15.114:0/2043792389 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42800f8e0 con 0x7fb4341556f0 2024-04-28T13:08:16.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.806+0000 7fb43a607640 1 -- 172.21.15.114:0/2043792389 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4341582e0 con 0x7fb4341556f0 2024-04-28T13:08:16.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.806+0000 7fb43a607640 1 -- 172.21.15.114:0/2043792389 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4340cd490 con 0x7fb4341556f0 2024-04-28T13:08:16.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.806+0000 7fb43a607640 1 -- 172.21.15.114:0/2043792389 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb434075c40 con 0x7fb4341556f0 2024-04-28T13:08:16.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.807+0000 7fb430ff9640 1 -- 172.21.15.114:0/2043792389 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb42801c070 con 0x7fb4341556f0 2024-04-28T13:08:16.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.807+0000 7fb430ff9640 1 --2- 172.21.15.114:0/2043792389 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb42006c8f0 0x7fb42006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:16.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.807+0000 7fb430ff9640 1 -- 172.21.15.114:0/2043792389 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5227+0+0 (secure 0 0 0) 0x7fb42808bd50 con 0x7fb4341556f0 2024-04-28T13:08:16.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.807+0000 7fb433fff640 1 --2- 172.21.15.114:0/2043792389 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb42006c8f0 0x7fb42006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:16.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.808+0000 7fb433fff640 1 --2- 172.21.15.114:0/2043792389 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb42006c8f0 0x7fb42006edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb424033000 tx=0x7fb424009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:16.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.812+0000 7fb430ff9640 1 -- 172.21.15.114:0/2043792389 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb42808f030 con 0x7fb4341556f0 2024-04-28T13:08:16.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:16.986+0000 7fb43a607640 1 -- 172.21.15.114:0/2043792389 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb43415a630 con 0x7fb4341556f0 2024-04-28T13:08:17.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.681+0000 7fb430ff9640 1 -- 172.21.15.114:0/2043792389 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) ==== 170+0+0 (secure 0 0 0) 0x7fb42805a360 con 0x7fb4341556f0 2024-04-28T13:08:17.682 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2024-04-28T13:08:17.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.685+0000 7fb43a607640 1 -- 172.21.15.114:0/2043792389 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb42006c8f0 msgr2=0x7fb42006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:17.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.685+0000 7fb43a607640 1 --2- 172.21.15.114:0/2043792389 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb42006c8f0 0x7fb42006edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb424033000 tx=0x7fb424009030 comp rx=0 tx=0).stop 2024-04-28T13:08:17.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.685+0000 7fb43a607640 1 -- 172.21.15.114:0/2043792389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4341556f0 msgr2=0x7fb434145360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:17.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.685+0000 7fb43a607640 1 --2- 172.21.15.114:0/2043792389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4341556f0 0x7fb434145360 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb428011910 tx=0x7fb428011dd0 comp rx=0 tx=0).stop 2024-04-28T13:08:17.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.685+0000 7fb43a607640 1 -- 172.21.15.114:0/2043792389 shutdown_connections 2024-04-28T13:08:17.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.685+0000 7fb43a607640 1 --2- 172.21.15.114:0/2043792389 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb42006c8f0 0x7fb42006edb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:17.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.685+0000 7fb43a607640 1 --2- 172.21.15.114:0/2043792389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb434157980 0x7fb4341f85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:17.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.685+0000 7fb43a607640 1 --2- 172.21.15.114:0/2043792389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4341556f0 0x7fb434145360 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:17.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.685+0000 7fb43a607640 1 --2- 172.21.15.114:0/2043792389 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb41c0039b0 0x7fb4340cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:17.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.685+0000 7fb43a607640 1 -- 172.21.15.114:0/2043792389 >> 172.21.15.114:0/2043792389 conn(0x7fb4340633a0 msgr2=0x7fb4340d00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:17.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.685+0000 7fb43a607640 1 -- 172.21.15.114:0/2043792389 shutdown_connections 2024-04-28T13:08:17.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.685+0000 7fb43a607640 1 -- 172.21.15.114:0/2043792389 wait complete. 2024-04-28T13:08:17.710 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-28T13:08:17.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.813+0000 7ff3b7215640 1 Processor -- start 2024-04-28T13:08:17.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.813+0000 7ff3b7215640 1 -- start start 2024-04-28T13:08:17.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.814+0000 7ff3b7215640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3b006c350 0x7ff3b00b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:17.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.814+0000 7ff3b7215640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff3b0162f00 0x7ff3b0070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:17.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.814+0000 7ff3b7215640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3b0163390 con 0x7ff3b00ce9a0 2024-04-28T13:08:17.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.814+0000 7ff3b7215640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ff3b0163ea0 con 0x7ff3b0162f00 2024-04-28T13:08:17.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.814+0000 7ff3b7215640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff3b0163600 con 0x7ff3b006c350 2024-04-28T13:08:17.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.814+0000 7ff3affff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff3b00ce9a0 0x7ff3b006c730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:32876/0 (socket says 172.21.15.114:32876) 2024-04-28T13:08:17.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.814+0000 7ff3affff640 1 -- 172.21.15.114:0/1243107639 learned_addr learned my addr 172.21.15.114:0/1243107639 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:17.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.814+0000 7ff3b4fb1640 1 --2- 172.21.15.114:0/1243107639 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3b006c350 0x7ff3b00b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:17.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.814+0000 7ff3b57b2640 1 --2- 172.21.15.114:0/1243107639 >> v2:172.21.15.134:3300/0 conn(0x7ff3b0162f00 0x7ff3b0070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:17.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.814+0000 7ff3af7fe640 1 -- 172.21.15.114:0/1243107639 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1858331598 0 0) 0x7ff3b0163390 con 0x7ff3b00ce9a0 2024-04-28T13:08:17.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.814+0000 7ff3af7fe640 1 -- 172.21.15.114:0/1243107639 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff398003520 con 0x7ff3b00ce9a0 2024-04-28T13:08:17.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.815+0000 7ff3af7fe640 1 -- 172.21.15.114:0/1243107639 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1989312903 0 0) 0x7ff398003520 con 0x7ff3b00ce9a0 2024-04-28T13:08:17.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.815+0000 7ff3af7fe640 1 -- 172.21.15.114:0/1243107639 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3b006c350 msgr2=0x7ff3b00b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:17.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.815+0000 7ff3af7fe640 1 --2- 172.21.15.114:0/1243107639 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3b006c350 0x7ff3b00b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:17.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.815+0000 7ff3af7fe640 1 -- 172.21.15.114:0/1243107639 >> v2:172.21.15.134:3300/0 conn(0x7ff3b0162f00 msgr2=0x7ff3b0070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:17.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.815+0000 7ff3af7fe640 1 --2- 172.21.15.114:0/1243107639 >> v2:172.21.15.134:3300/0 conn(0x7ff3b0162f00 0x7ff3b0070e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:17.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.815+0000 7ff3af7fe640 1 -- 172.21.15.114:0/1243107639 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3b01638e0 con 0x7ff3b00ce9a0 2024-04-28T13:08:17.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.815+0000 7ff3af7fe640 1 -- 172.21.15.114:0/1243107639 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7ff3a4001670 con 0x7ff3b00ce9a0 2024-04-28T13:08:17.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.815+0000 7ff3b4fb1640 1 --2- 172.21.15.114:0/1243107639 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3b006c350 0x7ff3b00b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:08:17.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.815+0000 7ff3af7fe640 1 -- 172.21.15.114:0/1243107639 >> v1:172.21.15.114:6789/0 conn(0x7ff3b00ce9a0 legacy=0x7ff3b006c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:17.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.815+0000 7ff3af7fe640 1 --2- 172.21.15.114:0/1243107639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3980039b0 0x7ff398003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:17.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.815+0000 7ff3af7fe640 1 --2- 172.21.15.114:0/1243107639 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3b006c350 0x7ff398004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:17.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.815+0000 7ff3af7fe640 1 --2- 172.21.15.114:0/1243107639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff398004d40 0x7ff3980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:17.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.815+0000 7ff3af7fe640 1 -- 172.21.15.114:0/1243107639 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b0163600 con 0x7ff3980039b0 2024-04-28T13:08:17.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.815+0000 7ff3af7fe640 1 -- 172.21.15.114:0/1243107639 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff39800b9c0 con 0x7ff398004d40 2024-04-28T13:08:17.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.815+0000 7ff3af7fe640 1 -- 172.21.15.114:0/1243107639 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff39800bb40 con 0x7ff3b006c350 2024-04-28T13:08:17.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.815+0000 7ff3b57b2640 1 --2- 172.21.15.114:0/1243107639 >> v2:172.21.15.134:3300/0 conn(0x7ff3b0162f00 0x7ff3b0070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:08:17.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.815+0000 7ff3b4fb1640 1 --2- 172.21.15.114:0/1243107639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3980039b0 0x7ff398003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:17.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.815+0000 7ff3affff640 1 --2- 172.21.15.114:0/1243107639 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3b006c350 0x7ff398004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:17.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.815+0000 7ff3b57b2640 1 --2- 172.21.15.114:0/1243107639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff398004d40 0x7ff3980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:17.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.815+0000 7ff3b4fb1640 1 -- 172.21.15.114:0/1243107639 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3b006c350 msgr2=0x7ff398004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:17.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.815+0000 7ff3b4fb1640 1 --2- 172.21.15.114:0/1243107639 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3b006c350 0x7ff398004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:17.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.815+0000 7ff3b4fb1640 1 -- 172.21.15.114:0/1243107639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff398004d40 msgr2=0x7ff3980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:17.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.815+0000 7ff3b4fb1640 1 --2- 172.21.15.114:0/1243107639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff398004d40 0x7ff3980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:17.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.815+0000 7ff3b4fb1640 1 -- 172.21.15.114:0/1243107639 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff398003520 con 0x7ff3980039b0 2024-04-28T13:08:17.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.816+0000 7ff3b4fb1640 1 --2- 172.21.15.114:0/1243107639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3980039b0 0x7ff398003dd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0009c90 tx=0x7ff398005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e7041761e1a9fc server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:17.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.816+0000 7ff3af7fe640 1 -- 172.21.15.114:0/1243107639 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0036070 con 0x7ff3980039b0 2024-04-28T13:08:17.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.816+0000 7ff3af7fe640 1 -- 172.21.15.114:0/1243107639 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3a0031400 con 0x7ff3980039b0 2024-04-28T13:08:17.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.816+0000 7ff3af7fe640 1 -- 172.21.15.114:0/1243107639 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0009860 con 0x7ff3980039b0 2024-04-28T13:08:17.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.817+0000 7ff3b7215640 1 -- 172.21.15.114:0/1243107639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3980039b0 msgr2=0x7ff398003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:17.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.817+0000 7ff3b7215640 1 --2- 172.21.15.114:0/1243107639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3980039b0 0x7ff398003dd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0009c90 tx=0x7ff398005830 comp rx=0 tx=0).stop 2024-04-28T13:08:17.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.817+0000 7ff3b57b2640 1 -- 172.21.15.114:0/1243107639 reap_dead start 2024-04-28T13:08:17.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.817+0000 7ff3b7215640 1 -- 172.21.15.114:0/1243107639 shutdown_connections 2024-04-28T13:08:17.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.817+0000 7ff3b7215640 1 -- 172.21.15.114:0/1243107639 >> 172.21.15.114:0/1243107639 conn(0x7ff3b006f4f0 msgr2=0x7ff3b006f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:17.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.817+0000 7ff3b7215640 1 -- 172.21.15.114:0/1243107639 shutdown_connections 2024-04-28T13:08:17.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.817+0000 7ff3b7215640 1 -- 172.21.15.114:0/1243107639 wait complete. 2024-04-28T13:08:17.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.818+0000 7ff3b7215640 1 Processor -- start 2024-04-28T13:08:17.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.818+0000 7ff3b7215640 1 -- start start 2024-04-28T13:08:17.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.819+0000 7ff3b7215640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3980039b0 0x7ff3b0143c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:17.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.819+0000 7ff3b7215640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3b013dba0 0x7ff3b00d1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:17.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.819+0000 7ff3b7215640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3b0141120 0x7ff3b00b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:17.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.819+0000 7ff3b7215640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b0148f40 con 0x7ff3980039b0 2024-04-28T13:08:17.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.819+0000 7ff3b7215640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b0148dc0 con 0x7ff3b013dba0 2024-04-28T13:08:17.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.819+0000 7ff3b7215640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff3b00b59a0 con 0x7ff3b0141120 2024-04-28T13:08:17.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.819+0000 7ff3b4fb1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3980039b0 0x7ff3b0143c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:17.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.819+0000 7ff3b4fb1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3980039b0 0x7ff3b0143c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52918/0 (socket says 172.21.15.114:52918) 2024-04-28T13:08:17.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.819+0000 7ff3b4fb1640 1 -- 172.21.15.114:0/3293485791 learned_addr learned my addr 172.21.15.114:0/3293485791 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:17.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.819+0000 7ff3b57b2640 1 --2- 172.21.15.114:0/3293485791 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3b0141120 0x7ff3b00b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:17.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.819+0000 7ff3affff640 1 --2- 172.21.15.114:0/3293485791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3b013dba0 0x7ff3b00d1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:17.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.819+0000 7ff3b4fb1640 1 -- 172.21.15.114:0/3293485791 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3b0141120 msgr2=0x7ff3b00b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:17.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.819+0000 7ff3b4fb1640 1 --2- 172.21.15.114:0/3293485791 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3b0141120 0x7ff3b00b40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:17.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.819+0000 7ff3b4fb1640 1 -- 172.21.15.114:0/3293485791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3b013dba0 msgr2=0x7ff3b00d1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:17.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.819+0000 7ff3b4fb1640 1 --2- 172.21.15.114:0/3293485791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3b013dba0 0x7ff3b00d1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:17.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.819+0000 7ff3b4fb1640 1 -- 172.21.15.114:0/3293485791 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3b00b3060 con 0x7ff3980039b0 2024-04-28T13:08:17.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.819+0000 7ff3b4fb1640 1 --2- 172.21.15.114:0/3293485791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3980039b0 0x7ff3b0143c70 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0009db0 tx=0x7ff3a0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:17.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.819+0000 7ff3ad7fa640 1 -- 172.21.15.114:0/3293485791 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0041020 con 0x7ff3980039b0 2024-04-28T13:08:17.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.819+0000 7ff3ad7fa640 1 -- 172.21.15.114:0/3293485791 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3a00093e0 con 0x7ff3980039b0 2024-04-28T13:08:17.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.819+0000 7ff3b7215640 1 -- 172.21.15.114:0/3293485791 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3b00b3320 con 0x7ff3980039b0 2024-04-28T13:08:17.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.819+0000 7ff3ad7fa640 1 -- 172.21.15.114:0/3293485791 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0036040 con 0x7ff3980039b0 2024-04-28T13:08:17.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.819+0000 7ff3b7215640 1 -- 172.21.15.114:0/3293485791 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3b00b38e0 con 0x7ff3980039b0 2024-04-28T13:08:17.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.820+0000 7ff3b7215640 1 -- 172.21.15.114:0/3293485791 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3b006a3d0 con 0x7ff3980039b0 2024-04-28T13:08:17.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.821+0000 7ff3ad7fa640 1 -- 172.21.15.114:0/3293485791 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff3a0044020 con 0x7ff3980039b0 2024-04-28T13:08:17.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.821+0000 7ff3ad7fa640 1 --2- 172.21.15.114:0/3293485791 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff39c06c920 0x7ff39c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:17.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.821+0000 7ff3ad7fa640 1 -- 172.21.15.114:0/3293485791 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5609+0+0 (secure 0 0 0) 0x7ff3a00abf00 con 0x7ff3980039b0 2024-04-28T13:08:17.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.821+0000 7ff3affff640 1 --2- 172.21.15.114:0/3293485791 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff39c06c920 0x7ff39c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:17.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.822+0000 7ff3affff640 1 --2- 172.21.15.114:0/3293485791 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff39c06c920 0x7ff39c06ede0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0146a50 tx=0x7ff3a4000f80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:17.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:17.826+0000 7ff3ad7fa640 1 -- 172.21.15.114:0/3293485791 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff3a004b070 con 0x7ff3980039b0 2024-04-28T13:08:18.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.036+0000 7ff3b7215640 1 -- 172.21.15.114:0/3293485791 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff3b0073810 con 0x7ff3980039b0 2024-04-28T13:08:18.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.694+0000 7ff3ad7fa640 1 -- 172.21.15.114:0/3293485791 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) ==== 172+0+0 (secure 0 0 0) 0x7ff3a0079cb0 con 0x7ff3980039b0 2024-04-28T13:08:18.695 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 4 and data pool 5 2024-04-28T13:08:18.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.698+0000 7ff3b7215640 1 -- 172.21.15.114:0/3293485791 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff39c06c920 msgr2=0x7ff39c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:18.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.698+0000 7ff3b7215640 1 --2- 172.21.15.114:0/3293485791 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff39c06c920 0x7ff39c06ede0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0146a50 tx=0x7ff3a4000f80 comp rx=0 tx=0).stop 2024-04-28T13:08:18.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.698+0000 7ff3b7215640 1 -- 172.21.15.114:0/3293485791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3980039b0 msgr2=0x7ff3b0143c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:18.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.698+0000 7ff3b7215640 1 --2- 172.21.15.114:0/3293485791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3980039b0 0x7ff3b0143c70 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0009db0 tx=0x7ff3a0004730 comp rx=0 tx=0).stop 2024-04-28T13:08:18.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.700+0000 7ff3b7215640 1 -- 172.21.15.114:0/3293485791 shutdown_connections 2024-04-28T13:08:18.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.700+0000 7ff3b7215640 1 --2- 172.21.15.114:0/3293485791 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3b0141120 0x7ff3b00b40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:18.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.700+0000 7ff3b7215640 1 --2- 172.21.15.114:0/3293485791 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff39c06c920 0x7ff39c06ede0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:18.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.700+0000 7ff3b7215640 1 --2- 172.21.15.114:0/3293485791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3b013dba0 0x7ff3b00d1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:18.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.700+0000 7ff3b7215640 1 --2- 172.21.15.114:0/3293485791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3980039b0 0x7ff3b0143c70 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:18.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.700+0000 7ff3b7215640 1 -- 172.21.15.114:0/3293485791 >> 172.21.15.114:0/3293485791 conn(0x7ff3b006f4f0 msgr2=0x7ff3b00b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:18.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.702+0000 7ff3b7215640 1 -- 172.21.15.114:0/3293485791 shutdown_connections 2024-04-28T13:08:18.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.703+0000 7ff3b7215640 1 -- 172.21.15.114:0/3293485791 wait complete. 2024-04-28T13:08:18.723 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:08:18.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.821+0000 7f0f9254e640 1 Processor -- start 2024-04-28T13:08:18.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.821+0000 7f0f9254e640 1 -- start start 2024-04-28T13:08:18.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.822+0000 7f0f9254e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f8c15f3f0 0x7f0f8c0d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:18.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.822+0000 7f0f9254e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0f8c0b73a0 0x7f0f8c0b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:18.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.822+0000 7f0f9254e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f8c0b82a0 con 0x7f0f8c0d4ca0 2024-04-28T13:08:18.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.822+0000 7f0f9254e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f0f8c15f7d0 con 0x7f0f8c0b73a0 2024-04-28T13:08:18.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.822+0000 7f0f9254e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f0f8c0d4a00 con 0x7f0f8c15f3f0 2024-04-28T13:08:18.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.822+0000 7f0f8b7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0f8c0d4ca0 0x7f0f8c0b6c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:32884/0 (socket says 172.21.15.114:32884) 2024-04-28T13:08:18.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.822+0000 7f0f8b7fe640 1 -- 172.21.15.114:0/2151005476 learned_addr learned my addr 172.21.15.114:0/2151005476 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:18.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.822+0000 7f0f8affd640 1 -- 172.21.15.114:0/2151005476 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1693409001 0 0) 0x7f0f8c0b82a0 con 0x7f0f8c0d4ca0 2024-04-28T13:08:18.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.822+0000 7f0f8affd640 1 -- 172.21.15.114:0/2151005476 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f74003520 con 0x7f0f8c0d4ca0 2024-04-28T13:08:18.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.822+0000 7f0f8bfff640 1 --2- 172.21.15.114:0/2151005476 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f8c15f3f0 0x7f0f8c0d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:18.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.822+0000 7f0f90aeb640 1 --2- 172.21.15.114:0/2151005476 >> v2:172.21.15.134:3300/0 conn(0x7f0f8c0b73a0 0x7f0f8c0b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:18.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.822+0000 7f0f8affd640 1 -- 172.21.15.114:0/2151005476 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1682816214 0 0) 0x7f0f74003520 con 0x7f0f8c0d4ca0 2024-04-28T13:08:18.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.822+0000 7f0f8affd640 1 -- 172.21.15.114:0/2151005476 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f8c15f3f0 msgr2=0x7f0f8c0d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:18.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.822+0000 7f0f8affd640 1 --2- 172.21.15.114:0/2151005476 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f8c15f3f0 0x7f0f8c0d32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:18.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.822+0000 7f0f8affd640 1 -- 172.21.15.114:0/2151005476 >> v2:172.21.15.134:3300/0 conn(0x7f0f8c0b73a0 msgr2=0x7f0f8c0b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:18.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.822+0000 7f0f8affd640 1 --2- 172.21.15.114:0/2151005476 >> v2:172.21.15.134:3300/0 conn(0x7f0f8c0b73a0 0x7f0f8c0b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:18.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.822+0000 7f0f8affd640 1 -- 172.21.15.114:0/2151005476 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f8c0d3880 con 0x7f0f8c0d4ca0 2024-04-28T13:08:18.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.822+0000 7f0f8affd640 1 -- 172.21.15.114:0/2151005476 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f0f80001670 con 0x7f0f8c0d4ca0 2024-04-28T13:08:18.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.822+0000 7f0f8affd640 1 -- 172.21.15.114:0/2151005476 >> v1:172.21.15.114:6789/0 conn(0x7f0f8c0d4ca0 legacy=0x7f0f8c0b6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:18.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.823+0000 7f0f8affd640 1 --2- 172.21.15.114:0/2151005476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f740039b0 0x7f0f74003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:18.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.823+0000 7f0f8affd640 1 --2- 172.21.15.114:0/2151005476 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f8c15f3f0 0x7f0f74004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:18.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.823+0000 7f0f8affd640 1 --2- 172.21.15.114:0/2151005476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f74004d40 0x7f0f740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:18.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.823+0000 7f0f8affd640 1 -- 172.21.15.114:0/2151005476 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8c15f7d0 con 0x7f0f74004d40 2024-04-28T13:08:18.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.823+0000 7f0f8affd640 1 -- 172.21.15.114:0/2151005476 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8c0d4a00 con 0x7f0f740039b0 2024-04-28T13:08:18.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.823+0000 7f0f8affd640 1 -- 172.21.15.114:0/2151005476 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f0f7400b9c0 con 0x7f0f8c15f3f0 2024-04-28T13:08:18.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.823+0000 7f0f90aeb640 1 --2- 172.21.15.114:0/2151005476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f74004d40 0x7f0f740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:18.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.823+0000 7f0f8bfff640 1 --2- 172.21.15.114:0/2151005476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f740039b0 0x7f0f74003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:18.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.823+0000 7f0f8b7fe640 1 --2- 172.21.15.114:0/2151005476 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f8c15f3f0 0x7f0f74004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:18.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.823+0000 7f0f90aeb640 1 -- 172.21.15.114:0/2151005476 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f8c15f3f0 msgr2=0x7f0f74004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:18.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.823+0000 7f0f90aeb640 1 --2- 172.21.15.114:0/2151005476 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f8c15f3f0 0x7f0f74004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:18.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.823+0000 7f0f90aeb640 1 -- 172.21.15.114:0/2151005476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f740039b0 msgr2=0x7f0f74003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:18.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.823+0000 7f0f90aeb640 1 --2- 172.21.15.114:0/2151005476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f740039b0 0x7f0f74003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:18.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.823+0000 7f0f90aeb640 1 -- 172.21.15.114:0/2151005476 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f74003520 con 0x7f0f74004d40 2024-04-28T13:08:18.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.824+0000 7f0f90aeb640 1 --2- 172.21.15.114:0/2151005476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f74004d40 0x7f0f740051c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0f84009f90 tx=0x7f0f74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9e86f722e5c742 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:18.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.824+0000 7f0f8affd640 1 -- 172.21.15.114:0/2151005476 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f84009c10 con 0x7f0f74004d40 2024-04-28T13:08:18.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.824+0000 7f0f8affd640 1 -- 172.21.15.114:0/2151005476 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f84036070 con 0x7f0f74004d40 2024-04-28T13:08:18.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.824+0000 7f0f8affd640 1 -- 172.21.15.114:0/2151005476 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f84031880 con 0x7f0f74004d40 2024-04-28T13:08:18.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.824+0000 7f0f9254e640 1 -- 172.21.15.114:0/2151005476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f74004d40 msgr2=0x7f0f740051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:18.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.824+0000 7f0f9254e640 1 --2- 172.21.15.114:0/2151005476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f74004d40 0x7f0f740051c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0f84009f90 tx=0x7f0f74005830 comp rx=0 tx=0).stop 2024-04-28T13:08:18.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.824+0000 7f0f90aeb640 1 -- 172.21.15.114:0/2151005476 reap_dead start 2024-04-28T13:08:18.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.824+0000 7f0f9254e640 1 -- 172.21.15.114:0/2151005476 shutdown_connections 2024-04-28T13:08:18.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.824+0000 7f0f9254e640 1 -- 172.21.15.114:0/2151005476 >> 172.21.15.114:0/2151005476 conn(0x7f0f8c0633a0 msgr2=0x7f0f8c0d1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:18.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.824+0000 7f0f9254e640 1 -- 172.21.15.114:0/2151005476 shutdown_connections 2024-04-28T13:08:18.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.824+0000 7f0f9254e640 1 -- 172.21.15.114:0/2151005476 wait complete. 2024-04-28T13:08:18.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.825+0000 7f0f9254e640 1 Processor -- start 2024-04-28T13:08:18.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.826+0000 7f0f9254e640 1 -- start start 2024-04-28T13:08:18.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.826+0000 7f0f9254e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f8c161390 0x7f0f8c14ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:18.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.826+0000 7f0f9254e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f8c161770 0x7f0f8c1514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:18.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.826+0000 7f0f9254e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f8c150170 0x7f0f8c14dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:18.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.826+0000 7f0f9254e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8c0d4120 con 0x7f0f8c161390 2024-04-28T13:08:18.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.826+0000 7f0f9254e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8c0d3e40 con 0x7f0f8c150170 2024-04-28T13:08:18.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.826+0000 7f0f9254e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f0f8c0d32a0 con 0x7f0f8c161770 2024-04-28T13:08:18.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.826+0000 7f0f8bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f8c161390 0x7f0f8c14ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:18.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.826+0000 7f0f8bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f8c161390 0x7f0f8c14ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52936/0 (socket says 172.21.15.114:52936) 2024-04-28T13:08:18.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.826+0000 7f0f8bfff640 1 -- 172.21.15.114:0/483291556 learned_addr learned my addr 172.21.15.114:0/483291556 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:18.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.827+0000 7f0f8b7fe640 1 --2- 172.21.15.114:0/483291556 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f8c161770 0x7f0f8c1514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:18.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.827+0000 7f0f90aeb640 1 --2- 172.21.15.114:0/483291556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f8c150170 0x7f0f8c14dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:18.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.827+0000 7f0f8bfff640 1 -- 172.21.15.114:0/483291556 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f8c161770 msgr2=0x7f0f8c1514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:18.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.827+0000 7f0f8bfff640 1 --2- 172.21.15.114:0/483291556 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f8c161770 0x7f0f8c1514d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:18.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.827+0000 7f0f8bfff640 1 -- 172.21.15.114:0/483291556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f8c150170 msgr2=0x7f0f8c14dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:18.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.827+0000 7f0f8bfff640 1 --2- 172.21.15.114:0/483291556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f8c150170 0x7f0f8c14dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:18.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.827+0000 7f0f8bfff640 1 -- 172.21.15.114:0/483291556 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f8c14f0d0 con 0x7f0f8c161390 2024-04-28T13:08:18.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.827+0000 7f0f8bfff640 1 --2- 172.21.15.114:0/483291556 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f8c161390 0x7f0f8c14ea10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c0118e0 tx=0x7f0f7c011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:18.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.827+0000 7f0f88ff9640 1 -- 172.21.15.114:0/483291556 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c00fa90 con 0x7f0f8c161390 2024-04-28T13:08:18.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.827+0000 7f0f88ff9640 1 -- 172.21.15.114:0/483291556 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f7c00fc30 con 0x7f0f8c161390 2024-04-28T13:08:18.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.827+0000 7f0f9254e640 1 -- 172.21.15.114:0/483291556 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f8c14f3b0 con 0x7f0f8c161390 2024-04-28T13:08:18.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.827+0000 7f0f88ff9640 1 -- 172.21.15.114:0/483291556 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c014440 con 0x7f0f8c161390 2024-04-28T13:08:18.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.827+0000 7f0f9254e640 1 -- 172.21.15.114:0/483291556 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f8c14f970 con 0x7f0f8c161390 2024-04-28T13:08:18.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.828+0000 7f0f9254e640 1 -- 172.21.15.114:0/483291556 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f8c0b9930 con 0x7f0f8c161390 2024-04-28T13:08:18.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.829+0000 7f0f88ff9640 1 -- 172.21.15.114:0/483291556 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0f7c012040 con 0x7f0f8c161390 2024-04-28T13:08:18.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.829+0000 7f0f88ff9640 1 --2- 172.21.15.114:0/483291556 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f0f7806c920 0x7f0f7806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:18.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.829+0000 7f0f88ff9640 1 -- 172.21.15.114:0/483291556 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f0f7c08c160 con 0x7f0f8c161390 2024-04-28T13:08:18.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.829+0000 7f0f8b7fe640 1 --2- 172.21.15.114:0/483291556 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f0f7806c920 0x7f0f7806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:18.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.829+0000 7f0f8b7fe640 1 --2- 172.21.15.114:0/483291556 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f0f7806c920 0x7f0f7806ede0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0f80004840 tx=0x7f0f80009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:18.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:18.834+0000 7f0f88ff9640 1 -- 172.21.15.114:0/483291556 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0f8c0b9930 con 0x7f0f8c161390 2024-04-28T13:08:19.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.009+0000 7f0f9254e640 1 -- 172.21.15.114:0/483291556 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f8c06a3d0 con 0x7f0f8c161390 2024-04-28T13:08:19.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.010+0000 7f0f88ff9640 1 -- 172.21.15.114:0/483291556 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16730 (secure 0 0 0) 0x7f0f7c019030 con 0x7f0f8c161390 2024-04-28T13:08:19.011 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:19.011 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":33,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:08:18.038249+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-28T13:08:16.244962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-28T13:08:16.991345+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:08:19.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.012+0000 7f0f9254e640 1 -- 172.21.15.114:0/483291556 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f0f7806c920 msgr2=0x7f0f7806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:19.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.012+0000 7f0f9254e640 1 --2- 172.21.15.114:0/483291556 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f0f7806c920 0x7f0f7806ede0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0f80004840 tx=0x7f0f80009040 comp rx=0 tx=0).stop 2024-04-28T13:08:19.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.012+0000 7f0f9254e640 1 -- 172.21.15.114:0/483291556 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f8c161390 msgr2=0x7f0f8c14ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:19.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.012+0000 7f0f9254e640 1 --2- 172.21.15.114:0/483291556 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f8c161390 0x7f0f8c14ea10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c0118e0 tx=0x7f0f7c011da0 comp rx=0 tx=0).stop 2024-04-28T13:08:19.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.012+0000 7f0f9254e640 1 -- 172.21.15.114:0/483291556 shutdown_connections 2024-04-28T13:08:19.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.012+0000 7f0f9254e640 1 --2- 172.21.15.114:0/483291556 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f0f7806c920 0x7f0f7806ede0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:19.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.012+0000 7f0f9254e640 1 --2- 172.21.15.114:0/483291556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f8c150170 0x7f0f8c14dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:19.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.012+0000 7f0f9254e640 1 --2- 172.21.15.114:0/483291556 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f8c161770 0x7f0f8c1514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:19.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.012+0000 7f0f9254e640 1 --2- 172.21.15.114:0/483291556 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f8c161390 0x7f0f8c14ea10 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:19.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.012+0000 7f0f9254e640 1 -- 172.21.15.114:0/483291556 >> 172.21.15.114:0/483291556 conn(0x7f0f8c0633a0 msgr2=0x7f0f8c0ba610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:19.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.012+0000 7f0f9254e640 1 -- 172.21.15.114:0/483291556 shutdown_connections 2024-04-28T13:08:19.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.012+0000 7f0f9254e640 1 -- 172.21.15.114:0/483291556 wait complete. 2024-04-28T13:08:19.024 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:08:19.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.119+0000 7faa8e946640 1 Processor -- start 2024-04-28T13:08:19.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.119+0000 7faa8e946640 1 -- start start 2024-04-28T13:08:19.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.120+0000 7faa8e946640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7faa88070710 0x7faa88070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:19.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.120+0000 7faa8e946640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faa88071b90 0x7faa88071fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:19.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.120+0000 7faa8e946640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa88072830 con 0x7faa880b73d0 2024-04-28T13:08:19.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.120+0000 7faa8e946640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7faa88072b10 con 0x7faa88071b90 2024-04-28T13:08:19.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.120+0000 7faa8e946640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7faa880d2f00 con 0x7faa88070710 2024-04-28T13:08:19.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.120+0000 7faa8cee3640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faa88071b90 0x7faa88071fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:19.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.120+0000 7faa8cee3640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faa88071b90 0x7faa88071fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52946/0 (socket says 172.21.15.114:52946) 2024-04-28T13:08:19.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.120+0000 7faa8cee3640 1 -- 172.21.15.114:0/913148008 learned_addr learned my addr 172.21.15.114:0/913148008 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:19.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.121+0000 7faa877fe640 1 --2- 172.21.15.114:0/913148008 >> v2:172.21.15.134:3300/0 conn(0x7faa88070710 0x7faa88070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:19.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.121+0000 7faa8cee3640 1 -- 172.21.15.114:0/913148008 >> v2:172.21.15.134:3300/0 conn(0x7faa88070710 msgr2=0x7faa88070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:19.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.121+0000 7faa8cee3640 1 --2- 172.21.15.114:0/913148008 >> v2:172.21.15.134:3300/0 conn(0x7faa88070710 0x7faa88070ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:19.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.121+0000 7faa8cee3640 1 -- 172.21.15.114:0/913148008 >> v1:172.21.15.134:6789/0 conn(0x7faa880b73d0 legacy=0x7faa880d27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:19.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.121+0000 7faa8cee3640 1 -- 172.21.15.114:0/913148008 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa880d1d10 con 0x7faa88071b90 2024-04-28T13:08:19.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.121+0000 7faa877fe640 1 --2- 172.21.15.114:0/913148008 >> v2:172.21.15.134:3300/0 conn(0x7faa88070710 0x7faa88070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:19.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.121+0000 7faa8cee3640 1 --2- 172.21.15.114:0/913148008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa88071b90 0x7faa88071fe0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7faa88063dc0 tx=0x7faa8002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a7a33eab01e945 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:19.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.121+0000 7faa86ffd640 1 -- 172.21.15.114:0/913148008 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa80036070 con 0x7faa88071b90 2024-04-28T13:08:19.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.122+0000 7faa86ffd640 1 -- 172.21.15.114:0/913148008 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa80031600 con 0x7faa88071b90 2024-04-28T13:08:19.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.122+0000 7faa86ffd640 1 -- 172.21.15.114:0/913148008 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa800319d0 con 0x7faa88071b90 2024-04-28T13:08:19.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.122+0000 7faa8e946640 1 -- 172.21.15.114:0/913148008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa88071b90 msgr2=0x7faa88071fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:19.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.122+0000 7faa8e946640 1 --2- 172.21.15.114:0/913148008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa88071b90 0x7faa88071fe0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7faa88063dc0 tx=0x7faa8002a730 comp rx=0 tx=0).stop 2024-04-28T13:08:19.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.122+0000 7faa8e946640 1 -- 172.21.15.114:0/913148008 shutdown_connections 2024-04-28T13:08:19.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.122+0000 7faa8e946640 1 --2- 172.21.15.114:0/913148008 >> v2:172.21.15.134:3300/0 conn(0x7faa88070710 0x7faa88070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:19.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.122+0000 7faa8e946640 1 --2- 172.21.15.114:0/913148008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa88071b90 0x7faa88071fe0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:19.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.122+0000 7faa8e946640 1 -- 172.21.15.114:0/913148008 >> 172.21.15.114:0/913148008 conn(0x7faa880b4c60 msgr2=0x7faa880b5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:19.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.122+0000 7faa8e946640 1 -- 172.21.15.114:0/913148008 shutdown_connections 2024-04-28T13:08:19.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.122+0000 7faa8e946640 1 -- 172.21.15.114:0/913148008 wait complete. 2024-04-28T13:08:19.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.123+0000 7faa8e946640 1 Processor -- start 2024-04-28T13:08:19.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.123+0000 7faa8e946640 1 -- start start 2024-04-28T13:08:19.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.124+0000 7faa8e946640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faa88070710 0x7faa881e8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:19.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.124+0000 7faa8e946640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa88071b90 0x7faa881e5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:19.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.124+0000 7faa8e946640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa880b73d0 0x7faa88150930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:19.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.124+0000 7faa8e946640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7faa88072520 con 0x7faa88071b90 2024-04-28T13:08:19.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.124+0000 7faa8e946640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faa880d22d0 con 0x7faa880b73d0 2024-04-28T13:08:19.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.124+0000 7faa8e946640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7faa880b77b0 con 0x7faa88070710 2024-04-28T13:08:19.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.124+0000 7faa877fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa88071b90 0x7faa881e5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:19.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.124+0000 7faa877fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa88071b90 0x7faa881e5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52950/0 (socket says 172.21.15.114:52950) 2024-04-28T13:08:19.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.124+0000 7faa877fe640 1 -- 172.21.15.114:0/2139204848 learned_addr learned my addr 172.21.15.114:0/2139204848 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:19.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.124+0000 7faa8cee3640 1 --2- 172.21.15.114:0/2139204848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa880b73d0 0x7faa88150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:19.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.124+0000 7faa87fff640 1 --2- 172.21.15.114:0/2139204848 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faa88070710 0x7faa881e8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:19.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.125+0000 7faa877fe640 1 -- 172.21.15.114:0/2139204848 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faa88070710 msgr2=0x7faa881e8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:19.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.125+0000 7faa877fe640 1 --2- 172.21.15.114:0/2139204848 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faa88070710 0x7faa881e8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:19.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.125+0000 7faa877fe640 1 -- 172.21.15.114:0/2139204848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa880b73d0 msgr2=0x7faa88150930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:19.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.125+0000 7faa877fe640 1 --2- 172.21.15.114:0/2139204848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa880b73d0 0x7faa88150930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:19.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.125+0000 7faa877fe640 1 -- 172.21.15.114:0/2139204848 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa8814d950 con 0x7faa88071b90 2024-04-28T13:08:19.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.125+0000 7faa8cee3640 1 --2- 172.21.15.114:0/2139204848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa880b73d0 0x7faa88150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:19.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.125+0000 7faa877fe640 1 --2- 172.21.15.114:0/2139204848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa88071b90 0x7faa881e5ec0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7faa7c00e730 tx=0x7faa7c00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:19.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.125+0000 7faa84ff9640 1 -- 172.21.15.114:0/2139204848 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa7c00f040 con 0x7faa88071b90 2024-04-28T13:08:19.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.125+0000 7faa84ff9640 1 -- 172.21.15.114:0/2139204848 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa7c004230 con 0x7faa88071b90 2024-04-28T13:08:19.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.125+0000 7faa8e946640 1 -- 172.21.15.114:0/2139204848 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa8814f890 con 0x7faa88071b90 2024-04-28T13:08:19.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.125+0000 7faa84ff9640 1 -- 172.21.15.114:0/2139204848 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa7c00ee40 con 0x7faa88071b90 2024-04-28T13:08:19.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.125+0000 7faa8e946640 1 -- 172.21.15.114:0/2139204848 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa8814fe50 con 0x7faa88071b90 2024-04-28T13:08:19.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.126+0000 7faa8e946640 1 -- 172.21.15.114:0/2139204848 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa88150620 con 0x7faa88071b90 2024-04-28T13:08:19.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.126+0000 7faa84ff9640 1 -- 172.21.15.114:0/2139204848 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faa7c00c6d0 con 0x7faa88071b90 2024-04-28T13:08:19.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.127+0000 7faa84ff9640 1 --2- 172.21.15.114:0/2139204848 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7faa7406c8f0 0x7faa7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:19.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.127+0000 7faa84ff9640 1 -- 172.21.15.114:0/2139204848 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7faa7c08b820 con 0x7faa88071b90 2024-04-28T13:08:19.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.127+0000 7faa87fff640 1 --2- 172.21.15.114:0/2139204848 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7faa7406c8f0 0x7faa7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:19.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.127+0000 7faa87fff640 1 --2- 172.21.15.114:0/2139204848 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7faa7406c8f0 0x7faa7406edb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7faa78007fd0 tx=0x7faa78009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:19.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.131+0000 7faa84ff9640 1 -- 172.21.15.114:0/2139204848 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7faa8814d950 con 0x7faa88071b90 2024-04-28T13:08:19.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.305+0000 7faa8e946640 1 -- 172.21.15.114:0/2139204848 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faa88071460 con 0x7faa88071b90 2024-04-28T13:08:19.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.306+0000 7faa84ff9640 1 -- 172.21.15.114:0/2139204848 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16730 (secure 0 0 0) 0x7faa7c017020 con 0x7faa88071b90 2024-04-28T13:08:19.308 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:19.308 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":33,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:08:18.038249+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-28T13:08:16.244962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-28T13:08:16.991345+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:08:19.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.308+0000 7faa8e946640 1 -- 172.21.15.114:0/2139204848 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7faa7406c8f0 msgr2=0x7faa7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:19.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.308+0000 7faa8e946640 1 --2- 172.21.15.114:0/2139204848 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7faa7406c8f0 0x7faa7406edb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7faa78007fd0 tx=0x7faa78009040 comp rx=0 tx=0).stop 2024-04-28T13:08:19.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.308+0000 7faa8e946640 1 -- 172.21.15.114:0/2139204848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa88071b90 msgr2=0x7faa881e5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:19.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.308+0000 7faa8e946640 1 --2- 172.21.15.114:0/2139204848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa88071b90 0x7faa881e5ec0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7faa7c00e730 tx=0x7faa7c00ebf0 comp rx=0 tx=0).stop 2024-04-28T13:08:19.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.308+0000 7faa8e946640 1 -- 172.21.15.114:0/2139204848 shutdown_connections 2024-04-28T13:08:19.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.308+0000 7faa8e946640 1 --2- 172.21.15.114:0/2139204848 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7faa7406c8f0 0x7faa7406edb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:19.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.308+0000 7faa8e946640 1 --2- 172.21.15.114:0/2139204848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa880b73d0 0x7faa88150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:19.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.308+0000 7faa8e946640 1 --2- 172.21.15.114:0/2139204848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa88071b90 0x7faa881e5ec0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:19.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.308+0000 7faa8e946640 1 --2- 172.21.15.114:0/2139204848 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faa88070710 0x7faa881e8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:19.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.308+0000 7faa8e946640 1 -- 172.21.15.114:0/2139204848 >> 172.21.15.114:0/2139204848 conn(0x7faa880b4c60 msgr2=0x7faa880b4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:19.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.309+0000 7faa8e946640 1 -- 172.21.15.114:0/2139204848 shutdown_connections 2024-04-28T13:08:19.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.309+0000 7faa8e946640 1 -- 172.21.15.114:0/2139204848 wait complete. 2024-04-28T13:08:19.321 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-28T13:08:19.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.420+0000 7fc43c615640 1 Processor -- start 2024-04-28T13:08:19.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.420+0000 7fc43c615640 1 -- start start 2024-04-28T13:08:19.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.421+0000 7fc43c615640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc43415f430 0x7fc4340d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:19.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.421+0000 7fc43c615640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc4340d1fc0 0x7fc4340d5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:19.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.421+0000 7fc43c615640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4340d2a40 con 0x7fc4340baf40 2024-04-28T13:08:19.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.421+0000 7fc43c615640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc43415f810 con 0x7fc4340d1fc0 2024-04-28T13:08:19.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.421+0000 7fc43c615640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc4340d36d0 con 0x7fc43415f430 2024-04-28T13:08:19.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.421+0000 7fc43abb2640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc4340baf40 0x7fc434162ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:32898/0 (socket says 172.21.15.114:32898) 2024-04-28T13:08:19.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.421+0000 7fc43abb2640 1 -- 172.21.15.114:0/1598350346 learned_addr learned my addr 172.21.15.114:0/1598350346 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:19.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.421+0000 7fc439bb0640 1 --2- 172.21.15.114:0/1598350346 >> v2:172.21.15.134:3300/0 conn(0x7fc4340d1fc0 0x7fc4340d5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:19.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.421+0000 7fc43a3b1640 1 --2- 172.21.15.114:0/1598350346 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc43415f430 0x7fc4340d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:19.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.421+0000 7fc4393af640 1 -- 172.21.15.114:0/1598350346 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 409274104 0 0) 0x7fc4340d2a40 con 0x7fc4340baf40 2024-04-28T13:08:19.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.422+0000 7fc4393af640 1 -- 172.21.15.114:0/1598350346 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc420003520 con 0x7fc4340baf40 2024-04-28T13:08:19.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.422+0000 7fc4393af640 1 -- 172.21.15.114:0/1598350346 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2874927626 0 0) 0x7fc420003520 con 0x7fc4340baf40 2024-04-28T13:08:19.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.422+0000 7fc4393af640 1 -- 172.21.15.114:0/1598350346 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc43415f430 msgr2=0x7fc4340d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:19.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.422+0000 7fc4393af640 1 --2- 172.21.15.114:0/1598350346 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc43415f430 0x7fc4340d1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:19.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.422+0000 7fc4393af640 1 -- 172.21.15.114:0/1598350346 >> v2:172.21.15.134:3300/0 conn(0x7fc4340d1fc0 msgr2=0x7fc4340d5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:19.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.422+0000 7fc4393af640 1 --2- 172.21.15.114:0/1598350346 >> v2:172.21.15.134:3300/0 conn(0x7fc4340d1fc0 0x7fc4340d5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:19.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.422+0000 7fc4393af640 1 -- 172.21.15.114:0/1598350346 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4340d2480 con 0x7fc4340baf40 2024-04-28T13:08:19.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.422+0000 7fc4393af640 1 -- 172.21.15.114:0/1598350346 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7fc42c001670 con 0x7fc4340baf40 2024-04-28T13:08:19.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.422+0000 7fc4393af640 1 -- 172.21.15.114:0/1598350346 >> v1:172.21.15.114:6789/0 conn(0x7fc4340baf40 legacy=0x7fc434162ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:19.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.422+0000 7fc4393af640 1 --2- 172.21.15.114:0/1598350346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4200039b0 0x7fc420003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:19.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.422+0000 7fc4393af640 1 --2- 172.21.15.114:0/1598350346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc420004800 0x7fc420004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:19.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.422+0000 7fc4393af640 1 --2- 172.21.15.114:0/1598350346 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc43415f430 0x7fc4200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:19.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.422+0000 7fc4393af640 1 -- 172.21.15.114:0/1598350346 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc4340d36d0 con 0x7fc4200039b0 2024-04-28T13:08:19.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.422+0000 7fc4393af640 1 -- 172.21.15.114:0/1598350346 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc42000b9c0 con 0x7fc420004800 2024-04-28T13:08:19.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.422+0000 7fc4393af640 1 -- 172.21.15.114:0/1598350346 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc42000bb40 con 0x7fc43415f430 2024-04-28T13:08:19.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.422+0000 7fc43a3b1640 1 --2- 172.21.15.114:0/1598350346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4200039b0 0x7fc420003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:19.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.422+0000 7fc439bb0640 1 --2- 172.21.15.114:0/1598350346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc420004800 0x7fc420004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:19.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.422+0000 7fc43abb2640 1 --2- 172.21.15.114:0/1598350346 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc43415f430 0x7fc4200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:19.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.422+0000 7fc43a3b1640 1 -- 172.21.15.114:0/1598350346 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc43415f430 msgr2=0x7fc4200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:19.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.422+0000 7fc43a3b1640 1 --2- 172.21.15.114:0/1598350346 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc43415f430 0x7fc4200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:19.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.422+0000 7fc43a3b1640 1 -- 172.21.15.114:0/1598350346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc420004800 msgr2=0x7fc420004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:19.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.422+0000 7fc43a3b1640 1 --2- 172.21.15.114:0/1598350346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc420004800 0x7fc420004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:19.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.422+0000 7fc43a3b1640 1 -- 172.21.15.114:0/1598350346 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc420003520 con 0x7fc4200039b0 2024-04-28T13:08:19.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.422+0000 7fc439bb0640 1 --2- 172.21.15.114:0/1598350346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc420004800 0x7fc420004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:19.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.423+0000 7fc43a3b1640 1 --2- 172.21.15.114:0/1598350346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4200039b0 0x7fc420003df0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc43000e170 tx=0x7fc420005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd5ced7b4a66ae39 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:19.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.423+0000 7fc4393af640 1 -- 172.21.15.114:0/1598350346 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc430034020 con 0x7fc4200039b0 2024-04-28T13:08:19.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.423+0000 7fc4393af640 1 -- 172.21.15.114:0/1598350346 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4300305f0 con 0x7fc4200039b0 2024-04-28T13:08:19.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.423+0000 7fc4393af640 1 -- 172.21.15.114:0/1598350346 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc430009c10 con 0x7fc4200039b0 2024-04-28T13:08:19.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.423+0000 7fc43c615640 1 -- 172.21.15.114:0/1598350346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4200039b0 msgr2=0x7fc420003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:19.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.423+0000 7fc43c615640 1 --2- 172.21.15.114:0/1598350346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4200039b0 0x7fc420003df0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc43000e170 tx=0x7fc420005830 comp rx=0 tx=0).stop 2024-04-28T13:08:19.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.423+0000 7fc43abb2640 1 -- 172.21.15.114:0/1598350346 reap_dead start 2024-04-28T13:08:19.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.423+0000 7fc43c615640 1 -- 172.21.15.114:0/1598350346 shutdown_connections 2024-04-28T13:08:19.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.423+0000 7fc43c615640 1 -- 172.21.15.114:0/1598350346 >> 172.21.15.114:0/1598350346 conn(0x7fc4340633a0 msgr2=0x7fc43406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:19.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.424+0000 7fc43c615640 1 -- 172.21.15.114:0/1598350346 shutdown_connections 2024-04-28T13:08:19.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.424+0000 7fc43c615640 1 -- 172.21.15.114:0/1598350346 wait complete. 2024-04-28T13:08:19.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.425+0000 7fc43c615640 1 Processor -- start 2024-04-28T13:08:19.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.425+0000 7fc43c615640 1 -- start start 2024-04-28T13:08:19.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.425+0000 7fc43c615640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4200039b0 0x7fc434145280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:19.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.425+0000 7fc43c615640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc434155010 0x7fc4340cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:19.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.425+0000 7fc43c615640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4340ce190 0x7fc4340ce640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:19.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.425+0000 7fc43c615640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc4340d4b70 con 0x7fc434155010 2024-04-28T13:08:19.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.425+0000 7fc43c615640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc4340d3360 con 0x7fc4200039b0 2024-04-28T13:08:19.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.425+0000 7fc43c615640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc4340d4cf0 con 0x7fc4340ce190 2024-04-28T13:08:19.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.425+0000 7fc439bb0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc434155010 0x7fc4340cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:19.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.425+0000 7fc439bb0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc434155010 0x7fc4340cb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52970/0 (socket says 172.21.15.114:52970) 2024-04-28T13:08:19.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.425+0000 7fc439bb0640 1 -- 172.21.15.114:0/1366316954 learned_addr learned my addr 172.21.15.114:0/1366316954 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:19.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.426+0000 7fc439bb0640 1 -- 172.21.15.114:0/1366316954 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4340ce190 msgr2=0x7fc4340ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:19.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.426+0000 7fc439bb0640 1 --2- 172.21.15.114:0/1366316954 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4340ce190 0x7fc4340ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:19.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.426+0000 7fc439bb0640 1 -- 172.21.15.114:0/1366316954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4200039b0 msgr2=0x7fc434145280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:19.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.426+0000 7fc439bb0640 1 --2- 172.21.15.114:0/1366316954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4200039b0 0x7fc434145280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:19.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.426+0000 7fc439bb0640 1 -- 172.21.15.114:0/1366316954 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc434157c70 con 0x7fc434155010 2024-04-28T13:08:19.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.426+0000 7fc439bb0640 1 --2- 172.21.15.114:0/1366316954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc434155010 0x7fc4340cb440 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc424011650 tx=0x7fc424011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:19.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.426+0000 7fc42affd640 1 -- 172.21.15.114:0/1366316954 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42400f9c0 con 0x7fc434155010 2024-04-28T13:08:19.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.426+0000 7fc42affd640 1 -- 172.21.15.114:0/1366316954 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc42400fb60 con 0x7fc434155010 2024-04-28T13:08:19.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.426+0000 7fc43c615640 1 -- 172.21.15.114:0/1366316954 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc434157f50 con 0x7fc434155010 2024-04-28T13:08:19.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.426+0000 7fc42affd640 1 -- 172.21.15.114:0/1366316954 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc424015460 con 0x7fc434155010 2024-04-28T13:08:19.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.426+0000 7fc43c615640 1 -- 172.21.15.114:0/1366316954 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4340ceb80 con 0x7fc434155010 2024-04-28T13:08:19.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.427+0000 7fc43c615640 1 -- 172.21.15.114:0/1366316954 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc434075c40 con 0x7fc434155010 2024-04-28T13:08:19.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.428+0000 7fc42affd640 1 -- 172.21.15.114:0/1366316954 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc424015600 con 0x7fc434155010 2024-04-28T13:08:19.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.428+0000 7fc42affd640 1 --2- 172.21.15.114:0/1366316954 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc41806c8f0 0x7fc41806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:19.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.428+0000 7fc42affd640 1 -- 172.21.15.114:0/1366316954 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fc42408c4d0 con 0x7fc434155010 2024-04-28T13:08:19.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.428+0000 7fc43a3b1640 1 --2- 172.21.15.114:0/1366316954 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc41806c8f0 0x7fc41806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:19.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.428+0000 7fc43a3b1640 1 --2- 172.21.15.114:0/1366316954 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc41806c8f0 0x7fc41806edb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc430035000 tx=0x7fc43002d000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:19.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.432+0000 7fc42affd640 1 -- 172.21.15.114:0/1366316954 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc424019030 con 0x7fc434155010 2024-04-28T13:08:19.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.646+0000 7fc43c615640 1 -- 172.21.15.114:0/1366316954 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc434160c10 con 0x7fc434155010 2024-04-28T13:08:19.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.693+0000 7fc42affd640 1 -- 172.21.15.114:0/1366316954 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) ==== 118+0+0 (secure 0 0 0) 0x7fc42408ae20 con 0x7fc434155010 2024-04-28T13:08:19.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.696+0000 7fc43c615640 1 -- 172.21.15.114:0/1366316954 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc41806c8f0 msgr2=0x7fc41806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:19.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.696+0000 7fc43c615640 1 --2- 172.21.15.114:0/1366316954 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc41806c8f0 0x7fc41806edb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc430035000 tx=0x7fc43002d000 comp rx=0 tx=0).stop 2024-04-28T13:08:19.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.696+0000 7fc43c615640 1 -- 172.21.15.114:0/1366316954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc434155010 msgr2=0x7fc4340cb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:19.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.696+0000 7fc43c615640 1 --2- 172.21.15.114:0/1366316954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc434155010 0x7fc4340cb440 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc424011650 tx=0x7fc424011b10 comp rx=0 tx=0).stop 2024-04-28T13:08:19.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.696+0000 7fc43c615640 1 -- 172.21.15.114:0/1366316954 shutdown_connections 2024-04-28T13:08:19.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.696+0000 7fc43c615640 1 --2- 172.21.15.114:0/1366316954 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4340ce190 0x7fc4340ce640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:19.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.696+0000 7fc43c615640 1 --2- 172.21.15.114:0/1366316954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc434155010 0x7fc4340cb440 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:19.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.696+0000 7fc43c615640 1 --2- 172.21.15.114:0/1366316954 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc41806c8f0 0x7fc41806edb0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:19.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.696+0000 7fc43c615640 1 --2- 172.21.15.114:0/1366316954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4200039b0 0x7fc434145280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:19.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.696+0000 7fc43c615640 1 -- 172.21.15.114:0/1366316954 >> 172.21.15.114:0/1366316954 conn(0x7fc4340633a0 msgr2=0x7fc4340ba070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:19.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.696+0000 7fc43c615640 1 -- 172.21.15.114:0/1366316954 shutdown_connections 2024-04-28T13:08:19.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.696+0000 7fc43c615640 1 -- 172.21.15.114:0/1366316954 wait complete. 2024-04-28T13:08:19.709 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-28T13:08:19.709 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-28T13:08:19.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.808+0000 7fc6b2c83640 1 Processor -- start 2024-04-28T13:08:19.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.808+0000 7fc6b2c83640 1 -- start start 2024-04-28T13:08:19.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.809+0000 7fc6b2c83640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc6ac0baf40 0x7fc6ac0d5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:19.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.809+0000 7fc6b2c83640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6ac0d56a0 0x7fc6ac0d3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:19.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.809+0000 7fc6b2c83640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6ac0d2a40 con 0x7fc6ac15f430 2024-04-28T13:08:19.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.809+0000 7fc6b2c83640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc6ac15f810 con 0x7fc6ac0baf40 2024-04-28T13:08:19.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.809+0000 7fc6b2c83640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc6ac0d36d0 con 0x7fc6ac0d56a0 2024-04-28T13:08:19.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.809+0000 7fc6b0a1f640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc6ac15f430 0x7fc6ac0d1a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:32908/0 (socket says 172.21.15.114:32908) 2024-04-28T13:08:19.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.809+0000 7fc6b0a1f640 1 -- 172.21.15.114:0/295615146 learned_addr learned my addr 172.21.15.114:0/295615146 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:19.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.810+0000 7fc6ab7fe640 1 -- 172.21.15.114:0/295615146 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3563569095 0 0) 0x7fc6ac0d2a40 con 0x7fc6ac15f430 2024-04-28T13:08:19.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.810+0000 7fc6b1220640 1 --2- 172.21.15.114:0/295615146 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6ac0d56a0 0x7fc6ac0d3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:19.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.810+0000 7fc6ab7fe640 1 -- 172.21.15.114:0/295615146 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc694003520 con 0x7fc6ac15f430 2024-04-28T13:08:19.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.810+0000 7fc6abfff640 1 --2- 172.21.15.114:0/295615146 >> v2:172.21.15.134:3300/0 conn(0x7fc6ac0baf40 0x7fc6ac0d5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:19.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.810+0000 7fc6ab7fe640 1 -- 172.21.15.114:0/295615146 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 196182269 0 0) 0x7fc694003520 con 0x7fc6ac15f430 2024-04-28T13:08:19.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.810+0000 7fc6ab7fe640 1 -- 172.21.15.114:0/295615146 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6ac0d56a0 msgr2=0x7fc6ac0d3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:19.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.810+0000 7fc6ab7fe640 1 --2- 172.21.15.114:0/295615146 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6ac0d56a0 0x7fc6ac0d3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:19.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.810+0000 7fc6ab7fe640 1 -- 172.21.15.114:0/295615146 >> v2:172.21.15.134:3300/0 conn(0x7fc6ac0baf40 msgr2=0x7fc6ac0d5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:19.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.810+0000 7fc6ab7fe640 1 --2- 172.21.15.114:0/295615146 >> v2:172.21.15.134:3300/0 conn(0x7fc6ac0baf40 0x7fc6ac0d5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:19.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.810+0000 7fc6ab7fe640 1 -- 172.21.15.114:0/295615146 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ac0d2480 con 0x7fc6ac15f430 2024-04-28T13:08:19.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.810+0000 7fc6ab7fe640 1 -- 172.21.15.114:0/295615146 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7fc69c001670 con 0x7fc6ac15f430 2024-04-28T13:08:19.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.810+0000 7fc6ab7fe640 1 -- 172.21.15.114:0/295615146 >> v1:172.21.15.114:6789/0 conn(0x7fc6ac15f430 legacy=0x7fc6ac0d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:19.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.810+0000 7fc6ab7fe640 1 --2- 172.21.15.114:0/295615146 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6ac0d56a0 0x7fc6940039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:19.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.810+0000 7fc6ab7fe640 1 --2- 172.21.15.114:0/295615146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc694003f30 0x7fc694004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:19.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.810+0000 7fc6ab7fe640 1 --2- 172.21.15.114:0/295615146 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc694004d40 0x7fc6940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:19.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.810+0000 7fc6ab7fe640 1 -- 172.21.15.114:0/295615146 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ac0d36d0 con 0x7fc694003f30 2024-04-28T13:08:19.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.810+0000 7fc6ab7fe640 1 -- 172.21.15.114:0/295615146 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc69400b9c0 con 0x7fc694004d40 2024-04-28T13:08:19.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.810+0000 7fc6ab7fe640 1 -- 172.21.15.114:0/295615146 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc69400bb40 con 0x7fc6ac0d56a0 2024-04-28T13:08:19.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.810+0000 7fc6abfff640 1 --2- 172.21.15.114:0/295615146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc694003f30 0x7fc694004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:19.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.810+0000 7fc6b1220640 1 --2- 172.21.15.114:0/295615146 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc694004d40 0x7fc6940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:19.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.810+0000 7fc6b0a1f640 1 --2- 172.21.15.114:0/295615146 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6ac0d56a0 0x7fc6940039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:19.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.810+0000 7fc6abfff640 1 -- 172.21.15.114:0/295615146 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6ac0d56a0 msgr2=0x7fc6940039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:19.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.810+0000 7fc6abfff640 1 --2- 172.21.15.114:0/295615146 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6ac0d56a0 0x7fc6940039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:19.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.810+0000 7fc6abfff640 1 -- 172.21.15.114:0/295615146 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc694004d40 msgr2=0x7fc6940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:19.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.810+0000 7fc6abfff640 1 --2- 172.21.15.114:0/295615146 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc694004d40 0x7fc6940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:19.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.810+0000 7fc6abfff640 1 -- 172.21.15.114:0/295615146 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc694003520 con 0x7fc694003f30 2024-04-28T13:08:19.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.810+0000 7fc6b1220640 1 --2- 172.21.15.114:0/295615146 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc694004d40 0x7fc6940051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:19.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.811+0000 7fc6abfff640 1 --2- 172.21.15.114:0/295615146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc694003f30 0x7fc694004800 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0009a90 tx=0x7fc694005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4edc46d183ed537 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:19.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.811+0000 7fc6ab7fe640 1 -- 172.21.15.114:0/295615146 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0036070 con 0x7fc694003f30 2024-04-28T13:08:19.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.811+0000 7fc6ab7fe640 1 -- 172.21.15.114:0/295615146 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6a0031400 con 0x7fc694003f30 2024-04-28T13:08:19.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.811+0000 7fc6ab7fe640 1 -- 172.21.15.114:0/295615146 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0009690 con 0x7fc694003f30 2024-04-28T13:08:19.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.812+0000 7fc6b2c83640 1 -- 172.21.15.114:0/295615146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc694003f30 msgr2=0x7fc694004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:19.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.812+0000 7fc6b2c83640 1 --2- 172.21.15.114:0/295615146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc694003f30 0x7fc694004800 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0009a90 tx=0x7fc694005830 comp rx=0 tx=0).stop 2024-04-28T13:08:19.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.812+0000 7fc6b1220640 1 -- 172.21.15.114:0/295615146 reap_dead start 2024-04-28T13:08:19.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.812+0000 7fc6b2c83640 1 -- 172.21.15.114:0/295615146 shutdown_connections 2024-04-28T13:08:19.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.812+0000 7fc6b2c83640 1 -- 172.21.15.114:0/295615146 >> 172.21.15.114:0/295615146 conn(0x7fc6ac0633a0 msgr2=0x7fc6ac06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:19.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.812+0000 7fc6b2c83640 1 -- 172.21.15.114:0/295615146 shutdown_connections 2024-04-28T13:08:19.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.812+0000 7fc6b2c83640 1 -- 172.21.15.114:0/295615146 wait complete. 2024-04-28T13:08:19.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.813+0000 7fc6b2c83640 1 Processor -- start 2024-04-28T13:08:19.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.813+0000 7fc6b2c83640 1 -- start start 2024-04-28T13:08:19.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.814+0000 7fc6b2c83640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc694003f30 0x7fc6ac15d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:19.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.814+0000 7fc6b2c83640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6ac0cb470 0x7fc6ac147540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:19.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.814+0000 7fc6b2c83640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6ac147a80 0x7fc6ac1454b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:19.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.814+0000 7fc6b2c83640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ac0d2190 con 0x7fc6ac147a80 2024-04-28T13:08:19.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.814+0000 7fc6b2c83640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ac0d3360 con 0x7fc6ac0cb470 2024-04-28T13:08:19.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.814+0000 7fc6b2c83640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc6ac0d3b60 con 0x7fc694003f30 2024-04-28T13:08:19.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.814+0000 7fc6b1220640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6ac147a80 0x7fc6ac1454b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:19.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.814+0000 7fc6b1220640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6ac147a80 0x7fc6ac1454b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52992/0 (socket says 172.21.15.114:52992) 2024-04-28T13:08:19.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.814+0000 7fc6b1220640 1 -- 172.21.15.114:0/130110189 learned_addr learned my addr 172.21.15.114:0/130110189 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:19.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.814+0000 7fc6b0a1f640 1 --2- 172.21.15.114:0/130110189 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc694003f30 0x7fc6ac15d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:19.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.814+0000 7fc6abfff640 1 --2- 172.21.15.114:0/130110189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6ac0cb470 0x7fc6ac147540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:19.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.814+0000 7fc6b1220640 1 -- 172.21.15.114:0/130110189 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc694003f30 msgr2=0x7fc6ac15d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:19.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.814+0000 7fc6b1220640 1 --2- 172.21.15.114:0/130110189 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc694003f30 0x7fc6ac15d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:19.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.814+0000 7fc6b1220640 1 -- 172.21.15.114:0/130110189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6ac0cb470 msgr2=0x7fc6ac147540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:19.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.814+0000 7fc6b1220640 1 --2- 172.21.15.114:0/130110189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6ac0cb470 0x7fc6ac147540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:19.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.814+0000 7fc6b1220640 1 -- 172.21.15.114:0/130110189 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ac15c3a0 con 0x7fc6ac147a80 2024-04-28T13:08:19.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.814+0000 7fc6b0a1f640 1 --2- 172.21.15.114:0/130110189 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc694003f30 0x7fc6ac15d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:19.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.814+0000 7fc6abfff640 1 --2- 172.21.15.114:0/130110189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6ac0cb470 0x7fc6ac147540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:19.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.814+0000 7fc6b1220640 1 --2- 172.21.15.114:0/130110189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6ac147a80 0x7fc6ac1454b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac0d2d50 tx=0x7fc6a4010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:19.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.815+0000 7fc6a97fa640 1 -- 172.21.15.114:0/130110189 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4010d80 con 0x7fc6ac147a80 2024-04-28T13:08:19.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.815+0000 7fc6a97fa640 1 -- 172.21.15.114:0/130110189 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6a4003990 con 0x7fc6ac147a80 2024-04-28T13:08:19.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.815+0000 7fc6b2c83640 1 -- 172.21.15.114:0/130110189 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6ac15c680 con 0x7fc6ac147a80 2024-04-28T13:08:19.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.815+0000 7fc6a97fa640 1 -- 172.21.15.114:0/130110189 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4003d80 con 0x7fc6ac147a80 2024-04-28T13:08:19.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.815+0000 7fc6b2c83640 1 -- 172.21.15.114:0/130110189 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6ac15cc40 con 0x7fc6ac147a80 2024-04-28T13:08:19.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.816+0000 7fc6b2c83640 1 -- 172.21.15.114:0/130110189 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6ac075c40 con 0x7fc6ac147a80 2024-04-28T13:08:19.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.816+0000 7fc6a97fa640 1 -- 172.21.15.114:0/130110189 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc6a4005d10 con 0x7fc6ac147a80 2024-04-28T13:08:19.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.816+0000 7fc6a97fa640 1 --2- 172.21.15.114:0/130110189 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc69806c8f0 0x7fc69806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:19.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.816+0000 7fc6a97fa640 1 -- 172.21.15.114:0/130110189 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc6a408c230 con 0x7fc6ac147a80 2024-04-28T13:08:19.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.816+0000 7fc6b0a1f640 1 --2- 172.21.15.114:0/130110189 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc69806c8f0 0x7fc69806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:19.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.817+0000 7fc6b0a1f640 1 --2- 172.21.15.114:0/130110189 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc69806c8f0 0x7fc69806edb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc69c000fb0 tx=0x7fc69c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:19.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:19.821+0000 7fc6a97fa640 1 -- 172.21.15.114:0/130110189 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc6a4025020 con 0x7fc6ac147a80 2024-04-28T13:08:19.845 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:08:19.847 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:08:20.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.037+0000 7fc6b2c83640 1 -- 172.21.15.114:0/130110189 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc6ac162780 con 0x7fc6ac147a80 2024-04-28T13:08:20.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.694+0000 7fc6a97fa640 1 -- 172.21.15.114:0/130110189 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) ==== 122+0+0 (secure 0 0 0) 0x7fc6a405a5d0 con 0x7fc6ac147a80 2024-04-28T13:08:20.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.696+0000 7fc6b2c83640 1 -- 172.21.15.114:0/130110189 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc69806c8f0 msgr2=0x7fc69806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:20.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.696+0000 7fc6b2c83640 1 --2- 172.21.15.114:0/130110189 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc69806c8f0 0x7fc69806edb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc69c000fb0 tx=0x7fc69c009040 comp rx=0 tx=0).stop 2024-04-28T13:08:20.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.696+0000 7fc6b2c83640 1 -- 172.21.15.114:0/130110189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6ac147a80 msgr2=0x7fc6ac1454b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:20.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.696+0000 7fc6b2c83640 1 --2- 172.21.15.114:0/130110189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6ac147a80 0x7fc6ac1454b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac0d2d50 tx=0x7fc6a4010590 comp rx=0 tx=0).stop 2024-04-28T13:08:20.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.696+0000 7fc6b2c83640 1 -- 172.21.15.114:0/130110189 shutdown_connections 2024-04-28T13:08:20.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.696+0000 7fc6b2c83640 1 --2- 172.21.15.114:0/130110189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6ac147a80 0x7fc6ac1454b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:20.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.696+0000 7fc6b2c83640 1 --2- 172.21.15.114:0/130110189 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc69806c8f0 0x7fc69806edb0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:20.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.696+0000 7fc6b2c83640 1 --2- 172.21.15.114:0/130110189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6ac0cb470 0x7fc6ac147540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:20.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.696+0000 7fc6b2c83640 1 --2- 172.21.15.114:0/130110189 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc694003f30 0x7fc6ac15d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:20.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.696+0000 7fc6b2c83640 1 -- 172.21.15.114:0/130110189 >> 172.21.15.114:0/130110189 conn(0x7fc6ac0633a0 msgr2=0x7fc6ac0b9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:20.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.696+0000 7fc6b2c83640 1 -- 172.21.15.114:0/130110189 shutdown_connections 2024-04-28T13:08:20.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.696+0000 7fc6b2c83640 1 -- 172.21.15.114:0/130110189 wait complete. 2024-04-28T13:08:20.709 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-28T13:08:20.709 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-28T13:08:20.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.808+0000 7fca557e2640 1 Processor -- start 2024-04-28T13:08:20.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.808+0000 7fca557e2640 1 -- start start 2024-04-28T13:08:20.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.809+0000 7fca557e2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fca5006cdf0 0x7fca500ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:20.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.809+0000 7fca557e2640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fca500cef10 0x7fca500b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:20.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.809+0000 7fca557e2640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca500b0f00 con 0x7fca5015bab0 2024-04-28T13:08:20.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.809+0000 7fca557e2640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fca500cf360 con 0x7fca5006cdf0 2024-04-28T13:08:20.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.809+0000 7fca557e2640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fca5006f0c0 con 0x7fca500cef10 2024-04-28T13:08:20.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.809+0000 7fca47fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fca5006cdf0 0x7fca500ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:20.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.809+0000 7fca4effd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fca5015bab0 0x7fca500b06b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52924/0 (socket says 172.21.15.114:52924) 2024-04-28T13:08:20.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.809+0000 7fca4effd640 1 -- 172.21.15.114:0/3882535001 learned_addr learned my addr 172.21.15.114:0/3882535001 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:20.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.809+0000 7fca47fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fca5006cdf0 0x7fca500ce9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:32954/0 (socket says 172.21.15.114:32954) 2024-04-28T13:08:20.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.809+0000 7fca4f7fe640 1 --2- 172.21.15.114:0/3882535001 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fca500cef10 0x7fca500b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:20.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.809+0000 7fca47fff640 1 -- 172.21.15.114:0/3882535001 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fca500cef10 msgr2=0x7fca500b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:20.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.809+0000 7fca47fff640 1 --2- 172.21.15.114:0/3882535001 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fca500cef10 0x7fca500b52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:20.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.809+0000 7fca47fff640 1 -- 172.21.15.114:0/3882535001 >> v1:172.21.15.114:6789/0 conn(0x7fca5015bab0 legacy=0x7fca500b06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:20.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.809+0000 7fca47fff640 1 -- 172.21.15.114:0/3882535001 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca5006f3a0 con 0x7fca5006cdf0 2024-04-28T13:08:20.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.810+0000 7fca47fff640 1 --2- 172.21.15.114:0/3882535001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca5006cdf0 0x7fca500ce9d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fca3800a940 tx=0x7fca3802b550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd2ac4bf9147600 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:20.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.810+0000 7fca4e7fc640 1 -- 172.21.15.114:0/3882535001 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3800b040 con 0x7fca5006cdf0 2024-04-28T13:08:20.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.810+0000 7fca4e7fc640 1 -- 172.21.15.114:0/3882535001 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca38030710 con 0x7fca5006cdf0 2024-04-28T13:08:20.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.810+0000 7fca4e7fc640 1 -- 172.21.15.114:0/3882535001 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca38030ae0 con 0x7fca5006cdf0 2024-04-28T13:08:20.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.810+0000 7fca557e2640 1 -- 172.21.15.114:0/3882535001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca5006cdf0 msgr2=0x7fca500ce9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:20.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.810+0000 7fca557e2640 1 --2- 172.21.15.114:0/3882535001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca5006cdf0 0x7fca500ce9d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fca3800a940 tx=0x7fca3802b550 comp rx=0 tx=0).stop 2024-04-28T13:08:20.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.810+0000 7fca557e2640 1 -- 172.21.15.114:0/3882535001 shutdown_connections 2024-04-28T13:08:20.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.810+0000 7fca557e2640 1 --2- 172.21.15.114:0/3882535001 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fca500cef10 0x7fca500b52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:20.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.810+0000 7fca557e2640 1 --2- 172.21.15.114:0/3882535001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca5006cdf0 0x7fca500ce9d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:20.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.810+0000 7fca557e2640 1 -- 172.21.15.114:0/3882535001 >> 172.21.15.114:0/3882535001 conn(0x7fca500b3c30 msgr2=0x7fca500ce2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:20.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.810+0000 7fca557e2640 1 -- 172.21.15.114:0/3882535001 shutdown_connections 2024-04-28T13:08:20.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.811+0000 7fca557e2640 1 -- 172.21.15.114:0/3882535001 wait complete. 2024-04-28T13:08:20.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.812+0000 7fca557e2640 1 Processor -- start 2024-04-28T13:08:20.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.812+0000 7fca557e2640 1 -- start start 2024-04-28T13:08:20.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.812+0000 7fca557e2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca5006cdf0 0x7fca501f48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:20.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.812+0000 7fca557e2640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fca500cef10 0x7fca500ace10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:20.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.812+0000 7fca557e2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca5015bab0 0x7fca5014b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:20.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.812+0000 7fca557e2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fca5006fe80 con 0x7fca5006cdf0 2024-04-28T13:08:20.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.812+0000 7fca557e2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fca5006f960 con 0x7fca5015bab0 2024-04-28T13:08:20.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.812+0000 7fca557e2640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fca501f5860 con 0x7fca500cef10 2024-04-28T13:08:20.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.812+0000 7fca4effd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca5006cdf0 0x7fca501f48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:20.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.812+0000 7fca4effd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca5006cdf0 0x7fca501f48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:32968/0 (socket says 172.21.15.114:32968) 2024-04-28T13:08:20.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.812+0000 7fca4effd640 1 -- 172.21.15.114:0/3537582247 learned_addr learned my addr 172.21.15.114:0/3537582247 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:20.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.812+0000 7fca47fff640 1 --2- 172.21.15.114:0/3537582247 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fca500cef10 0x7fca500ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:20.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.812+0000 7fca4f7fe640 1 --2- 172.21.15.114:0/3537582247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca5015bab0 0x7fca5014b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:20.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.813+0000 7fca4effd640 1 -- 172.21.15.114:0/3537582247 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fca500cef10 msgr2=0x7fca500ace10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:20.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.813+0000 7fca4effd640 1 --2- 172.21.15.114:0/3537582247 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fca500cef10 0x7fca500ace10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:20.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.813+0000 7fca4effd640 1 -- 172.21.15.114:0/3537582247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca5015bab0 msgr2=0x7fca5014b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:20.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.813+0000 7fca4effd640 1 --2- 172.21.15.114:0/3537582247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca5015bab0 0x7fca5014b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:20.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.813+0000 7fca4effd640 1 -- 172.21.15.114:0/3537582247 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca501f4fc0 con 0x7fca5006cdf0 2024-04-28T13:08:20.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.813+0000 7fca4effd640 1 --2- 172.21.15.114:0/3537582247 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca5006cdf0 0x7fca501f48e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fca4000c3c0 tx=0x7fca4000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:20.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.813+0000 7fca477fe640 1 -- 172.21.15.114:0/3537582247 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca40017070 con 0x7fca5006cdf0 2024-04-28T13:08:20.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.813+0000 7fca477fe640 1 -- 172.21.15.114:0/3537582247 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca40005ce0 con 0x7fca5006cdf0 2024-04-28T13:08:20.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.813+0000 7fca557e2640 1 -- 172.21.15.114:0/3537582247 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca501f52a0 con 0x7fca5006cdf0 2024-04-28T13:08:20.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.813+0000 7fca477fe640 1 -- 172.21.15.114:0/3537582247 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca400072f0 con 0x7fca5006cdf0 2024-04-28T13:08:20.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.813+0000 7fca557e2640 1 -- 172.21.15.114:0/3537582247 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca5015d110 con 0x7fca5006cdf0 2024-04-28T13:08:20.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.814+0000 7fca557e2640 1 -- 172.21.15.114:0/3537582247 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca5006a3d0 con 0x7fca5006cdf0 2024-04-28T13:08:20.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.814+0000 7fca477fe640 1 -- 172.21.15.114:0/3537582247 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fca4001a070 con 0x7fca5006cdf0 2024-04-28T13:08:20.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.815+0000 7fca477fe640 1 --2- 172.21.15.114:0/3537582247 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fca3006c920 0x7fca3006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:20.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.815+0000 7fca477fe640 1 -- 172.21.15.114:0/3537582247 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fca4008ad90 con 0x7fca5006cdf0 2024-04-28T13:08:20.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.815+0000 7fca47fff640 1 --2- 172.21.15.114:0/3537582247 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fca3006c920 0x7fca3006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:20.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.815+0000 7fca47fff640 1 --2- 172.21.15.114:0/3537582247 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fca3006c920 0x7fca3006ede0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fca38035000 tx=0x7fca3800c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:20.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:20.819+0000 7fca477fe640 1 -- 172.21.15.114:0/3537582247 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fca40058c00 con 0x7fca5006cdf0 2024-04-28T13:08:21.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.033+0000 7fca557e2640 1 -- 172.21.15.114:0/3537582247 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca500b1aa0 con 0x7fca5006cdf0 2024-04-28T13:08:21.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.034+0000 7fca477fe640 1 -- 172.21.15.114:0/3537582247 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5192 (secure 0 0 0) 0x7fca4005cf00 con 0x7fca5006cdf0 2024-04-28T13:08:21.035 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:21.035 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3832267996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":3832267996},{"type":"v1","addr":"172.21.15.134:6835","nonce":3832267996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5130,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2035724706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2035724706},{"type":"v1","addr":"172.21.15.114:6836","nonce":2035724706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":5133,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3180452801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3180452801},{"type":"v1","addr":"172.21.15.114:6837","nonce":3180452801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-28T13:08:18.038213+0000","modified":"2024-04-28T13:08:20.039019+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5145":{"gid":5145,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6834/1155749661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1155749661},{"type":"v1","addr":"172.21.15.134:6834","nonce":1155749661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5145,"qdb_cluster":[5145]},"id":2}]} 2024-04-28T13:08:21.035 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 13 2024-04-28T13:08:21.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.036+0000 7fca557e2640 1 -- 172.21.15.114:0/3537582247 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fca3006c920 msgr2=0x7fca3006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:21.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.036+0000 7fca557e2640 1 --2- 172.21.15.114:0/3537582247 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fca3006c920 0x7fca3006ede0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fca38035000 tx=0x7fca3800c040 comp rx=0 tx=0).stop 2024-04-28T13:08:21.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.036+0000 7fca557e2640 1 -- 172.21.15.114:0/3537582247 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca5006cdf0 msgr2=0x7fca501f48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:21.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.036+0000 7fca557e2640 1 --2- 172.21.15.114:0/3537582247 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca5006cdf0 0x7fca501f48e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fca4000c3c0 tx=0x7fca4000c880 comp rx=0 tx=0).stop 2024-04-28T13:08:21.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.036+0000 7fca557e2640 1 -- 172.21.15.114:0/3537582247 shutdown_connections 2024-04-28T13:08:21.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.036+0000 7fca557e2640 1 --2- 172.21.15.114:0/3537582247 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fca3006c920 0x7fca3006ede0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.036+0000 7fca557e2640 1 --2- 172.21.15.114:0/3537582247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca5015bab0 0x7fca5014b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.036+0000 7fca557e2640 1 --2- 172.21.15.114:0/3537582247 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fca500cef10 0x7fca500ace10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.036+0000 7fca557e2640 1 --2- 172.21.15.114:0/3537582247 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca5006cdf0 0x7fca501f48e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.036+0000 7fca557e2640 1 -- 172.21.15.114:0/3537582247 >> 172.21.15.114:0/3537582247 conn(0x7fca500b3c30 msgr2=0x7fca500b55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:21.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.036+0000 7fca557e2640 1 -- 172.21.15.114:0/3537582247 shutdown_connections 2024-04-28T13:08:21.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.036+0000 7fca557e2640 1 -- 172.21.15.114:0/3537582247 wait complete. 2024-04-28T13:08:21.048 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:08:21.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.145+0000 7f58cde37640 1 Processor -- start 2024-04-28T13:08:21.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.145+0000 7f58cde37640 1 -- start start 2024-04-28T13:08:21.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.146+0000 7f58cde37640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f58c8070d60 0x7f58c816a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:21.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.146+0000 7f58cde37640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58c81459c0 con 0x7f58c8142a40 2024-04-28T13:08:21.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.146+0000 7f58cde37640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58c80b6ea0 con 0x7f58c81423f0 2024-04-28T13:08:21.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.146+0000 7f58cde37640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f58c8160710 con 0x7f58c8070d60 2024-04-28T13:08:21.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.146+0000 7f58bffff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f58c8142a40 0x7f58c8070650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52928/0 (socket says 172.21.15.114:52928) 2024-04-28T13:08:21.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.146+0000 7f58bffff640 1 -- 172.21.15.114:0/2273641804 learned_addr learned my addr 172.21.15.114:0/2273641804 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:21.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.146+0000 7f58c7fff640 1 --2- 172.21.15.114:0/2273641804 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f58c8070d60 0x7f58c816a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:21.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.146+0000 7f58c6ffd640 1 -- 172.21.15.114:0/2273641804 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1339927253 0 0) 0x7f58c81459c0 con 0x7f58c8142a40 2024-04-28T13:08:21.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.146+0000 7f58c6ffd640 1 -- 172.21.15.114:0/2273641804 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58b4003520 con 0x7f58c8142a40 2024-04-28T13:08:21.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.146+0000 7f58c6ffd640 1 -- 172.21.15.114:0/2273641804 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2139450859 0 0) 0x7f58c80b6ea0 con 0x7f58c81423f0 2024-04-28T13:08:21.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.146+0000 7f58c6ffd640 1 -- 172.21.15.114:0/2273641804 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58c81459c0 con 0x7f58c81423f0 2024-04-28T13:08:21.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.146+0000 7f58c6ffd640 1 -- 172.21.15.114:0/2273641804 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3119733022 0 0) 0x7f58b4003520 con 0x7f58c8142a40 2024-04-28T13:08:21.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.146+0000 7f58c6ffd640 1 -- 172.21.15.114:0/2273641804 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f58c8070d60 msgr2=0x7f58c816a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:21.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.146+0000 7f58c6ffd640 1 --2- 172.21.15.114:0/2273641804 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f58c8070d60 0x7f58c816a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.146+0000 7f58c6ffd640 1 -- 172.21.15.114:0/2273641804 >> v1:172.21.15.134:6789/0 conn(0x7f58c81423f0 legacy=0x7f58c80b6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:21.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.146+0000 7f58c6ffd640 1 -- 172.21.15.114:0/2273641804 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c815fb00 con 0x7f58c8142a40 2024-04-28T13:08:21.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.146+0000 7f58c6ffd640 1 -- 172.21.15.114:0/2273641804 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f58b0001670 con 0x7f58c8142a40 2024-04-28T13:08:21.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.146+0000 7f58c6ffd640 1 -- 172.21.15.114:0/2273641804 >> v1:172.21.15.114:6789/0 conn(0x7f58c8142a40 legacy=0x7f58c8070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:21.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.146+0000 7f58c6ffd640 1 --2- 172.21.15.114:0/2273641804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58b4003b70 0x7f58b4003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:21.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.146+0000 7f58c6ffd640 1 --2- 172.21.15.114:0/2273641804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58b4004800 0x7f58b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:21.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.146+0000 7f58c6ffd640 1 --2- 172.21.15.114:0/2273641804 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f58c8070d60 0x7f58b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:21.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.146+0000 7f58c6ffd640 1 -- 172.21.15.114:0/2273641804 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f58c8160710 con 0x7f58b4003b70 2024-04-28T13:08:21.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.146+0000 7f58c6ffd640 1 -- 172.21.15.114:0/2273641804 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f58b400baa0 con 0x7f58b4004800 2024-04-28T13:08:21.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.146+0000 7f58c6ffd640 1 -- 172.21.15.114:0/2273641804 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f58b400bca0 con 0x7f58c8070d60 2024-04-28T13:08:21.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.146+0000 7f58c77fe640 1 --2- 172.21.15.114:0/2273641804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58b4003b70 0x7f58b4003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:21.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.146+0000 7f58c7fff640 1 --2- 172.21.15.114:0/2273641804 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f58c8070d60 0x7f58b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:21.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.146+0000 7f58bffff640 1 --2- 172.21.15.114:0/2273641804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58b4004800 0x7f58b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:21.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.147+0000 7f58c77fe640 1 -- 172.21.15.114:0/2273641804 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f58c8070d60 msgr2=0x7f58b40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:21.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.147+0000 7f58c77fe640 1 --2- 172.21.15.114:0/2273641804 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f58c8070d60 0x7f58b40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.147+0000 7f58c77fe640 1 -- 172.21.15.114:0/2273641804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58b4004800 msgr2=0x7f58b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:21.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.147+0000 7f58c77fe640 1 --2- 172.21.15.114:0/2273641804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58b4004800 0x7f58b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.147+0000 7f58c77fe640 1 -- 172.21.15.114:0/2273641804 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b4003520 con 0x7f58b4003b70 2024-04-28T13:08:21.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.147+0000 7f58c77fe640 1 --2- 172.21.15.114:0/2273641804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58b4003b70 0x7f58b4003f70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f58c80b7070 tx=0x7f58b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b39f7a708989e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:21.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.147+0000 7f58c6ffd640 1 -- 172.21.15.114:0/2273641804 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b803e070 con 0x7f58b4003b70 2024-04-28T13:08:21.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.148+0000 7f58c6ffd640 1 -- 172.21.15.114:0/2273641804 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58b80052d0 con 0x7f58b4003b70 2024-04-28T13:08:21.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.148+0000 7f58c6ffd640 1 -- 172.21.15.114:0/2273641804 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b8001500 con 0x7f58b4003b70 2024-04-28T13:08:21.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.148+0000 7f58cde37640 1 -- 172.21.15.114:0/2273641804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58b4003b70 msgr2=0x7f58b4003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:21.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.148+0000 7f58cde37640 1 --2- 172.21.15.114:0/2273641804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58b4003b70 0x7f58b4003f70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f58c80b7070 tx=0x7f58b4005830 comp rx=0 tx=0).stop 2024-04-28T13:08:21.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.148+0000 7f58c7fff640 1 -- 172.21.15.114:0/2273641804 reap_dead start 2024-04-28T13:08:21.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.148+0000 7f58cde37640 1 -- 172.21.15.114:0/2273641804 shutdown_connections 2024-04-28T13:08:21.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.148+0000 7f58cde37640 1 -- 172.21.15.114:0/2273641804 >> 172.21.15.114:0/2273641804 conn(0x7f58c80b4c60 msgr2=0x7f58c80b5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:21.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.148+0000 7f58cde37640 1 -- 172.21.15.114:0/2273641804 shutdown_connections 2024-04-28T13:08:21.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.148+0000 7f58cde37640 1 -- 172.21.15.114:0/2273641804 wait complete. 2024-04-28T13:08:21.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.149+0000 7f58cde37640 1 Processor -- start 2024-04-28T13:08:21.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.149+0000 7f58cde37640 1 -- start start 2024-04-28T13:08:21.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.150+0000 7f58cde37640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58b4003b70 0x7f58c8147b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:21.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.150+0000 7f58cde37640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f58c806eff0 0x7f58c8158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:21.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.150+0000 7f58cde37640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58c8140870 0x7f58c8140cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:21.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.150+0000 7f58cde37640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f58c81603a0 con 0x7f58b4003b70 2024-04-28T13:08:21.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.150+0000 7f58cde37640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f58c81600c0 con 0x7f58c8140870 2024-04-28T13:08:21.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.150+0000 7f58cde37640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f58c80b60f0 con 0x7f58c806eff0 2024-04-28T13:08:21.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.150+0000 7f58c77fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58b4003b70 0x7f58c8147b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:21.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.150+0000 7f58c77fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58b4003b70 0x7f58c8147b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:32994/0 (socket says 172.21.15.114:32994) 2024-04-28T13:08:21.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.150+0000 7f58c77fe640 1 -- 172.21.15.114:0/1145546719 learned_addr learned my addr 172.21.15.114:0/1145546719 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:21.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.150+0000 7f58bffff640 1 --2- 172.21.15.114:0/1145546719 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f58c806eff0 0x7f58c8158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:21.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.150+0000 7f58c7fff640 1 --2- 172.21.15.114:0/1145546719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58c8140870 0x7f58c8140cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:21.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.150+0000 7f58c77fe640 1 -- 172.21.15.114:0/1145546719 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f58c806eff0 msgr2=0x7f58c8158380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:21.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.150+0000 7f58c77fe640 1 --2- 172.21.15.114:0/1145546719 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f58c806eff0 0x7f58c8158380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.150+0000 7f58c77fe640 1 -- 172.21.15.114:0/1145546719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58c8140870 msgr2=0x7f58c8140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:21.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.150+0000 7f58c77fe640 1 --2- 172.21.15.114:0/1145546719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58c8140870 0x7f58c8140cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.150+0000 7f58c77fe640 1 -- 172.21.15.114:0/1145546719 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c8148e10 con 0x7f58b4003b70 2024-04-28T13:08:21.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.150+0000 7f58c7fff640 1 --2- 172.21.15.114:0/1145546719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58c8140870 0x7f58c8140cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:21.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.151+0000 7f58c77fe640 1 --2- 172.21.15.114:0/1145546719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58b4003b70 0x7f58c8147b40 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f58b8005040 tx=0x7f58b80012f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:21.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.151+0000 7f58c4ff9640 1 -- 172.21.15.114:0/1145546719 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b803e040 con 0x7f58b4003b70 2024-04-28T13:08:21.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.151+0000 7f58c4ff9640 1 -- 172.21.15.114:0/1145546719 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58b8005480 con 0x7f58b4003b70 2024-04-28T13:08:21.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.151+0000 7f58cde37640 1 -- 172.21.15.114:0/1145546719 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58c8148200 con 0x7f58b4003b70 2024-04-28T13:08:21.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.151+0000 7f58c4ff9640 1 -- 172.21.15.114:0/1145546719 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b8035070 con 0x7f58b4003b70 2024-04-28T13:08:21.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.151+0000 7f58cde37640 1 -- 172.21.15.114:0/1145546719 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58c81487c0 con 0x7f58b4003b70 2024-04-28T13:08:21.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.152+0000 7f58cde37640 1 -- 172.21.15.114:0/1145546719 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58c806a3d0 con 0x7f58b4003b70 2024-04-28T13:08:21.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.152+0000 7f58c4ff9640 1 -- 172.21.15.114:0/1145546719 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f58b8007230 con 0x7f58b4003b70 2024-04-28T13:08:21.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.152+0000 7f58c4ff9640 1 --2- 172.21.15.114:0/1145546719 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f58a806c8f0 0x7f58a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:21.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.152+0000 7f58c4ff9640 1 -- 172.21.15.114:0/1145546719 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f58b80b4500 con 0x7f58b4003b70 2024-04-28T13:08:21.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.152+0000 7f58bffff640 1 --2- 172.21.15.114:0/1145546719 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f58a806c8f0 0x7f58a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:21.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.153+0000 7f58bffff640 1 --2- 172.21.15.114:0/1145546719 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f58a806c8f0 0x7f58a806edb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f58c80b6fd0 tx=0x7f58b0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:21.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.157+0000 7f58c4ff9640 1 -- 172.21.15.114:0/1145546719 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f58b8049020 con 0x7f58b4003b70 2024-04-28T13:08:21.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.333+0000 7f58cde37640 1 -- 172.21.15.114:0/1145546719 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f58c8071570 con 0x7f58b4003b70 2024-04-28T13:08:21.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.334+0000 7f58c4ff9640 1 -- 172.21.15.114:0/1145546719 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16717 (secure 0 0 0) 0x7f58b8082370 con 0x7f58b4003b70 2024-04-28T13:08:21.334 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:21.334 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":34,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:08:19.691257+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-28T13:08:16.244962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-28T13:08:16.991345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:08:21.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.336+0000 7f58cde37640 1 -- 172.21.15.114:0/1145546719 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f58a806c8f0 msgr2=0x7f58a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:21.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.336+0000 7f58cde37640 1 --2- 172.21.15.114:0/1145546719 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f58a806c8f0 0x7f58a806edb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f58c80b6fd0 tx=0x7f58b0009040 comp rx=0 tx=0).stop 2024-04-28T13:08:21.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.336+0000 7f58cde37640 1 -- 172.21.15.114:0/1145546719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58b4003b70 msgr2=0x7f58c8147b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:21.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.336+0000 7f58cde37640 1 --2- 172.21.15.114:0/1145546719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58b4003b70 0x7f58c8147b40 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f58b8005040 tx=0x7f58b80012f0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.336+0000 7f58cde37640 1 -- 172.21.15.114:0/1145546719 shutdown_connections 2024-04-28T13:08:21.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.336+0000 7f58cde37640 1 --2- 172.21.15.114:0/1145546719 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f58a806c8f0 0x7f58a806edb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.336+0000 7f58cde37640 1 --2- 172.21.15.114:0/1145546719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58c8140870 0x7f58c8140cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.336+0000 7f58cde37640 1 --2- 172.21.15.114:0/1145546719 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f58c806eff0 0x7f58c8158380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.336+0000 7f58cde37640 1 --2- 172.21.15.114:0/1145546719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58b4003b70 0x7f58c8147b40 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.336+0000 7f58cde37640 1 -- 172.21.15.114:0/1145546719 >> 172.21.15.114:0/1145546719 conn(0x7f58c80b4c60 msgr2=0x7f58c8141630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:21.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.336+0000 7f58cde37640 1 -- 172.21.15.114:0/1145546719 shutdown_connections 2024-04-28T13:08:21.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.336+0000 7f58cde37640 1 -- 172.21.15.114:0/1145546719 wait complete. 2024-04-28T13:08:21.347 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-28T13:08:21.347 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-28T13:08:21.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.443+0000 7fa58d215640 1 Processor -- start 2024-04-28T13:08:21.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.443+0000 7fa58d215640 1 -- start start 2024-04-28T13:08:21.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.444+0000 7fa58d215640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa588153330 0x7fa58815d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:21.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.444+0000 7fa58d215640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5880742c0 0x7fa5880cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:21.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.444+0000 7fa58d215640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa588153710 con 0x7fa5880723d0 2024-04-28T13:08:21.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.444+0000 7fa58d215640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fa5880b4a60 con 0x7fa588153330 2024-04-28T13:08:21.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.444+0000 7fa58d215640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fa588072990 con 0x7fa5880742c0 2024-04-28T13:08:21.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.444+0000 7fa586d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa588153330 0x7fa58815d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:21.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.444+0000 7fa58659c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa5880723d0 0x7fa588073bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52932/0 (socket says 172.21.15.114:52932) 2024-04-28T13:08:21.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.444+0000 7fa58659c640 1 -- 172.21.15.114:0/704051869 learned_addr learned my addr 172.21.15.114:0/704051869 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:21.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.444+0000 7fa58759e640 1 --2- 172.21.15.114:0/704051869 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5880742c0 0x7fa5880cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:21.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.444+0000 7fa586d9d640 1 -- 172.21.15.114:0/704051869 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5880742c0 msgr2=0x7fa5880cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:21.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.444+0000 7fa586d9d640 1 --2- 172.21.15.114:0/704051869 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5880742c0 0x7fa5880cedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.444+0000 7fa586d9d640 1 -- 172.21.15.114:0/704051869 >> v1:172.21.15.114:6789/0 conn(0x7fa5880723d0 legacy=0x7fa588073bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:21.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.444+0000 7fa585d9b640 1 -- 172.21.15.114:0/704051869 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2987392300 0 0) 0x7fa57c001110 con 0x7fa5880723d0 2024-04-28T13:08:21.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.444+0000 7fa586d9d640 1 -- 172.21.15.114:0/704051869 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa588072c70 con 0x7fa588153330 2024-04-28T13:08:21.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.445+0000 7fa586d9d640 1 --2- 172.21.15.114:0/704051869 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa588153330 0x7fa58815d2e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa578009d90 tx=0x7fa57802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab04aba653324c98 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:21.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.445+0000 7fa585d9b640 1 -- 172.21.15.114:0/704051869 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa578031600 con 0x7fa588153330 2024-04-28T13:08:21.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.445+0000 7fa585d9b640 1 -- 172.21.15.114:0/704051869 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5780317a0 con 0x7fa588153330 2024-04-28T13:08:21.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.445+0000 7fa585d9b640 1 -- 172.21.15.114:0/704051869 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa578031b70 con 0x7fa588153330 2024-04-28T13:08:21.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.446+0000 7fa58d215640 1 -- 172.21.15.114:0/704051869 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa588153330 msgr2=0x7fa58815d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:21.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.446+0000 7fa58d215640 1 --2- 172.21.15.114:0/704051869 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa588153330 0x7fa58815d2e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa578009d90 tx=0x7fa57802a5d0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.446+0000 7fa58d215640 1 -- 172.21.15.114:0/704051869 shutdown_connections 2024-04-28T13:08:21.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.446+0000 7fa58d215640 1 --2- 172.21.15.114:0/704051869 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5880742c0 0x7fa5880cedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.446+0000 7fa58d215640 1 --2- 172.21.15.114:0/704051869 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa588153330 0x7fa58815d2e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.446+0000 7fa58d215640 1 -- 172.21.15.114:0/704051869 >> 172.21.15.114:0/704051869 conn(0x7fa58806c980 msgr2=0x7fa5880b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:21.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.446+0000 7fa58d215640 1 -- 172.21.15.114:0/704051869 shutdown_connections 2024-04-28T13:08:21.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.446+0000 7fa58d215640 1 -- 172.21.15.114:0/704051869 wait complete. 2024-04-28T13:08:21.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.447+0000 7fa58d215640 1 Processor -- start 2024-04-28T13:08:21.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.447+0000 7fa58d215640 1 -- start start 2024-04-28T13:08:21.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.448+0000 7fa58d215640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5880723d0 0x7fa58814eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:21.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.448+0000 7fa58d215640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5880742c0 0x7fa588157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:21.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.448+0000 7fa58d215640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa588153330 0x7fa58814e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:21.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.448+0000 7fa58d215640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa588073510 con 0x7fa588153330 2024-04-28T13:08:21.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.448+0000 7fa58d215640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa588073230 con 0x7fa5880742c0 2024-04-28T13:08:21.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.448+0000 7fa58d215640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fa5880cf330 con 0x7fa5880723d0 2024-04-28T13:08:21.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.448+0000 7fa58759e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa588153330 0x7fa58814e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:21.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.448+0000 7fa58759e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa588153330 0x7fa58814e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33012/0 (socket says 172.21.15.114:33012) 2024-04-28T13:08:21.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.448+0000 7fa58759e640 1 -- 172.21.15.114:0/61252833 learned_addr learned my addr 172.21.15.114:0/61252833 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:21.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.448+0000 7fa58659c640 1 --2- 172.21.15.114:0/61252833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5880742c0 0x7fa588157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:21.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.448+0000 7fa586d9d640 1 --2- 172.21.15.114:0/61252833 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5880723d0 0x7fa58814eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:21.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.448+0000 7fa58759e640 1 -- 172.21.15.114:0/61252833 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5880723d0 msgr2=0x7fa58814eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:21.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.448+0000 7fa58759e640 1 --2- 172.21.15.114:0/61252833 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5880723d0 0x7fa58814eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.448+0000 7fa58759e640 1 -- 172.21.15.114:0/61252833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5880742c0 msgr2=0x7fa588157340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:21.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.448+0000 7fa58759e640 1 --2- 172.21.15.114:0/61252833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5880742c0 0x7fa588157340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.448+0000 7fa58759e640 1 -- 172.21.15.114:0/61252833 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa588159710 con 0x7fa588153330 2024-04-28T13:08:21.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.448+0000 7fa586d9d640 1 --2- 172.21.15.114:0/61252833 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5880723d0 0x7fa58814eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:21.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.449+0000 7fa58759e640 1 --2- 172.21.15.114:0/61252833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa588153330 0x7fa58814e2c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa58000c5f0 tx=0x7fa58000cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:21.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.449+0000 7fa56f7fe640 1 -- 172.21.15.114:0/61252833 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa580015070 con 0x7fa588153330 2024-04-28T13:08:21.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.449+0000 7fa56f7fe640 1 -- 172.21.15.114:0/61252833 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa580004220 con 0x7fa588153330 2024-04-28T13:08:21.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.449+0000 7fa58d215640 1 -- 172.21.15.114:0/61252833 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5881599f0 con 0x7fa588153330 2024-04-28T13:08:21.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.449+0000 7fa56f7fe640 1 -- 172.21.15.114:0/61252833 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa580003610 con 0x7fa588153330 2024-04-28T13:08:21.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.449+0000 7fa58d215640 1 -- 172.21.15.114:0/61252833 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa58814e800 con 0x7fa588153330 2024-04-28T13:08:21.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.450+0000 7fa58d215640 1 -- 172.21.15.114:0/61252833 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa58806a3d0 con 0x7fa588153330 2024-04-28T13:08:21.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.450+0000 7fa56f7fe640 1 -- 172.21.15.114:0/61252833 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa5800037b0 con 0x7fa588153330 2024-04-28T13:08:21.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.451+0000 7fa56f7fe640 1 --2- 172.21.15.114:0/61252833 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa57406c8f0 0x7fa57406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:21.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.451+0000 7fa586d9d640 1 --2- 172.21.15.114:0/61252833 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa57406c8f0 0x7fa57406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:21.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.451+0000 7fa56f7fe640 1 -- 172.21.15.114:0/61252833 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fa58008b8f0 con 0x7fa588153330 2024-04-28T13:08:21.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.451+0000 7fa586d9d640 1 --2- 172.21.15.114:0/61252833 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa57406c8f0 0x7fa57406edb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa578034000 tx=0x7fa578033040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:21.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.455+0000 7fa56f7fe640 1 -- 172.21.15.114:0/61252833 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa580059db0 con 0x7fa588153330 2024-04-28T13:08:21.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.624+0000 7fa58d215640 1 -- 172.21.15.114:0/61252833 --> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa58815fbc0 con 0x7fa57406c8f0 2024-04-28T13:08:21.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.631+0000 7fa56f7fe640 1 -- 172.21.15.114:0/61252833 <== mgr.4104 v2:172.21.15.114:6832/2240257326 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251878 (secure 0 0 0) 0x7fa58815fbc0 con 0x7fa57406c8f0 2024-04-28T13:08:21.633 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:21.635 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-04-28T13:08:21.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.634+0000 7fa58d215640 1 -- 172.21.15.114:0/61252833 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa57406c8f0 msgr2=0x7fa57406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:21.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.634+0000 7fa58d215640 1 --2- 172.21.15.114:0/61252833 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa57406c8f0 0x7fa57406edb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa578034000 tx=0x7fa578033040 comp rx=0 tx=0).stop 2024-04-28T13:08:21.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.634+0000 7fa58d215640 1 -- 172.21.15.114:0/61252833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa588153330 msgr2=0x7fa58814e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:21.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.634+0000 7fa58d215640 1 --2- 172.21.15.114:0/61252833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa588153330 0x7fa58814e2c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa58000c5f0 tx=0x7fa58000cab0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.634+0000 7fa58d215640 1 -- 172.21.15.114:0/61252833 shutdown_connections 2024-04-28T13:08:21.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.634+0000 7fa58d215640 1 --2- 172.21.15.114:0/61252833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa588153330 0x7fa58814e2c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.634+0000 7fa58d215640 1 --2- 172.21.15.114:0/61252833 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa57406c8f0 0x7fa57406edb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.634+0000 7fa58d215640 1 --2- 172.21.15.114:0/61252833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5880742c0 0x7fa588157340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.634+0000 7fa58d215640 1 --2- 172.21.15.114:0/61252833 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5880723d0 0x7fa58814eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.634+0000 7fa58d215640 1 -- 172.21.15.114:0/61252833 >> 172.21.15.114:0/61252833 conn(0x7fa58806c980 msgr2=0x7fa58815b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:21.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.634+0000 7fa58d215640 1 -- 172.21.15.114:0/61252833 shutdown_connections 2024-04-28T13:08:21.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.634+0000 7fa58d215640 1 -- 172.21.15.114:0/61252833 wait complete. 2024-04-28T13:08:21.645 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-04-28T13:08:20.716715+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220164,"kb_used_data":3992,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754556,"statfs":{"total":773094113280,"available":772868665344,"internally_reserved":0,"allocated":4087808,"data_stored":2293277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.038448"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.708637+0000","last_change":"2024-04-28T13:08:18.706640+0000","last_active":"2024-04-28T13:08:18.708637+0000","last_peered":"2024-04-28T13:08:18.708637+0000","last_clean":"2024-04-28T13:08:18.708637+0000","last_became_active":"2024-04-28T13:08:18.706124+0000","last_became_peered":"2024-04-28T13:08:18.706124+0000","last_unstale":"2024-04-28T13:08:18.708637+0000","last_undegraded":"2024-04-28T13:08:18.708637+0000","last_fullsized":"2024-04-28T13:08:18.708637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:02:50.132656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.706729+0000","last_change":"2024-04-28T13:08:18.700988+0000","last_active":"2024-04-28T13:08:18.706729+0000","last_peered":"2024-04-28T13:08:18.706729+0000","last_clean":"2024-04-28T13:08:18.706729+0000","last_became_active":"2024-04-28T13:08:18.700700+0000","last_became_peered":"2024-04-28T13:08:18.700700+0000","last_unstale":"2024-04-28T13:08:18.706729+0000","last_undegraded":"2024-04-28T13:08:18.706729+0000","last_fullsized":"2024-04-28T13:08:18.706729+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:47:10.449842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.714157+0000","last_change":"2024-04-28T13:08:18.712262+0000","last_active":"2024-04-28T13:08:18.714157+0000","last_peered":"2024-04-28T13:08:18.714157+0000","last_clean":"2024-04-28T13:08:18.714157+0000","last_became_active":"2024-04-28T13:08:18.711970+0000","last_became_peered":"2024-04-28T13:08:18.711970+0000","last_unstale":"2024-04-28T13:08:18.714157+0000","last_undegraded":"2024-04-28T13:08:18.714157+0000","last_fullsized":"2024-04-28T13:08:18.714157+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:47:10.449842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.716905+0000","last_change":"2024-04-28T13:08:18.711207+0000","last_active":"2024-04-28T13:08:18.716905+0000","last_peered":"2024-04-28T13:08:18.716905+0000","last_clean":"2024-04-28T13:08:18.716905+0000","last_became_active":"2024-04-28T13:08:18.710950+0000","last_became_peered":"2024-04-28T13:08:18.710950+0000","last_unstale":"2024-04-28T13:08:18.716905+0000","last_undegraded":"2024-04-28T13:08:18.716905+0000","last_fullsized":"2024-04-28T13:08:18.716905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:24:29.898441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.705848+0000","last_change":"2024-04-28T13:08:18.704258+0000","last_active":"2024-04-28T13:08:18.705848+0000","last_peered":"2024-04-28T13:08:18.705848+0000","last_clean":"2024-04-28T13:08:18.705848+0000","last_became_active":"2024-04-28T13:08:18.703983+0000","last_became_peered":"2024-04-28T13:08:18.703983+0000","last_unstale":"2024-04-28T13:08:18.705848+0000","last_undegraded":"2024-04-28T13:08:18.705848+0000","last_fullsized":"2024-04-28T13:08:18.705848+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:43:48.065676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.711467+0000","last_change":"2024-04-28T13:08:18.707002+0000","last_active":"2024-04-28T13:08:18.711467+0000","last_peered":"2024-04-28T13:08:18.711467+0000","last_clean":"2024-04-28T13:08:18.711467+0000","last_became_active":"2024-04-28T13:08:18.706713+0000","last_became_peered":"2024-04-28T13:08:18.706713+0000","last_unstale":"2024-04-28T13:08:18.711467+0000","last_undegraded":"2024-04-28T13:08:18.711467+0000","last_fullsized":"2024-04-28T13:08:18.711467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:24:02.655969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.705694+0000","last_change":"2024-04-28T13:08:18.704436+0000","last_active":"2024-04-28T13:08:18.705694+0000","last_peered":"2024-04-28T13:08:18.705694+0000","last_clean":"2024-04-28T13:08:18.705694+0000","last_became_active":"2024-04-28T13:08:18.704143+0000","last_became_peered":"2024-04-28T13:08:18.704143+0000","last_unstale":"2024-04-28T13:08:18.705694+0000","last_undegraded":"2024-04-28T13:08:18.705694+0000","last_fullsized":"2024-04-28T13:08:18.705694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:24:29.898441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.700659+0000","last_change":"2024-04-28T13:08:18.699000+0000","last_active":"2024-04-28T13:08:18.700659+0000","last_peered":"2024-04-28T13:08:18.700659+0000","last_clean":"2024-04-28T13:08:18.700659+0000","last_became_active":"2024-04-28T13:08:18.698696+0000","last_became_peered":"2024-04-28T13:08:18.698696+0000","last_unstale":"2024-04-28T13:08:18.700659+0000","last_undegraded":"2024-04-28T13:08:18.700659+0000","last_fullsized":"2024-04-28T13:08:18.700659+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:23:58.662977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.710357+0000","last_change":"2024-04-28T13:08:18.707125+0000","last_active":"2024-04-28T13:08:18.710357+0000","last_peered":"2024-04-28T13:08:18.710357+0000","last_clean":"2024-04-28T13:08:18.710357+0000","last_became_active":"2024-04-28T13:08:18.705027+0000","last_became_peered":"2024-04-28T13:08:18.705027+0000","last_unstale":"2024-04-28T13:08:18.710357+0000","last_undegraded":"2024-04-28T13:08:18.710357+0000","last_fullsized":"2024-04-28T13:08:18.710357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:38:31.472938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.709680+0000","last_change":"2024-04-28T13:08:18.703853+0000","last_active":"2024-04-28T13:08:18.709680+0000","last_peered":"2024-04-28T13:08:18.709680+0000","last_clean":"2024-04-28T13:08:18.709680+0000","last_became_active":"2024-04-28T13:08:18.703609+0000","last_became_peered":"2024-04-28T13:08:18.703609+0000","last_unstale":"2024-04-28T13:08:18.709680+0000","last_undegraded":"2024-04-28T13:08:18.709680+0000","last_fullsized":"2024-04-28T13:08:18.709680+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:44:19.552362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.707265+0000","last_change":"2024-04-28T13:08:18.704704+0000","last_active":"2024-04-28T13:08:18.707265+0000","last_peered":"2024-04-28T13:08:18.707265+0000","last_clean":"2024-04-28T13:08:18.707265+0000","last_became_active":"2024-04-28T13:08:18.704363+0000","last_became_peered":"2024-04-28T13:08:18.704363+0000","last_unstale":"2024-04-28T13:08:18.707265+0000","last_undegraded":"2024-04-28T13:08:18.707265+0000","last_fullsized":"2024-04-28T13:08:18.707265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:48:27.578962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.710924+0000","last_change":"2024-04-28T13:08:18.708122+0000","last_active":"2024-04-28T13:08:18.710924+0000","last_peered":"2024-04-28T13:08:18.710924+0000","last_clean":"2024-04-28T13:08:18.710924+0000","last_became_active":"2024-04-28T13:08:18.707839+0000","last_became_peered":"2024-04-28T13:08:18.707839+0000","last_unstale":"2024-04-28T13:08:18.710924+0000","last_undegraded":"2024-04-28T13:08:18.710924+0000","last_fullsized":"2024-04-28T13:08:18.710924+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:48:27.578962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.708559+0000","last_change":"2024-04-28T13:08:18.705249+0000","last_active":"2024-04-28T13:08:18.708559+0000","last_peered":"2024-04-28T13:08:18.708559+0000","last_clean":"2024-04-28T13:08:18.708559+0000","last_became_active":"2024-04-28T13:08:18.704946+0000","last_became_peered":"2024-04-28T13:08:18.704946+0000","last_unstale":"2024-04-28T13:08:18.708559+0000","last_undegraded":"2024-04-28T13:08:18.708559+0000","last_fullsized":"2024-04-28T13:08:18.708559+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:38:45.701556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.701070+0000","last_change":"2024-04-28T13:08:18.693872+0000","last_active":"2024-04-28T13:08:18.701070+0000","last_peered":"2024-04-28T13:08:18.701070+0000","last_clean":"2024-04-28T13:08:18.701070+0000","last_became_active":"2024-04-28T13:08:18.693612+0000","last_became_peered":"2024-04-28T13:08:18.693612+0000","last_unstale":"2024-04-28T13:08:18.701070+0000","last_undegraded":"2024-04-28T13:08:18.701070+0000","last_fullsized":"2024-04-28T13:08:18.701070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:48:27.578962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.708812+0000","last_change":"2024-04-28T13:08:18.704541+0000","last_active":"2024-04-28T13:08:18.708812+0000","last_peered":"2024-04-28T13:08:18.708812+0000","last_clean":"2024-04-28T13:08:18.708812+0000","last_became_active":"2024-04-28T13:08:18.704191+0000","last_became_peered":"2024-04-28T13:08:18.704191+0000","last_unstale":"2024-04-28T13:08:18.708812+0000","last_undegraded":"2024-04-28T13:08:18.708812+0000","last_fullsized":"2024-04-28T13:08:18.708812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:24:29.898441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.705646+0000","last_change":"2024-04-28T13:08:18.703867+0000","last_active":"2024-04-28T13:08:18.705646+0000","last_peered":"2024-04-28T13:08:18.705646+0000","last_clean":"2024-04-28T13:08:18.705646+0000","last_became_active":"2024-04-28T13:08:18.703590+0000","last_became_peered":"2024-04-28T13:08:18.703590+0000","last_unstale":"2024-04-28T13:08:18.705646+0000","last_undegraded":"2024-04-28T13:08:18.705646+0000","last_fullsized":"2024-04-28T13:08:18.705646+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:43:35.816012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.702641+0000","last_change":"2024-04-28T13:08:18.701428+0000","last_active":"2024-04-28T13:08:18.702641+0000","last_peered":"2024-04-28T13:08:18.702641+0000","last_clean":"2024-04-28T13:08:18.702641+0000","last_became_active":"2024-04-28T13:08:18.701098+0000","last_became_peered":"2024-04-28T13:08:18.701098+0000","last_unstale":"2024-04-28T13:08:18.702641+0000","last_undegraded":"2024-04-28T13:08:18.702641+0000","last_fullsized":"2024-04-28T13:08:18.702641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:16:09.096775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.706853+0000","last_change":"2024-04-28T13:08:18.701860+0000","last_active":"2024-04-28T13:08:18.706853+0000","last_peered":"2024-04-28T13:08:18.706853+0000","last_clean":"2024-04-28T13:08:18.706853+0000","last_became_active":"2024-04-28T13:08:18.701560+0000","last_became_peered":"2024-04-28T13:08:18.701560+0000","last_unstale":"2024-04-28T13:08:18.706853+0000","last_undegraded":"2024-04-28T13:08:18.706853+0000","last_fullsized":"2024-04-28T13:08:18.706853+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T13:58:44.311012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.706045+0000","last_change":"2024-04-28T13:08:18.703179+0000","last_active":"2024-04-28T13:08:18.706045+0000","last_peered":"2024-04-28T13:08:18.706045+0000","last_clean":"2024-04-28T13:08:18.706045+0000","last_became_active":"2024-04-28T13:08:18.702861+0000","last_became_peered":"2024-04-28T13:08:18.702861+0000","last_unstale":"2024-04-28T13:08:18.706045+0000","last_undegraded":"2024-04-28T13:08:18.706045+0000","last_fullsized":"2024-04-28T13:08:18.706045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:46:20.181490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.712587+0000","last_change":"2024-04-28T13:08:18.706536+0000","last_active":"2024-04-28T13:08:18.712587+0000","last_peered":"2024-04-28T13:08:18.712587+0000","last_clean":"2024-04-28T13:08:18.712587+0000","last_became_active":"2024-04-28T13:08:18.706257+0000","last_became_peered":"2024-04-28T13:08:18.706257+0000","last_unstale":"2024-04-28T13:08:18.712587+0000","last_undegraded":"2024-04-28T13:08:18.712587+0000","last_fullsized":"2024-04-28T13:08:18.712587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:55:00.537074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.709370+0000","last_change":"2024-04-28T13:08:18.690666+0000","last_active":"2024-04-28T13:08:18.709370+0000","last_peered":"2024-04-28T13:08:18.709370+0000","last_clean":"2024-04-28T13:08:18.709370+0000","last_became_active":"2024-04-28T13:08:18.690283+0000","last_became_peered":"2024-04-28T13:08:18.690283+0000","last_unstale":"2024-04-28T13:08:18.709370+0000","last_undegraded":"2024-04-28T13:08:18.709370+0000","last_fullsized":"2024-04-28T13:08:18.709370+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:04:12.569245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.709585+0000","last_change":"2024-04-28T13:08:18.697664+0000","last_active":"2024-04-28T13:08:18.709585+0000","last_peered":"2024-04-28T13:08:18.709585+0000","last_clean":"2024-04-28T13:08:18.709585+0000","last_became_active":"2024-04-28T13:08:18.697386+0000","last_became_peered":"2024-04-28T13:08:18.697386+0000","last_unstale":"2024-04-28T13:08:18.709585+0000","last_undegraded":"2024-04-28T13:08:18.709585+0000","last_fullsized":"2024-04-28T13:08:18.709585+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:47:41.611958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.701257+0000","last_change":"2024-04-28T13:08:18.700105+0000","last_active":"2024-04-28T13:08:18.701257+0000","last_peered":"2024-04-28T13:08:18.701257+0000","last_clean":"2024-04-28T13:08:18.701257+0000","last_became_active":"2024-04-28T13:08:18.699831+0000","last_became_peered":"2024-04-28T13:08:18.699831+0000","last_unstale":"2024-04-28T13:08:18.701257+0000","last_undegraded":"2024-04-28T13:08:18.701257+0000","last_fullsized":"2024-04-28T13:08:18.701257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:17:51.395365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.708012+0000","last_change":"2024-04-28T13:08:18.703837+0000","last_active":"2024-04-28T13:08:18.708012+0000","last_peered":"2024-04-28T13:08:18.708012+0000","last_clean":"2024-04-28T13:08:18.708012+0000","last_became_active":"2024-04-28T13:08:18.703543+0000","last_became_peered":"2024-04-28T13:08:18.703543+0000","last_unstale":"2024-04-28T13:08:18.708012+0000","last_undegraded":"2024-04-28T13:08:18.708012+0000","last_fullsized":"2024-04-28T13:08:18.708012+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:38:31.472938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.705702+0000","last_change":"2024-04-28T13:08:18.701718+0000","last_active":"2024-04-28T13:08:18.705702+0000","last_peered":"2024-04-28T13:08:18.705702+0000","last_clean":"2024-04-28T13:08:18.705702+0000","last_became_active":"2024-04-28T13:08:18.701477+0000","last_became_peered":"2024-04-28T13:08:18.701477+0000","last_unstale":"2024-04-28T13:08:18.705702+0000","last_undegraded":"2024-04-28T13:08:18.705702+0000","last_fullsized":"2024-04-28T13:08:18.705702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:17:51.395365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.711450+0000","last_change":"2024-04-28T13:08:18.706595+0000","last_active":"2024-04-28T13:08:18.711450+0000","last_peered":"2024-04-28T13:08:18.711450+0000","last_clean":"2024-04-28T13:08:18.711450+0000","last_became_active":"2024-04-28T13:08:18.703299+0000","last_became_peered":"2024-04-28T13:08:18.703299+0000","last_unstale":"2024-04-28T13:08:18.711450+0000","last_undegraded":"2024-04-28T13:08:18.711450+0000","last_fullsized":"2024-04-28T13:08:18.711450+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:01:47.532571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.717465+0000","last_change":"2024-04-28T13:08:18.715540+0000","last_active":"2024-04-28T13:08:18.717465+0000","last_peered":"2024-04-28T13:08:18.717465+0000","last_clean":"2024-04-28T13:08:18.717465+0000","last_became_active":"2024-04-28T13:08:18.715289+0000","last_became_peered":"2024-04-28T13:08:18.715289+0000","last_unstale":"2024-04-28T13:08:18.717465+0000","last_undegraded":"2024-04-28T13:08:18.717465+0000","last_fullsized":"2024-04-28T13:08:18.717465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:10:26.243303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.708265+0000","last_change":"2024-04-28T13:08:18.703913+0000","last_active":"2024-04-28T13:08:18.708265+0000","last_peered":"2024-04-28T13:08:18.708265+0000","last_clean":"2024-04-28T13:08:18.708265+0000","last_became_active":"2024-04-28T13:08:18.703629+0000","last_became_peered":"2024-04-28T13:08:18.703629+0000","last_unstale":"2024-04-28T13:08:18.708265+0000","last_undegraded":"2024-04-28T13:08:18.708265+0000","last_fullsized":"2024-04-28T13:08:18.708265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:43:35.816012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.710138+0000","last_change":"2024-04-28T13:08:18.702391+0000","last_active":"2024-04-28T13:08:18.710138+0000","last_peered":"2024-04-28T13:08:18.710138+0000","last_clean":"2024-04-28T13:08:18.710138+0000","last_became_active":"2024-04-28T13:08:18.702051+0000","last_became_peered":"2024-04-28T13:08:18.702051+0000","last_unstale":"2024-04-28T13:08:18.710138+0000","last_undegraded":"2024-04-28T13:08:18.710138+0000","last_fullsized":"2024-04-28T13:08:18.710138+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:23:58.662977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.705601+0000","last_change":"2024-04-28T13:08:18.703436+0000","last_active":"2024-04-28T13:08:18.705601+0000","last_peered":"2024-04-28T13:08:18.705601+0000","last_clean":"2024-04-28T13:08:18.705601+0000","last_became_active":"2024-04-28T13:08:18.703144+0000","last_became_peered":"2024-04-28T13:08:18.703144+0000","last_unstale":"2024-04-28T13:08:18.705601+0000","last_undegraded":"2024-04-28T13:08:18.705601+0000","last_fullsized":"2024-04-28T13:08:18.705601+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:38:31.472938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.703907+0000","last_change":"2024-04-28T13:08:18.702251+0000","last_active":"2024-04-28T13:08:18.703907+0000","last_peered":"2024-04-28T13:08:18.703907+0000","last_clean":"2024-04-28T13:08:18.703907+0000","last_became_active":"2024-04-28T13:08:18.701992+0000","last_became_peered":"2024-04-28T13:08:18.701992+0000","last_unstale":"2024-04-28T13:08:18.703907+0000","last_undegraded":"2024-04-28T13:08:18.703907+0000","last_fullsized":"2024-04-28T13:08:18.703907+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:04:12.569245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.712806+0000","last_change":"2024-04-28T13:08:18.711193+0000","last_active":"2024-04-28T13:08:18.712806+0000","last_peered":"2024-04-28T13:08:18.712806+0000","last_clean":"2024-04-28T13:08:18.712806+0000","last_became_active":"2024-04-28T13:08:18.710895+0000","last_became_peered":"2024-04-28T13:08:18.710895+0000","last_unstale":"2024-04-28T13:08:18.712806+0000","last_undegraded":"2024-04-28T13:08:18.712806+0000","last_fullsized":"2024-04-28T13:08:18.712806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:10:26.243303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.703590+0000","last_change":"2024-04-28T13:08:18.701234+0000","last_active":"2024-04-28T13:08:18.703590+0000","last_peered":"2024-04-28T13:08:18.703590+0000","last_clean":"2024-04-28T13:08:18.703590+0000","last_became_active":"2024-04-28T13:08:18.700799+0000","last_became_peered":"2024-04-28T13:08:18.700799+0000","last_unstale":"2024-04-28T13:08:18.703590+0000","last_undegraded":"2024-04-28T13:08:18.703590+0000","last_fullsized":"2024-04-28T13:08:18.703590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:16:09.096775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.712311+0000","last_change":"2024-04-28T13:08:17.699555+0000","last_active":"2024-04-28T13:08:18.712311+0000","last_peered":"2024-04-28T13:08:18.712311+0000","last_clean":"2024-04-28T13:08:18.712311+0000","last_became_active":"2024-04-28T13:08:17.699235+0000","last_became_peered":"2024-04-28T13:08:17.699235+0000","last_unstale":"2024-04-28T13:08:18.712311+0000","last_undegraded":"2024-04-28T13:08:18.712311+0000","last_fullsized":"2024-04-28T13:08:18.712311+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:25:07.327590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.712834+0000","last_change":"2024-04-28T13:08:18.710465+0000","last_active":"2024-04-28T13:08:18.712834+0000","last_peered":"2024-04-28T13:08:18.712834+0000","last_clean":"2024-04-28T13:08:18.712834+0000","last_became_active":"2024-04-28T13:08:18.710175+0000","last_became_peered":"2024-04-28T13:08:18.710175+0000","last_unstale":"2024-04-28T13:08:18.712834+0000","last_undegraded":"2024-04-28T13:08:18.712834+0000","last_fullsized":"2024-04-28T13:08:18.712834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:23:58.662977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.716156+0000","last_change":"2024-04-28T13:08:17.702269+0000","last_active":"2024-04-28T13:08:18.716156+0000","last_peered":"2024-04-28T13:08:18.716156+0000","last_clean":"2024-04-28T13:08:18.716156+0000","last_became_active":"2024-04-28T13:08:17.702000+0000","last_became_peered":"2024-04-28T13:08:17.702000+0000","last_unstale":"2024-04-28T13:08:18.716156+0000","last_undegraded":"2024-04-28T13:08:18.716156+0000","last_fullsized":"2024-04-28T13:08:18.716156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:47:40.609566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.710383+0000","last_change":"2024-04-28T13:08:18.699088+0000","last_active":"2024-04-28T13:08:18.710383+0000","last_peered":"2024-04-28T13:08:18.710383+0000","last_clean":"2024-04-28T13:08:18.710383+0000","last_became_active":"2024-04-28T13:08:18.697601+0000","last_became_peered":"2024-04-28T13:08:18.697601+0000","last_unstale":"2024-04-28T13:08:18.710383+0000","last_undegraded":"2024-04-28T13:08:18.710383+0000","last_fullsized":"2024-04-28T13:08:18.710383+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:02:50.132656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.717385+0000","last_change":"2024-04-28T13:08:17.705190+0000","last_active":"2024-04-28T13:08:18.717385+0000","last_peered":"2024-04-28T13:08:18.717385+0000","last_clean":"2024-04-28T13:08:18.717385+0000","last_became_active":"2024-04-28T13:08:17.704874+0000","last_became_peered":"2024-04-28T13:08:17.704874+0000","last_unstale":"2024-04-28T13:08:18.717385+0000","last_undegraded":"2024-04-28T13:08:18.717385+0000","last_fullsized":"2024-04-28T13:08:18.717385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:24:28.896049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.717174+0000","last_change":"2024-04-28T13:08:18.712541+0000","last_active":"2024-04-28T13:08:18.717174+0000","last_peered":"2024-04-28T13:08:18.717174+0000","last_clean":"2024-04-28T13:08:18.717174+0000","last_became_active":"2024-04-28T13:08:18.712070+0000","last_became_peered":"2024-04-28T13:08:18.712070+0000","last_unstale":"2024-04-28T13:08:18.717174+0000","last_undegraded":"2024-04-28T13:08:18.717174+0000","last_fullsized":"2024-04-28T13:08:18.717174+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:48:27.578962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.717693+0000","last_change":"2024-04-28T13:08:17.704632+0000","last_active":"2024-04-28T13:08:18.717693+0000","last_peered":"2024-04-28T13:08:18.717693+0000","last_clean":"2024-04-28T13:08:18.717693+0000","last_became_active":"2024-04-28T13:08:17.704330+0000","last_became_peered":"2024-04-28T13:08:17.704330+0000","last_unstale":"2024-04-28T13:08:18.717693+0000","last_undegraded":"2024-04-28T13:08:18.717693+0000","last_fullsized":"2024-04-28T13:08:18.717693+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:40:01.572227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.712405+0000","last_change":"2024-04-28T13:08:18.711267+0000","last_active":"2024-04-28T13:08:18.712405+0000","last_peered":"2024-04-28T13:08:18.712405+0000","last_clean":"2024-04-28T13:08:18.712405+0000","last_became_active":"2024-04-28T13:08:18.710970+0000","last_became_peered":"2024-04-28T13:08:18.710970+0000","last_unstale":"2024-04-28T13:08:18.712405+0000","last_undegraded":"2024-04-28T13:08:18.712405+0000","last_fullsized":"2024-04-28T13:08:18.712405+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:47:10.449842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.715047+0000","last_change":"2024-04-28T13:08:17.700508+0000","last_active":"2024-04-28T13:08:18.715047+0000","last_peered":"2024-04-28T13:08:18.715047+0000","last_clean":"2024-04-28T13:08:18.715047+0000","last_became_active":"2024-04-28T13:08:17.700224+0000","last_became_peered":"2024-04-28T13:08:17.700224+0000","last_unstale":"2024-04-28T13:08:18.715047+0000","last_undegraded":"2024-04-28T13:08:18.715047+0000","last_fullsized":"2024-04-28T13:08:18.715047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:30:22.763598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.707987+0000","last_change":"2024-04-28T13:08:18.703429+0000","last_active":"2024-04-28T13:08:18.707987+0000","last_peered":"2024-04-28T13:08:18.707987+0000","last_clean":"2024-04-28T13:08:18.707987+0000","last_became_active":"2024-04-28T13:08:18.703078+0000","last_became_peered":"2024-04-28T13:08:18.703078+0000","last_unstale":"2024-04-28T13:08:18.707987+0000","last_undegraded":"2024-04-28T13:08:18.707987+0000","last_fullsized":"2024-04-28T13:08:18.707987+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:16:09.096775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.715166+0000","last_change":"2024-04-28T13:08:17.696426+0000","last_active":"2024-04-28T13:08:18.715166+0000","last_peered":"2024-04-28T13:08:18.715166+0000","last_clean":"2024-04-28T13:08:18.715166+0000","last_became_active":"2024-04-28T13:08:17.696111+0000","last_became_peered":"2024-04-28T13:08:17.696111+0000","last_unstale":"2024-04-28T13:08:18.715166+0000","last_undegraded":"2024-04-28T13:08:18.715166+0000","last_fullsized":"2024-04-28T13:08:18.715166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:43:47.063284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.710147+0000","last_change":"2024-04-28T13:08:18.705676+0000","last_active":"2024-04-28T13:08:18.710147+0000","last_peered":"2024-04-28T13:08:18.710147+0000","last_clean":"2024-04-28T13:08:18.710147+0000","last_became_active":"2024-04-28T13:08:18.705390+0000","last_became_peered":"2024-04-28T13:08:18.705390+0000","last_unstale":"2024-04-28T13:08:18.710147+0000","last_undegraded":"2024-04-28T13:08:18.710147+0000","last_fullsized":"2024-04-28T13:08:18.710147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:44:19.552362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.693387+0000","last_change":"2024-04-28T13:08:17.697729+0000","last_active":"2024-04-28T13:08:18.693387+0000","last_peered":"2024-04-28T13:08:18.693387+0000","last_clean":"2024-04-28T13:08:18.693387+0000","last_became_active":"2024-04-28T13:08:17.697227+0000","last_became_peered":"2024-04-28T13:08:17.697227+0000","last_unstale":"2024-04-28T13:08:18.693387+0000","last_undegraded":"2024-04-28T13:08:18.693387+0000","last_fullsized":"2024-04-28T13:08:18.693387+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:43:34.813620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.714645+0000","last_change":"2024-04-28T13:08:18.709628+0000","last_active":"2024-04-28T13:08:18.714645+0000","last_peered":"2024-04-28T13:08:18.714645+0000","last_clean":"2024-04-28T13:08:18.714645+0000","last_became_active":"2024-04-28T13:08:18.709341+0000","last_became_peered":"2024-04-28T13:08:18.709341+0000","last_unstale":"2024-04-28T13:08:18.714645+0000","last_undegraded":"2024-04-28T13:08:18.714645+0000","last_fullsized":"2024-04-28T13:08:18.714645+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:16:09.096775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.687583+0000","last_change":"2024-04-28T13:08:17.697697+0000","last_active":"2024-04-28T13:08:18.687583+0000","last_peered":"2024-04-28T13:08:18.687583+0000","last_clean":"2024-04-28T13:08:18.687583+0000","last_became_active":"2024-04-28T13:08:17.697426+0000","last_became_peered":"2024-04-28T13:08:17.697426+0000","last_unstale":"2024-04-28T13:08:18.687583+0000","last_undegraded":"2024-04-28T13:08:18.687583+0000","last_fullsized":"2024-04-28T13:08:18.687583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T13:48:14.457717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.711756+0000","last_change":"2024-04-28T13:08:18.708833+0000","last_active":"2024-04-28T13:08:18.711756+0000","last_peered":"2024-04-28T13:08:18.711756+0000","last_clean":"2024-04-28T13:08:18.711756+0000","last_became_active":"2024-04-28T13:08:18.708538+0000","last_became_peered":"2024-04-28T13:08:18.708538+0000","last_unstale":"2024-04-28T13:08:18.711756+0000","last_undegraded":"2024-04-28T13:08:18.711756+0000","last_fullsized":"2024-04-28T13:08:18.711756+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:10:26.243303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.691906+0000","last_change":"2024-04-28T13:08:17.703849+0000","last_active":"2024-04-28T13:08:18.691906+0000","last_peered":"2024-04-28T13:08:18.691906+0000","last_clean":"2024-04-28T13:08:18.691906+0000","last_became_active":"2024-04-28T13:08:17.703448+0000","last_became_peered":"2024-04-28T13:08:17.703448+0000","last_unstale":"2024-04-28T13:08:18.691906+0000","last_undegraded":"2024-04-28T13:08:18.691906+0000","last_fullsized":"2024-04-28T13:08:18.691906+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:17:50.392973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.705511+0000","last_change":"2024-04-28T13:08:18.702903+0000","last_active":"2024-04-28T13:08:18.705511+0000","last_peered":"2024-04-28T13:08:18.705511+0000","last_clean":"2024-04-28T13:08:18.705511+0000","last_became_active":"2024-04-28T13:08:18.701681+0000","last_became_peered":"2024-04-28T13:08:18.701681+0000","last_unstale":"2024-04-28T13:08:18.705511+0000","last_undegraded":"2024-04-28T13:08:18.705511+0000","last_fullsized":"2024-04-28T13:08:18.705511+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:09:40.886228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.686376+0000","last_change":"2024-04-28T13:08:17.700440+0000","last_active":"2024-04-28T13:08:18.686376+0000","last_peered":"2024-04-28T13:08:18.686376+0000","last_clean":"2024-04-28T13:08:18.686376+0000","last_became_active":"2024-04-28T13:08:17.700161+0000","last_became_peered":"2024-04-28T13:08:17.700161+0000","last_unstale":"2024-04-28T13:08:18.686376+0000","last_undegraded":"2024-04-28T13:08:18.686376+0000","last_fullsized":"2024-04-28T13:08:18.686376+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:02:49.130264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.711023+0000","last_change":"2024-04-28T13:08:18.703636+0000","last_active":"2024-04-28T13:08:18.711023+0000","last_peered":"2024-04-28T13:08:18.711023+0000","last_clean":"2024-04-28T13:08:18.711023+0000","last_became_active":"2024-04-28T13:08:18.703355+0000","last_became_peered":"2024-04-28T13:08:18.703355+0000","last_unstale":"2024-04-28T13:08:18.711023+0000","last_undegraded":"2024-04-28T13:08:18.711023+0000","last_fullsized":"2024-04-28T13:08:18.711023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:52:17.759352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.716332+0000","last_change":"2024-04-28T13:08:17.702533+0000","last_active":"2024-04-28T13:08:18.716332+0000","last_peered":"2024-04-28T13:08:18.716332+0000","last_clean":"2024-04-28T13:08:18.716332+0000","last_became_active":"2024-04-28T13:08:17.702055+0000","last_became_peered":"2024-04-28T13:08:17.702055+0000","last_unstale":"2024-04-28T13:08:18.716332+0000","last_undegraded":"2024-04-28T13:08:18.716332+0000","last_fullsized":"2024-04-28T13:08:18.716332+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:44:18.549970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.714178+0000","last_change":"2024-04-28T13:08:18.712330+0000","last_active":"2024-04-28T13:08:18.714178+0000","last_peered":"2024-04-28T13:08:18.714178+0000","last_clean":"2024-04-28T13:08:18.714178+0000","last_became_active":"2024-04-28T13:08:18.712052+0000","last_became_peered":"2024-04-28T13:08:18.712052+0000","last_unstale":"2024-04-28T13:08:18.714178+0000","last_undegraded":"2024-04-28T13:08:18.714178+0000","last_fullsized":"2024-04-28T13:08:18.714178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T13:58:44.311012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.719559+0000","last_change":"2024-04-28T13:08:17.699535+0000","last_active":"2024-04-28T13:08:18.719559+0000","last_peered":"2024-04-28T13:08:18.719559+0000","last_clean":"2024-04-28T13:08:18.719559+0000","last_became_active":"2024-04-28T13:08:17.699265+0000","last_became_peered":"2024-04-28T13:08:17.699265+0000","last_unstale":"2024-04-28T13:08:18.719559+0000","last_undegraded":"2024-04-28T13:08:18.719559+0000","last_fullsized":"2024-04-28T13:08:18.719559+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:23:57.660585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.714706+0000","last_change":"2024-04-28T13:08:18.710292+0000","last_active":"2024-04-28T13:08:18.714706+0000","last_peered":"2024-04-28T13:08:18.714706+0000","last_clean":"2024-04-28T13:08:18.714706+0000","last_became_active":"2024-04-28T13:08:18.710034+0000","last_became_peered":"2024-04-28T13:08:18.710034+0000","last_unstale":"2024-04-28T13:08:18.714706+0000","last_undegraded":"2024-04-28T13:08:18.714706+0000","last_fullsized":"2024-04-28T13:08:18.714706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:38:31.472938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.714983+0000","last_change":"2024-04-28T13:08:17.698422+0000","last_active":"2024-04-28T13:08:18.714983+0000","last_peered":"2024-04-28T13:08:18.714983+0000","last_clean":"2024-04-28T13:08:18.714983+0000","last_became_active":"2024-04-28T13:08:17.698154+0000","last_became_peered":"2024-04-28T13:08:17.698154+0000","last_unstale":"2024-04-28T13:08:18.714983+0000","last_undegraded":"2024-04-28T13:08:18.714983+0000","last_fullsized":"2024-04-28T13:08:18.714983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:06:36.930120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.706245+0000","last_change":"2024-04-28T13:08:18.698107+0000","last_active":"2024-04-28T13:08:18.706245+0000","last_peered":"2024-04-28T13:08:18.706245+0000","last_clean":"2024-04-28T13:08:18.706245+0000","last_became_active":"2024-04-28T13:08:18.697851+0000","last_became_peered":"2024-04-28T13:08:18.697851+0000","last_unstale":"2024-04-28T13:08:18.706245+0000","last_undegraded":"2024-04-28T13:08:18.706245+0000","last_fullsized":"2024-04-28T13:08:18.706245+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:10:26.243303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.690866+0000","last_change":"2024-04-28T13:08:17.702703+0000","last_active":"2024-04-28T13:08:18.690866+0000","last_peered":"2024-04-28T13:08:18.690866+0000","last_clean":"2024-04-28T13:08:18.690866+0000","last_became_active":"2024-04-28T13:08:17.702428+0000","last_became_peered":"2024-04-28T13:08:17.702428+0000","last_unstale":"2024-04-28T13:08:18.690866+0000","last_undegraded":"2024-04-28T13:08:18.690866+0000","last_fullsized":"2024-04-28T13:08:18.690866+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:04:11.566854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.712827+0000","last_change":"2024-04-28T13:08:18.711322+0000","last_active":"2024-04-28T13:08:18.712827+0000","last_peered":"2024-04-28T13:08:18.712827+0000","last_clean":"2024-04-28T13:08:18.712827+0000","last_became_active":"2024-04-28T13:08:18.710922+0000","last_became_peered":"2024-04-28T13:08:18.710922+0000","last_unstale":"2024-04-28T13:08:18.712827+0000","last_undegraded":"2024-04-28T13:08:18.712827+0000","last_fullsized":"2024-04-28T13:08:18.712827+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T13:58:44.311012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.693243+0000","last_change":"2024-04-28T13:08:17.702510+0000","last_active":"2024-04-28T13:08:18.693243+0000","last_peered":"2024-04-28T13:08:18.693243+0000","last_clean":"2024-04-28T13:08:18.693243+0000","last_became_active":"2024-04-28T13:08:17.702213+0000","last_became_peered":"2024-04-28T13:08:17.702213+0000","last_unstale":"2024-04-28T13:08:18.693243+0000","last_undegraded":"2024-04-28T13:08:18.693243+0000","last_fullsized":"2024-04-28T13:08:18.693243+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:38:30.470547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.712796+0000","last_change":"2024-04-28T13:08:18.710508+0000","last_active":"2024-04-28T13:08:18.712796+0000","last_peered":"2024-04-28T13:08:18.712796+0000","last_clean":"2024-04-28T13:08:18.712796+0000","last_became_active":"2024-04-28T13:08:18.710234+0000","last_became_peered":"2024-04-28T13:08:18.710234+0000","last_unstale":"2024-04-28T13:08:18.712796+0000","last_undegraded":"2024-04-28T13:08:18.712796+0000","last_fullsized":"2024-04-28T13:08:18.712796+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:17:51.395365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.718026+0000","last_change":"2024-04-28T13:08:17.695229+0000","last_active":"2024-04-28T13:08:18.718026+0000","last_peered":"2024-04-28T13:08:18.718026+0000","last_clean":"2024-04-28T13:08:18.718026+0000","last_became_active":"2024-04-28T13:08:17.694764+0000","last_became_peered":"2024-04-28T13:08:17.694764+0000","last_unstale":"2024-04-28T13:08:18.718026+0000","last_undegraded":"2024-04-28T13:08:18.718026+0000","last_fullsized":"2024-04-28T13:08:18.718026+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:16:08.094383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.710226+0000","last_change":"2024-04-28T13:08:18.706061+0000","last_active":"2024-04-28T13:08:18.710226+0000","last_peered":"2024-04-28T13:08:18.710226+0000","last_clean":"2024-04-28T13:08:18.710226+0000","last_became_active":"2024-04-28T13:08:18.705581+0000","last_became_peered":"2024-04-28T13:08:18.705581+0000","last_unstale":"2024-04-28T13:08:18.710226+0000","last_undegraded":"2024-04-28T13:08:18.710226+0000","last_fullsized":"2024-04-28T13:08:18.710226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:16:09.096775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.711593+0000","last_change":"2024-04-28T13:08:17.701639+0000","last_active":"2024-04-28T13:08:18.711593+0000","last_peered":"2024-04-28T13:08:18.711593+0000","last_clean":"2024-04-28T13:08:18.711593+0000","last_became_active":"2024-04-28T13:08:17.701393+0000","last_became_peered":"2024-04-28T13:08:17.701393+0000","last_unstale":"2024-04-28T13:08:18.711593+0000","last_undegraded":"2024-04-28T13:08:18.711593+0000","last_fullsized":"2024-04-28T13:08:18.711593+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:02:49.130264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.715545+0000","last_change":"2024-04-28T13:08:18.714007+0000","last_active":"2024-04-28T13:08:18.715545+0000","last_peered":"2024-04-28T13:08:18.715545+0000","last_clean":"2024-04-28T13:08:18.715545+0000","last_became_active":"2024-04-28T13:08:18.713651+0000","last_became_peered":"2024-04-28T13:08:18.713651+0000","last_unstale":"2024-04-28T13:08:18.715545+0000","last_undegraded":"2024-04-28T13:08:18.715545+0000","last_fullsized":"2024-04-28T13:08:18.715545+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:46:20.181490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.714937+0000","last_change":"2024-04-28T13:08:17.698550+0000","last_active":"2024-04-28T13:08:18.714937+0000","last_peered":"2024-04-28T13:08:18.714937+0000","last_clean":"2024-04-28T13:08:18.714937+0000","last_became_active":"2024-04-28T13:08:17.698278+0000","last_became_peered":"2024-04-28T13:08:17.698278+0000","last_unstale":"2024-04-28T13:08:18.714937+0000","last_undegraded":"2024-04-28T13:08:18.714937+0000","last_fullsized":"2024-04-28T13:08:18.714937+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:20:08.827919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.714939+0000","last_change":"2024-04-28T13:08:18.710814+0000","last_active":"2024-04-28T13:08:18.714939+0000","last_peered":"2024-04-28T13:08:18.714939+0000","last_clean":"2024-04-28T13:08:18.714939+0000","last_became_active":"2024-04-28T13:08:18.710494+0000","last_became_peered":"2024-04-28T13:08:18.710494+0000","last_unstale":"2024-04-28T13:08:18.714939+0000","last_undegraded":"2024-04-28T13:08:18.714939+0000","last_fullsized":"2024-04-28T13:08:18.714939+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:43:35.816012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.716927+0000","last_change":"2024-04-28T13:08:17.699664+0000","last_active":"2024-04-28T13:08:18.716927+0000","last_peered":"2024-04-28T13:08:18.716927+0000","last_clean":"2024-04-28T13:08:18.716927+0000","last_became_active":"2024-04-28T13:08:17.699358+0000","last_became_peered":"2024-04-28T13:08:17.699358+0000","last_unstale":"2024-04-28T13:08:18.716927+0000","last_undegraded":"2024-04-28T13:08:18.716927+0000","last_fullsized":"2024-04-28T13:08:18.716927+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:25:07.327590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.702588+0000","last_change":"2024-04-28T13:08:18.700629+0000","last_active":"2024-04-28T13:08:18.702588+0000","last_peered":"2024-04-28T13:08:18.702588+0000","last_clean":"2024-04-28T13:08:18.702588+0000","last_became_active":"2024-04-28T13:08:18.700357+0000","last_became_peered":"2024-04-28T13:08:18.700357+0000","last_unstale":"2024-04-28T13:08:18.702588+0000","last_undegraded":"2024-04-28T13:08:18.702588+0000","last_fullsized":"2024-04-28T13:08:18.702588+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T13:48:15.460108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.688084+0000","last_change":"2024-04-28T13:08:17.697965+0000","last_active":"2024-04-28T13:08:18.688084+0000","last_peered":"2024-04-28T13:08:18.688084+0000","last_clean":"2024-04-28T13:08:18.688084+0000","last_became_active":"2024-04-28T13:08:17.697679+0000","last_became_peered":"2024-04-28T13:08:17.697679+0000","last_unstale":"2024-04-28T13:08:18.688084+0000","last_undegraded":"2024-04-28T13:08:18.688084+0000","last_fullsized":"2024-04-28T13:08:18.688084+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:54:59.534682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.716742+0000","last_change":"2024-04-28T13:08:18.714211+0000","last_active":"2024-04-28T13:08:18.716742+0000","last_peered":"2024-04-28T13:08:18.716742+0000","last_clean":"2024-04-28T13:08:18.716742+0000","last_became_active":"2024-04-28T13:08:18.713848+0000","last_became_peered":"2024-04-28T13:08:18.713848+0000","last_unstale":"2024-04-28T13:08:18.716742+0000","last_undegraded":"2024-04-28T13:08:18.716742+0000","last_fullsized":"2024-04-28T13:08:18.716742+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:30:23.765989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.717910+0000","last_change":"2024-04-28T13:08:17.704239+0000","last_active":"2024-04-28T13:08:18.717910+0000","last_peered":"2024-04-28T13:08:18.717910+0000","last_clean":"2024-04-28T13:08:18.717910+0000","last_became_active":"2024-04-28T13:08:17.703962+0000","last_became_peered":"2024-04-28T13:08:17.703962+0000","last_unstale":"2024-04-28T13:08:18.717910+0000","last_undegraded":"2024-04-28T13:08:18.717910+0000","last_fullsized":"2024-04-28T13:08:18.717910+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:06:36.930120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.700793+0000","last_change":"2024-04-28T13:08:18.698725+0000","last_active":"2024-04-28T13:08:18.700793+0000","last_peered":"2024-04-28T13:08:18.700793+0000","last_clean":"2024-04-28T13:08:18.700793+0000","last_became_active":"2024-04-28T13:08:18.698465+0000","last_became_peered":"2024-04-28T13:08:18.698465+0000","last_unstale":"2024-04-28T13:08:18.700793+0000","last_undegraded":"2024-04-28T13:08:18.700793+0000","last_fullsized":"2024-04-28T13:08:18.700793+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:06:13.585618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.696709+0000","last_change":"2024-04-28T13:08:17.705048+0000","last_active":"2024-04-28T13:08:18.696709+0000","last_peered":"2024-04-28T13:08:18.696709+0000","last_clean":"2024-04-28T13:08:18.696709+0000","last_became_active":"2024-04-28T13:08:17.704737+0000","last_became_peered":"2024-04-28T13:08:17.704737+0000","last_unstale":"2024-04-28T13:08:18.696709+0000","last_undegraded":"2024-04-28T13:08:18.696709+0000","last_fullsized":"2024-04-28T13:08:18.696709+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:06:36.930120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.700778+0000","last_change":"2024-04-28T13:08:18.698156+0000","last_active":"2024-04-28T13:08:18.700778+0000","last_peered":"2024-04-28T13:08:18.700778+0000","last_clean":"2024-04-28T13:08:18.700778+0000","last_became_active":"2024-04-28T13:08:18.697901+0000","last_became_peered":"2024-04-28T13:08:18.697901+0000","last_unstale":"2024-04-28T13:08:18.700778+0000","last_undegraded":"2024-04-28T13:08:18.700778+0000","last_fullsized":"2024-04-28T13:08:18.700778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:05:17.164607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.688009+0000","last_change":"2024-04-28T13:08:17.703198+0000","last_active":"2024-04-28T13:08:18.688009+0000","last_peered":"2024-04-28T13:08:18.688009+0000","last_clean":"2024-04-28T13:08:18.688009+0000","last_became_active":"2024-04-28T13:08:17.702950+0000","last_became_peered":"2024-04-28T13:08:17.702950+0000","last_unstale":"2024-04-28T13:08:18.688009+0000","last_undegraded":"2024-04-28T13:08:18.688009+0000","last_fullsized":"2024-04-28T13:08:18.688009+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:38:44.699164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.702568+0000","last_change":"2024-04-28T13:08:18.701083+0000","last_active":"2024-04-28T13:08:18.702568+0000","last_peered":"2024-04-28T13:08:18.702568+0000","last_clean":"2024-04-28T13:08:18.702568+0000","last_became_active":"2024-04-28T13:08:18.700788+0000","last_became_peered":"2024-04-28T13:08:18.700788+0000","last_unstale":"2024-04-28T13:08:18.702568+0000","last_undegraded":"2024-04-28T13:08:18.702568+0000","last_fullsized":"2024-04-28T13:08:18.702568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:44:19.552362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.696292+0000","last_change":"2024-04-28T13:08:17.702516+0000","last_active":"2024-04-28T13:08:18.696292+0000","last_peered":"2024-04-28T13:08:18.696292+0000","last_clean":"2024-04-28T13:08:18.696292+0000","last_became_active":"2024-04-28T13:08:17.702024+0000","last_became_peered":"2024-04-28T13:08:17.702024+0000","last_unstale":"2024-04-28T13:08:18.696292+0000","last_undegraded":"2024-04-28T13:08:18.696292+0000","last_fullsized":"2024-04-28T13:08:18.696292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:17:50.392973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.708474+0000","last_change":"2024-04-28T13:08:18.704697+0000","last_active":"2024-04-28T13:08:18.708474+0000","last_peered":"2024-04-28T13:08:18.708474+0000","last_clean":"2024-04-28T13:08:18.708474+0000","last_became_active":"2024-04-28T13:08:18.704425+0000","last_became_peered":"2024-04-28T13:08:18.704425+0000","last_unstale":"2024-04-28T13:08:18.708474+0000","last_undegraded":"2024-04-28T13:08:18.708474+0000","last_fullsized":"2024-04-28T13:08:18.708474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:32:52.129781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.714786+0000","last_change":"2024-04-28T13:08:17.701108+0000","last_active":"2024-04-28T13:08:18.714786+0000","last_peered":"2024-04-28T13:08:18.714786+0000","last_clean":"2024-04-28T13:08:18.714786+0000","last_became_active":"2024-04-28T13:08:17.700805+0000","last_became_peered":"2024-04-28T13:08:17.700805+0000","last_unstale":"2024-04-28T13:08:18.714786+0000","last_undegraded":"2024-04-28T13:08:18.714786+0000","last_fullsized":"2024-04-28T13:08:18.714786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:23:57.660585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.714182+0000","last_change":"2024-04-28T13:08:18.712612+0000","last_active":"2024-04-28T13:08:18.714182+0000","last_peered":"2024-04-28T13:08:18.714182+0000","last_clean":"2024-04-28T13:08:18.714182+0000","last_became_active":"2024-04-28T13:08:18.712107+0000","last_became_peered":"2024-04-28T13:08:18.712107+0000","last_unstale":"2024-04-28T13:08:18.714182+0000","last_undegraded":"2024-04-28T13:08:18.714182+0000","last_fullsized":"2024-04-28T13:08:18.714182+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:09:40.886228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.686496+0000","last_change":"2024-04-28T13:08:17.705412+0000","last_active":"2024-04-28T13:08:18.686496+0000","last_peered":"2024-04-28T13:08:18.686496+0000","last_clean":"2024-04-28T13:08:18.686496+0000","last_became_active":"2024-04-28T13:08:17.705137+0000","last_became_peered":"2024-04-28T13:08:17.705137+0000","last_unstale":"2024-04-28T13:08:18.686496+0000","last_undegraded":"2024-04-28T13:08:18.686496+0000","last_fullsized":"2024-04-28T13:08:18.686496+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:23:57.660585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.712163+0000","last_change":"2024-04-28T13:08:18.703888+0000","last_active":"2024-04-28T13:08:18.712163+0000","last_peered":"2024-04-28T13:08:18.712163+0000","last_clean":"2024-04-28T13:08:18.712163+0000","last_became_active":"2024-04-28T13:08:18.703617+0000","last_became_peered":"2024-04-28T13:08:18.703617+0000","last_unstale":"2024-04-28T13:08:18.712163+0000","last_undegraded":"2024-04-28T13:08:18.712163+0000","last_fullsized":"2024-04-28T13:08:18.712163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:38:31.472938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.690366+0000","last_change":"2024-04-28T13:08:17.697870+0000","last_active":"2024-04-28T13:08:18.690366+0000","last_peered":"2024-04-28T13:08:18.690366+0000","last_clean":"2024-04-28T13:08:18.690366+0000","last_became_active":"2024-04-28T13:08:17.697291+0000","last_became_peered":"2024-04-28T13:08:17.697291+0000","last_unstale":"2024-04-28T13:08:18.690366+0000","last_undegraded":"2024-04-28T13:08:18.690366+0000","last_fullsized":"2024-04-28T13:08:18.690366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:06:36.930120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.705296+0000","last_change":"2024-04-28T13:08:18.704138+0000","last_active":"2024-04-28T13:08:18.705296+0000","last_peered":"2024-04-28T13:08:18.705296+0000","last_clean":"2024-04-28T13:08:18.705296+0000","last_became_active":"2024-04-28T13:08:18.703851+0000","last_became_peered":"2024-04-28T13:08:18.703851+0000","last_unstale":"2024-04-28T13:08:18.705296+0000","last_undegraded":"2024-04-28T13:08:18.705296+0000","last_fullsized":"2024-04-28T13:08:18.705296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:47:41.611958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.686167+0000","last_change":"2024-04-28T13:08:17.698373+0000","last_active":"2024-04-28T13:08:18.686167+0000","last_peered":"2024-04-28T13:08:18.686167+0000","last_clean":"2024-04-28T13:08:18.686167+0000","last_became_active":"2024-04-28T13:08:17.698093+0000","last_became_peered":"2024-04-28T13:08:17.698093+0000","last_unstale":"2024-04-28T13:08:18.686167+0000","last_undegraded":"2024-04-28T13:08:18.686167+0000","last_fullsized":"2024-04-28T13:08:18.686167+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:04:11.566854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.703625+0000","last_change":"2024-04-28T13:08:18.701117+0000","last_active":"2024-04-28T13:08:18.703625+0000","last_peered":"2024-04-28T13:08:18.703625+0000","last_clean":"2024-04-28T13:08:18.703625+0000","last_became_active":"2024-04-28T13:08:18.700856+0000","last_became_peered":"2024-04-28T13:08:18.700856+0000","last_unstale":"2024-04-28T13:08:18.703625+0000","last_undegraded":"2024-04-28T13:08:18.703625+0000","last_fullsized":"2024-04-28T13:08:18.703625+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:44:19.552362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.691013+0000","last_change":"2024-04-28T13:08:17.708128+0000","last_active":"2024-04-28T13:08:18.691013+0000","last_peered":"2024-04-28T13:08:18.691013+0000","last_clean":"2024-04-28T13:08:18.691013+0000","last_became_active":"2024-04-28T13:08:17.707846+0000","last_became_peered":"2024-04-28T13:08:17.707846+0000","last_unstale":"2024-04-28T13:08:18.691013+0000","last_undegraded":"2024-04-28T13:08:18.691013+0000","last_fullsized":"2024-04-28T13:08:18.691013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:47:40.609566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.711059+0000","last_change":"2024-04-28T13:08:18.703934+0000","last_active":"2024-04-28T13:08:18.711059+0000","last_peered":"2024-04-28T13:08:18.711059+0000","last_clean":"2024-04-28T13:08:18.711059+0000","last_became_active":"2024-04-28T13:08:18.701960+0000","last_became_peered":"2024-04-28T13:08:18.701960+0000","last_unstale":"2024-04-28T13:08:18.711059+0000","last_undegraded":"2024-04-28T13:08:18.711059+0000","last_fullsized":"2024-04-28T13:08:18.711059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T16:12:59.642117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.687789+0000","last_change":"2024-04-28T13:08:17.695566+0000","last_active":"2024-04-28T13:08:18.687789+0000","last_peered":"2024-04-28T13:08:18.687789+0000","last_clean":"2024-04-28T13:08:18.687789+0000","last_became_active":"2024-04-28T13:08:17.695279+0000","last_became_peered":"2024-04-28T13:08:17.695279+0000","last_unstale":"2024-04-28T13:08:18.687789+0000","last_undegraded":"2024-04-28T13:08:18.687789+0000","last_fullsized":"2024-04-28T13:08:18.687789+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:32:51.127389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.710405+0000","last_change":"2024-04-28T13:08:18.703684+0000","last_active":"2024-04-28T13:08:18.710405+0000","last_peered":"2024-04-28T13:08:18.710405+0000","last_clean":"2024-04-28T13:08:18.710405+0000","last_became_active":"2024-04-28T13:08:18.703178+0000","last_became_peered":"2024-04-28T13:08:18.703178+0000","last_unstale":"2024-04-28T13:08:18.710405+0000","last_undegraded":"2024-04-28T13:08:18.710405+0000","last_fullsized":"2024-04-28T13:08:18.710405+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:17:51.395365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.692192+0000","last_change":"2024-04-28T13:08:17.702817+0000","last_active":"2024-04-28T13:08:18.692192+0000","last_peered":"2024-04-28T13:08:18.692192+0000","last_clean":"2024-04-28T13:08:18.692192+0000","last_became_active":"2024-04-28T13:08:17.702110+0000","last_became_peered":"2024-04-28T13:08:17.702110+0000","last_unstale":"2024-04-28T13:08:18.692192+0000","last_undegraded":"2024-04-28T13:08:18.692192+0000","last_fullsized":"2024-04-28T13:08:18.692192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:44:18.549970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.700638+0000","last_change":"2024-04-28T13:08:18.699123+0000","last_active":"2024-04-28T13:08:18.700638+0000","last_peered":"2024-04-28T13:08:18.700638+0000","last_clean":"2024-04-28T13:08:18.700638+0000","last_became_active":"2024-04-28T13:08:18.698843+0000","last_became_peered":"2024-04-28T13:08:18.698843+0000","last_unstale":"2024-04-28T13:08:18.700638+0000","last_undegraded":"2024-04-28T13:08:18.700638+0000","last_fullsized":"2024-04-28T13:08:18.700638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:17:51.395365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.694842+0000","last_change":"2024-04-28T13:08:17.699231+0000","last_active":"2024-04-28T13:08:18.694842+0000","last_peered":"2024-04-28T13:08:18.694842+0000","last_clean":"2024-04-28T13:08:18.694842+0000","last_became_active":"2024-04-28T13:08:17.698911+0000","last_became_peered":"2024-04-28T13:08:17.698911+0000","last_unstale":"2024-04-28T13:08:18.694842+0000","last_undegraded":"2024-04-28T13:08:18.694842+0000","last_fullsized":"2024-04-28T13:08:18.694842+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:20:08.827919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.691589+0000","last_change":"2024-04-28T13:07:16.698740+0000","last_active":"2024-04-28T13:08:18.691589+0000","last_peered":"2024-04-28T13:08:18.691589+0000","last_clean":"2024-04-28T13:08:18.691589+0000","last_became_active":"2024-04-28T13:07:16.696364+0000","last_became_peered":"2024-04-28T13:07:16.696364+0000","last_unstale":"2024-04-28T13:08:18.691589+0000","last_undegraded":"2024-04-28T13:08:18.691589+0000","last_fullsized":"2024-04-28T13:08:18.691589+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:14.770499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:14.770499+0000","last_clean_scrub_stamp":"2024-04-28T13:07:14.770499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:39:38.986133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":728580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":138212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":138212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":138212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":138212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":145057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":138212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":728580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-28T13:08:21.650 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-28T13:08:21.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.783+0000 7fec0d6dc640 1 Processor -- start 2024-04-28T13:08:21.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.783+0000 7fec0d6dc640 1 -- start start 2024-04-28T13:08:21.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.784+0000 7fec0d6dc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fec08160a20 0x7fec08160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:21.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.784+0000 7fec0d6dc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec080d3850 con 0x7fec080d32b0 2024-04-28T13:08:21.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.784+0000 7fec0d6dc640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec080d3b30 con 0x7fec08159b00 2024-04-28T13:08:21.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.784+0000 7fec0d6dc640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fec080b8250 con 0x7fec08160a20 2024-04-28T13:08:21.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.784+0000 7fec067fc640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fec080d32b0 0x7fec080d48f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52944/0 (socket says 172.21.15.114:52944) 2024-04-28T13:08:21.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.784+0000 7fec067fc640 1 -- 172.21.15.114:0/4096817678 learned_addr learned my addr 172.21.15.114:0/4096817678 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:21.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.784+0000 7fec077fe640 1 --2- 172.21.15.114:0/4096817678 >> v2:172.21.15.134:3300/0 conn(0x7fec08160a20 0x7fec08160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:21.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.785+0000 7fec05ffb640 1 -- 172.21.15.114:0/4096817678 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1894190051 0 0) 0x7fec080d3850 con 0x7fec080d32b0 2024-04-28T13:08:21.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.785+0000 7fec05ffb640 1 -- 172.21.15.114:0/4096817678 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febf0003520 con 0x7fec080d32b0 2024-04-28T13:08:21.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.785+0000 7fec077fe640 1 -- 172.21.15.114:0/4096817678 >> v1:172.21.15.134:6789/0 conn(0x7fec08159b00 legacy=0x7fec081602b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:21.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.785+0000 7fec077fe640 1 -- 172.21.15.114:0/4096817678 >> v1:172.21.15.114:6789/0 conn(0x7fec080d32b0 legacy=0x7fec080d48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:21.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.785+0000 7fec077fe640 1 -- 172.21.15.114:0/4096817678 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec080d3e10 con 0x7fec08160a20 2024-04-28T13:08:21.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.785+0000 7fec077fe640 1 --2- 172.21.15.114:0/4096817678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec08160a20 0x7fec08160eb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fec000097a0 tx=0x7fec0002a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a2b58949edceb1a server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:21.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.786+0000 7fec05ffb640 1 -- 172.21.15.114:0/4096817678 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec00037070 con 0x7fec08160a20 2024-04-28T13:08:21.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.786+0000 7fec05ffb640 1 -- 172.21.15.114:0/4096817678 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec00032640 con 0x7fec08160a20 2024-04-28T13:08:21.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.786+0000 7fec05ffb640 1 -- 172.21.15.114:0/4096817678 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec00032a10 con 0x7fec08160a20 2024-04-28T13:08:21.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.786+0000 7fec0d6dc640 1 -- 172.21.15.114:0/4096817678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec08160a20 msgr2=0x7fec08160eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:21.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.786+0000 7fec0d6dc640 1 --2- 172.21.15.114:0/4096817678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec08160a20 0x7fec08160eb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fec000097a0 tx=0x7fec0002a2c0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.786+0000 7fec0d6dc640 1 -- 172.21.15.114:0/4096817678 shutdown_connections 2024-04-28T13:08:21.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.786+0000 7fec0d6dc640 1 --2- 172.21.15.114:0/4096817678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec08160a20 0x7fec08160eb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.786+0000 7fec0d6dc640 1 -- 172.21.15.114:0/4096817678 >> 172.21.15.114:0/4096817678 conn(0x7fec080633a0 msgr2=0x7fec080d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:21.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.786+0000 7fec0d6dc640 1 -- 172.21.15.114:0/4096817678 shutdown_connections 2024-04-28T13:08:21.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.786+0000 7fec0d6dc640 1 -- 172.21.15.114:0/4096817678 wait complete. 2024-04-28T13:08:21.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.787+0000 7fec0d6dc640 1 Processor -- start 2024-04-28T13:08:21.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.787+0000 7fec0d6dc640 1 -- start start 2024-04-28T13:08:21.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.788+0000 7fec0d6dc640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec080d32b0 0x7fec08159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:21.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.788+0000 7fec0d6dc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec08159b00 0x7fec0815ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:21.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.788+0000 7fec0d6dc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec08160a20 0x7fec0815b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:21.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.788+0000 7fec0d6dc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fec080d5000 con 0x7fec08160a20 2024-04-28T13:08:21.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.788+0000 7fec0d6dc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fec080d43d0 con 0x7fec08159b00 2024-04-28T13:08:21.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.788+0000 7fec0d6dc640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fec080b6d10 con 0x7fec080d32b0 2024-04-28T13:08:21.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.788+0000 7fec077fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec08160a20 0x7fec0815b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:21.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.788+0000 7fec077fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec08160a20 0x7fec0815b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33018/0 (socket says 172.21.15.114:33018) 2024-04-28T13:08:21.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.788+0000 7fec077fe640 1 -- 172.21.15.114:0/3300846870 learned_addr learned my addr 172.21.15.114:0/3300846870 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:21.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.788+0000 7fec067fc640 1 --2- 172.21.15.114:0/3300846870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec08159b00 0x7fec0815ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:21.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.788+0000 7fec06ffd640 1 --2- 172.21.15.114:0/3300846870 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec080d32b0 0x7fec08159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:21.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.789+0000 7fec077fe640 1 -- 172.21.15.114:0/3300846870 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec080d32b0 msgr2=0x7fec08159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:21.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.789+0000 7fec077fe640 1 --2- 172.21.15.114:0/3300846870 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec080d32b0 0x7fec08159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.789+0000 7fec077fe640 1 -- 172.21.15.114:0/3300846870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec08159b00 msgr2=0x7fec0815ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:21.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.789+0000 7fec077fe640 1 --2- 172.21.15.114:0/3300846870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec08159b00 0x7fec0815ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.789+0000 7fec077fe640 1 -- 172.21.15.114:0/3300846870 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec0815b160 con 0x7fec08160a20 2024-04-28T13:08:21.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.789+0000 7fec077fe640 1 --2- 172.21.15.114:0/3300846870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec08160a20 0x7fec0815b5b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fec00035040 tx=0x7fec000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:21.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.789+0000 7febef7fe640 1 -- 172.21.15.114:0/3300846870 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec00037040 con 0x7fec08160a20 2024-04-28T13:08:21.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.789+0000 7fec0d6dc640 1 -- 172.21.15.114:0/3300846870 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec081f5160 con 0x7fec08160a20 2024-04-28T13:08:21.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.789+0000 7febef7fe640 1 -- 172.21.15.114:0/3300846870 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec00042070 con 0x7fec08160a20 2024-04-28T13:08:21.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.789+0000 7febef7fe640 1 -- 172.21.15.114:0/3300846870 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec000308f0 con 0x7fec08160a20 2024-04-28T13:08:21.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.789+0000 7fec0d6dc640 1 -- 172.21.15.114:0/3300846870 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec081f5720 con 0x7fec08160a20 2024-04-28T13:08:21.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.790+0000 7fec0d6dc640 1 -- 172.21.15.114:0/3300846870 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec0806a3d0 con 0x7fec08160a20 2024-04-28T13:08:21.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.790+0000 7febef7fe640 1 -- 172.21.15.114:0/3300846870 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fec00030a90 con 0x7fec08160a20 2024-04-28T13:08:21.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.791+0000 7febef7fe640 1 --2- 172.21.15.114:0/3300846870 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7febf406c8f0 0x7febf406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:21.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.791+0000 7fec06ffd640 1 --2- 172.21.15.114:0/3300846870 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7febf406c8f0 0x7febf406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:21.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.791+0000 7febef7fe640 1 -- 172.21.15.114:0/3300846870 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fec000ac350 con 0x7fec08160a20 2024-04-28T13:08:21.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.791+0000 7fec06ffd640 1 --2- 172.21.15.114:0/3300846870 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7febf406c8f0 0x7febf406edb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fec08158950 tx=0x7febf8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:21.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.795+0000 7febef7fe640 1 -- 172.21.15.114:0/3300846870 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fec0007a140 con 0x7fec08160a20 2024-04-28T13:08:21.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.964+0000 7fec0d6dc640 1 -- 172.21.15.114:0/3300846870 --> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fec08154db0 con 0x7febf406c8f0 2024-04-28T13:08:21.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.970+0000 7febef7fe640 1 -- 172.21.15.114:0/3300846870 <== mgr.4104 v2:172.21.15.114:6832/2240257326 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251878 (secure 0 0 0) 0x7fec08154db0 con 0x7febf406c8f0 2024-04-28T13:08:21.972 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:21.973 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-04-28T13:08:21.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.973+0000 7fec0d6dc640 1 -- 172.21.15.114:0/3300846870 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7febf406c8f0 msgr2=0x7febf406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:21.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.973+0000 7fec0d6dc640 1 --2- 172.21.15.114:0/3300846870 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7febf406c8f0 0x7febf406edb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fec08158950 tx=0x7febf8009040 comp rx=0 tx=0).stop 2024-04-28T13:08:21.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.973+0000 7fec0d6dc640 1 -- 172.21.15.114:0/3300846870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec08160a20 msgr2=0x7fec0815b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:21.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.973+0000 7fec0d6dc640 1 --2- 172.21.15.114:0/3300846870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec08160a20 0x7fec0815b5b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fec00035040 tx=0x7fec000046c0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.973+0000 7fec0d6dc640 1 -- 172.21.15.114:0/3300846870 shutdown_connections 2024-04-28T13:08:21.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.973+0000 7fec0d6dc640 1 --2- 172.21.15.114:0/3300846870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec08160a20 0x7fec0815b5b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.973+0000 7fec0d6dc640 1 --2- 172.21.15.114:0/3300846870 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7febf406c8f0 0x7febf406edb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.973+0000 7fec0d6dc640 1 --2- 172.21.15.114:0/3300846870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec08159b00 0x7fec0815ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.973+0000 7fec0d6dc640 1 --2- 172.21.15.114:0/3300846870 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec080d32b0 0x7fec08159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:21.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.973+0000 7fec0d6dc640 1 -- 172.21.15.114:0/3300846870 >> 172.21.15.114:0/3300846870 conn(0x7fec080633a0 msgr2=0x7fec0815d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:21.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.973+0000 7fec0d6dc640 1 -- 172.21.15.114:0/3300846870 shutdown_connections 2024-04-28T13:08:21.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:21.973+0000 7fec0d6dc640 1 -- 172.21.15.114:0/3300846870 wait complete. 2024-04-28T13:08:21.983 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-04-28T13:08:20.716715+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220164,"kb_used_data":3992,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754556,"statfs":{"total":773094113280,"available":772868665344,"internally_reserved":0,"allocated":4087808,"data_stored":2293277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.038448"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.708637+0000","last_change":"2024-04-28T13:08:18.706640+0000","last_active":"2024-04-28T13:08:18.708637+0000","last_peered":"2024-04-28T13:08:18.708637+0000","last_clean":"2024-04-28T13:08:18.708637+0000","last_became_active":"2024-04-28T13:08:18.706124+0000","last_became_peered":"2024-04-28T13:08:18.706124+0000","last_unstale":"2024-04-28T13:08:18.708637+0000","last_undegraded":"2024-04-28T13:08:18.708637+0000","last_fullsized":"2024-04-28T13:08:18.708637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:02:50.132656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.706729+0000","last_change":"2024-04-28T13:08:18.700988+0000","last_active":"2024-04-28T13:08:18.706729+0000","last_peered":"2024-04-28T13:08:18.706729+0000","last_clean":"2024-04-28T13:08:18.706729+0000","last_became_active":"2024-04-28T13:08:18.700700+0000","last_became_peered":"2024-04-28T13:08:18.700700+0000","last_unstale":"2024-04-28T13:08:18.706729+0000","last_undegraded":"2024-04-28T13:08:18.706729+0000","last_fullsized":"2024-04-28T13:08:18.706729+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:47:10.449842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.714157+0000","last_change":"2024-04-28T13:08:18.712262+0000","last_active":"2024-04-28T13:08:18.714157+0000","last_peered":"2024-04-28T13:08:18.714157+0000","last_clean":"2024-04-28T13:08:18.714157+0000","last_became_active":"2024-04-28T13:08:18.711970+0000","last_became_peered":"2024-04-28T13:08:18.711970+0000","last_unstale":"2024-04-28T13:08:18.714157+0000","last_undegraded":"2024-04-28T13:08:18.714157+0000","last_fullsized":"2024-04-28T13:08:18.714157+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:47:10.449842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.716905+0000","last_change":"2024-04-28T13:08:18.711207+0000","last_active":"2024-04-28T13:08:18.716905+0000","last_peered":"2024-04-28T13:08:18.716905+0000","last_clean":"2024-04-28T13:08:18.716905+0000","last_became_active":"2024-04-28T13:08:18.710950+0000","last_became_peered":"2024-04-28T13:08:18.710950+0000","last_unstale":"2024-04-28T13:08:18.716905+0000","last_undegraded":"2024-04-28T13:08:18.716905+0000","last_fullsized":"2024-04-28T13:08:18.716905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:24:29.898441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.705848+0000","last_change":"2024-04-28T13:08:18.704258+0000","last_active":"2024-04-28T13:08:18.705848+0000","last_peered":"2024-04-28T13:08:18.705848+0000","last_clean":"2024-04-28T13:08:18.705848+0000","last_became_active":"2024-04-28T13:08:18.703983+0000","last_became_peered":"2024-04-28T13:08:18.703983+0000","last_unstale":"2024-04-28T13:08:18.705848+0000","last_undegraded":"2024-04-28T13:08:18.705848+0000","last_fullsized":"2024-04-28T13:08:18.705848+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:43:48.065676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.711467+0000","last_change":"2024-04-28T13:08:18.707002+0000","last_active":"2024-04-28T13:08:18.711467+0000","last_peered":"2024-04-28T13:08:18.711467+0000","last_clean":"2024-04-28T13:08:18.711467+0000","last_became_active":"2024-04-28T13:08:18.706713+0000","last_became_peered":"2024-04-28T13:08:18.706713+0000","last_unstale":"2024-04-28T13:08:18.711467+0000","last_undegraded":"2024-04-28T13:08:18.711467+0000","last_fullsized":"2024-04-28T13:08:18.711467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:24:02.655969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.705694+0000","last_change":"2024-04-28T13:08:18.704436+0000","last_active":"2024-04-28T13:08:18.705694+0000","last_peered":"2024-04-28T13:08:18.705694+0000","last_clean":"2024-04-28T13:08:18.705694+0000","last_became_active":"2024-04-28T13:08:18.704143+0000","last_became_peered":"2024-04-28T13:08:18.704143+0000","last_unstale":"2024-04-28T13:08:18.705694+0000","last_undegraded":"2024-04-28T13:08:18.705694+0000","last_fullsized":"2024-04-28T13:08:18.705694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:24:29.898441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.700659+0000","last_change":"2024-04-28T13:08:18.699000+0000","last_active":"2024-04-28T13:08:18.700659+0000","last_peered":"2024-04-28T13:08:18.700659+0000","last_clean":"2024-04-28T13:08:18.700659+0000","last_became_active":"2024-04-28T13:08:18.698696+0000","last_became_peered":"2024-04-28T13:08:18.698696+0000","last_unstale":"2024-04-28T13:08:18.700659+0000","last_undegraded":"2024-04-28T13:08:18.700659+0000","last_fullsized":"2024-04-28T13:08:18.700659+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:23:58.662977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.710357+0000","last_change":"2024-04-28T13:08:18.707125+0000","last_active":"2024-04-28T13:08:18.710357+0000","last_peered":"2024-04-28T13:08:18.710357+0000","last_clean":"2024-04-28T13:08:18.710357+0000","last_became_active":"2024-04-28T13:08:18.705027+0000","last_became_peered":"2024-04-28T13:08:18.705027+0000","last_unstale":"2024-04-28T13:08:18.710357+0000","last_undegraded":"2024-04-28T13:08:18.710357+0000","last_fullsized":"2024-04-28T13:08:18.710357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:38:31.472938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.709680+0000","last_change":"2024-04-28T13:08:18.703853+0000","last_active":"2024-04-28T13:08:18.709680+0000","last_peered":"2024-04-28T13:08:18.709680+0000","last_clean":"2024-04-28T13:08:18.709680+0000","last_became_active":"2024-04-28T13:08:18.703609+0000","last_became_peered":"2024-04-28T13:08:18.703609+0000","last_unstale":"2024-04-28T13:08:18.709680+0000","last_undegraded":"2024-04-28T13:08:18.709680+0000","last_fullsized":"2024-04-28T13:08:18.709680+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:44:19.552362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.707265+0000","last_change":"2024-04-28T13:08:18.704704+0000","last_active":"2024-04-28T13:08:18.707265+0000","last_peered":"2024-04-28T13:08:18.707265+0000","last_clean":"2024-04-28T13:08:18.707265+0000","last_became_active":"2024-04-28T13:08:18.704363+0000","last_became_peered":"2024-04-28T13:08:18.704363+0000","last_unstale":"2024-04-28T13:08:18.707265+0000","last_undegraded":"2024-04-28T13:08:18.707265+0000","last_fullsized":"2024-04-28T13:08:18.707265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:48:27.578962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.710924+0000","last_change":"2024-04-28T13:08:18.708122+0000","last_active":"2024-04-28T13:08:18.710924+0000","last_peered":"2024-04-28T13:08:18.710924+0000","last_clean":"2024-04-28T13:08:18.710924+0000","last_became_active":"2024-04-28T13:08:18.707839+0000","last_became_peered":"2024-04-28T13:08:18.707839+0000","last_unstale":"2024-04-28T13:08:18.710924+0000","last_undegraded":"2024-04-28T13:08:18.710924+0000","last_fullsized":"2024-04-28T13:08:18.710924+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:48:27.578962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.708559+0000","last_change":"2024-04-28T13:08:18.705249+0000","last_active":"2024-04-28T13:08:18.708559+0000","last_peered":"2024-04-28T13:08:18.708559+0000","last_clean":"2024-04-28T13:08:18.708559+0000","last_became_active":"2024-04-28T13:08:18.704946+0000","last_became_peered":"2024-04-28T13:08:18.704946+0000","last_unstale":"2024-04-28T13:08:18.708559+0000","last_undegraded":"2024-04-28T13:08:18.708559+0000","last_fullsized":"2024-04-28T13:08:18.708559+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:38:45.701556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.701070+0000","last_change":"2024-04-28T13:08:18.693872+0000","last_active":"2024-04-28T13:08:18.701070+0000","last_peered":"2024-04-28T13:08:18.701070+0000","last_clean":"2024-04-28T13:08:18.701070+0000","last_became_active":"2024-04-28T13:08:18.693612+0000","last_became_peered":"2024-04-28T13:08:18.693612+0000","last_unstale":"2024-04-28T13:08:18.701070+0000","last_undegraded":"2024-04-28T13:08:18.701070+0000","last_fullsized":"2024-04-28T13:08:18.701070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:48:27.578962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.708812+0000","last_change":"2024-04-28T13:08:18.704541+0000","last_active":"2024-04-28T13:08:18.708812+0000","last_peered":"2024-04-28T13:08:18.708812+0000","last_clean":"2024-04-28T13:08:18.708812+0000","last_became_active":"2024-04-28T13:08:18.704191+0000","last_became_peered":"2024-04-28T13:08:18.704191+0000","last_unstale":"2024-04-28T13:08:18.708812+0000","last_undegraded":"2024-04-28T13:08:18.708812+0000","last_fullsized":"2024-04-28T13:08:18.708812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:24:29.898441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.705646+0000","last_change":"2024-04-28T13:08:18.703867+0000","last_active":"2024-04-28T13:08:18.705646+0000","last_peered":"2024-04-28T13:08:18.705646+0000","last_clean":"2024-04-28T13:08:18.705646+0000","last_became_active":"2024-04-28T13:08:18.703590+0000","last_became_peered":"2024-04-28T13:08:18.703590+0000","last_unstale":"2024-04-28T13:08:18.705646+0000","last_undegraded":"2024-04-28T13:08:18.705646+0000","last_fullsized":"2024-04-28T13:08:18.705646+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:43:35.816012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.702641+0000","last_change":"2024-04-28T13:08:18.701428+0000","last_active":"2024-04-28T13:08:18.702641+0000","last_peered":"2024-04-28T13:08:18.702641+0000","last_clean":"2024-04-28T13:08:18.702641+0000","last_became_active":"2024-04-28T13:08:18.701098+0000","last_became_peered":"2024-04-28T13:08:18.701098+0000","last_unstale":"2024-04-28T13:08:18.702641+0000","last_undegraded":"2024-04-28T13:08:18.702641+0000","last_fullsized":"2024-04-28T13:08:18.702641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:16:09.096775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.706853+0000","last_change":"2024-04-28T13:08:18.701860+0000","last_active":"2024-04-28T13:08:18.706853+0000","last_peered":"2024-04-28T13:08:18.706853+0000","last_clean":"2024-04-28T13:08:18.706853+0000","last_became_active":"2024-04-28T13:08:18.701560+0000","last_became_peered":"2024-04-28T13:08:18.701560+0000","last_unstale":"2024-04-28T13:08:18.706853+0000","last_undegraded":"2024-04-28T13:08:18.706853+0000","last_fullsized":"2024-04-28T13:08:18.706853+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T13:58:44.311012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.706045+0000","last_change":"2024-04-28T13:08:18.703179+0000","last_active":"2024-04-28T13:08:18.706045+0000","last_peered":"2024-04-28T13:08:18.706045+0000","last_clean":"2024-04-28T13:08:18.706045+0000","last_became_active":"2024-04-28T13:08:18.702861+0000","last_became_peered":"2024-04-28T13:08:18.702861+0000","last_unstale":"2024-04-28T13:08:18.706045+0000","last_undegraded":"2024-04-28T13:08:18.706045+0000","last_fullsized":"2024-04-28T13:08:18.706045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:46:20.181490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.712587+0000","last_change":"2024-04-28T13:08:18.706536+0000","last_active":"2024-04-28T13:08:18.712587+0000","last_peered":"2024-04-28T13:08:18.712587+0000","last_clean":"2024-04-28T13:08:18.712587+0000","last_became_active":"2024-04-28T13:08:18.706257+0000","last_became_peered":"2024-04-28T13:08:18.706257+0000","last_unstale":"2024-04-28T13:08:18.712587+0000","last_undegraded":"2024-04-28T13:08:18.712587+0000","last_fullsized":"2024-04-28T13:08:18.712587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:55:00.537074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.709370+0000","last_change":"2024-04-28T13:08:18.690666+0000","last_active":"2024-04-28T13:08:18.709370+0000","last_peered":"2024-04-28T13:08:18.709370+0000","last_clean":"2024-04-28T13:08:18.709370+0000","last_became_active":"2024-04-28T13:08:18.690283+0000","last_became_peered":"2024-04-28T13:08:18.690283+0000","last_unstale":"2024-04-28T13:08:18.709370+0000","last_undegraded":"2024-04-28T13:08:18.709370+0000","last_fullsized":"2024-04-28T13:08:18.709370+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:04:12.569245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.709585+0000","last_change":"2024-04-28T13:08:18.697664+0000","last_active":"2024-04-28T13:08:18.709585+0000","last_peered":"2024-04-28T13:08:18.709585+0000","last_clean":"2024-04-28T13:08:18.709585+0000","last_became_active":"2024-04-28T13:08:18.697386+0000","last_became_peered":"2024-04-28T13:08:18.697386+0000","last_unstale":"2024-04-28T13:08:18.709585+0000","last_undegraded":"2024-04-28T13:08:18.709585+0000","last_fullsized":"2024-04-28T13:08:18.709585+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:47:41.611958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.701257+0000","last_change":"2024-04-28T13:08:18.700105+0000","last_active":"2024-04-28T13:08:18.701257+0000","last_peered":"2024-04-28T13:08:18.701257+0000","last_clean":"2024-04-28T13:08:18.701257+0000","last_became_active":"2024-04-28T13:08:18.699831+0000","last_became_peered":"2024-04-28T13:08:18.699831+0000","last_unstale":"2024-04-28T13:08:18.701257+0000","last_undegraded":"2024-04-28T13:08:18.701257+0000","last_fullsized":"2024-04-28T13:08:18.701257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:17:51.395365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.708012+0000","last_change":"2024-04-28T13:08:18.703837+0000","last_active":"2024-04-28T13:08:18.708012+0000","last_peered":"2024-04-28T13:08:18.708012+0000","last_clean":"2024-04-28T13:08:18.708012+0000","last_became_active":"2024-04-28T13:08:18.703543+0000","last_became_peered":"2024-04-28T13:08:18.703543+0000","last_unstale":"2024-04-28T13:08:18.708012+0000","last_undegraded":"2024-04-28T13:08:18.708012+0000","last_fullsized":"2024-04-28T13:08:18.708012+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:38:31.472938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.705702+0000","last_change":"2024-04-28T13:08:18.701718+0000","last_active":"2024-04-28T13:08:18.705702+0000","last_peered":"2024-04-28T13:08:18.705702+0000","last_clean":"2024-04-28T13:08:18.705702+0000","last_became_active":"2024-04-28T13:08:18.701477+0000","last_became_peered":"2024-04-28T13:08:18.701477+0000","last_unstale":"2024-04-28T13:08:18.705702+0000","last_undegraded":"2024-04-28T13:08:18.705702+0000","last_fullsized":"2024-04-28T13:08:18.705702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:17:51.395365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.711450+0000","last_change":"2024-04-28T13:08:18.706595+0000","last_active":"2024-04-28T13:08:18.711450+0000","last_peered":"2024-04-28T13:08:18.711450+0000","last_clean":"2024-04-28T13:08:18.711450+0000","last_became_active":"2024-04-28T13:08:18.703299+0000","last_became_peered":"2024-04-28T13:08:18.703299+0000","last_unstale":"2024-04-28T13:08:18.711450+0000","last_undegraded":"2024-04-28T13:08:18.711450+0000","last_fullsized":"2024-04-28T13:08:18.711450+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:01:47.532571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.717465+0000","last_change":"2024-04-28T13:08:18.715540+0000","last_active":"2024-04-28T13:08:18.717465+0000","last_peered":"2024-04-28T13:08:18.717465+0000","last_clean":"2024-04-28T13:08:18.717465+0000","last_became_active":"2024-04-28T13:08:18.715289+0000","last_became_peered":"2024-04-28T13:08:18.715289+0000","last_unstale":"2024-04-28T13:08:18.717465+0000","last_undegraded":"2024-04-28T13:08:18.717465+0000","last_fullsized":"2024-04-28T13:08:18.717465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:10:26.243303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.708265+0000","last_change":"2024-04-28T13:08:18.703913+0000","last_active":"2024-04-28T13:08:18.708265+0000","last_peered":"2024-04-28T13:08:18.708265+0000","last_clean":"2024-04-28T13:08:18.708265+0000","last_became_active":"2024-04-28T13:08:18.703629+0000","last_became_peered":"2024-04-28T13:08:18.703629+0000","last_unstale":"2024-04-28T13:08:18.708265+0000","last_undegraded":"2024-04-28T13:08:18.708265+0000","last_fullsized":"2024-04-28T13:08:18.708265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:43:35.816012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.710138+0000","last_change":"2024-04-28T13:08:18.702391+0000","last_active":"2024-04-28T13:08:18.710138+0000","last_peered":"2024-04-28T13:08:18.710138+0000","last_clean":"2024-04-28T13:08:18.710138+0000","last_became_active":"2024-04-28T13:08:18.702051+0000","last_became_peered":"2024-04-28T13:08:18.702051+0000","last_unstale":"2024-04-28T13:08:18.710138+0000","last_undegraded":"2024-04-28T13:08:18.710138+0000","last_fullsized":"2024-04-28T13:08:18.710138+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:23:58.662977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.705601+0000","last_change":"2024-04-28T13:08:18.703436+0000","last_active":"2024-04-28T13:08:18.705601+0000","last_peered":"2024-04-28T13:08:18.705601+0000","last_clean":"2024-04-28T13:08:18.705601+0000","last_became_active":"2024-04-28T13:08:18.703144+0000","last_became_peered":"2024-04-28T13:08:18.703144+0000","last_unstale":"2024-04-28T13:08:18.705601+0000","last_undegraded":"2024-04-28T13:08:18.705601+0000","last_fullsized":"2024-04-28T13:08:18.705601+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:38:31.472938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.703907+0000","last_change":"2024-04-28T13:08:18.702251+0000","last_active":"2024-04-28T13:08:18.703907+0000","last_peered":"2024-04-28T13:08:18.703907+0000","last_clean":"2024-04-28T13:08:18.703907+0000","last_became_active":"2024-04-28T13:08:18.701992+0000","last_became_peered":"2024-04-28T13:08:18.701992+0000","last_unstale":"2024-04-28T13:08:18.703907+0000","last_undegraded":"2024-04-28T13:08:18.703907+0000","last_fullsized":"2024-04-28T13:08:18.703907+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:04:12.569245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.712806+0000","last_change":"2024-04-28T13:08:18.711193+0000","last_active":"2024-04-28T13:08:18.712806+0000","last_peered":"2024-04-28T13:08:18.712806+0000","last_clean":"2024-04-28T13:08:18.712806+0000","last_became_active":"2024-04-28T13:08:18.710895+0000","last_became_peered":"2024-04-28T13:08:18.710895+0000","last_unstale":"2024-04-28T13:08:18.712806+0000","last_undegraded":"2024-04-28T13:08:18.712806+0000","last_fullsized":"2024-04-28T13:08:18.712806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:10:26.243303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.703590+0000","last_change":"2024-04-28T13:08:18.701234+0000","last_active":"2024-04-28T13:08:18.703590+0000","last_peered":"2024-04-28T13:08:18.703590+0000","last_clean":"2024-04-28T13:08:18.703590+0000","last_became_active":"2024-04-28T13:08:18.700799+0000","last_became_peered":"2024-04-28T13:08:18.700799+0000","last_unstale":"2024-04-28T13:08:18.703590+0000","last_undegraded":"2024-04-28T13:08:18.703590+0000","last_fullsized":"2024-04-28T13:08:18.703590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:16:09.096775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.712311+0000","last_change":"2024-04-28T13:08:17.699555+0000","last_active":"2024-04-28T13:08:18.712311+0000","last_peered":"2024-04-28T13:08:18.712311+0000","last_clean":"2024-04-28T13:08:18.712311+0000","last_became_active":"2024-04-28T13:08:17.699235+0000","last_became_peered":"2024-04-28T13:08:17.699235+0000","last_unstale":"2024-04-28T13:08:18.712311+0000","last_undegraded":"2024-04-28T13:08:18.712311+0000","last_fullsized":"2024-04-28T13:08:18.712311+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:25:07.327590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.712834+0000","last_change":"2024-04-28T13:08:18.710465+0000","last_active":"2024-04-28T13:08:18.712834+0000","last_peered":"2024-04-28T13:08:18.712834+0000","last_clean":"2024-04-28T13:08:18.712834+0000","last_became_active":"2024-04-28T13:08:18.710175+0000","last_became_peered":"2024-04-28T13:08:18.710175+0000","last_unstale":"2024-04-28T13:08:18.712834+0000","last_undegraded":"2024-04-28T13:08:18.712834+0000","last_fullsized":"2024-04-28T13:08:18.712834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:23:58.662977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.716156+0000","last_change":"2024-04-28T13:08:17.702269+0000","last_active":"2024-04-28T13:08:18.716156+0000","last_peered":"2024-04-28T13:08:18.716156+0000","last_clean":"2024-04-28T13:08:18.716156+0000","last_became_active":"2024-04-28T13:08:17.702000+0000","last_became_peered":"2024-04-28T13:08:17.702000+0000","last_unstale":"2024-04-28T13:08:18.716156+0000","last_undegraded":"2024-04-28T13:08:18.716156+0000","last_fullsized":"2024-04-28T13:08:18.716156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:47:40.609566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.710383+0000","last_change":"2024-04-28T13:08:18.699088+0000","last_active":"2024-04-28T13:08:18.710383+0000","last_peered":"2024-04-28T13:08:18.710383+0000","last_clean":"2024-04-28T13:08:18.710383+0000","last_became_active":"2024-04-28T13:08:18.697601+0000","last_became_peered":"2024-04-28T13:08:18.697601+0000","last_unstale":"2024-04-28T13:08:18.710383+0000","last_undegraded":"2024-04-28T13:08:18.710383+0000","last_fullsized":"2024-04-28T13:08:18.710383+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:02:50.132656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.717385+0000","last_change":"2024-04-28T13:08:17.705190+0000","last_active":"2024-04-28T13:08:18.717385+0000","last_peered":"2024-04-28T13:08:18.717385+0000","last_clean":"2024-04-28T13:08:18.717385+0000","last_became_active":"2024-04-28T13:08:17.704874+0000","last_became_peered":"2024-04-28T13:08:17.704874+0000","last_unstale":"2024-04-28T13:08:18.717385+0000","last_undegraded":"2024-04-28T13:08:18.717385+0000","last_fullsized":"2024-04-28T13:08:18.717385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:24:28.896049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.717174+0000","last_change":"2024-04-28T13:08:18.712541+0000","last_active":"2024-04-28T13:08:18.717174+0000","last_peered":"2024-04-28T13:08:18.717174+0000","last_clean":"2024-04-28T13:08:18.717174+0000","last_became_active":"2024-04-28T13:08:18.712070+0000","last_became_peered":"2024-04-28T13:08:18.712070+0000","last_unstale":"2024-04-28T13:08:18.717174+0000","last_undegraded":"2024-04-28T13:08:18.717174+0000","last_fullsized":"2024-04-28T13:08:18.717174+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:48:27.578962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.717693+0000","last_change":"2024-04-28T13:08:17.704632+0000","last_active":"2024-04-28T13:08:18.717693+0000","last_peered":"2024-04-28T13:08:18.717693+0000","last_clean":"2024-04-28T13:08:18.717693+0000","last_became_active":"2024-04-28T13:08:17.704330+0000","last_became_peered":"2024-04-28T13:08:17.704330+0000","last_unstale":"2024-04-28T13:08:18.717693+0000","last_undegraded":"2024-04-28T13:08:18.717693+0000","last_fullsized":"2024-04-28T13:08:18.717693+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:40:01.572227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.712405+0000","last_change":"2024-04-28T13:08:18.711267+0000","last_active":"2024-04-28T13:08:18.712405+0000","last_peered":"2024-04-28T13:08:18.712405+0000","last_clean":"2024-04-28T13:08:18.712405+0000","last_became_active":"2024-04-28T13:08:18.710970+0000","last_became_peered":"2024-04-28T13:08:18.710970+0000","last_unstale":"2024-04-28T13:08:18.712405+0000","last_undegraded":"2024-04-28T13:08:18.712405+0000","last_fullsized":"2024-04-28T13:08:18.712405+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:47:10.449842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.715047+0000","last_change":"2024-04-28T13:08:17.700508+0000","last_active":"2024-04-28T13:08:18.715047+0000","last_peered":"2024-04-28T13:08:18.715047+0000","last_clean":"2024-04-28T13:08:18.715047+0000","last_became_active":"2024-04-28T13:08:17.700224+0000","last_became_peered":"2024-04-28T13:08:17.700224+0000","last_unstale":"2024-04-28T13:08:18.715047+0000","last_undegraded":"2024-04-28T13:08:18.715047+0000","last_fullsized":"2024-04-28T13:08:18.715047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:30:22.763598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.707987+0000","last_change":"2024-04-28T13:08:18.703429+0000","last_active":"2024-04-28T13:08:18.707987+0000","last_peered":"2024-04-28T13:08:18.707987+0000","last_clean":"2024-04-28T13:08:18.707987+0000","last_became_active":"2024-04-28T13:08:18.703078+0000","last_became_peered":"2024-04-28T13:08:18.703078+0000","last_unstale":"2024-04-28T13:08:18.707987+0000","last_undegraded":"2024-04-28T13:08:18.707987+0000","last_fullsized":"2024-04-28T13:08:18.707987+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:16:09.096775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.715166+0000","last_change":"2024-04-28T13:08:17.696426+0000","last_active":"2024-04-28T13:08:18.715166+0000","last_peered":"2024-04-28T13:08:18.715166+0000","last_clean":"2024-04-28T13:08:18.715166+0000","last_became_active":"2024-04-28T13:08:17.696111+0000","last_became_peered":"2024-04-28T13:08:17.696111+0000","last_unstale":"2024-04-28T13:08:18.715166+0000","last_undegraded":"2024-04-28T13:08:18.715166+0000","last_fullsized":"2024-04-28T13:08:18.715166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:43:47.063284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.710147+0000","last_change":"2024-04-28T13:08:18.705676+0000","last_active":"2024-04-28T13:08:18.710147+0000","last_peered":"2024-04-28T13:08:18.710147+0000","last_clean":"2024-04-28T13:08:18.710147+0000","last_became_active":"2024-04-28T13:08:18.705390+0000","last_became_peered":"2024-04-28T13:08:18.705390+0000","last_unstale":"2024-04-28T13:08:18.710147+0000","last_undegraded":"2024-04-28T13:08:18.710147+0000","last_fullsized":"2024-04-28T13:08:18.710147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:44:19.552362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.693387+0000","last_change":"2024-04-28T13:08:17.697729+0000","last_active":"2024-04-28T13:08:18.693387+0000","last_peered":"2024-04-28T13:08:18.693387+0000","last_clean":"2024-04-28T13:08:18.693387+0000","last_became_active":"2024-04-28T13:08:17.697227+0000","last_became_peered":"2024-04-28T13:08:17.697227+0000","last_unstale":"2024-04-28T13:08:18.693387+0000","last_undegraded":"2024-04-28T13:08:18.693387+0000","last_fullsized":"2024-04-28T13:08:18.693387+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:43:34.813620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.714645+0000","last_change":"2024-04-28T13:08:18.709628+0000","last_active":"2024-04-28T13:08:18.714645+0000","last_peered":"2024-04-28T13:08:18.714645+0000","last_clean":"2024-04-28T13:08:18.714645+0000","last_became_active":"2024-04-28T13:08:18.709341+0000","last_became_peered":"2024-04-28T13:08:18.709341+0000","last_unstale":"2024-04-28T13:08:18.714645+0000","last_undegraded":"2024-04-28T13:08:18.714645+0000","last_fullsized":"2024-04-28T13:08:18.714645+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:16:09.096775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.687583+0000","last_change":"2024-04-28T13:08:17.697697+0000","last_active":"2024-04-28T13:08:18.687583+0000","last_peered":"2024-04-28T13:08:18.687583+0000","last_clean":"2024-04-28T13:08:18.687583+0000","last_became_active":"2024-04-28T13:08:17.697426+0000","last_became_peered":"2024-04-28T13:08:17.697426+0000","last_unstale":"2024-04-28T13:08:18.687583+0000","last_undegraded":"2024-04-28T13:08:18.687583+0000","last_fullsized":"2024-04-28T13:08:18.687583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T13:48:14.457717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.711756+0000","last_change":"2024-04-28T13:08:18.708833+0000","last_active":"2024-04-28T13:08:18.711756+0000","last_peered":"2024-04-28T13:08:18.711756+0000","last_clean":"2024-04-28T13:08:18.711756+0000","last_became_active":"2024-04-28T13:08:18.708538+0000","last_became_peered":"2024-04-28T13:08:18.708538+0000","last_unstale":"2024-04-28T13:08:18.711756+0000","last_undegraded":"2024-04-28T13:08:18.711756+0000","last_fullsized":"2024-04-28T13:08:18.711756+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:10:26.243303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.691906+0000","last_change":"2024-04-28T13:08:17.703849+0000","last_active":"2024-04-28T13:08:18.691906+0000","last_peered":"2024-04-28T13:08:18.691906+0000","last_clean":"2024-04-28T13:08:18.691906+0000","last_became_active":"2024-04-28T13:08:17.703448+0000","last_became_peered":"2024-04-28T13:08:17.703448+0000","last_unstale":"2024-04-28T13:08:18.691906+0000","last_undegraded":"2024-04-28T13:08:18.691906+0000","last_fullsized":"2024-04-28T13:08:18.691906+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:17:50.392973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.705511+0000","last_change":"2024-04-28T13:08:18.702903+0000","last_active":"2024-04-28T13:08:18.705511+0000","last_peered":"2024-04-28T13:08:18.705511+0000","last_clean":"2024-04-28T13:08:18.705511+0000","last_became_active":"2024-04-28T13:08:18.701681+0000","last_became_peered":"2024-04-28T13:08:18.701681+0000","last_unstale":"2024-04-28T13:08:18.705511+0000","last_undegraded":"2024-04-28T13:08:18.705511+0000","last_fullsized":"2024-04-28T13:08:18.705511+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:09:40.886228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.686376+0000","last_change":"2024-04-28T13:08:17.700440+0000","last_active":"2024-04-28T13:08:18.686376+0000","last_peered":"2024-04-28T13:08:18.686376+0000","last_clean":"2024-04-28T13:08:18.686376+0000","last_became_active":"2024-04-28T13:08:17.700161+0000","last_became_peered":"2024-04-28T13:08:17.700161+0000","last_unstale":"2024-04-28T13:08:18.686376+0000","last_undegraded":"2024-04-28T13:08:18.686376+0000","last_fullsized":"2024-04-28T13:08:18.686376+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:02:49.130264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.711023+0000","last_change":"2024-04-28T13:08:18.703636+0000","last_active":"2024-04-28T13:08:18.711023+0000","last_peered":"2024-04-28T13:08:18.711023+0000","last_clean":"2024-04-28T13:08:18.711023+0000","last_became_active":"2024-04-28T13:08:18.703355+0000","last_became_peered":"2024-04-28T13:08:18.703355+0000","last_unstale":"2024-04-28T13:08:18.711023+0000","last_undegraded":"2024-04-28T13:08:18.711023+0000","last_fullsized":"2024-04-28T13:08:18.711023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:52:17.759352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.716332+0000","last_change":"2024-04-28T13:08:17.702533+0000","last_active":"2024-04-28T13:08:18.716332+0000","last_peered":"2024-04-28T13:08:18.716332+0000","last_clean":"2024-04-28T13:08:18.716332+0000","last_became_active":"2024-04-28T13:08:17.702055+0000","last_became_peered":"2024-04-28T13:08:17.702055+0000","last_unstale":"2024-04-28T13:08:18.716332+0000","last_undegraded":"2024-04-28T13:08:18.716332+0000","last_fullsized":"2024-04-28T13:08:18.716332+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:44:18.549970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.714178+0000","last_change":"2024-04-28T13:08:18.712330+0000","last_active":"2024-04-28T13:08:18.714178+0000","last_peered":"2024-04-28T13:08:18.714178+0000","last_clean":"2024-04-28T13:08:18.714178+0000","last_became_active":"2024-04-28T13:08:18.712052+0000","last_became_peered":"2024-04-28T13:08:18.712052+0000","last_unstale":"2024-04-28T13:08:18.714178+0000","last_undegraded":"2024-04-28T13:08:18.714178+0000","last_fullsized":"2024-04-28T13:08:18.714178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T13:58:44.311012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.719559+0000","last_change":"2024-04-28T13:08:17.699535+0000","last_active":"2024-04-28T13:08:18.719559+0000","last_peered":"2024-04-28T13:08:18.719559+0000","last_clean":"2024-04-28T13:08:18.719559+0000","last_became_active":"2024-04-28T13:08:17.699265+0000","last_became_peered":"2024-04-28T13:08:17.699265+0000","last_unstale":"2024-04-28T13:08:18.719559+0000","last_undegraded":"2024-04-28T13:08:18.719559+0000","last_fullsized":"2024-04-28T13:08:18.719559+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:23:57.660585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.714706+0000","last_change":"2024-04-28T13:08:18.710292+0000","last_active":"2024-04-28T13:08:18.714706+0000","last_peered":"2024-04-28T13:08:18.714706+0000","last_clean":"2024-04-28T13:08:18.714706+0000","last_became_active":"2024-04-28T13:08:18.710034+0000","last_became_peered":"2024-04-28T13:08:18.710034+0000","last_unstale":"2024-04-28T13:08:18.714706+0000","last_undegraded":"2024-04-28T13:08:18.714706+0000","last_fullsized":"2024-04-28T13:08:18.714706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:38:31.472938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.714983+0000","last_change":"2024-04-28T13:08:17.698422+0000","last_active":"2024-04-28T13:08:18.714983+0000","last_peered":"2024-04-28T13:08:18.714983+0000","last_clean":"2024-04-28T13:08:18.714983+0000","last_became_active":"2024-04-28T13:08:17.698154+0000","last_became_peered":"2024-04-28T13:08:17.698154+0000","last_unstale":"2024-04-28T13:08:18.714983+0000","last_undegraded":"2024-04-28T13:08:18.714983+0000","last_fullsized":"2024-04-28T13:08:18.714983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:06:36.930120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.706245+0000","last_change":"2024-04-28T13:08:18.698107+0000","last_active":"2024-04-28T13:08:18.706245+0000","last_peered":"2024-04-28T13:08:18.706245+0000","last_clean":"2024-04-28T13:08:18.706245+0000","last_became_active":"2024-04-28T13:08:18.697851+0000","last_became_peered":"2024-04-28T13:08:18.697851+0000","last_unstale":"2024-04-28T13:08:18.706245+0000","last_undegraded":"2024-04-28T13:08:18.706245+0000","last_fullsized":"2024-04-28T13:08:18.706245+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:10:26.243303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.690866+0000","last_change":"2024-04-28T13:08:17.702703+0000","last_active":"2024-04-28T13:08:18.690866+0000","last_peered":"2024-04-28T13:08:18.690866+0000","last_clean":"2024-04-28T13:08:18.690866+0000","last_became_active":"2024-04-28T13:08:17.702428+0000","last_became_peered":"2024-04-28T13:08:17.702428+0000","last_unstale":"2024-04-28T13:08:18.690866+0000","last_undegraded":"2024-04-28T13:08:18.690866+0000","last_fullsized":"2024-04-28T13:08:18.690866+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:04:11.566854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.712827+0000","last_change":"2024-04-28T13:08:18.711322+0000","last_active":"2024-04-28T13:08:18.712827+0000","last_peered":"2024-04-28T13:08:18.712827+0000","last_clean":"2024-04-28T13:08:18.712827+0000","last_became_active":"2024-04-28T13:08:18.710922+0000","last_became_peered":"2024-04-28T13:08:18.710922+0000","last_unstale":"2024-04-28T13:08:18.712827+0000","last_undegraded":"2024-04-28T13:08:18.712827+0000","last_fullsized":"2024-04-28T13:08:18.712827+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T13:58:44.311012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.693243+0000","last_change":"2024-04-28T13:08:17.702510+0000","last_active":"2024-04-28T13:08:18.693243+0000","last_peered":"2024-04-28T13:08:18.693243+0000","last_clean":"2024-04-28T13:08:18.693243+0000","last_became_active":"2024-04-28T13:08:17.702213+0000","last_became_peered":"2024-04-28T13:08:17.702213+0000","last_unstale":"2024-04-28T13:08:18.693243+0000","last_undegraded":"2024-04-28T13:08:18.693243+0000","last_fullsized":"2024-04-28T13:08:18.693243+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:38:30.470547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.712796+0000","last_change":"2024-04-28T13:08:18.710508+0000","last_active":"2024-04-28T13:08:18.712796+0000","last_peered":"2024-04-28T13:08:18.712796+0000","last_clean":"2024-04-28T13:08:18.712796+0000","last_became_active":"2024-04-28T13:08:18.710234+0000","last_became_peered":"2024-04-28T13:08:18.710234+0000","last_unstale":"2024-04-28T13:08:18.712796+0000","last_undegraded":"2024-04-28T13:08:18.712796+0000","last_fullsized":"2024-04-28T13:08:18.712796+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:17:51.395365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.718026+0000","last_change":"2024-04-28T13:08:17.695229+0000","last_active":"2024-04-28T13:08:18.718026+0000","last_peered":"2024-04-28T13:08:18.718026+0000","last_clean":"2024-04-28T13:08:18.718026+0000","last_became_active":"2024-04-28T13:08:17.694764+0000","last_became_peered":"2024-04-28T13:08:17.694764+0000","last_unstale":"2024-04-28T13:08:18.718026+0000","last_undegraded":"2024-04-28T13:08:18.718026+0000","last_fullsized":"2024-04-28T13:08:18.718026+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:16:08.094383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.710226+0000","last_change":"2024-04-28T13:08:18.706061+0000","last_active":"2024-04-28T13:08:18.710226+0000","last_peered":"2024-04-28T13:08:18.710226+0000","last_clean":"2024-04-28T13:08:18.710226+0000","last_became_active":"2024-04-28T13:08:18.705581+0000","last_became_peered":"2024-04-28T13:08:18.705581+0000","last_unstale":"2024-04-28T13:08:18.710226+0000","last_undegraded":"2024-04-28T13:08:18.710226+0000","last_fullsized":"2024-04-28T13:08:18.710226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:16:09.096775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.711593+0000","last_change":"2024-04-28T13:08:17.701639+0000","last_active":"2024-04-28T13:08:18.711593+0000","last_peered":"2024-04-28T13:08:18.711593+0000","last_clean":"2024-04-28T13:08:18.711593+0000","last_became_active":"2024-04-28T13:08:17.701393+0000","last_became_peered":"2024-04-28T13:08:17.701393+0000","last_unstale":"2024-04-28T13:08:18.711593+0000","last_undegraded":"2024-04-28T13:08:18.711593+0000","last_fullsized":"2024-04-28T13:08:18.711593+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:02:49.130264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.715545+0000","last_change":"2024-04-28T13:08:18.714007+0000","last_active":"2024-04-28T13:08:18.715545+0000","last_peered":"2024-04-28T13:08:18.715545+0000","last_clean":"2024-04-28T13:08:18.715545+0000","last_became_active":"2024-04-28T13:08:18.713651+0000","last_became_peered":"2024-04-28T13:08:18.713651+0000","last_unstale":"2024-04-28T13:08:18.715545+0000","last_undegraded":"2024-04-28T13:08:18.715545+0000","last_fullsized":"2024-04-28T13:08:18.715545+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:46:20.181490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.714937+0000","last_change":"2024-04-28T13:08:17.698550+0000","last_active":"2024-04-28T13:08:18.714937+0000","last_peered":"2024-04-28T13:08:18.714937+0000","last_clean":"2024-04-28T13:08:18.714937+0000","last_became_active":"2024-04-28T13:08:17.698278+0000","last_became_peered":"2024-04-28T13:08:17.698278+0000","last_unstale":"2024-04-28T13:08:18.714937+0000","last_undegraded":"2024-04-28T13:08:18.714937+0000","last_fullsized":"2024-04-28T13:08:18.714937+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:20:08.827919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.714939+0000","last_change":"2024-04-28T13:08:18.710814+0000","last_active":"2024-04-28T13:08:18.714939+0000","last_peered":"2024-04-28T13:08:18.714939+0000","last_clean":"2024-04-28T13:08:18.714939+0000","last_became_active":"2024-04-28T13:08:18.710494+0000","last_became_peered":"2024-04-28T13:08:18.710494+0000","last_unstale":"2024-04-28T13:08:18.714939+0000","last_undegraded":"2024-04-28T13:08:18.714939+0000","last_fullsized":"2024-04-28T13:08:18.714939+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:43:35.816012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.716927+0000","last_change":"2024-04-28T13:08:17.699664+0000","last_active":"2024-04-28T13:08:18.716927+0000","last_peered":"2024-04-28T13:08:18.716927+0000","last_clean":"2024-04-28T13:08:18.716927+0000","last_became_active":"2024-04-28T13:08:17.699358+0000","last_became_peered":"2024-04-28T13:08:17.699358+0000","last_unstale":"2024-04-28T13:08:18.716927+0000","last_undegraded":"2024-04-28T13:08:18.716927+0000","last_fullsized":"2024-04-28T13:08:18.716927+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:25:07.327590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.702588+0000","last_change":"2024-04-28T13:08:18.700629+0000","last_active":"2024-04-28T13:08:18.702588+0000","last_peered":"2024-04-28T13:08:18.702588+0000","last_clean":"2024-04-28T13:08:18.702588+0000","last_became_active":"2024-04-28T13:08:18.700357+0000","last_became_peered":"2024-04-28T13:08:18.700357+0000","last_unstale":"2024-04-28T13:08:18.702588+0000","last_undegraded":"2024-04-28T13:08:18.702588+0000","last_fullsized":"2024-04-28T13:08:18.702588+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T13:48:15.460108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.688084+0000","last_change":"2024-04-28T13:08:17.697965+0000","last_active":"2024-04-28T13:08:18.688084+0000","last_peered":"2024-04-28T13:08:18.688084+0000","last_clean":"2024-04-28T13:08:18.688084+0000","last_became_active":"2024-04-28T13:08:17.697679+0000","last_became_peered":"2024-04-28T13:08:17.697679+0000","last_unstale":"2024-04-28T13:08:18.688084+0000","last_undegraded":"2024-04-28T13:08:18.688084+0000","last_fullsized":"2024-04-28T13:08:18.688084+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:54:59.534682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.716742+0000","last_change":"2024-04-28T13:08:18.714211+0000","last_active":"2024-04-28T13:08:18.716742+0000","last_peered":"2024-04-28T13:08:18.716742+0000","last_clean":"2024-04-28T13:08:18.716742+0000","last_became_active":"2024-04-28T13:08:18.713848+0000","last_became_peered":"2024-04-28T13:08:18.713848+0000","last_unstale":"2024-04-28T13:08:18.716742+0000","last_undegraded":"2024-04-28T13:08:18.716742+0000","last_fullsized":"2024-04-28T13:08:18.716742+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:30:23.765989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.717910+0000","last_change":"2024-04-28T13:08:17.704239+0000","last_active":"2024-04-28T13:08:18.717910+0000","last_peered":"2024-04-28T13:08:18.717910+0000","last_clean":"2024-04-28T13:08:18.717910+0000","last_became_active":"2024-04-28T13:08:17.703962+0000","last_became_peered":"2024-04-28T13:08:17.703962+0000","last_unstale":"2024-04-28T13:08:18.717910+0000","last_undegraded":"2024-04-28T13:08:18.717910+0000","last_fullsized":"2024-04-28T13:08:18.717910+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:06:36.930120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.700793+0000","last_change":"2024-04-28T13:08:18.698725+0000","last_active":"2024-04-28T13:08:18.700793+0000","last_peered":"2024-04-28T13:08:18.700793+0000","last_clean":"2024-04-28T13:08:18.700793+0000","last_became_active":"2024-04-28T13:08:18.698465+0000","last_became_peered":"2024-04-28T13:08:18.698465+0000","last_unstale":"2024-04-28T13:08:18.700793+0000","last_undegraded":"2024-04-28T13:08:18.700793+0000","last_fullsized":"2024-04-28T13:08:18.700793+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:06:13.585618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.696709+0000","last_change":"2024-04-28T13:08:17.705048+0000","last_active":"2024-04-28T13:08:18.696709+0000","last_peered":"2024-04-28T13:08:18.696709+0000","last_clean":"2024-04-28T13:08:18.696709+0000","last_became_active":"2024-04-28T13:08:17.704737+0000","last_became_peered":"2024-04-28T13:08:17.704737+0000","last_unstale":"2024-04-28T13:08:18.696709+0000","last_undegraded":"2024-04-28T13:08:18.696709+0000","last_fullsized":"2024-04-28T13:08:18.696709+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:06:36.930120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.700778+0000","last_change":"2024-04-28T13:08:18.698156+0000","last_active":"2024-04-28T13:08:18.700778+0000","last_peered":"2024-04-28T13:08:18.700778+0000","last_clean":"2024-04-28T13:08:18.700778+0000","last_became_active":"2024-04-28T13:08:18.697901+0000","last_became_peered":"2024-04-28T13:08:18.697901+0000","last_unstale":"2024-04-28T13:08:18.700778+0000","last_undegraded":"2024-04-28T13:08:18.700778+0000","last_fullsized":"2024-04-28T13:08:18.700778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:05:17.164607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.688009+0000","last_change":"2024-04-28T13:08:17.703198+0000","last_active":"2024-04-28T13:08:18.688009+0000","last_peered":"2024-04-28T13:08:18.688009+0000","last_clean":"2024-04-28T13:08:18.688009+0000","last_became_active":"2024-04-28T13:08:17.702950+0000","last_became_peered":"2024-04-28T13:08:17.702950+0000","last_unstale":"2024-04-28T13:08:18.688009+0000","last_undegraded":"2024-04-28T13:08:18.688009+0000","last_fullsized":"2024-04-28T13:08:18.688009+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:38:44.699164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.702568+0000","last_change":"2024-04-28T13:08:18.701083+0000","last_active":"2024-04-28T13:08:18.702568+0000","last_peered":"2024-04-28T13:08:18.702568+0000","last_clean":"2024-04-28T13:08:18.702568+0000","last_became_active":"2024-04-28T13:08:18.700788+0000","last_became_peered":"2024-04-28T13:08:18.700788+0000","last_unstale":"2024-04-28T13:08:18.702568+0000","last_undegraded":"2024-04-28T13:08:18.702568+0000","last_fullsized":"2024-04-28T13:08:18.702568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:44:19.552362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.696292+0000","last_change":"2024-04-28T13:08:17.702516+0000","last_active":"2024-04-28T13:08:18.696292+0000","last_peered":"2024-04-28T13:08:18.696292+0000","last_clean":"2024-04-28T13:08:18.696292+0000","last_became_active":"2024-04-28T13:08:17.702024+0000","last_became_peered":"2024-04-28T13:08:17.702024+0000","last_unstale":"2024-04-28T13:08:18.696292+0000","last_undegraded":"2024-04-28T13:08:18.696292+0000","last_fullsized":"2024-04-28T13:08:18.696292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:17:50.392973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.708474+0000","last_change":"2024-04-28T13:08:18.704697+0000","last_active":"2024-04-28T13:08:18.708474+0000","last_peered":"2024-04-28T13:08:18.708474+0000","last_clean":"2024-04-28T13:08:18.708474+0000","last_became_active":"2024-04-28T13:08:18.704425+0000","last_became_peered":"2024-04-28T13:08:18.704425+0000","last_unstale":"2024-04-28T13:08:18.708474+0000","last_undegraded":"2024-04-28T13:08:18.708474+0000","last_fullsized":"2024-04-28T13:08:18.708474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:32:52.129781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.714786+0000","last_change":"2024-04-28T13:08:17.701108+0000","last_active":"2024-04-28T13:08:18.714786+0000","last_peered":"2024-04-28T13:08:18.714786+0000","last_clean":"2024-04-28T13:08:18.714786+0000","last_became_active":"2024-04-28T13:08:17.700805+0000","last_became_peered":"2024-04-28T13:08:17.700805+0000","last_unstale":"2024-04-28T13:08:18.714786+0000","last_undegraded":"2024-04-28T13:08:18.714786+0000","last_fullsized":"2024-04-28T13:08:18.714786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:23:57.660585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.714182+0000","last_change":"2024-04-28T13:08:18.712612+0000","last_active":"2024-04-28T13:08:18.714182+0000","last_peered":"2024-04-28T13:08:18.714182+0000","last_clean":"2024-04-28T13:08:18.714182+0000","last_became_active":"2024-04-28T13:08:18.712107+0000","last_became_peered":"2024-04-28T13:08:18.712107+0000","last_unstale":"2024-04-28T13:08:18.714182+0000","last_undegraded":"2024-04-28T13:08:18.714182+0000","last_fullsized":"2024-04-28T13:08:18.714182+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:09:40.886228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.686496+0000","last_change":"2024-04-28T13:08:17.705412+0000","last_active":"2024-04-28T13:08:18.686496+0000","last_peered":"2024-04-28T13:08:18.686496+0000","last_clean":"2024-04-28T13:08:18.686496+0000","last_became_active":"2024-04-28T13:08:17.705137+0000","last_became_peered":"2024-04-28T13:08:17.705137+0000","last_unstale":"2024-04-28T13:08:18.686496+0000","last_undegraded":"2024-04-28T13:08:18.686496+0000","last_fullsized":"2024-04-28T13:08:18.686496+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:23:57.660585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.712163+0000","last_change":"2024-04-28T13:08:18.703888+0000","last_active":"2024-04-28T13:08:18.712163+0000","last_peered":"2024-04-28T13:08:18.712163+0000","last_clean":"2024-04-28T13:08:18.712163+0000","last_became_active":"2024-04-28T13:08:18.703617+0000","last_became_peered":"2024-04-28T13:08:18.703617+0000","last_unstale":"2024-04-28T13:08:18.712163+0000","last_undegraded":"2024-04-28T13:08:18.712163+0000","last_fullsized":"2024-04-28T13:08:18.712163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:38:31.472938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.690366+0000","last_change":"2024-04-28T13:08:17.697870+0000","last_active":"2024-04-28T13:08:18.690366+0000","last_peered":"2024-04-28T13:08:18.690366+0000","last_clean":"2024-04-28T13:08:18.690366+0000","last_became_active":"2024-04-28T13:08:17.697291+0000","last_became_peered":"2024-04-28T13:08:17.697291+0000","last_unstale":"2024-04-28T13:08:18.690366+0000","last_undegraded":"2024-04-28T13:08:18.690366+0000","last_fullsized":"2024-04-28T13:08:18.690366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:06:36.930120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.705296+0000","last_change":"2024-04-28T13:08:18.704138+0000","last_active":"2024-04-28T13:08:18.705296+0000","last_peered":"2024-04-28T13:08:18.705296+0000","last_clean":"2024-04-28T13:08:18.705296+0000","last_became_active":"2024-04-28T13:08:18.703851+0000","last_became_peered":"2024-04-28T13:08:18.703851+0000","last_unstale":"2024-04-28T13:08:18.705296+0000","last_undegraded":"2024-04-28T13:08:18.705296+0000","last_fullsized":"2024-04-28T13:08:18.705296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:47:41.611958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.686167+0000","last_change":"2024-04-28T13:08:17.698373+0000","last_active":"2024-04-28T13:08:18.686167+0000","last_peered":"2024-04-28T13:08:18.686167+0000","last_clean":"2024-04-28T13:08:18.686167+0000","last_became_active":"2024-04-28T13:08:17.698093+0000","last_became_peered":"2024-04-28T13:08:17.698093+0000","last_unstale":"2024-04-28T13:08:18.686167+0000","last_undegraded":"2024-04-28T13:08:18.686167+0000","last_fullsized":"2024-04-28T13:08:18.686167+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:04:11.566854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.703625+0000","last_change":"2024-04-28T13:08:18.701117+0000","last_active":"2024-04-28T13:08:18.703625+0000","last_peered":"2024-04-28T13:08:18.703625+0000","last_clean":"2024-04-28T13:08:18.703625+0000","last_became_active":"2024-04-28T13:08:18.700856+0000","last_became_peered":"2024-04-28T13:08:18.700856+0000","last_unstale":"2024-04-28T13:08:18.703625+0000","last_undegraded":"2024-04-28T13:08:18.703625+0000","last_fullsized":"2024-04-28T13:08:18.703625+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:44:19.552362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.691013+0000","last_change":"2024-04-28T13:08:17.708128+0000","last_active":"2024-04-28T13:08:18.691013+0000","last_peered":"2024-04-28T13:08:18.691013+0000","last_clean":"2024-04-28T13:08:18.691013+0000","last_became_active":"2024-04-28T13:08:17.707846+0000","last_became_peered":"2024-04-28T13:08:17.707846+0000","last_unstale":"2024-04-28T13:08:18.691013+0000","last_undegraded":"2024-04-28T13:08:18.691013+0000","last_fullsized":"2024-04-28T13:08:18.691013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:47:40.609566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.711059+0000","last_change":"2024-04-28T13:08:18.703934+0000","last_active":"2024-04-28T13:08:18.711059+0000","last_peered":"2024-04-28T13:08:18.711059+0000","last_clean":"2024-04-28T13:08:18.711059+0000","last_became_active":"2024-04-28T13:08:18.701960+0000","last_became_peered":"2024-04-28T13:08:18.701960+0000","last_unstale":"2024-04-28T13:08:18.711059+0000","last_undegraded":"2024-04-28T13:08:18.711059+0000","last_fullsized":"2024-04-28T13:08:18.711059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T16:12:59.642117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.687789+0000","last_change":"2024-04-28T13:08:17.695566+0000","last_active":"2024-04-28T13:08:18.687789+0000","last_peered":"2024-04-28T13:08:18.687789+0000","last_clean":"2024-04-28T13:08:18.687789+0000","last_became_active":"2024-04-28T13:08:17.695279+0000","last_became_peered":"2024-04-28T13:08:17.695279+0000","last_unstale":"2024-04-28T13:08:18.687789+0000","last_undegraded":"2024-04-28T13:08:18.687789+0000","last_fullsized":"2024-04-28T13:08:18.687789+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:32:51.127389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.710405+0000","last_change":"2024-04-28T13:08:18.703684+0000","last_active":"2024-04-28T13:08:18.710405+0000","last_peered":"2024-04-28T13:08:18.710405+0000","last_clean":"2024-04-28T13:08:18.710405+0000","last_became_active":"2024-04-28T13:08:18.703178+0000","last_became_peered":"2024-04-28T13:08:18.703178+0000","last_unstale":"2024-04-28T13:08:18.710405+0000","last_undegraded":"2024-04-28T13:08:18.710405+0000","last_fullsized":"2024-04-28T13:08:18.710405+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:17:51.395365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.692192+0000","last_change":"2024-04-28T13:08:17.702817+0000","last_active":"2024-04-28T13:08:18.692192+0000","last_peered":"2024-04-28T13:08:18.692192+0000","last_clean":"2024-04-28T13:08:18.692192+0000","last_became_active":"2024-04-28T13:08:17.702110+0000","last_became_peered":"2024-04-28T13:08:17.702110+0000","last_unstale":"2024-04-28T13:08:18.692192+0000","last_undegraded":"2024-04-28T13:08:18.692192+0000","last_fullsized":"2024-04-28T13:08:18.692192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:44:18.549970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.700638+0000","last_change":"2024-04-28T13:08:18.699123+0000","last_active":"2024-04-28T13:08:18.700638+0000","last_peered":"2024-04-28T13:08:18.700638+0000","last_clean":"2024-04-28T13:08:18.700638+0000","last_became_active":"2024-04-28T13:08:18.698843+0000","last_became_peered":"2024-04-28T13:08:18.698843+0000","last_unstale":"2024-04-28T13:08:18.700638+0000","last_undegraded":"2024-04-28T13:08:18.700638+0000","last_fullsized":"2024-04-28T13:08:18.700638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:17.678021+0000","last_clean_scrub_stamp":"2024-04-28T13:08:17.678021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:17:51.395365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.694842+0000","last_change":"2024-04-28T13:08:17.699231+0000","last_active":"2024-04-28T13:08:18.694842+0000","last_peered":"2024-04-28T13:08:18.694842+0000","last_clean":"2024-04-28T13:08:18.694842+0000","last_became_active":"2024-04-28T13:08:17.698911+0000","last_became_peered":"2024-04-28T13:08:17.698911+0000","last_unstale":"2024-04-28T13:08:18.694842+0000","last_undegraded":"2024-04-28T13:08:18.694842+0000","last_fullsized":"2024-04-28T13:08:18.694842+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:16.675630+0000","last_clean_scrub_stamp":"2024-04-28T13:08:16.675630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:20:08.827919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-28T13:08:18.691589+0000","last_change":"2024-04-28T13:07:16.698740+0000","last_active":"2024-04-28T13:08:18.691589+0000","last_peered":"2024-04-28T13:08:18.691589+0000","last_clean":"2024-04-28T13:08:18.691589+0000","last_became_active":"2024-04-28T13:07:16.696364+0000","last_became_peered":"2024-04-28T13:07:16.696364+0000","last_unstale":"2024-04-28T13:08:18.691589+0000","last_undegraded":"2024-04-28T13:08:18.691589+0000","last_fullsized":"2024-04-28T13:08:18.691589+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:14.770499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:14.770499+0000","last_clean_scrub_stamp":"2024-04-28T13:07:14.770499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:39:38.986133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":728580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":138212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":138212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":138212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":138212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":145057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":138212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":728580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-28T13:08:21.987 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-28T13:08:21.987 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-28T13:08:22.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.127+0000 7f73c6b0a640 1 Processor -- start 2024-04-28T13:08:22.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.128+0000 7f73c6b0a640 1 -- start start 2024-04-28T13:08:22.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.128+0000 7f73c6b0a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f73c0072e30 0x7f73c00732b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:22.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.128+0000 7f73c6b0a640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73c00d02b0 con 0x7f73c00b4850 2024-04-28T13:08:22.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.128+0000 7f73c6b0a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73c00cedc0 con 0x7f73c015c370 2024-04-28T13:08:22.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.128+0000 7f73c6b0a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f73c0073cc0 con 0x7f73c0072e30 2024-04-28T13:08:22.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.129+0000 7f73c48a6640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f73c00b4850 0x7f73c00b4c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52958/0 (socket says 172.21.15.114:52958) 2024-04-28T13:08:22.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.129+0000 7f73c48a6640 1 -- 172.21.15.114:0/2692351492 learned_addr learned my addr 172.21.15.114:0/2692351492 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:22.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.129+0000 7f73bffff640 1 --2- 172.21.15.114:0/2692351492 >> v2:172.21.15.134:3300/0 conn(0x7f73c0072e30 0x7f73c00732b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:22.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.129+0000 7f73bf7fe640 1 -- 172.21.15.114:0/2692351492 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3054721383 0 0) 0x7f73c00d02b0 con 0x7f73c00b4850 2024-04-28T13:08:22.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.129+0000 7f73bf7fe640 1 -- 172.21.15.114:0/2692351492 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73b0003520 con 0x7f73c00b4850 2024-04-28T13:08:22.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.129+0000 7f73bf7fe640 1 -- 172.21.15.114:0/2692351492 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3217132567 0 0) 0x7f73b0003520 con 0x7f73c00b4850 2024-04-28T13:08:22.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.129+0000 7f73bf7fe640 1 -- 172.21.15.114:0/2692351492 >> v2:172.21.15.134:3300/0 conn(0x7f73c0072e30 msgr2=0x7f73c00732b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:22.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.129+0000 7f73bf7fe640 1 --2- 172.21.15.114:0/2692351492 >> v2:172.21.15.134:3300/0 conn(0x7f73c0072e30 0x7f73c00732b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:22.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.129+0000 7f73bf7fe640 1 -- 172.21.15.114:0/2692351492 >> v1:172.21.15.134:6789/0 conn(0x7f73c015c370 legacy=0x7f73c015c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:22.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.129+0000 7f73bf7fe640 1 -- 172.21.15.114:0/2692351492 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c0073fa0 con 0x7f73c00b4850 2024-04-28T13:08:22.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.129+0000 7f73bf7fe640 1 -- 172.21.15.114:0/2692351492 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f73b4001670 con 0x7f73c00b4850 2024-04-28T13:08:22.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.129+0000 7f73bf7fe640 1 -- 172.21.15.114:0/2692351492 >> v1:172.21.15.114:6789/0 conn(0x7f73c00b4850 legacy=0x7f73c00b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:22.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.129+0000 7f73bf7fe640 1 --2- 172.21.15.114:0/2692351492 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73b00039b0 0x7f73b0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:22.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.129+0000 7f73bf7fe640 1 --2- 172.21.15.114:0/2692351492 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73b0004800 0x7f73b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:22.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.129+0000 7f73bf7fe640 1 --2- 172.21.15.114:0/2692351492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73b00051c0 0x7f73b000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:22.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.129+0000 7f73bf7fe640 1 -- 172.21.15.114:0/2692351492 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f73c0073cc0 con 0x7f73b00039b0 2024-04-28T13:08:22.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.129+0000 7f73bf7fe640 1 -- 172.21.15.114:0/2692351492 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f73b000c160 con 0x7f73b00051c0 2024-04-28T13:08:22.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.129+0000 7f73bf7fe640 1 -- 172.21.15.114:0/2692351492 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f73b000c360 con 0x7f73b0004800 2024-04-28T13:08:22.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.129+0000 7f73c48a6640 1 --2- 172.21.15.114:0/2692351492 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73b00039b0 0x7f73b0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:22.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.129+0000 7f73bffff640 1 --2- 172.21.15.114:0/2692351492 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73b0004800 0x7f73b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:22.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.129+0000 7f73c50a7640 1 --2- 172.21.15.114:0/2692351492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73b00051c0 0x7f73b000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:22.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.130+0000 7f73c48a6640 1 -- 172.21.15.114:0/2692351492 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73b0004800 msgr2=0x7f73b0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:22.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.130+0000 7f73c48a6640 1 --2- 172.21.15.114:0/2692351492 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73b0004800 0x7f73b0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:22.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.130+0000 7f73c48a6640 1 -- 172.21.15.114:0/2692351492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73b00051c0 msgr2=0x7f73b000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:22.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.130+0000 7f73c48a6640 1 --2- 172.21.15.114:0/2692351492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73b00051c0 0x7f73b000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:22.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.130+0000 7f73c48a6640 1 -- 172.21.15.114:0/2692351492 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b0003520 con 0x7f73b00039b0 2024-04-28T13:08:22.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.130+0000 7f73c50a7640 1 -- 172.21.15.114:0/2692351492 reap_dead start 2024-04-28T13:08:22.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.130+0000 7f73c48a6640 1 --2- 172.21.15.114:0/2692351492 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73b00039b0 0x7f73b0003dd0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f73b400c210 tx=0x7f73b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c08dc4d434bc5b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:22.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.130+0000 7f73bf7fe640 1 -- 172.21.15.114:0/2692351492 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b4007d10 con 0x7f73b00039b0 2024-04-28T13:08:22.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.130+0000 7f73bf7fe640 1 -- 172.21.15.114:0/2692351492 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73b40058d0 con 0x7f73b00039b0 2024-04-28T13:08:22.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.130+0000 7f73bf7fe640 1 -- 172.21.15.114:0/2692351492 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b4005ce0 con 0x7f73b00039b0 2024-04-28T13:08:22.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.131+0000 7f73c6b0a640 1 -- 172.21.15.114:0/2692351492 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73b00039b0 msgr2=0x7f73b0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:22.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.131+0000 7f73c6b0a640 1 --2- 172.21.15.114:0/2692351492 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73b00039b0 0x7f73b0003dd0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f73b400c210 tx=0x7f73b0005830 comp rx=0 tx=0).stop 2024-04-28T13:08:22.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.131+0000 7f73c6b0a640 1 -- 172.21.15.114:0/2692351492 shutdown_connections 2024-04-28T13:08:22.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.131+0000 7f73c6b0a640 1 --2- 172.21.15.114:0/2692351492 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73b00039b0 0x7f73b0003dd0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:22.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.131+0000 7f73c6b0a640 1 -- 172.21.15.114:0/2692351492 >> 172.21.15.114:0/2692351492 conn(0x7f73c006c980 msgr2=0x7f73c00b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:22.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.131+0000 7f73c6b0a640 1 -- 172.21.15.114:0/2692351492 shutdown_connections 2024-04-28T13:08:22.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.131+0000 7f73c6b0a640 1 -- 172.21.15.114:0/2692351492 wait complete. 2024-04-28T13:08:22.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.132+0000 7f73c6b0a640 1 Processor -- start 2024-04-28T13:08:22.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.132+0000 7f73c6b0a640 1 -- start start 2024-04-28T13:08:22.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.133+0000 7f73c6b0a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73b00039b0 0x7f73c013f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:22.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.133+0000 7f73c6b0a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73c014db90 0x7f73c015ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:22.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.133+0000 7f73c6b0a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73c01563d0 0x7f73c0156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:22.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.133+0000 7f73c6b0a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f73c006e3e0 con 0x7f73b00039b0 2024-04-28T13:08:22.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.133+0000 7f73c6b0a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f73c0074560 con 0x7f73c014db90 2024-04-28T13:08:22.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.133+0000 7f73c6b0a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f73c00732b0 con 0x7f73c01563d0 2024-04-28T13:08:22.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.133+0000 7f73c48a6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73b00039b0 0x7f73c013f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:22.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.133+0000 7f73c48a6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73b00039b0 0x7f73c013f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33038/0 (socket says 172.21.15.114:33038) 2024-04-28T13:08:22.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.133+0000 7f73c48a6640 1 -- 172.21.15.114:0/1186521523 learned_addr learned my addr 172.21.15.114:0/1186521523 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:22.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.133+0000 7f73c50a7640 1 --2- 172.21.15.114:0/1186521523 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73c01563d0 0x7f73c0156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:22.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.133+0000 7f73bffff640 1 --2- 172.21.15.114:0/1186521523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73c014db90 0x7f73c015ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:22.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.133+0000 7f73c48a6640 1 -- 172.21.15.114:0/1186521523 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73c01563d0 msgr2=0x7f73c0156850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:22.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.133+0000 7f73c48a6640 1 --2- 172.21.15.114:0/1186521523 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73c01563d0 0x7f73c0156850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:22.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.133+0000 7f73c48a6640 1 -- 172.21.15.114:0/1186521523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73c014db90 msgr2=0x7f73c015ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:22.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.133+0000 7f73c48a6640 1 --2- 172.21.15.114:0/1186521523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73c014db90 0x7f73c015ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:22.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.133+0000 7f73c48a6640 1 -- 172.21.15.114:0/1186521523 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c015f600 con 0x7f73b00039b0 2024-04-28T13:08:22.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.133+0000 7f73c50a7640 1 --2- 172.21.15.114:0/1186521523 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73c01563d0 0x7f73c0156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:22.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.133+0000 7f73bffff640 1 --2- 172.21.15.114:0/1186521523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73c014db90 0x7f73c015ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:22.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.133+0000 7f73c48a6640 1 --2- 172.21.15.114:0/1186521523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73b00039b0 0x7f73c013f880 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f73b400c210 tx=0x7f73c0074170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:22.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.134+0000 7f73bd7fa640 1 -- 172.21.15.114:0/1186521523 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b4001c70 con 0x7f73b00039b0 2024-04-28T13:08:22.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.134+0000 7f73bd7fa640 1 -- 172.21.15.114:0/1186521523 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73b40049f0 con 0x7f73b00039b0 2024-04-28T13:08:22.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.134+0000 7f73c6b0a640 1 -- 172.21.15.114:0/1186521523 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73c01410e0 con 0x7f73b00039b0 2024-04-28T13:08:22.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.134+0000 7f73bd7fa640 1 -- 172.21.15.114:0/1186521523 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b4004bc0 con 0x7f73b00039b0 2024-04-28T13:08:22.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.134+0000 7f73c6b0a640 1 -- 172.21.15.114:0/1186521523 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73c01416a0 con 0x7f73b00039b0 2024-04-28T13:08:22.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.135+0000 7f73c6b0a640 1 -- 172.21.15.114:0/1186521523 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73c006a3d0 con 0x7f73b00039b0 2024-04-28T13:08:22.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.135+0000 7f73bd7fa640 1 -- 172.21.15.114:0/1186521523 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f73b403b070 con 0x7f73b00039b0 2024-04-28T13:08:22.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.135+0000 7f73bd7fa640 1 --2- 172.21.15.114:0/1186521523 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f73a406c8f0 0x7f73a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:22.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.136+0000 7f73bd7fa640 1 -- 172.21.15.114:0/1186521523 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f73b40ab770 con 0x7f73b00039b0 2024-04-28T13:08:22.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.136+0000 7f73bffff640 1 --2- 172.21.15.114:0/1186521523 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f73a406c8f0 0x7f73a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:22.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.136+0000 7f73bffff640 1 --2- 172.21.15.114:0/1186521523 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f73a406c8f0 0x7f73a406edb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f73c015cc10 tx=0x7f73ac00b3a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:22.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.140+0000 7f73bd7fa640 1 -- 172.21.15.114:0/1186521523 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f73b4079c80 con 0x7f73b00039b0 2024-04-28T13:08:22.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.382+0000 7f73c6b0a640 1 -- 172.21.15.114:0/1186521523 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f73c00ce870 con 0x7f73b00039b0 2024-04-28T13:08:22.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.384+0000 7f73bd7fa640 1 -- 172.21.15.114:0/1186521523 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f73b4044e90 con 0x7f73b00039b0 2024-04-28T13:08:22.384 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2024-04-28T13:08:22.384 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDOSS5mzotvJhAAlis8wXdOL4WCzxzUL8L3qw== 2024-04-28T13:08:22.384 INFO:teuthology.orchestra.run.smithi114.stdout: caps mds = "allow" 2024-04-28T13:08:22.385 INFO:teuthology.orchestra.run.smithi114.stdout: caps mon = "allow r" 2024-04-28T13:08:22.385 INFO:teuthology.orchestra.run.smithi114.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-28T13:08:22.385 INFO:teuthology.orchestra.run.smithi114.stderr:updated caps for client.0 2024-04-28T13:08:22.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.386+0000 7f73c6b0a640 1 -- 172.21.15.114:0/1186521523 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f73a406c8f0 msgr2=0x7f73a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:22.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.386+0000 7f73c6b0a640 1 --2- 172.21.15.114:0/1186521523 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f73a406c8f0 0x7f73a406edb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f73c015cc10 tx=0x7f73ac00b3a0 comp rx=0 tx=0).stop 2024-04-28T13:08:22.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.386+0000 7f73c6b0a640 1 -- 172.21.15.114:0/1186521523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73b00039b0 msgr2=0x7f73c013f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:22.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.386+0000 7f73c6b0a640 1 --2- 172.21.15.114:0/1186521523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73b00039b0 0x7f73c013f880 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f73b400c210 tx=0x7f73c0074170 comp rx=0 tx=0).stop 2024-04-28T13:08:22.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.386+0000 7f73c6b0a640 1 -- 172.21.15.114:0/1186521523 shutdown_connections 2024-04-28T13:08:22.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.386+0000 7f73c6b0a640 1 --2- 172.21.15.114:0/1186521523 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73c01563d0 0x7f73c0156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:22.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.386+0000 7f73c6b0a640 1 --2- 172.21.15.114:0/1186521523 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f73a406c8f0 0x7f73a406edb0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:22.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.387+0000 7f73c6b0a640 1 --2- 172.21.15.114:0/1186521523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73c014db90 0x7f73c015ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:22.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.387+0000 7f73c6b0a640 1 --2- 172.21.15.114:0/1186521523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73b00039b0 0x7f73c013f880 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:22.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.387+0000 7f73c6b0a640 1 -- 172.21.15.114:0/1186521523 >> 172.21.15.114:0/1186521523 conn(0x7f73c006c980 msgr2=0x7f73c015b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:22.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.387+0000 7f73c6b0a640 1 -- 172.21.15.114:0/1186521523 shutdown_connections 2024-04-28T13:08:22.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.387+0000 7f73c6b0a640 1 -- 172.21.15.114:0/1186521523 wait complete. 2024-04-28T13:08:22.397 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-28T13:08:22.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.494+0000 7f7303baf640 1 Processor -- start 2024-04-28T13:08:22.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.494+0000 7f7303baf640 1 -- start start 2024-04-28T13:08:22.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.495+0000 7f7303baf640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f72fc0b58a0 0x7f72fc071490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:22.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.495+0000 7f7303baf640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72fc073ce0 con 0x7f72fc0b53f0 2024-04-28T13:08:22.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.495+0000 7f7303baf640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72fc073fc0 con 0x7f72fc1487f0 2024-04-28T13:08:22.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.495+0000 7f7303baf640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f72fc074580 con 0x7f72fc0b58a0 2024-04-28T13:08:22.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.495+0000 7f730114a640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f72fc0b53f0 0x7f72fc070d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52964/0 (socket says 172.21.15.114:52964) 2024-04-28T13:08:22.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.495+0000 7f730114a640 1 -- 172.21.15.114:0/704804759 learned_addr learned my addr 172.21.15.114:0/704804759 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:22.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.495+0000 7f7300949640 1 -- 172.21.15.114:0/704804759 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1842919860 0 0) 0x7f72fc073ce0 con 0x7f72fc0b53f0 2024-04-28T13:08:22.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.495+0000 7f7300949640 1 -- 172.21.15.114:0/704804759 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72e8003520 con 0x7f72fc0b53f0 2024-04-28T13:08:22.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.495+0000 7f730214c640 1 --2- 172.21.15.114:0/704804759 >> v2:172.21.15.134:3300/0 conn(0x7f72fc0b58a0 0x7f72fc071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:22.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.495+0000 7f7300949640 1 -- 172.21.15.114:0/704804759 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3347892081 0 0) 0x7f72e8003520 con 0x7f72fc0b53f0 2024-04-28T13:08:22.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.495+0000 7f7300949640 1 -- 172.21.15.114:0/704804759 >> v2:172.21.15.134:3300/0 conn(0x7f72fc0b58a0 msgr2=0x7f72fc071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:22.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.495+0000 7f7300949640 1 --2- 172.21.15.114:0/704804759 >> v2:172.21.15.134:3300/0 conn(0x7f72fc0b58a0 0x7f72fc071490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:22.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.495+0000 7f7300949640 1 -- 172.21.15.114:0/704804759 >> v1:172.21.15.134:6789/0 conn(0x7f72fc1487f0 legacy=0x7f72fc073290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:22.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.495+0000 7f7300949640 1 -- 172.21.15.114:0/704804759 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72fc0742a0 con 0x7f72fc0b53f0 2024-04-28T13:08:22.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.495+0000 7f7300949640 1 -- 172.21.15.114:0/704804759 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f72f8001670 con 0x7f72fc0b53f0 2024-04-28T13:08:22.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.495+0000 7f7300949640 1 -- 172.21.15.114:0/704804759 >> v1:172.21.15.114:6789/0 conn(0x7f72fc0b53f0 legacy=0x7f72fc070d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:22.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.495+0000 7f7300949640 1 --2- 172.21.15.114:0/704804759 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72e80039b0 0x7f72e8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:22.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.495+0000 7f7300949640 1 --2- 172.21.15.114:0/704804759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72e8004800 0x7f72e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:22.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.495+0000 7f7300949640 1 --2- 172.21.15.114:0/704804759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72e80051c0 0x7f72e800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:22.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.495+0000 7f7300949640 1 -- 172.21.15.114:0/704804759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f72fc074580 con 0x7f72e80051c0 2024-04-28T13:08:22.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.495+0000 7f7300949640 1 -- 172.21.15.114:0/704804759 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f72e800c160 con 0x7f72e8004800 2024-04-28T13:08:22.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.495+0000 7f7300949640 1 -- 172.21.15.114:0/704804759 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f72e800c360 con 0x7f72e80039b0 2024-04-28T13:08:22.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.495+0000 7f730214c640 1 --2- 172.21.15.114:0/704804759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72e80051c0 0x7f72e800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:22.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.495+0000 7f730114a640 1 --2- 172.21.15.114:0/704804759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72e8004800 0x7f72e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:22.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.495+0000 7f730194b640 1 --2- 172.21.15.114:0/704804759 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72e80039b0 0x7f72e8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:22.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.496+0000 7f730214c640 1 -- 172.21.15.114:0/704804759 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72e80039b0 msgr2=0x7f72e8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:22.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.496+0000 7f730214c640 1 --2- 172.21.15.114:0/704804759 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72e80039b0 0x7f72e8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:22.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.496+0000 7f730214c640 1 -- 172.21.15.114:0/704804759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72e8004800 msgr2=0x7f72e8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:22.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.496+0000 7f730214c640 1 --2- 172.21.15.114:0/704804759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72e8004800 0x7f72e8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:22.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.496+0000 7f730214c640 1 -- 172.21.15.114:0/704804759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e8003520 con 0x7f72e80051c0 2024-04-28T13:08:22.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.496+0000 7f730214c640 1 -- 172.21.15.114:0/704804759 reap_dead start 2024-04-28T13:08:22.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.496+0000 7f730214c640 1 --2- 172.21.15.114:0/704804759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72e80051c0 0x7f72e800b9c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f72f4009fc0 tx=0x7f72e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86580d97e46ac9a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:22.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.496+0000 7f7300949640 1 -- 172.21.15.114:0/704804759 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f4035020 con 0x7f72e80051c0 2024-04-28T13:08:22.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.496+0000 7f7300949640 1 -- 172.21.15.114:0/704804759 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f4003bd0 con 0x7f72e80051c0 2024-04-28T13:08:22.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.496+0000 7f7300949640 1 -- 172.21.15.114:0/704804759 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f4009c10 con 0x7f72e80051c0 2024-04-28T13:08:22.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.497+0000 7f7303baf640 1 -- 172.21.15.114:0/704804759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72e80051c0 msgr2=0x7f72e800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:22.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.497+0000 7f7303baf640 1 --2- 172.21.15.114:0/704804759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72e80051c0 0x7f72e800b9c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f72f4009fc0 tx=0x7f72e8005830 comp rx=0 tx=0).stop 2024-04-28T13:08:22.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.497+0000 7f7303baf640 1 -- 172.21.15.114:0/704804759 shutdown_connections 2024-04-28T13:08:22.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.497+0000 7f7303baf640 1 --2- 172.21.15.114:0/704804759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72e80051c0 0x7f72e800b9c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:22.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.497+0000 7f7303baf640 1 -- 172.21.15.114:0/704804759 >> 172.21.15.114:0/704804759 conn(0x7f72fc0b3d50 msgr2=0x7f72fc0b4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:22.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.497+0000 7f7303baf640 1 -- 172.21.15.114:0/704804759 shutdown_connections 2024-04-28T13:08:22.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.497+0000 7f7303baf640 1 -- 172.21.15.114:0/704804759 wait complete. 2024-04-28T13:08:22.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.498+0000 7f7303baf640 1 Processor -- start 2024-04-28T13:08:22.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.498+0000 7f7303baf640 1 -- start start 2024-04-28T13:08:22.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.499+0000 7f7303baf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72e80051c0 0x7f72fc0d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:22.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.499+0000 7f7303baf640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72fc159770 0x7f72fc155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:22.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.499+0000 7f7303baf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72fc159bf0 0x7f72fc155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:22.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.499+0000 7f7303baf640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f72fc0ae850 con 0x7f72fc159bf0 2024-04-28T13:08:22.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.499+0000 7f7303baf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f72fc0b5c80 con 0x7f72e80051c0 2024-04-28T13:08:22.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.499+0000 7f7303baf640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f72fc0ae9d0 con 0x7f72fc159770 2024-04-28T13:08:22.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.499+0000 7f730214c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72fc159bf0 0x7f72fc155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:22.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.499+0000 7f730214c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72fc159bf0 0x7f72fc155980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33054/0 (socket says 172.21.15.114:33054) 2024-04-28T13:08:22.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.499+0000 7f730214c640 1 -- 172.21.15.114:0/495555770 learned_addr learned my addr 172.21.15.114:0/495555770 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:22.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.499+0000 7f730114a640 1 --2- 172.21.15.114:0/495555770 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72fc159770 0x7f72fc155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:22.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.499+0000 7f730194b640 1 --2- 172.21.15.114:0/495555770 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72e80051c0 0x7f72fc0d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:22.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.499+0000 7f730214c640 1 -- 172.21.15.114:0/495555770 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72fc159770 msgr2=0x7f72fc155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:22.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.499+0000 7f730214c640 1 --2- 172.21.15.114:0/495555770 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72fc159770 0x7f72fc155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:22.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.499+0000 7f730214c640 1 -- 172.21.15.114:0/495555770 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72e80051c0 msgr2=0x7f72fc0d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:22.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.499+0000 7f730214c640 1 --2- 172.21.15.114:0/495555770 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72e80051c0 0x7f72fc0d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:22.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.499+0000 7f730214c640 1 -- 172.21.15.114:0/495555770 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72fc0d0fa0 con 0x7f72fc159bf0 2024-04-28T13:08:22.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.499+0000 7f730194b640 1 --2- 172.21.15.114:0/495555770 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72e80051c0 0x7f72fc0d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:22.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.499+0000 7f730114a640 1 --2- 172.21.15.114:0/495555770 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72fc159770 0x7f72fc155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:22.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.499+0000 7f730214c640 1 --2- 172.21.15.114:0/495555770 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72fc159bf0 0x7f72fc155980 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f72f400e230 tx=0x7f72f4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:22.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.500+0000 7f72f27fc640 1 -- 172.21.15.114:0/495555770 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f4035030 con 0x7f72fc159bf0 2024-04-28T13:08:22.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.500+0000 7f72f27fc640 1 -- 172.21.15.114:0/495555770 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f4043070 con 0x7f72fc159bf0 2024-04-28T13:08:22.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.500+0000 7f7303baf640 1 -- 172.21.15.114:0/495555770 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72fc15ae90 con 0x7f72fc159bf0 2024-04-28T13:08:22.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.500+0000 7f72f27fc640 1 -- 172.21.15.114:0/495555770 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f402d070 con 0x7f72fc159bf0 2024-04-28T13:08:22.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.500+0000 7f7303baf640 1 -- 172.21.15.114:0/495555770 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72fc0d14f0 con 0x7f72fc159bf0 2024-04-28T13:08:22.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.501+0000 7f7303baf640 1 -- 172.21.15.114:0/495555770 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72fc06a3d0 con 0x7f72fc159bf0 2024-04-28T13:08:22.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.501+0000 7f72f27fc640 1 -- 172.21.15.114:0/495555770 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f72f4005d10 con 0x7f72fc159bf0 2024-04-28T13:08:22.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.502+0000 7f72f27fc640 1 --2- 172.21.15.114:0/495555770 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f72e006c8f0 0x7f72e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:22.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.502+0000 7f730194b640 1 --2- 172.21.15.114:0/495555770 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f72e006c8f0 0x7f72e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:22.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.502+0000 7f72f27fc640 1 -- 172.21.15.114:0/495555770 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f72f40acc30 con 0x7f72fc159bf0 2024-04-28T13:08:22.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.502+0000 7f730194b640 1 --2- 172.21.15.114:0/495555770 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f72e006c8f0 0x7f72e006edb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f72ec000c00 tx=0x7f72ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:22.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.506+0000 7f72f27fc640 1 -- 172.21.15.114:0/495555770 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f72f407b210 con 0x7f72fc159bf0 2024-04-28T13:08:22.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.720+0000 7f7303baf640 1 -- 172.21.15.114:0/495555770 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72fc0b4840 con 0x7f72fc159bf0 2024-04-28T13:08:22.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.721+0000 7f72f27fc640 1 -- 172.21.15.114:0/495555770 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5192 (secure 0 0 0) 0x7f72f407ab10 con 0x7f72fc159bf0 2024-04-28T13:08:22.721 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:22.721 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3832267996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":3832267996},{"type":"v1","addr":"172.21.15.134:6835","nonce":3832267996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5130,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2035724706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2035724706},{"type":"v1","addr":"172.21.15.114:6836","nonce":2035724706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":5133,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3180452801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3180452801},{"type":"v1","addr":"172.21.15.114:6837","nonce":3180452801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-28T13:08:18.038213+0000","modified":"2024-04-28T13:08:20.039019+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5145":{"gid":5145,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6834/1155749661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1155749661},{"type":"v1","addr":"172.21.15.134:6834","nonce":1155749661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5145,"qdb_cluster":[5145]},"id":2}]} 2024-04-28T13:08:22.721 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 13 2024-04-28T13:08:22.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.723+0000 7f7303baf640 1 -- 172.21.15.114:0/495555770 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f72e006c8f0 msgr2=0x7f72e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:22.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.723+0000 7f7303baf640 1 --2- 172.21.15.114:0/495555770 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f72e006c8f0 0x7f72e006edb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f72ec000c00 tx=0x7f72ec009040 comp rx=0 tx=0).stop 2024-04-28T13:08:22.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.723+0000 7f7303baf640 1 -- 172.21.15.114:0/495555770 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72fc159bf0 msgr2=0x7f72fc155980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:22.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.723+0000 7f7303baf640 1 --2- 172.21.15.114:0/495555770 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72fc159bf0 0x7f72fc155980 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f72f400e230 tx=0x7f72f4009750 comp rx=0 tx=0).stop 2024-04-28T13:08:22.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.723+0000 7f7303baf640 1 -- 172.21.15.114:0/495555770 shutdown_connections 2024-04-28T13:08:22.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.723+0000 7f7303baf640 1 --2- 172.21.15.114:0/495555770 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72fc159bf0 0x7f72fc155980 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:22.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.723+0000 7f7303baf640 1 --2- 172.21.15.114:0/495555770 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72fc159770 0x7f72fc155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:22.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.723+0000 7f7303baf640 1 --2- 172.21.15.114:0/495555770 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f72e006c8f0 0x7f72e006edb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:22.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.723+0000 7f7303baf640 1 --2- 172.21.15.114:0/495555770 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72e80051c0 0x7f72fc0d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:22.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.723+0000 7f7303baf640 1 -- 172.21.15.114:0/495555770 >> 172.21.15.114:0/495555770 conn(0x7f72fc0b3d50 msgr2=0x7f72fc146aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:22.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.723+0000 7f7303baf640 1 -- 172.21.15.114:0/495555770 shutdown_connections 2024-04-28T13:08:22.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:22.723+0000 7f7303baf640 1 -- 172.21.15.114:0/495555770 wait complete. 2024-04-28T13:08:23.136 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-28T13:08:18.038213+0000', 'modified': '2024-04-28T13:08:20.039019+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5145}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5145': {'gid': 5145, 'name': 'd', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.134:6834/1155749661', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6832', 'nonce': 1155749661}, {'type': 'v1', 'addr': '172.21.15.134:6834', 'nonce': 1155749661}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5145, 'qdb_cluster': [5145]} 2024-04-28T13:08:23.136 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-28T13:08:23.137 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-28T13:08:23.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.235+0000 7f9ae8a62640 1 Processor -- start 2024-04-28T13:08:23.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.235+0000 7f9ae8a62640 1 -- start start 2024-04-28T13:08:23.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.236+0000 7f9ae8a62640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9ae415f1f0 0x7f9ae40b0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:23.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.236+0000 7f9ae8a62640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ae406faa0 con 0x7f9ae40b4700 2024-04-28T13:08:23.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.236+0000 7f9ae8a62640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ae406fd40 con 0x7f9ae40b6890 2024-04-28T13:08:23.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.236+0000 7f9ae8a62640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f9ae4070670 con 0x7f9ae415f1f0 2024-04-28T13:08:23.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.236+0000 7f9ae259c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9ae415f1f0 0x7f9ae40b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:23.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.236+0000 7f9ae2d9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9ae40b4700 0x7f9ae40ae850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52974/0 (socket says 172.21.15.114:52974) 2024-04-28T13:08:23.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.236+0000 7f9ae2d9d640 1 -- 172.21.15.114:0/516092136 learned_addr learned my addr 172.21.15.114:0/516092136 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:23.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.236+0000 7f9ae259c640 1 -- 172.21.15.114:0/516092136 >> v1:172.21.15.134:6789/0 conn(0x7f9ae40b6890 legacy=0x7f9ae4070b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:23.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.236+0000 7f9ae259c640 1 -- 172.21.15.114:0/516092136 >> v1:172.21.15.114:6789/0 conn(0x7f9ae40b4700 legacy=0x7f9ae40ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:23.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.236+0000 7f9ae259c640 1 -- 172.21.15.114:0/516092136 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae4070020 con 0x7f9ae415f1f0 2024-04-28T13:08:23.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.237+0000 7f9ae259c640 1 --2- 172.21.15.114:0/516092136 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ae415f1f0 0x7f9ae40b0940 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9ae40707f0 tx=0x7f9ad402a590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ab7fffa6167c13 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:23.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.237+0000 7f9ae159a640 1 -- 172.21.15.114:0/516092136 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad4007740 con 0x7f9ae415f1f0 2024-04-28T13:08:23.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.237+0000 7f9ae159a640 1 -- 172.21.15.114:0/516092136 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ad40078e0 con 0x7f9ae415f1f0 2024-04-28T13:08:23.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.237+0000 7f9ae159a640 1 -- 172.21.15.114:0/516092136 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad4007cb0 con 0x7f9ae415f1f0 2024-04-28T13:08:23.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.238+0000 7f9ae8a62640 1 -- 172.21.15.114:0/516092136 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ae415f1f0 msgr2=0x7f9ae40b0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:23.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.238+0000 7f9ae8a62640 1 --2- 172.21.15.114:0/516092136 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ae415f1f0 0x7f9ae40b0940 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9ae40707f0 tx=0x7f9ad402a590 comp rx=0 tx=0).stop 2024-04-28T13:08:23.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.238+0000 7f9ae8a62640 1 -- 172.21.15.114:0/516092136 shutdown_connections 2024-04-28T13:08:23.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.238+0000 7f9ae8a62640 1 --2- 172.21.15.114:0/516092136 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ae415f1f0 0x7f9ae40b0940 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.238+0000 7f9ae8a62640 1 -- 172.21.15.114:0/516092136 >> 172.21.15.114:0/516092136 conn(0x7f9ae40738d0 msgr2=0x7f9ae406c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:23.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.238+0000 7f9ae8a62640 1 -- 172.21.15.114:0/516092136 shutdown_connections 2024-04-28T13:08:23.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.238+0000 7f9ae8a62640 1 -- 172.21.15.114:0/516092136 wait complete. 2024-04-28T13:08:23.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.239+0000 7f9ae8a62640 1 Processor -- start 2024-04-28T13:08:23.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.239+0000 7f9ae8a62640 1 -- start start 2024-04-28T13:08:23.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.240+0000 7f9ae8a62640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ae40b4700 0x7f9ae4155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:23.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.240+0000 7f9ae8a62640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ae40b6890 0x7f9ae4154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:23.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.240+0000 7f9ae8a62640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ae415f1f0 0x7f9ae4142e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:23.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.240+0000 7f9ae8a62640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae40b0e80 con 0x7f9ae415f1f0 2024-04-28T13:08:23.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.240+0000 7f9ae8a62640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae415f5d0 con 0x7f9ae40b4700 2024-04-28T13:08:23.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.240+0000 7f9ae8a62640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f9ae40b1000 con 0x7f9ae40b6890 2024-04-28T13:08:23.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.240+0000 7f9ae2d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ae415f1f0 0x7f9ae4142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:23.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.240+0000 7f9ae2d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ae415f1f0 0x7f9ae4142e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33074/0 (socket says 172.21.15.114:33074) 2024-04-28T13:08:23.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.240+0000 7f9ae2d9d640 1 -- 172.21.15.114:0/795692253 learned_addr learned my addr 172.21.15.114:0/795692253 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:23.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.240+0000 7f9ae2d9d640 1 -- 172.21.15.114:0/795692253 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ae40b6890 msgr2=0x7f9ae4154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:23.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.240+0000 7f9ae2d9d640 1 --2- 172.21.15.114:0/795692253 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ae40b6890 0x7f9ae4154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.240+0000 7f9ae2d9d640 1 -- 172.21.15.114:0/795692253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ae40b4700 msgr2=0x7f9ae4155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:23.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.240+0000 7f9ae2d9d640 1 --2- 172.21.15.114:0/795692253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ae40b4700 0x7f9ae4155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.240+0000 7f9ae2d9d640 1 -- 172.21.15.114:0/795692253 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae4156430 con 0x7f9ae415f1f0 2024-04-28T13:08:23.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.240+0000 7f9ae2d9d640 1 --2- 172.21.15.114:0/795692253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ae415f1f0 0x7f9ae4142e20 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00c550 tx=0x7f9adc00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:23.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.240+0000 7f9ad2ffd640 1 -- 172.21.15.114:0/795692253 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc018070 con 0x7f9ae415f1f0 2024-04-28T13:08:23.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.240+0000 7f9ad2ffd640 1 -- 172.21.15.114:0/795692253 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9adc007500 con 0x7f9ae415f1f0 2024-04-28T13:08:23.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.241+0000 7f9ae8a62640 1 -- 172.21.15.114:0/795692253 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ae4156700 con 0x7f9ae415f1f0 2024-04-28T13:08:23.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.241+0000 7f9ad2ffd640 1 -- 172.21.15.114:0/795692253 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc004a20 con 0x7f9ae415f1f0 2024-04-28T13:08:23.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.241+0000 7f9ae8a62640 1 -- 172.21.15.114:0/795692253 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ae4153e70 con 0x7f9ae415f1f0 2024-04-28T13:08:23.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.242+0000 7f9ad2ffd640 1 -- 172.21.15.114:0/795692253 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9adc01b070 con 0x7f9ae415f1f0 2024-04-28T13:08:23.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.242+0000 7f9ad2ffd640 1 --2- 172.21.15.114:0/795692253 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9ac406c8f0 0x7f9ac406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:23.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.242+0000 7f9ad2ffd640 1 -- 172.21.15.114:0/795692253 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f9adc08aef0 con 0x7f9ae415f1f0 2024-04-28T13:08:23.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.242+0000 7f9ae259c640 1 --2- 172.21.15.114:0/795692253 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9ac406c8f0 0x7f9ac406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:23.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.243+0000 7f9ae259c640 1 --2- 172.21.15.114:0/795692253 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9ac406c8f0 0x7f9ac406edb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4034000 tx=0x7f9ad402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:23.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.243+0000 7f9aeb779740 1 Processor -- start 2024-04-28T13:08:23.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.243+0000 7f9aeb779740 1 -- start start 2024-04-28T13:08:23.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.244+0000 7f9aeb779740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558d806ab440 0x558d806ab820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:23.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.244+0000 7f9aeb779740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d806c8ce0 0x558d806c9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:23.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.244+0000 7f9aeb779740 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558d80681120 0x558d806c73a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:23.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.244+0000 7f9aeb779740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x558d805e5740 con 0x558d806ab440 2024-04-28T13:08:23.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.244+0000 7f9aeb779740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558d805813a0 con 0x558d806c8ce0 2024-04-28T13:08:23.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.244+0000 7f9aeb779740 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x558d805e1700 con 0x558d80681120 2024-04-28T13:08:23.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.244+0000 7f9ae259c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558d806ab440 0x558d806ab820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:23.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.244+0000 7f9ae259c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558d806ab440 0x558d806ab820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33090/0 (socket says 172.21.15.114:33090) 2024-04-28T13:08:23.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.244+0000 7f9ae259c640 1 -- 172.21.15.114:0/617342800 learned_addr learned my addr 172.21.15.114:0/617342800 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:23.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.244+0000 7f9ae2d9d640 1 --2- 172.21.15.114:0/617342800 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558d80681120 0x558d806c73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:23.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.244+0000 7f9ae1d9b640 1 --2- 172.21.15.114:0/617342800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d806c8ce0 0x558d806c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:23.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.244+0000 7f9ae259c640 1 -- 172.21.15.114:0/617342800 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558d80681120 msgr2=0x558d806c73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:23.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.244+0000 7f9ae259c640 1 --2- 172.21.15.114:0/617342800 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558d80681120 0x558d806c73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.244+0000 7f9ae259c640 1 -- 172.21.15.114:0/617342800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d806c8ce0 msgr2=0x558d806c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:23.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.244+0000 7f9ae259c640 1 --2- 172.21.15.114:0/617342800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d806c8ce0 0x558d806c9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.244+0000 7f9ae259c640 1 -- 172.21.15.114:0/617342800 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d8059d750 con 0x558d806ab440 2024-04-28T13:08:23.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.245+0000 7f9ae259c640 1 --2- 172.21.15.114:0/617342800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558d806ab440 0x558d806ab820 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4000f80 tx=0x7f9ad4030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37681680c79b406c server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:23.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.245+0000 7f9ac3fff640 1 -- 172.21.15.114:0/617342800 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad404d070 con 0x558d806ab440 2024-04-28T13:08:23.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.245+0000 7f9ac3fff640 1 -- 172.21.15.114:0/617342800 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ad4003bb0 con 0x558d806ab440 2024-04-28T13:08:23.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.245+0000 7f9ac3fff640 1 -- 172.21.15.114:0/617342800 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad4004020 con 0x558d806ab440 2024-04-28T13:08:23.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.245+0000 7f9aeb779740 1 -- 172.21.15.114:0/617342800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558d806ab440 msgr2=0x558d806ab820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:23.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.245+0000 7f9aeb779740 1 --2- 172.21.15.114:0/617342800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558d806ab440 0x558d806ab820 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4000f80 tx=0x7f9ad4030000 comp rx=0 tx=0).stop 2024-04-28T13:08:23.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.245+0000 7f9aeb779740 1 -- 172.21.15.114:0/617342800 shutdown_connections 2024-04-28T13:08:23.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.245+0000 7f9aeb779740 1 --2- 172.21.15.114:0/617342800 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558d80681120 0x558d806c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.245+0000 7f9aeb779740 1 --2- 172.21.15.114:0/617342800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d806c8ce0 0x558d806c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.245+0000 7f9aeb779740 1 --2- 172.21.15.114:0/617342800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558d806ab440 0x558d806ab820 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.245+0000 7f9aeb779740 1 -- 172.21.15.114:0/617342800 >> 172.21.15.114:0/617342800 conn(0x558d8067da50 msgr2=0x558d806c6250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:23.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.246+0000 7f9aeb779740 1 -- 172.21.15.114:0/617342800 shutdown_connections 2024-04-28T13:08:23.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.246+0000 7f9aeb779740 1 -- 172.21.15.114:0/617342800 wait complete. 2024-04-28T13:08:23.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.246+0000 7f9aeb779740 1 -- start start 2024-04-28T13:08:23.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.246+0000 7f9aeb779740 1 Processor -- start 2024-04-28T13:08:23.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.247+0000 7f9aeb779740 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558d806ab440 0x558d806a6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:23.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.247+0000 7f9aeb779740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d806c8ce0 0x558d806d7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:23.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.247+0000 7f9aeb779740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558d8067eff0 0x558d8067f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:23.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.247+0000 7f9aeb779740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x558d80681ec0 con 0x558d8067eff0 2024-04-28T13:08:23.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.247+0000 7f9aeb779740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558d8056cfe0 con 0x558d806c8ce0 2024-04-28T13:08:23.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.247+0000 7f9aeb779740 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x558d8067b980 con 0x558d806ab440 2024-04-28T13:08:23.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.247+0000 7f9aeb779740 10 client.0 _ll_register_callbacks cb 0x558d80583150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-28T13:08:23.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.247+0000 7f9ae2d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558d8067eff0 0x558d8067f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:23.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.247+0000 7f9ae2d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558d8067eff0 0x558d8067f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33100/0 (socket says 172.21.15.114:33100) 2024-04-28T13:08:23.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.247+0000 7f9ae2d9d640 1 -- 172.21.15.114:0/3790635121 learned_addr learned my addr 172.21.15.114:0/3790635121 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:23.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.247+0000 7f9ae1d9b640 1 --2- 172.21.15.114:0/3790635121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d806c8ce0 0x558d806d7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:23.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.247+0000 7f9ae259c640 1 --2- 172.21.15.114:0/3790635121 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558d806ab440 0x558d806a6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:23.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.247+0000 7f9ae2d9d640 1 -- 172.21.15.114:0/3790635121 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558d806ab440 msgr2=0x558d806a6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:23.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.247+0000 7f9ae2d9d640 1 --2- 172.21.15.114:0/3790635121 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558d806ab440 0x558d806a6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.247+0000 7f9ae2d9d640 1 -- 172.21.15.114:0/3790635121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d806c8ce0 msgr2=0x558d806d7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:23.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.247+0000 7f9ae2d9d640 1 --2- 172.21.15.114:0/3790635121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d806c8ce0 0x558d806d7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.247+0000 7f9ae2d9d640 1 -- 172.21.15.114:0/3790635121 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d802f72d0 con 0x558d8067eff0 2024-04-28T13:08:23.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.248+0000 7f9ae2d9d640 1 --2- 172.21.15.114:0/3790635121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558d8067eff0 0x558d8067f470 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9adc0612d0 tx=0x7f9adc059460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b833f972d7aebe61 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:23.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.248+0000 7f9ac17fa640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-04-28T13:08:23.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.248+0000 7f9ac17fa640 1 -- 172.21.15.114:0/3790635121 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc004dc0 con 0x558d8067eff0 2024-04-28T13:08:23.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.248+0000 7f9ac17fa640 1 -- 172.21.15.114:0/3790635121 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f9adc058070 con 0x558d8067eff0 2024-04-28T13:08:23.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.248+0000 7f9aeb779740 1 -- 172.21.15.114:0/3790635121 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ad4003bb0 con 0x558d8067eff0 2024-04-28T13:08:23.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.248+0000 7f9ac17fa640 1 -- 172.21.15.114:0/3790635121 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f9adc089050 con 0x558d8067eff0 2024-04-28T13:08:23.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.248+0000 7f9aeb779740 10 client.5307 fetch_fsmap learned FSMap version 13 2024-04-28T13:08:23.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.248+0000 7f9aeb779740 1 -- 172.21.15.114:0/3790635121 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x558d803c16b0 con 0x558d8067eff0 2024-04-28T13:08:23.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.248+0000 7f9ac17fa640 1 -- 172.21.15.114:0/3790635121 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ad4003bb0 con 0x558d8067eff0 2024-04-28T13:08:23.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.248+0000 7f9ac17fa640 1 -- 172.21.15.114:0/3790635121 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 13) ==== 3494+0+0 (secure 0 0 0) 0x7f9adc05f1d0 con 0x558d8067eff0 2024-04-28T13:08:23.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.248+0000 7f9aeb779740 10 client.5307 fetch_fsmap finished waiting for FSMap version 13 2024-04-28T13:08:23.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.248+0000 7f9aeb779740 10 client.5307 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-28T13:08:23.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.248+0000 7f9aeb779740 20 client.5307 populate_metadata read hostname 'smithi114' 2024-04-28T13:08:23.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.248+0000 7f9aeb779740 1 --2- 172.21.15.114:0/3790635121 >> [v2:172.21.15.134:6832/1155749661,v1:172.21.15.134:6834/1155749661] conn(0x558d806ac280 0x558d806cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:23.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.248+0000 7f9aeb779740 4 client.5307 mds_command: new command op to 5145 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-28T13:08:23.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.248+0000 7f9aeb779740 1 -- 172.21.15.114:0/3790635121 --> [v2:172.21.15.134:6832/1155749661,v1:172.21.15.134:6834/1155749661] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d805f3350 con 0x558d806ac280 2024-04-28T13:08:23.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.248+0000 7f9ae259c640 1 --2- 172.21.15.114:0/3790635121 >> [v2:172.21.15.134:6832/1155749661,v1:172.21.15.134:6834/1155749661] conn(0x558d806ac280 0x558d806cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:23.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.249+0000 7f9ac17fa640 10 client.5307 ms_handle_connect on v2:172.21.15.134:6832/1155749661 2024-04-28T13:08:23.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.249+0000 7f9ae259c640 1 --2- 172.21.15.114:0/3790635121 >> [v2:172.21.15.134:6832/1155749661,v1:172.21.15.134:6834/1155749661] conn(0x558d806ac280 0x558d806cab00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17ba913fd442167e server_cookie=8a90e96db558dbd4 in_seq=0 out_seq=0 2024-04-28T13:08:23.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.249+0000 7f9ac17fa640 1 -- 172.21.15.114:0/3790635121 <== mds.0 v2:172.21.15.134:6832/1155749661 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558d805f3350 con 0x558d806ac280 2024-04-28T13:08:23.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.250+0000 7f9ac17fa640 10 client.5307 handle_command_reply: tid=0 2024-04-28T13:08:23.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.250+0000 7f9aeb779740 1 client.5307 shutdown 2024-04-28T13:08:23.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.250+0000 7f9aeb779740 1 -- 172.21.15.114:0/3790635121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558d8067eff0 msgr2=0x558d8067f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:23.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.250+0000 7f9aeb779740 1 --2- 172.21.15.114:0/3790635121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558d8067eff0 0x558d8067f470 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9adc0612d0 tx=0x7f9adc059460 comp rx=0 tx=0).stop 2024-04-28T13:08:23.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.250+0000 7f9aeb779740 1 -- 172.21.15.114:0/3790635121 shutdown_connections 2024-04-28T13:08:23.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.250+0000 7f9aeb779740 1 --2- 172.21.15.114:0/3790635121 >> [v2:172.21.15.134:6832/1155749661,v1:172.21.15.134:6834/1155749661] conn(0x558d806ac280 0x558d806cab00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.250+0000 7f9aeb779740 1 --2- 172.21.15.114:0/3790635121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558d8067eff0 0x558d8067f470 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.250+0000 7f9aeb779740 1 --2- 172.21.15.114:0/3790635121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d806c8ce0 0x558d806d7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.250+0000 7f9ac17fa640 0 client.5307 ms_handle_reset on v2:172.21.15.134:6832/1155749661 2024-04-28T13:08:23.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.250+0000 7f9aeb779740 1 --2- 172.21.15.114:0/3790635121 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558d806ab440 0x558d806a6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.250+0000 7f9aeb779740 1 -- 172.21.15.114:0/3790635121 >> 172.21.15.114:0/3790635121 conn(0x558d80681120 msgr2=0x558d806ca060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:23.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.250+0000 7f9aeb779740 1 -- 172.21.15.114:0/3790635121 shutdown_connections 2024-04-28T13:08:23.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.250+0000 7f9aeb779740 1 -- 172.21.15.114:0/3790635121 wait complete. 2024-04-28T13:08:23.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.250+0000 7f9aeb779740 20 client.5307 trim_cache size 0 max 16384 2024-04-28T13:08:23.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.268+0000 7f9aeb779740 1 Processor -- start 2024-04-28T13:08:23.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.268+0000 7f9aeb779740 1 -- start start 2024-04-28T13:08:23.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.268+0000 7f9aeb779740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d8067eff0 0x558d806cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:23.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.268+0000 7f9aeb779740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558d806ab440 0x558d8067a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:23.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.268+0000 7f9aeb779740 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558d806c8ce0 0x558d8067ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:23.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.268+0000 7f9aeb779740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae415bb60 con 0x558d806ab440 2024-04-28T13:08:23.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.268+0000 7f9aeb779740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae415aec0 con 0x558d8067eff0 2024-04-28T13:08:23.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.268+0000 7f9aeb779740 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f9ae415b510 con 0x558d806c8ce0 2024-04-28T13:08:23.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.269+0000 7f9ae1d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558d806ab440 0x558d8067a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:23.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.269+0000 7f9ae1d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558d806ab440 0x558d8067a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33104/0 (socket says 172.21.15.114:33104) 2024-04-28T13:08:23.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.269+0000 7f9ae1d9b640 1 -- 172.21.15.114:0/1846298854 learned_addr learned my addr 172.21.15.114:0/1846298854 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:23.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.269+0000 7f9ae1d9b640 1 -- 172.21.15.114:0/1846298854 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558d806c8ce0 msgr2=0x558d8067ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:23.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.269+0000 7f9ae2d9d640 1 --2- 172.21.15.114:0/1846298854 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558d806c8ce0 0x558d8067ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:23.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.269+0000 7f9ae259c640 1 --2- 172.21.15.114:0/1846298854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d8067eff0 0x558d806cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:23.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.269+0000 7f9ae1d9b640 1 --2- 172.21.15.114:0/1846298854 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558d806c8ce0 0x558d8067ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.269+0000 7f9ae1d9b640 1 -- 172.21.15.114:0/1846298854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d8067eff0 msgr2=0x558d806cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:23.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.269+0000 7f9ae1d9b640 1 --2- 172.21.15.114:0/1846298854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d8067eff0 0x558d806cbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.269+0000 7f9ae1d9b640 1 -- 172.21.15.114:0/1846298854 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d806c3510 con 0x558d806ab440 2024-04-28T13:08:23.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.269+0000 7f9ae259c640 1 --2- 172.21.15.114:0/1846298854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d8067eff0 0x558d806cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:23.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.269+0000 7f9ae2d9d640 1 --2- 172.21.15.114:0/1846298854 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558d806c8ce0 0x558d8067ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:23.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.269+0000 7f9ae1d9b640 1 --2- 172.21.15.114:0/1846298854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558d806ab440 0x558d8067a700 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8001530 tx=0x7f9ad80019f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5f89c2e31dee41 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:23.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.269+0000 7f9ac37fe640 1 -- 172.21.15.114:0/1846298854 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad80050d0 con 0x558d806ab440 2024-04-28T13:08:23.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.269+0000 7f9ac37fe640 1 -- 172.21.15.114:0/1846298854 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ad8005270 con 0x558d806ab440 2024-04-28T13:08:23.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.269+0000 7f9ac37fe640 1 -- 172.21.15.114:0/1846298854 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8005460 con 0x558d806ab440 2024-04-28T13:08:23.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.270+0000 7f9aeb779740 1 -- 172.21.15.114:0/1846298854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558d806ab440 msgr2=0x558d8067a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:23.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.270+0000 7f9aeb779740 1 --2- 172.21.15.114:0/1846298854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558d806ab440 0x558d8067a700 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8001530 tx=0x7f9ad80019f0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.270+0000 7f9aeb779740 1 -- 172.21.15.114:0/1846298854 shutdown_connections 2024-04-28T13:08:23.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.270+0000 7f9aeb779740 1 --2- 172.21.15.114:0/1846298854 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558d806c8ce0 0x558d8067ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.270+0000 7f9aeb779740 1 --2- 172.21.15.114:0/1846298854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558d806ab440 0x558d8067a700 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.270+0000 7f9aeb779740 1 --2- 172.21.15.114:0/1846298854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d8067eff0 0x558d806cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.270+0000 7f9aeb779740 1 -- 172.21.15.114:0/1846298854 >> 172.21.15.114:0/1846298854 conn(0x558d80681120 msgr2=0x558d806aa770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:23.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.270+0000 7f9aeb779740 1 -- 172.21.15.114:0/1846298854 shutdown_connections 2024-04-28T13:08:23.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.270+0000 7f9aeb779740 1 -- 172.21.15.114:0/1846298854 wait complete. 2024-04-28T13:08:23.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.270+0000 7f9aeb779740 1 -- start start 2024-04-28T13:08:23.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.270+0000 7f9aeb779740 1 Processor -- start 2024-04-28T13:08:23.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.271+0000 7f9aeb779740 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558d8067eff0 0x558d806bbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:23.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.271+0000 7f9aeb779740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558d806ab440 0x558d806d5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:23.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.271+0000 7f9aeb779740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d806c8ce0 0x558d806ad140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:23.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.271+0000 7f9aeb779740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x558d806ac100 con 0x558d806ab440 2024-04-28T13:08:23.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.271+0000 7f9aeb779740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558d806da7d0 con 0x558d806c8ce0 2024-04-28T13:08:23.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.271+0000 7f9aeb779740 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x558d806c5150 con 0x558d8067eff0 2024-04-28T13:08:23.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.271+0000 7f9aeb779740 10 client.0 _ll_register_callbacks cb 0x7f9adc058580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-28T13:08:23.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.271+0000 7f9ae1d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558d806ab440 0x558d806d5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:23.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.271+0000 7f9ae1d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558d806ab440 0x558d806d5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33108/0 (socket says 172.21.15.114:33108) 2024-04-28T13:08:23.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.271+0000 7f9ae1d9b640 1 -- 172.21.15.114:0/2433812093 learned_addr learned my addr 172.21.15.114:0/2433812093 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:23.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.271+0000 7f9ae259c640 1 --2- 172.21.15.114:0/2433812093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558d8067eff0 0x558d806bbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:23.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.271+0000 7f9ae2d9d640 1 --2- 172.21.15.114:0/2433812093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d806c8ce0 0x558d806ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:23.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.272+0000 7f9ae1d9b640 1 -- 172.21.15.114:0/2433812093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558d8067eff0 msgr2=0x558d806bbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:23.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.272+0000 7f9ae1d9b640 1 --2- 172.21.15.114:0/2433812093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558d8067eff0 0x558d806bbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.272+0000 7f9ae1d9b640 1 -- 172.21.15.114:0/2433812093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d806c8ce0 msgr2=0x558d806ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:23.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.272+0000 7f9ae1d9b640 1 --2- 172.21.15.114:0/2433812093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d806c8ce0 0x558d806ad140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.272+0000 7f9ae1d9b640 1 -- 172.21.15.114:0/2433812093 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d806bc120 con 0x558d806ab440 2024-04-28T13:08:23.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.272+0000 7f9ae1d9b640 1 --2- 172.21.15.114:0/2433812093 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558d806ab440 0x558d806d5fa0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9ad80014d0 tx=0x7f9ad8001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccdc459def4f5c4c server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:23.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.272+0000 7f9ac17fa640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-04-28T13:08:23.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.272+0000 7f9ac17fa640 1 -- 172.21.15.114:0/2433812093 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8024060 con 0x558d806ab440 2024-04-28T13:08:23.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.272+0000 7f9ac17fa640 1 -- 172.21.15.114:0/2433812093 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f9ad800f040 con 0x558d806ab440 2024-04-28T13:08:23.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.272+0000 7f9aeb779740 1 -- 172.21.15.114:0/2433812093 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ad8005270 con 0x558d806ab440 2024-04-28T13:08:23.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.272+0000 7f9ac17fa640 1 -- 172.21.15.114:0/2433812093 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f9ad80050d0 con 0x558d806ab440 2024-04-28T13:08:23.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.272+0000 7f9aeb779740 10 client.5313 fetch_fsmap learned FSMap version 13 2024-04-28T13:08:23.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.272+0000 7f9aeb779740 1 -- 172.21.15.114:0/2433812093 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x558d8067c020 con 0x558d806ab440 2024-04-28T13:08:23.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.272+0000 7f9ac17fa640 1 -- 172.21.15.114:0/2433812093 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ad8005270 con 0x558d806ab440 2024-04-28T13:08:23.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.272+0000 7f9ac17fa640 1 -- 172.21.15.114:0/2433812093 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 13) ==== 3494+0+0 (secure 0 0 0) 0x7f9ad8011a40 con 0x558d806ab440 2024-04-28T13:08:23.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.272+0000 7f9aeb779740 10 client.5313 fetch_fsmap finished waiting for FSMap version 13 2024-04-28T13:08:23.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.272+0000 7f9aeb779740 10 client.5313 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-28T13:08:23.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.272+0000 7f9aeb779740 20 client.5313 populate_metadata read hostname 'smithi114' 2024-04-28T13:08:23.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.272+0000 7f9aeb779740 1 --2- 172.21.15.114:0/2433812093 >> [v2:172.21.15.134:6832/1155749661,v1:172.21.15.134:6834/1155749661] conn(0x558d80741210 0x558d806caa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:23.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.272+0000 7f9aeb779740 4 client.5313 mds_command: new command op to 5145 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-28T13:08:23.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.272+0000 7f9aeb779740 1 -- 172.21.15.114:0/2433812093 --> [v2:172.21.15.134:6832/1155749661,v1:172.21.15.134:6834/1155749661] -- command(tid 0: {"prefix": "status"}) -- 0x558d80681cd0 con 0x558d80741210 2024-04-28T13:08:23.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.273+0000 7f9ae259c640 1 --2- 172.21.15.114:0/2433812093 >> [v2:172.21.15.134:6832/1155749661,v1:172.21.15.134:6834/1155749661] conn(0x558d80741210 0x558d806caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:23.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.273+0000 7f9ac17fa640 10 client.5313 ms_handle_connect on v2:172.21.15.134:6832/1155749661 2024-04-28T13:08:23.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.273+0000 7f9ae259c640 1 --2- 172.21.15.114:0/2433812093 >> [v2:172.21.15.134:6832/1155749661,v1:172.21.15.134:6834/1155749661] conn(0x558d80741210 0x558d806caa60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4277c70a81b462f server_cookie=7a28522671b3382d in_seq=0 out_seq=0 2024-04-28T13:08:23.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.273+0000 7f9ac17fa640 1 -- 172.21.15.114:0/2433812093 <== mds.0 v2:172.21.15.134:6832/1155749661 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x558d80681cd0 con 0x558d80741210 2024-04-28T13:08:23.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.273+0000 7f9ac17fa640 10 client.5313 handle_command_reply: tid=0 2024-04-28T13:08:23.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.273+0000 7f9aeb779740 1 client.5313 shutdown 2024-04-28T13:08:23.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.273+0000 7f9aeb779740 1 -- 172.21.15.114:0/2433812093 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558d806ab440 msgr2=0x558d806d5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:23.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.273+0000 7f9aeb779740 1 --2- 172.21.15.114:0/2433812093 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558d806ab440 0x558d806d5fa0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9ad80014d0 tx=0x7f9ad8001090 comp rx=0 tx=0).stop 2024-04-28T13:08:23.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.274+0000 7f9aeb779740 1 -- 172.21.15.114:0/2433812093 shutdown_connections 2024-04-28T13:08:23.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.274+0000 7f9aeb779740 1 --2- 172.21.15.114:0/2433812093 >> [v2:172.21.15.134:6832/1155749661,v1:172.21.15.134:6834/1155749661] conn(0x558d80741210 0x558d806caa60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.274+0000 7f9aeb779740 1 --2- 172.21.15.114:0/2433812093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d806c8ce0 0x558d806ad140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.274+0000 7f9aeb779740 1 --2- 172.21.15.114:0/2433812093 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558d806ab440 0x558d806d5fa0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.274+0000 7f9aeb779740 1 --2- 172.21.15.114:0/2433812093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558d8067eff0 0x558d806bbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.274+0000 7f9ac17fa640 0 client.5313 ms_handle_reset on v2:172.21.15.134:6832/1155749661 2024-04-28T13:08:23.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.274+0000 7f9aeb779740 1 -- 172.21.15.114:0/2433812093 >> 172.21.15.114:0/2433812093 conn(0x558d80681120 msgr2=0x558d806805d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:23.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.274+0000 7f9aeb779740 1 -- 172.21.15.114:0/2433812093 shutdown_connections 2024-04-28T13:08:23.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.274+0000 7f9aeb779740 1 -- 172.21.15.114:0/2433812093 wait complete. 2024-04-28T13:08:23.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.274+0000 7f9aeb779740 20 client.5313 trim_cache size 0 max 16384 2024-04-28T13:08:23.280 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-04-28T13:08:23.280 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "0961cca0-69c8-4b26-b89a-621e12152fc4", 2024-04-28T13:08:23.281 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2024-04-28T13:08:23.281 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 5145, 2024-04-28T13:08:23.281 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2024-04-28T13:08:23.281 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2024-04-28T13:08:23.281 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2024-04-28T13:08:23.281 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 4.5801368690000004, 2024-04-28T13:08:23.281 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 13, 2024-04-28T13:08:23.281 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 34, 2024-04-28T13:08:23.281 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 34, 2024-04-28T13:08:23.281 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 11.682153032 2024-04-28T13:08:23.281 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-04-28T13:08:23.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.274+0000 7f9ae8a62640 1 -- 172.21.15.114:0/795692253 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9ac406c8f0 msgr2=0x7f9ac406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:23.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.274+0000 7f9ae8a62640 1 --2- 172.21.15.114:0/795692253 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9ac406c8f0 0x7f9ac406edb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4034000 tx=0x7f9ad402e000 comp rx=0 tx=0).stop 2024-04-28T13:08:23.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.274+0000 7f9ae8a62640 1 -- 172.21.15.114:0/795692253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ae415f1f0 msgr2=0x7f9ae4142e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:23.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.274+0000 7f9ae8a62640 1 --2- 172.21.15.114:0/795692253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ae415f1f0 0x7f9ae4142e20 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00c550 tx=0x7f9adc00ca10 comp rx=0 tx=0).stop 2024-04-28T13:08:23.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.274+0000 7f9ae8a62640 1 -- 172.21.15.114:0/795692253 shutdown_connections 2024-04-28T13:08:23.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.274+0000 7f9ae8a62640 1 --2- 172.21.15.114:0/795692253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ae415f1f0 0x7f9ae4142e20 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.274+0000 7f9ae8a62640 1 --2- 172.21.15.114:0/795692253 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ae40b6890 0x7f9ae4154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.274+0000 7f9ae8a62640 1 --2- 172.21.15.114:0/795692253 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9ac406c8f0 0x7f9ac406edb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.274+0000 7f9ae8a62640 1 --2- 172.21.15.114:0/795692253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ae40b4700 0x7f9ae4155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.274+0000 7f9ae8a62640 1 -- 172.21.15.114:0/795692253 >> 172.21.15.114:0/795692253 conn(0x7f9ae40738d0 msgr2=0x7f9ae40b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:23.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.274+0000 7f9ae8a62640 1 -- 172.21.15.114:0/795692253 shutdown_connections 2024-04-28T13:08:23.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.274+0000 7f9ae8a62640 1 -- 172.21.15.114:0/795692253 wait complete. 2024-04-28T13:08:23.285 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-28T13:08:23.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.380+0000 7f10d39b7640 1 Processor -- start 2024-04-28T13:08:23.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.381+0000 7f10d39b7640 1 -- start start 2024-04-28T13:08:23.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.381+0000 7f10d39b7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f10cc0742c0 0x7f10cc15d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:23.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.381+0000 7f10d39b7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10cc153710 con 0x7f10cc0723d0 2024-04-28T13:08:23.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.381+0000 7f10d39b7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10cc0b4a60 con 0x7f10cc153330 2024-04-28T13:08:23.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.381+0000 7f10d39b7640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f10cc072990 con 0x7f10cc0742c0 2024-04-28T13:08:23.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.382+0000 7f10d0f52640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f10cc0742c0 0x7f10cc15d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:23.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.382+0000 7f10d1f54640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f10cc0723d0 0x7f10cc0cedf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52978/0 (socket says 172.21.15.114:52978) 2024-04-28T13:08:23.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.382+0000 7f10d1f54640 1 -- 172.21.15.114:0/2086507192 learned_addr learned my addr 172.21.15.114:0/2086507192 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:23.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.382+0000 7f10d0f52640 1 -- 172.21.15.114:0/2086507192 >> v1:172.21.15.134:6789/0 conn(0x7f10cc153330 legacy=0x7f10cc073bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:23.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.382+0000 7f10c3fff640 1 -- 172.21.15.114:0/2086507192 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4077212026 0 0) 0x7f10c4001490 con 0x7f10cc0723d0 2024-04-28T13:08:23.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.382+0000 7f10d0f52640 1 -- 172.21.15.114:0/2086507192 >> v1:172.21.15.114:6789/0 conn(0x7f10cc0723d0 legacy=0x7f10cc0cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:23.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.382+0000 7f10d0f52640 1 -- 172.21.15.114:0/2086507192 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10cc072c70 con 0x7f10cc0742c0 2024-04-28T13:08:23.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.383+0000 7f10d0f52640 1 --2- 172.21.15.114:0/2086507192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10cc0742c0 0x7f10cc15d2e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f10c80097a0 tx=0x7f10c802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b49c6e5441c637d server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:23.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.383+0000 7f10c3fff640 1 -- 172.21.15.114:0/2086507192 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c8037070 con 0x7f10cc0742c0 2024-04-28T13:08:23.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.383+0000 7f10c3fff640 1 -- 172.21.15.114:0/2086507192 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10c8032440 con 0x7f10cc0742c0 2024-04-28T13:08:23.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.383+0000 7f10c3fff640 1 -- 172.21.15.114:0/2086507192 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c8032810 con 0x7f10cc0742c0 2024-04-28T13:08:23.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.383+0000 7f10d39b7640 1 -- 172.21.15.114:0/2086507192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10cc0742c0 msgr2=0x7f10cc15d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:23.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.383+0000 7f10d39b7640 1 --2- 172.21.15.114:0/2086507192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10cc0742c0 0x7f10cc15d2e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f10c80097a0 tx=0x7f10c802a230 comp rx=0 tx=0).stop 2024-04-28T13:08:23.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.383+0000 7f10d39b7640 1 -- 172.21.15.114:0/2086507192 shutdown_connections 2024-04-28T13:08:23.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.383+0000 7f10d39b7640 1 --2- 172.21.15.114:0/2086507192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10cc0742c0 0x7f10cc15d2e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.383+0000 7f10d39b7640 1 -- 172.21.15.114:0/2086507192 >> 172.21.15.114:0/2086507192 conn(0x7f10cc06c980 msgr2=0x7f10cc0b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:23.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.383+0000 7f10d39b7640 1 -- 172.21.15.114:0/2086507192 shutdown_connections 2024-04-28T13:08:23.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.383+0000 7f10d39b7640 1 -- 172.21.15.114:0/2086507192 wait complete. 2024-04-28T13:08:23.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.384+0000 7f10d39b7640 1 Processor -- start 2024-04-28T13:08:23.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.385+0000 7f10d39b7640 1 -- start start 2024-04-28T13:08:23.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.385+0000 7f10d39b7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10cc0723d0 0x7f10cc15e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:23.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.385+0000 7f10d39b7640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10cc0742c0 0x7f10cc1e6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:23.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.385+0000 7f10d39b7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10cc153330 0x7f10cc1e71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:23.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.385+0000 7f10d39b7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f10cc073510 con 0x7f10cc0723d0 2024-04-28T13:08:23.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.385+0000 7f10d39b7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f10cc073230 con 0x7f10cc153330 2024-04-28T13:08:23.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.385+0000 7f10d39b7640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f10cc0cf500 con 0x7f10cc0742c0 2024-04-28T13:08:23.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.385+0000 7f10d1753640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10cc0723d0 0x7f10cc15e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:23.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.385+0000 7f10d1753640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10cc0723d0 0x7f10cc15e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33134/0 (socket says 172.21.15.114:33134) 2024-04-28T13:08:23.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.385+0000 7f10d1753640 1 -- 172.21.15.114:0/1111023932 learned_addr learned my addr 172.21.15.114:0/1111023932 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:23.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.386+0000 7f10d1f54640 1 --2- 172.21.15.114:0/1111023932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10cc153330 0x7f10cc1e71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:23.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.386+0000 7f10d0f52640 1 --2- 172.21.15.114:0/1111023932 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10cc0742c0 0x7f10cc1e6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:23.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.386+0000 7f10d1753640 1 -- 172.21.15.114:0/1111023932 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10cc0742c0 msgr2=0x7f10cc1e6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:23.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.386+0000 7f10d1753640 1 --2- 172.21.15.114:0/1111023932 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10cc0742c0 0x7f10cc1e6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.386+0000 7f10d1753640 1 -- 172.21.15.114:0/1111023932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10cc153330 msgr2=0x7f10cc1e71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:23.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.386+0000 7f10d1753640 1 --2- 172.21.15.114:0/1111023932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10cc153330 0x7f10cc1e71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.386+0000 7f10d1753640 1 -- 172.21.15.114:0/1111023932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10cc150220 con 0x7f10cc0723d0 2024-04-28T13:08:23.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.386+0000 7f10d0f52640 1 --2- 172.21.15.114:0/1111023932 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10cc0742c0 0x7f10cc1e6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:23.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.386+0000 7f10d1753640 1 --2- 172.21.15.114:0/1111023932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10cc0723d0 0x7f10cc15e140 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00c400 tx=0x7f10bc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:23.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.386+0000 7f10c1ffb640 1 -- 172.21.15.114:0/1111023932 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10bc017070 con 0x7f10cc0723d0 2024-04-28T13:08:23.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.386+0000 7f10c1ffb640 1 -- 172.21.15.114:0/1111023932 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10bc0052d0 con 0x7f10cc0723d0 2024-04-28T13:08:23.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.386+0000 7f10d39b7640 1 -- 172.21.15.114:0/1111023932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10cc1f34e0 con 0x7f10cc0723d0 2024-04-28T13:08:23.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.386+0000 7f10c1ffb640 1 -- 172.21.15.114:0/1111023932 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10bc003830 con 0x7f10cc0723d0 2024-04-28T13:08:23.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.386+0000 7f10d39b7640 1 -- 172.21.15.114:0/1111023932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10cc1e7b40 con 0x7f10cc0723d0 2024-04-28T13:08:23.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.387+0000 7f10d39b7640 1 -- 172.21.15.114:0/1111023932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10cc06a3d0 con 0x7f10cc0723d0 2024-04-28T13:08:23.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.387+0000 7f10c1ffb640 1 -- 172.21.15.114:0/1111023932 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f10bc01a070 con 0x7f10cc0723d0 2024-04-28T13:08:23.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.388+0000 7f10c1ffb640 1 --2- 172.21.15.114:0/1111023932 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f10b006c8f0 0x7f10b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:23.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.388+0000 7f10c1ffb640 1 -- 172.21.15.114:0/1111023932 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f10bc08aeb0 con 0x7f10cc0723d0 2024-04-28T13:08:23.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.388+0000 7f10d0f52640 1 --2- 172.21.15.114:0/1111023932 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f10b006c8f0 0x7f10b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:23.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.388+0000 7f10d0f52640 1 --2- 172.21.15.114:0/1111023932 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f10b006c8f0 0x7f10b006edb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f10c8034000 tx=0x7f10c802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:23.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.392+0000 7f10c1ffb640 1 -- 172.21.15.114:0/1111023932 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f10cc150220 con 0x7f10cc0723d0 2024-04-28T13:08:23.461 INFO:tasks.ceph.mds.d.smithi134.stderr:2024-04-28T13:08:23.461+0000 7f8e4eb48640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-28T13:08:23.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.603+0000 7f10d39b7640 1 -- 172.21.15.114:0/1111023932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f10cc15fbc0 con 0x7f10cc0723d0 2024-04-28T13:08:23.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.603+0000 7f10c1ffb640 1 -- 172.21.15.114:0/1111023932 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) ==== 53+0+73 (secure 0 0 0) 0x7f10bc0592e0 con 0x7f10cc0723d0 2024-04-28T13:08:23.604 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-28T13:08:23.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.605+0000 7f10d39b7640 1 -- 172.21.15.114:0/1111023932 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f10b006c8f0 msgr2=0x7f10b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:23.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.605+0000 7f10d39b7640 1 --2- 172.21.15.114:0/1111023932 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f10b006c8f0 0x7f10b006edb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f10c8034000 tx=0x7f10c802e000 comp rx=0 tx=0).stop 2024-04-28T13:08:23.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.605+0000 7f10d39b7640 1 -- 172.21.15.114:0/1111023932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10cc0723d0 msgr2=0x7f10cc15e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:23.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.605+0000 7f10d39b7640 1 --2- 172.21.15.114:0/1111023932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10cc0723d0 0x7f10cc15e140 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00c400 tx=0x7f10bc00c8c0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.605+0000 7f10d39b7640 1 -- 172.21.15.114:0/1111023932 shutdown_connections 2024-04-28T13:08:23.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.605+0000 7f10d39b7640 1 --2- 172.21.15.114:0/1111023932 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f10b006c8f0 0x7f10b006edb0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.605+0000 7f10d39b7640 1 --2- 172.21.15.114:0/1111023932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10cc153330 0x7f10cc1e71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.605+0000 7f10d39b7640 1 --2- 172.21.15.114:0/1111023932 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10cc0742c0 0x7f10cc1e6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.605+0000 7f10d39b7640 1 --2- 172.21.15.114:0/1111023932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10cc0723d0 0x7f10cc15e140 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:23.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.605+0000 7f10d39b7640 1 -- 172.21.15.114:0/1111023932 >> 172.21.15.114:0/1111023932 conn(0x7f10cc06c980 msgr2=0x7f10cc0b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:23.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.606+0000 7f10d39b7640 1 -- 172.21.15.114:0/1111023932 shutdown_connections 2024-04-28T13:08:23.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23.606+0000 7f10d39b7640 1 -- 172.21.15.114:0/1111023932 wait complete. 2024-04-28T13:08:23.616 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-28T13:08:23.616 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-28T13:08:23.616 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-04-28T13:08:23.616 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-28T13:08:23.616 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-28T13:08:23.616 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-28T13:08:23.616 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-28T13:08:23.616 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-28T13:08:23.617 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-28T13:08:23.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:23.617 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-04-28T13:08:23.632 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-28T13:08:23.632 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-28T13:08:23.632 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-04-28T13:08:23.632 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:08:23.632 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-04-28T13:08:23.632 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:08:23.632 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-28T13:08:23.632 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:08:23.632 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-04-28T13:08:23.632 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-28T13:08:23.632 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:08:23.632 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-04-28T13:08:23.633 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-28T13:08:23.633 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:08:23.633 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-28T13:08:23.633 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:08:23.633 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-28T13:08:23.633 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42709sec preferred_lft 42709sec 2024-04-28T13:08:23.633 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::cd74:6bbf:5a:b4fa/64 scope link noprefixroute 2024-04-28T13:08:23.633 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:08:23.633 INFO:teuthology.orchestra.run.smithi114.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-28T13:08:23.633 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 32:1c:a9:6d:0c:94 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:08:23.633 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-28T13:08:23.633 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:08:23.633 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::e4ef:19ff:fecc:cecc/64 scope link 2024-04-28T13:08:23.633 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:08:23.633 INFO:teuthology.orchestra.run.smithi114.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-28T13:08:23.633 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether d2:4c:d3:d0:70:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-28T13:08:23.634 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::d04c:d3ff:fed0:70bf/64 scope link 2024-04-28T13:08:23.634 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:08:23.634 INFO:teuthology.orchestra.run.smithi114.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-28T13:08:23.634 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 32:1c:a9:6d:0c:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-28T13:08:23.634 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::301c:a9ff:fe6d:c94/64 scope link 2024-04-28T13:08:23.634 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:08:23.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:23.634 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-28T13:08:23.694 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-04-28T13:08:23.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:23.696 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-04-28T13:08:23.752 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-04-28T13:08:23.752 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-28T13:08:23.752 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-28T13:08:23.752 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-28T13:08:23.752 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-28T13:08:23.753 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-28T13:08:23.753 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-04-28T13:08:23.753 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-28T13:08:23.753 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-28T13:08:23.753 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-28T13:08:23.753 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-04-28T13:08:23.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-28T13:08:23.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:08:23.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:23.876 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-04-28T13:08:23.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-28T13:08:23.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-28T13:08:23.891 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-28T13:08:23.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:23.891 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-04-28T13:08:23.954 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-28T13:08:23.955 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-28T13:08:24.010 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-28T13:08:24.010 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-28T13:08:24.010 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-28T13:08:24.067 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-28T13:08:24.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:24.067 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-28T13:08:24.148 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-28T13:08:24.148 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-28T13:08:24.149 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-04-28T13:08:24.157 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-28T13:08:24.157 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-28T13:08:24.157 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-04-28T13:08:24.157 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.134:3300,172.21.15.134:3301" 2024-04-28T13:08:24.157 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-28T13:08:24.172 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-28T13:08:24.172 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-28T13:08:24.172 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-04-28T13:08:24.172 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.134:3300,172.21.15.134:3301" 2024-04-28T13:08:24.172 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-28T13:08:24.173 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.134:6789,172.21.15.134:6790" 2024-04-28T13:08:24.173 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.134:6789,172.21.15.134:6790:/ 2024-04-28T13:08:24.173 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=0961cca0-69c8-4b26-b89a-621e12152fc4" will pass to kernel 2024-04-28T13:08:24.173 INFO:teuthology.orchestra.run.smithi114.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-28T13:08:24.173 INFO:teuthology.orchestra.run.smithi114.stdout: You just mounted a file system that supports labels which does not 2024-04-28T13:08:24.173 INFO:teuthology.orchestra.run.smithi114.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-28T13:08:24.173 INFO:teuthology.orchestra.run.smithi114.stdout: applications will generate AVC messages and not be allowed access to 2024-04-28T13:08:24.173 INFO:teuthology.orchestra.run.smithi114.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-28T13:08:24.175 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-28T13:08:24.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:24.175 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-28T13:08:24.239 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-28T13:08:24.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-28T13:08:24.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:08:24.342 INFO:teuthology.orchestra.run.smithi114.stdout:client5325 2024-04-28T13:08:24.342 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:08:24.343 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-28T13:08:24.358 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-28T13:08:24.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.495+0000 7fdcdc7af640 1 Processor -- start 2024-04-28T13:08:24.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.495+0000 7fdcdc7af640 1 -- start start 2024-04-28T13:08:24.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.496+0000 7fdcdc7af640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdcd4153330 0x7fdcd415d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:24.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.496+0000 7fdcdc7af640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdcd40723d0 0x7fdcd4073bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:24.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.496+0000 7fdcdc7af640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcd4153710 con 0x7fdcd40740f0 2024-04-28T13:08:24.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.496+0000 7fdcdc7af640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fdcd4074560 con 0x7fdcd40723d0 2024-04-28T13:08:24.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.496+0000 7fdcdc7af640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fdcd40b4a60 con 0x7fdcd4153330 2024-04-28T13:08:24.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.496+0000 7fdcd9d4a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdcd40723d0 0x7fdcd4073bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:24.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.496+0000 7fdcda54b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdcd4153330 0x7fdcd415d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:24.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.496+0000 7fdcdad4c640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fdcd40740f0 0x7fdcd415fe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:52722/0 (socket says 172.21.15.114:52722) 2024-04-28T13:08:24.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.496+0000 7fdcdad4c640 1 -- 172.21.15.114:0/3457542950 learned_addr learned my addr 172.21.15.114:0/3457542950 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:24.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.496+0000 7fdcda54b640 1 -- 172.21.15.114:0/3457542950 >> v2:172.21.15.134:3300/0 conn(0x7fdcd40723d0 msgr2=0x7fdcd4073bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:24.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.496+0000 7fdcda54b640 1 --2- 172.21.15.114:0/3457542950 >> v2:172.21.15.134:3300/0 conn(0x7fdcd40723d0 0x7fdcd4073bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:24.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.496+0000 7fdcda54b640 1 -- 172.21.15.114:0/3457542950 >> v1:172.21.15.134:6789/0 conn(0x7fdcd40740f0 legacy=0x7fdcd415fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:24.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.496+0000 7fdcda54b640 1 -- 172.21.15.114:0/3457542950 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd4072990 con 0x7fdcd4153330 2024-04-28T13:08:24.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.496+0000 7fdcd9549640 1 -- 172.21.15.114:0/3457542950 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3012274574 0 0) 0x7fdccc001490 con 0x7fdcd40740f0 2024-04-28T13:08:24.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.496+0000 7fdcd9d4a640 1 --2- 172.21.15.114:0/3457542950 >> v2:172.21.15.134:3300/0 conn(0x7fdcd40723d0 0x7fdcd4073bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:08:24.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.497+0000 7fdcda54b640 1 --2- 172.21.15.114:0/3457542950 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdcd4153330 0x7fdcd415d2e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdcd00097a0 tx=0x7fdcd002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c24ea370686376b server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:24.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.497+0000 7fdcd9549640 1 -- 172.21.15.114:0/3457542950 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0037070 con 0x7fdcd4153330 2024-04-28T13:08:24.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.497+0000 7fdcd9549640 1 -- 172.21.15.114:0/3457542950 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd0032440 con 0x7fdcd4153330 2024-04-28T13:08:24.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.497+0000 7fdcd9549640 1 -- 172.21.15.114:0/3457542950 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0032810 con 0x7fdcd4153330 2024-04-28T13:08:24.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.498+0000 7fdcdc7af640 1 -- 172.21.15.114:0/3457542950 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdcd4153330 msgr2=0x7fdcd415d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:24.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.498+0000 7fdcdc7af640 1 --2- 172.21.15.114:0/3457542950 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdcd4153330 0x7fdcd415d2e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdcd00097a0 tx=0x7fdcd002a180 comp rx=0 tx=0).stop 2024-04-28T13:08:24.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.498+0000 7fdcdc7af640 1 -- 172.21.15.114:0/3457542950 shutdown_connections 2024-04-28T13:08:24.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.498+0000 7fdcdc7af640 1 --2- 172.21.15.114:0/3457542950 >> v2:172.21.15.134:3300/0 conn(0x7fdcd40723d0 0x7fdcd4073bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:24.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.498+0000 7fdcdc7af640 1 --2- 172.21.15.114:0/3457542950 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdcd4153330 0x7fdcd415d2e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:24.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.498+0000 7fdcdc7af640 1 -- 172.21.15.114:0/3457542950 >> 172.21.15.114:0/3457542950 conn(0x7fdcd406c980 msgr2=0x7fdcd40b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:24.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.498+0000 7fdcdc7af640 1 -- 172.21.15.114:0/3457542950 shutdown_connections 2024-04-28T13:08:24.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.498+0000 7fdcdc7af640 1 -- 172.21.15.114:0/3457542950 wait complete. 2024-04-28T13:08:24.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.499+0000 7fdcdc7af640 1 Processor -- start 2024-04-28T13:08:24.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.499+0000 7fdcdc7af640 1 -- start start 2024-04-28T13:08:24.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.500+0000 7fdcdc7af640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcd40723d0 0x7fdcd4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:24.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.500+0000 7fdcdc7af640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcd40740f0 0x7fdcd4143820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:24.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.500+0000 7fdcdc7af640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdcd4153330 0x7fdcd4155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:24.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.500+0000 7fdcdc7af640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd4073230 con 0x7fdcd40740f0 2024-04-28T13:08:24.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.500+0000 7fdcdc7af640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd4072f50 con 0x7fdcd40723d0 2024-04-28T13:08:24.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.500+0000 7fdcdc7af640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fdcd4073510 con 0x7fdcd4153330 2024-04-28T13:08:24.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.500+0000 7fdcd9d4a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcd40740f0 0x7fdcd4143820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:24.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.500+0000 7fdcd9d4a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcd40740f0 0x7fdcd4143820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33138/0 (socket says 172.21.15.114:33138) 2024-04-28T13:08:24.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.500+0000 7fdcd9d4a640 1 -- 172.21.15.114:0/1488363121 learned_addr learned my addr 172.21.15.114:0/1488363121 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:24.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.500+0000 7fdcd9d4a640 1 -- 172.21.15.114:0/1488363121 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdcd4153330 msgr2=0x7fdcd4155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:24.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.500+0000 7fdcdad4c640 1 --2- 172.21.15.114:0/1488363121 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdcd4153330 0x7fdcd4155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:24.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.500+0000 7fdcd9d4a640 1 --2- 172.21.15.114:0/1488363121 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdcd4153330 0x7fdcd4155430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:24.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.500+0000 7fdcd9d4a640 1 -- 172.21.15.114:0/1488363121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcd40723d0 msgr2=0x7fdcd4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:24.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.500+0000 7fdcda54b640 1 --2- 172.21.15.114:0/1488363121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcd40723d0 0x7fdcd4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:24.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.500+0000 7fdcd9d4a640 1 --2- 172.21.15.114:0/1488363121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcd40723d0 0x7fdcd4156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:24.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.500+0000 7fdcd9d4a640 1 -- 172.21.15.114:0/1488363121 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd41576e0 con 0x7fdcd40740f0 2024-04-28T13:08:24.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.500+0000 7fdcd9d4a640 1 --2- 172.21.15.114:0/1488363121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcd40740f0 0x7fdcd4143820 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400e960 tx=0x7fdcc400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:24.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.501+0000 7fdccaffd640 1 -- 172.21.15.114:0/1488363121 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4017070 con 0x7fdcd40740f0 2024-04-28T13:08:24.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.501+0000 7fdccaffd640 1 -- 172.21.15.114:0/1488363121 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcc400ca00 con 0x7fdcd40740f0 2024-04-28T13:08:24.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.501+0000 7fdcdc7af640 1 -- 172.21.15.114:0/1488363121 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcd41579c0 con 0x7fdcd40740f0 2024-04-28T13:08:24.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.501+0000 7fdccaffd640 1 -- 172.21.15.114:0/1488363121 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc400cdd0 con 0x7fdcd40740f0 2024-04-28T13:08:24.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.501+0000 7fdcdc7af640 1 -- 172.21.15.114:0/1488363121 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcd4157f80 con 0x7fdcd40740f0 2024-04-28T13:08:24.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.501+0000 7fdcdc7af640 1 -- 172.21.15.114:0/1488363121 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcd41583c0 con 0x7fdcd40740f0 2024-04-28T13:08:24.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.502+0000 7fdccaffd640 1 -- 172.21.15.114:0/1488363121 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdcc401a070 con 0x7fdcd40740f0 2024-04-28T13:08:24.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.502+0000 7fdccaffd640 1 --2- 172.21.15.114:0/1488363121 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fdcb806c8f0 0x7fdcb806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:24.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.502+0000 7fdccaffd640 1 -- 172.21.15.114:0/1488363121 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fdcc408bd30 con 0x7fdcd40740f0 2024-04-28T13:08:24.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.502+0000 7fdcda54b640 1 --2- 172.21.15.114:0/1488363121 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fdcb806c8f0 0x7fdcb806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:24.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.503+0000 7fdcda54b640 1 --2- 172.21.15.114:0/1488363121 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fdcb806c8f0 0x7fdcb806edb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0034000 tx=0x7fdcd002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:24.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.507+0000 7fdccaffd640 1 -- 172.21.15.114:0/1488363121 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fdcc405a1f0 con 0x7fdcd40740f0 2024-04-28T13:08:24.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.720+0000 7fdcdc7af640 1 -- 172.21.15.114:0/1488363121 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fdcd415fbc0 con 0x7fdcd40740f0 2024-04-28T13:08:24.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.720+0000 7fdccaffd640 1 -- 172.21.15.114:0/1488363121 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) ==== 53+0+73 (secure 0 0 0) 0x7fdcc4059af0 con 0x7fdcd40740f0 2024-04-28T13:08:24.720 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-28T13:08:24.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.722+0000 7fdcdc7af640 1 -- 172.21.15.114:0/1488363121 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fdcb806c8f0 msgr2=0x7fdcb806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:24.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.722+0000 7fdcdc7af640 1 --2- 172.21.15.114:0/1488363121 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fdcb806c8f0 0x7fdcb806edb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0034000 tx=0x7fdcd002e000 comp rx=0 tx=0).stop 2024-04-28T13:08:24.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.722+0000 7fdcdc7af640 1 -- 172.21.15.114:0/1488363121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcd40740f0 msgr2=0x7fdcd4143820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:24.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.722+0000 7fdcdc7af640 1 --2- 172.21.15.114:0/1488363121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcd40740f0 0x7fdcd4143820 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400e960 tx=0x7fdcc400ee20 comp rx=0 tx=0).stop 2024-04-28T13:08:24.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.722+0000 7fdcdc7af640 1 -- 172.21.15.114:0/1488363121 shutdown_connections 2024-04-28T13:08:24.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.722+0000 7fdcdc7af640 1 --2- 172.21.15.114:0/1488363121 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdcd4153330 0x7fdcd4155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:24.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.722+0000 7fdcdc7af640 1 --2- 172.21.15.114:0/1488363121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcd40740f0 0x7fdcd4143820 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:24.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.722+0000 7fdcdc7af640 1 --2- 172.21.15.114:0/1488363121 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fdcb806c8f0 0x7fdcb806edb0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:24.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.722+0000 7fdcdc7af640 1 --2- 172.21.15.114:0/1488363121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcd40723d0 0x7fdcd4156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:24.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.722+0000 7fdcdc7af640 1 -- 172.21.15.114:0/1488363121 >> 172.21.15.114:0/1488363121 conn(0x7fdcd406c980 msgr2=0x7fdcd415b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:24.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.722+0000 7fdcdc7af640 1 -- 172.21.15.114:0/1488363121 shutdown_connections 2024-04-28T13:08:24.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:24.722+0000 7fdcdc7af640 1 -- 172.21.15.114:0/1488363121 wait complete. 2024-04-28T13:08:24.733 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-28T13:08:24.733 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-28T13:08:24.733 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2024-04-28T13:08:24.733 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-28T13:08:24.733 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-28T13:08:24.734 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-28T13:08:24.734 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-28T13:08:24.734 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-28T13:08:24.734 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-28T13:08:24.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:24.734 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2024-04-28T13:08:24.753 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-28T13:08:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-28T13:08:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-04-28T13:08:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:08:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-04-28T13:08:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:08:24.754 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-28T13:08:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:08:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2024-04-28T13:08:24.754 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-28T13:08:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:08:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2024-04-28T13:08:24.754 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-28T13:08:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:08:24.754 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-28T13:08:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:08:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-28T13:08:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42704sec preferred_lft 42704sec 2024-04-28T13:08:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::26cd:4a7a:1eab:e9e4/64 scope link noprefixroute 2024-04-28T13:08:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:08:24.755 INFO:teuthology.orchestra.run.smithi134.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-28T13:08:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 56:6a:3a:53:27:30 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:08:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-28T13:08:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:08:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ccad:f6ff:feeb:4c86/64 scope link 2024-04-28T13:08:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:08:24.755 INFO:teuthology.orchestra.run.smithi134.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-28T13:08:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 56:6a:3a:53:27:30 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-28T13:08:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::546a:3aff:fe53:2730/64 scope link 2024-04-28T13:08:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:08:24.755 INFO:teuthology.orchestra.run.smithi134.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-28T13:08:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 9a:0b:b6:24:57:5a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-28T13:08:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::980b:b6ff:fe24:575a/64 scope link 2024-04-28T13:08:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:08:24.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:24.756 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-28T13:08:24.820 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-04-28T13:08:24.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:24.822 DEBUG:teuthology.orchestra.run.smithi134:> route 2024-04-28T13:08:24.880 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2024-04-28T13:08:24.880 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-28T13:08:24.880 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-28T13:08:24.881 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-28T13:08:24.881 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-28T13:08:24.881 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-28T13:08:24.881 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-04-28T13:08:24.881 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-28T13:08:24.881 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-28T13:08:24.881 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-28T13:08:24.881 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-04-28T13:08:24.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:08:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-28T13:08:25.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:08:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:08:25.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:25.012 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-04-28T13:08:25.027 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-28T13:08:25.027 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-28T13:08:25.027 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-28T13:08:25.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:25.027 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2024-04-28T13:08:25.091 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-28T13:08:25.091 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-28T13:08:25.146 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-28T13:08:25.146 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-28T13:08:25.146 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-28T13:08:25.200 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-28T13:08:25.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:25.200 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-28T13:08:25.282 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-28T13:08:25.282 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-28T13:08:25.282 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-04-28T13:08:25.290 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-28T13:08:25.290 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-28T13:08:25.290 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-04-28T13:08:25.291 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.134:3300,172.21.15.134:3301" 2024-04-28T13:08:25.291 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-28T13:08:25.295 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-28T13:08:25.295 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-28T13:08:25.296 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-04-28T13:08:25.296 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.134:3300,172.21.15.134:3301" 2024-04-28T13:08:25.296 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-28T13:08:25.296 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.134:6789,172.21.15.134:6790" 2024-04-28T13:08:25.296 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.134:6789,172.21.15.134:6790:/ 2024-04-28T13:08:25.296 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=0961cca0-69c8-4b26-b89a-621e12152fc4" will pass to kernel 2024-04-28T13:08:25.296 INFO:teuthology.orchestra.run.smithi134.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-28T13:08:25.296 INFO:teuthology.orchestra.run.smithi134.stdout: You just mounted a file system that supports labels which does not 2024-04-28T13:08:25.296 INFO:teuthology.orchestra.run.smithi134.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-28T13:08:25.296 INFO:teuthology.orchestra.run.smithi134.stdout: applications will generate AVC messages and not be allowed access to 2024-04-28T13:08:25.297 INFO:teuthology.orchestra.run.smithi134.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-28T13:08:25.298 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-28T13:08:25.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:25.298 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-28T13:08:25.362 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-28T13:08:25.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:08:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-28T13:08:25.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:08:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:08:25.458 INFO:teuthology.orchestra.run.smithi134.stdout:client4817 2024-04-28T13:08:25.458 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:08:25.458 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-28T13:08:25.473 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-04-28T13:08:25.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.578+0000 7fb329d59640 1 Processor -- start 2024-04-28T13:08:25.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.578+0000 7fb329d59640 1 -- start start 2024-04-28T13:08:25.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.578+0000 7fb329d59640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb3240d0530 0x7fb3240b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:25.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.578+0000 7fb329d59640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb32415c900 0x7fb3240b4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:25.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.578+0000 7fb329d59640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb324072cf0 con 0x7fb324155fd0 2024-04-28T13:08:25.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.578+0000 7fb329d59640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fb3241563b0 con 0x7fb32415c900 2024-04-28T13:08:25.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.578+0000 7fb329d59640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb324072fd0 con 0x7fb3240d0530 2024-04-28T13:08:25.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.579+0000 7fb323fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb32415c900 0x7fb3240b4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:25.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.579+0000 7fb323fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb32415c900 0x7fb3240b4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33154/0 (socket says 172.21.15.114:33154) 2024-04-28T13:08:25.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.579+0000 7fb323fff640 1 -- 172.21.15.114:0/1561594968 learned_addr learned my addr 172.21.15.114:0/1561594968 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:25.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.579+0000 7fb322ffd640 1 --2- 172.21.15.114:0/1561594968 >> v2:172.21.15.134:3300/0 conn(0x7fb3240d0530 0x7fb3240b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:25.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.579+0000 7fb323fff640 1 -- 172.21.15.114:0/1561594968 >> v2:172.21.15.134:3300/0 conn(0x7fb3240d0530 msgr2=0x7fb3240b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:25.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.579+0000 7fb323fff640 1 --2- 172.21.15.114:0/1561594968 >> v2:172.21.15.134:3300/0 conn(0x7fb3240d0530 0x7fb3240b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:25.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.579+0000 7fb323fff640 1 -- 172.21.15.114:0/1561594968 >> v1:172.21.15.134:6789/0 conn(0x7fb324155fd0 legacy=0x7fb32406e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:25.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.579+0000 7fb323fff640 1 -- 172.21.15.114:0/1561594968 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3240732b0 con 0x7fb32415c900 2024-04-28T13:08:25.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.580+0000 7fb323fff640 1 --2- 172.21.15.114:0/1561594968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb32415c900 0x7fb3240b4be0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb324159a50 tx=0x7fb31c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba9f98f19da1434 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:25.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.580+0000 7fb3227fc640 1 -- 172.21.15.114:0/1561594968 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31c036070 con 0x7fb32415c900 2024-04-28T13:08:25.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.580+0000 7fb3227fc640 1 -- 172.21.15.114:0/1561594968 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb31c031600 con 0x7fb32415c900 2024-04-28T13:08:25.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.580+0000 7fb3227fc640 1 -- 172.21.15.114:0/1561594968 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0319d0 con 0x7fb32415c900 2024-04-28T13:08:25.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.580+0000 7fb329d59640 1 -- 172.21.15.114:0/1561594968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb32415c900 msgr2=0x7fb3240b4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:25.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.580+0000 7fb329d59640 1 --2- 172.21.15.114:0/1561594968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb32415c900 0x7fb3240b4be0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb324159a50 tx=0x7fb31c02a730 comp rx=0 tx=0).stop 2024-04-28T13:08:25.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.580+0000 7fb329d59640 1 -- 172.21.15.114:0/1561594968 shutdown_connections 2024-04-28T13:08:25.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.580+0000 7fb329d59640 1 --2- 172.21.15.114:0/1561594968 >> v2:172.21.15.134:3300/0 conn(0x7fb3240d0530 0x7fb3240b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:25.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.580+0000 7fb329d59640 1 --2- 172.21.15.114:0/1561594968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb32415c900 0x7fb3240b4be0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:25.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.580+0000 7fb329d59640 1 -- 172.21.15.114:0/1561594968 >> 172.21.15.114:0/1561594968 conn(0x7fb32406c530 msgr2=0x7fb32406c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:25.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.580+0000 7fb329d59640 1 -- 172.21.15.114:0/1561594968 shutdown_connections 2024-04-28T13:08:25.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.580+0000 7fb329d59640 1 -- 172.21.15.114:0/1561594968 wait complete. 2024-04-28T13:08:25.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.581+0000 7fb329d59640 1 Processor -- start 2024-04-28T13:08:25.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.582+0000 7fb329d59640 1 -- start start 2024-04-28T13:08:25.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.582+0000 7fb329d59640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3240d0530 0x7fb3240b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:25.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.582+0000 7fb329d59640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb324155fd0 0x7fb324142c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:25.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.582+0000 7fb329d59640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb32415c900 0x7fb32406ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:25.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.582+0000 7fb329d59640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb3240b5380 con 0x7fb324155fd0 2024-04-28T13:08:25.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.582+0000 7fb329d59640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb32406ea30 con 0x7fb32415c900 2024-04-28T13:08:25.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.582+0000 7fb329d59640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb3240b5500 con 0x7fb3240d0530 2024-04-28T13:08:25.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.582+0000 7fb322ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb324155fd0 0x7fb324142c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:25.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.582+0000 7fb322ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb324155fd0 0x7fb324142c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33168/0 (socket says 172.21.15.114:33168) 2024-04-28T13:08:25.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.582+0000 7fb322ffd640 1 -- 172.21.15.114:0/1384150601 learned_addr learned my addr 172.21.15.114:0/1384150601 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:25.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.583+0000 7fb323fff640 1 --2- 172.21.15.114:0/1384150601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb32415c900 0x7fb32406ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:25.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.583+0000 7fb3237fe640 1 --2- 172.21.15.114:0/1384150601 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3240d0530 0x7fb3240b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:25.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.583+0000 7fb322ffd640 1 -- 172.21.15.114:0/1384150601 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3240d0530 msgr2=0x7fb3240b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:25.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.583+0000 7fb322ffd640 1 --2- 172.21.15.114:0/1384150601 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3240d0530 0x7fb3240b0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:25.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.583+0000 7fb322ffd640 1 -- 172.21.15.114:0/1384150601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb32415c900 msgr2=0x7fb32406ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:25.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.583+0000 7fb322ffd640 1 --2- 172.21.15.114:0/1384150601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb32415c900 0x7fb32406ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:25.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.583+0000 7fb322ffd640 1 -- 172.21.15.114:0/1384150601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3241e6ec0 con 0x7fb324155fd0 2024-04-28T13:08:25.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.583+0000 7fb322ffd640 1 --2- 172.21.15.114:0/1384150601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb324155fd0 0x7fb324142c80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb31800f8c0 tx=0x7fb31800fd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:25.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.583+0000 7fb30bfff640 1 -- 172.21.15.114:0/1384150601 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb318017020 con 0x7fb324155fd0 2024-04-28T13:08:25.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.583+0000 7fb30bfff640 1 -- 172.21.15.114:0/1384150601 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb318005ba0 con 0x7fb324155fd0 2024-04-28T13:08:25.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.583+0000 7fb30bfff640 1 -- 172.21.15.114:0/1384150601 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3180070d0 con 0x7fb324155fd0 2024-04-28T13:08:25.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.583+0000 7fb329d59640 1 -- 172.21.15.114:0/1384150601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3241e41d0 con 0x7fb324155fd0 2024-04-28T13:08:25.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.583+0000 7fb329d59640 1 -- 172.21.15.114:0/1384150601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb32414ffb0 con 0x7fb324155fd0 2024-04-28T13:08:25.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.584+0000 7fb329d59640 1 -- 172.21.15.114:0/1384150601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb32406a440 con 0x7fb324155fd0 2024-04-28T13:08:25.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.585+0000 7fb30bfff640 1 -- 172.21.15.114:0/1384150601 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb31801a020 con 0x7fb324155fd0 2024-04-28T13:08:25.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.585+0000 7fb30bfff640 1 --2- 172.21.15.114:0/1384150601 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb31006c920 0x7fb31006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:25.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.585+0000 7fb30bfff640 1 -- 172.21.15.114:0/1384150601 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb31808bab0 con 0x7fb324155fd0 2024-04-28T13:08:25.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.585+0000 7fb3237fe640 1 --2- 172.21.15.114:0/1384150601 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb31006c920 0x7fb31006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:25.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.585+0000 7fb3237fe640 1 --2- 172.21.15.114:0/1384150601 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb31006c920 0x7fb31006ede0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb314001780 tx=0x7fb314009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:25.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.589+0000 7fb30bfff640 1 -- 172.21.15.114:0/1384150601 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb318021020 con 0x7fb324155fd0 2024-04-28T13:08:25.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:25.805+0000 7fb329d59640 1 -- 172.21.15.114:0/1384150601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fb324072720 con 0x7fb324155fd0 2024-04-28T13:08:26.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.779+0000 7fb30bfff640 1 -- 172.21.15.114:0/1384150601 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v14) ==== 136+0+0 (secure 0 0 0) 0x7fb318059920 con 0x7fb324155fd0 2024-04-28T13:08:26.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.782+0000 7fb329d59640 1 -- 172.21.15.114:0/1384150601 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb31006c920 msgr2=0x7fb31006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:26.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.782+0000 7fb329d59640 1 --2- 172.21.15.114:0/1384150601 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb31006c920 0x7fb31006ede0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb314001780 tx=0x7fb314009040 comp rx=0 tx=0).stop 2024-04-28T13:08:26.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.782+0000 7fb329d59640 1 -- 172.21.15.114:0/1384150601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb324155fd0 msgr2=0x7fb324142c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:26.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.782+0000 7fb329d59640 1 --2- 172.21.15.114:0/1384150601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb324155fd0 0x7fb324142c80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb31800f8c0 tx=0x7fb31800fd80 comp rx=0 tx=0).stop 2024-04-28T13:08:26.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.782+0000 7fb329d59640 1 -- 172.21.15.114:0/1384150601 shutdown_connections 2024-04-28T13:08:26.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.782+0000 7fb329d59640 1 --2- 172.21.15.114:0/1384150601 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb31006c920 0x7fb31006ede0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:26.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.782+0000 7fb329d59640 1 --2- 172.21.15.114:0/1384150601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb32415c900 0x7fb32406ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:26.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.782+0000 7fb329d59640 1 --2- 172.21.15.114:0/1384150601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb324155fd0 0x7fb324142c80 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:26.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.782+0000 7fb329d59640 1 --2- 172.21.15.114:0/1384150601 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3240d0530 0x7fb3240b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:26.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.782+0000 7fb329d59640 1 -- 172.21.15.114:0/1384150601 >> 172.21.15.114:0/1384150601 conn(0x7fb32406c530 msgr2=0x7fb32406e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:26.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.782+0000 7fb329d59640 1 -- 172.21.15.114:0/1384150601 shutdown_connections 2024-04-28T13:08:26.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.782+0000 7fb329d59640 1 -- 172.21.15.114:0/1384150601 wait complete. 2024-04-28T13:08:26.795 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-04-28T13:08:26.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.898+0000 7faf0eb14640 1 Processor -- start 2024-04-28T13:08:26.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.898+0000 7faf0eb14640 1 -- start start 2024-04-28T13:08:26.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.899+0000 7faf0eb14640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7faf0815f230 0x7faf080bac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:26.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.899+0000 7faf0eb14640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf080d22a0 0x7faf080b82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:26.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.899+0000 7faf0eb14640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf080ba670 con 0x7faf0815f610 2024-04-28T13:08:26.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.899+0000 7faf0eb14640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7faf080b9830 con 0x7faf0815f230 2024-04-28T13:08:26.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.899+0000 7faf0eb14640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7faf080b9af0 con 0x7faf080d22a0 2024-04-28T13:08:26.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.900+0000 7faf0c8b0640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7faf0815f230 0x7faf080bac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:26.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.900+0000 7faf0d0b1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf080d22a0 0x7faf080b82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:26.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.900+0000 7faf07fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7faf0815f610 0x7faf080d1b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:52742/0 (socket says 172.21.15.114:52742) 2024-04-28T13:08:26.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.900+0000 7faf07fff640 1 -- 172.21.15.114:0/1197868464 learned_addr learned my addr 172.21.15.114:0/1197868464 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:26.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.900+0000 7faf0c8b0640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7faf0815f230 0x7faf080bac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:58606/0 (socket says 172.21.15.114:58606) 2024-04-28T13:08:26.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.900+0000 7faf0d0b1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf080d22a0 0x7faf080b82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:33694/0 (socket says 172.21.15.114:33694) 2024-04-28T13:08:26.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.900+0000 7faf0d0b1640 1 -- 172.21.15.114:0/1197868464 >> v2:172.21.15.134:3300/0 conn(0x7faf0815f230 msgr2=0x7faf080bac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:26.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.900+0000 7faf0d0b1640 1 --2- 172.21.15.114:0/1197868464 >> v2:172.21.15.134:3300/0 conn(0x7faf0815f230 0x7faf080bac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:26.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.900+0000 7faf0d0b1640 1 -- 172.21.15.114:0/1197868464 >> v1:172.21.15.134:6789/0 conn(0x7faf0815f610 legacy=0x7faf080d1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:26.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.900+0000 7faf0d0b1640 1 -- 172.21.15.114:0/1197868464 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf080b9dd0 con 0x7faf080d22a0 2024-04-28T13:08:26.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.900+0000 7faf0c8b0640 1 --2- 172.21.15.114:0/1197868464 >> v2:172.21.15.134:3300/0 conn(0x7faf0815f230 0x7faf080bac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:08:26.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.901+0000 7faf0d0b1640 1 --2- 172.21.15.114:0/1197868464 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf080d22a0 0x7faf080b82e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faf00009d90 tx=0x7faf0002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e86c8b4abaab2394 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:26.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.901+0000 7faf077fe640 1 -- 172.21.15.114:0/1197868464 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf00007740 con 0x7faf080d22a0 2024-04-28T13:08:26.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.901+0000 7faf077fe640 1 -- 172.21.15.114:0/1197868464 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf000078e0 con 0x7faf080d22a0 2024-04-28T13:08:26.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.901+0000 7faf077fe640 1 -- 172.21.15.114:0/1197868464 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf00007cb0 con 0x7faf080d22a0 2024-04-28T13:08:26.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.901+0000 7faf0eb14640 1 -- 172.21.15.114:0/1197868464 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf080d22a0 msgr2=0x7faf080b82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:26.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.901+0000 7faf0eb14640 1 --2- 172.21.15.114:0/1197868464 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf080d22a0 0x7faf080b82e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faf00009d90 tx=0x7faf0002a660 comp rx=0 tx=0).stop 2024-04-28T13:08:26.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.901+0000 7faf0eb14640 1 -- 172.21.15.114:0/1197868464 shutdown_connections 2024-04-28T13:08:26.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.901+0000 7faf0eb14640 1 --2- 172.21.15.114:0/1197868464 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf080d22a0 0x7faf080b82e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:26.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.902+0000 7faf0eb14640 1 --2- 172.21.15.114:0/1197868464 >> v2:172.21.15.134:3300/0 conn(0x7faf0815f230 0x7faf080bac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:26.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.902+0000 7faf0eb14640 1 -- 172.21.15.114:0/1197868464 >> 172.21.15.114:0/1197868464 conn(0x7faf08063190 msgr2=0x7faf080635a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:26.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.902+0000 7faf0eb14640 1 -- 172.21.15.114:0/1197868464 shutdown_connections 2024-04-28T13:08:26.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.902+0000 7faf0eb14640 1 -- 172.21.15.114:0/1197868464 wait complete. 2024-04-28T13:08:26.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.903+0000 7faf0eb14640 1 Processor -- start 2024-04-28T13:08:26.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.903+0000 7faf0eb14640 1 -- start start 2024-04-28T13:08:26.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.904+0000 7faf0eb14640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf080d22a0 0x7faf080cec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:26.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.904+0000 7faf0eb14640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf0815f230 0x7faf08145020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:26.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.904+0000 7faf0eb14640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf0815f610 0x7faf081f4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:26.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.904+0000 7faf0eb14640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7faf080d4590 con 0x7faf0815f610 2024-04-28T13:08:26.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.904+0000 7faf0eb14640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faf080ba390 con 0x7faf080d22a0 2024-04-28T13:08:26.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.904+0000 7faf0eb14640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7faf080d4710 con 0x7faf0815f230 2024-04-28T13:08:26.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.904+0000 7faf0d0b1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf0815f610 0x7faf081f4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:26.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.904+0000 7faf0d0b1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf0815f610 0x7faf081f4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33170/0 (socket says 172.21.15.114:33170) 2024-04-28T13:08:26.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.904+0000 7faf0d0b1640 1 -- 172.21.15.114:0/2527113480 learned_addr learned my addr 172.21.15.114:0/2527113480 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:26.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.904+0000 7faf0c8b0640 1 --2- 172.21.15.114:0/2527113480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf080d22a0 0x7faf080cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:26.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.904+0000 7faf07fff640 1 --2- 172.21.15.114:0/2527113480 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf0815f230 0x7faf08145020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:26.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.904+0000 7faf0d0b1640 1 -- 172.21.15.114:0/2527113480 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf0815f230 msgr2=0x7faf08145020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:26.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.904+0000 7faf0d0b1640 1 --2- 172.21.15.114:0/2527113480 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf0815f230 0x7faf08145020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:26.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.904+0000 7faf0d0b1640 1 -- 172.21.15.114:0/2527113480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf080d22a0 msgr2=0x7faf080cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:26.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.904+0000 7faf0d0b1640 1 --2- 172.21.15.114:0/2527113480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf080d22a0 0x7faf080cec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:26.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.904+0000 7faf0d0b1640 1 -- 172.21.15.114:0/2527113480 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf08145560 con 0x7faf0815f610 2024-04-28T13:08:26.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.904+0000 7faf0d0b1640 1 --2- 172.21.15.114:0/2527113480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf0815f610 0x7faf081f4d90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7faf00009eb0 tx=0x7faf00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:26.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.904+0000 7faf057fa640 1 -- 172.21.15.114:0/2527113480 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0003f070 con 0x7faf0815f610 2024-04-28T13:08:26.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.904+0000 7faf057fa640 1 -- 172.21.15.114:0/2527113480 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf00031c60 con 0x7faf0815f610 2024-04-28T13:08:26.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.904+0000 7faf057fa640 1 -- 172.21.15.114:0/2527113480 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf00009450 con 0x7faf0815f610 2024-04-28T13:08:26.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.904+0000 7faf0eb14640 1 -- 172.21.15.114:0/2527113480 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf08145800 con 0x7faf0815f610 2024-04-28T13:08:26.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.904+0000 7faf0eb14640 1 -- 172.21.15.114:0/2527113480 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf08161460 con 0x7faf0815f610 2024-04-28T13:08:26.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.906+0000 7faf0eb14640 1 -- 172.21.15.114:0/2527113480 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf08075c40 con 0x7faf0815f610 2024-04-28T13:08:26.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.906+0000 7faf057fa640 1 -- 172.21.15.114:0/2527113480 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faf0003b410 con 0x7faf0815f610 2024-04-28T13:08:26.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.906+0000 7faf057fa640 1 --2- 172.21.15.114:0/2527113480 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7faef406c8f0 0x7faef406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:26.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.906+0000 7faf057fa640 1 -- 172.21.15.114:0/2527113480 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7faf000acf30 con 0x7faf0815f610 2024-04-28T13:08:26.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.906+0000 7faf0c8b0640 1 --2- 172.21.15.114:0/2527113480 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7faef406c8f0 0x7faef406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:26.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.907+0000 7faf0c8b0640 1 --2- 172.21.15.114:0/2527113480 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7faef406c8f0 0x7faef406edb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faef8009a30 tx=0x7faef8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:26.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:26.911+0000 7faf057fa640 1 -- 172.21.15.114:0/2527113480 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7faf0007b3f0 con 0x7faf0815f610 2024-04-28T13:08:27.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.107+0000 7faf0eb14640 1 -- 172.21.15.114:0/2527113480 --> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7faf080cfd80 con 0x7faef406c8f0 2024-04-28T13:08:27.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.109+0000 7faf057fa640 1 -- 172.21.15.114:0/2527113480 <== mgr.4104 v2:172.21.15.114:6832/2240257326 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7faf080cfd80 con 0x7faef406c8f0 2024-04-28T13:08:27.108 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-04-28T13:08:27.109 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:27.109 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cephfs" 2024-04-28T13:08:27.109 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:27.109 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-04-28T13:08:27.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.111+0000 7faf0eb14640 1 -- 172.21.15.114:0/2527113480 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7faef406c8f0 msgr2=0x7faef406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:27.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.111+0000 7faf0eb14640 1 --2- 172.21.15.114:0/2527113480 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7faef406c8f0 0x7faef406edb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faef8009a30 tx=0x7faef8008040 comp rx=0 tx=0).stop 2024-04-28T13:08:27.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.111+0000 7faf0eb14640 1 -- 172.21.15.114:0/2527113480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf0815f610 msgr2=0x7faf081f4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:27.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.111+0000 7faf0eb14640 1 --2- 172.21.15.114:0/2527113480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf0815f610 0x7faf081f4d90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7faf00009eb0 tx=0x7faf00004a40 comp rx=0 tx=0).stop 2024-04-28T13:08:27.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.111+0000 7faf0eb14640 1 -- 172.21.15.114:0/2527113480 shutdown_connections 2024-04-28T13:08:27.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.111+0000 7faf0eb14640 1 --2- 172.21.15.114:0/2527113480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf0815f610 0x7faf081f4d90 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.111+0000 7faf0eb14640 1 --2- 172.21.15.114:0/2527113480 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf0815f230 0x7faf08145020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.111+0000 7faf0eb14640 1 --2- 172.21.15.114:0/2527113480 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7faef406c8f0 0x7faef406edb0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.111+0000 7faf0eb14640 1 --2- 172.21.15.114:0/2527113480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf080d22a0 0x7faf080cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.111+0000 7faf0eb14640 1 -- 172.21.15.114:0/2527113480 >> 172.21.15.114:0/2527113480 conn(0x7faf08063190 msgr2=0x7faf0815c550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:27.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.111+0000 7faf0eb14640 1 -- 172.21.15.114:0/2527113480 shutdown_connections 2024-04-28T13:08:27.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.111+0000 7faf0eb14640 1 -- 172.21.15.114:0/2527113480 wait complete. 2024-04-28T13:08:27.123 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-28T13:08:27.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.222+0000 7f0878837640 1 Processor -- start 2024-04-28T13:08:27.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.222+0000 7f0878837640 1 -- start start 2024-04-28T13:08:27.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.223+0000 7f0878837640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f087406f860 0x7f0874160dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:27.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.223+0000 7f0878837640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0874073420 0x7f0874073890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:27.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.223+0000 7f0878837640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0874146f80 con 0x7f0874146ba0 2024-04-28T13:08:27.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.223+0000 7f0878837640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f08740d0ca0 con 0x7f0874073420 2024-04-28T13:08:27.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.223+0000 7f0878837640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f0874161300 con 0x7f087406f860 2024-04-28T13:08:27.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.223+0000 7f0872d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0874073420 0x7f0874073890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:27.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.223+0000 7f087259c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0874146ba0 0x7f08740cf450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52988/0 (socket says 172.21.15.114:52988) 2024-04-28T13:08:27.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.223+0000 7f087259c640 1 -- 172.21.15.114:0/2531435801 learned_addr learned my addr 172.21.15.114:0/2531435801 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:27.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.223+0000 7f0871d9b640 1 --2- 172.21.15.114:0/2531435801 >> v2:172.21.15.134:3300/0 conn(0x7f087406f860 0x7f0874160dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:27.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.223+0000 7f0872d9d640 1 -- 172.21.15.114:0/2531435801 >> v2:172.21.15.134:3300/0 conn(0x7f087406f860 msgr2=0x7f0874160dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:27.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.223+0000 7f0872d9d640 1 --2- 172.21.15.114:0/2531435801 >> v2:172.21.15.134:3300/0 conn(0x7f087406f860 0x7f0874160dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.223+0000 7f0872d9d640 1 -- 172.21.15.114:0/2531435801 >> v1:172.21.15.114:6789/0 conn(0x7f0874146ba0 legacy=0x7f08740cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:27.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.223+0000 7f087159a640 1 -- 172.21.15.114:0/2531435801 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 17894722 0 0) 0x7f0864001110 con 0x7f0874146ba0 2024-04-28T13:08:27.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.223+0000 7f0872d9d640 1 -- 172.21.15.114:0/2531435801 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0874161530 con 0x7f0874073420 2024-04-28T13:08:27.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.224+0000 7f0872d9d640 1 --2- 172.21.15.114:0/2531435801 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0874073420 0x7f0874073890 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f087406d200 tx=0x7f086c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f60e7c3489dc381 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:27.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.224+0000 7f087159a640 1 -- 172.21.15.114:0/2531435801 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086c007740 con 0x7f0874073420 2024-04-28T13:08:27.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.224+0000 7f087159a640 1 -- 172.21.15.114:0/2531435801 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f086c0078e0 con 0x7f0874073420 2024-04-28T13:08:27.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.224+0000 7f087159a640 1 -- 172.21.15.114:0/2531435801 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086c007cb0 con 0x7f0874073420 2024-04-28T13:08:27.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.224+0000 7f0878837640 1 -- 172.21.15.114:0/2531435801 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0874073420 msgr2=0x7f0874073890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:27.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.224+0000 7f0878837640 1 --2- 172.21.15.114:0/2531435801 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0874073420 0x7f0874073890 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f087406d200 tx=0x7f086c02a5f0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.225+0000 7f0878837640 1 -- 172.21.15.114:0/2531435801 shutdown_connections 2024-04-28T13:08:27.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.225+0000 7f0878837640 1 --2- 172.21.15.114:0/2531435801 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0874073420 0x7f0874073890 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.225+0000 7f0878837640 1 --2- 172.21.15.114:0/2531435801 >> v2:172.21.15.134:3300/0 conn(0x7f087406f860 0x7f0874160dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.225+0000 7f0878837640 1 -- 172.21.15.114:0/2531435801 >> 172.21.15.114:0/2531435801 conn(0x7f087406c980 msgr2=0x7f08740b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:27.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.225+0000 7f0878837640 1 -- 172.21.15.114:0/2531435801 shutdown_connections 2024-04-28T13:08:27.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.225+0000 7f0878837640 1 -- 172.21.15.114:0/2531435801 wait complete. 2024-04-28T13:08:27.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.226+0000 7f0878837640 1 Processor -- start 2024-04-28T13:08:27.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.226+0000 7f0878837640 1 -- start start 2024-04-28T13:08:27.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.227+0000 7f0878837640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f087406f860 0x7f0874154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:27.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.227+0000 7f0878837640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0874073420 0x7f087413e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:27.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.227+0000 7f0878837640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0874146ba0 0x7f087413e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:27.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.227+0000 7f0878837640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f08740cfb60 con 0x7f0874146ba0 2024-04-28T13:08:27.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.227+0000 7f0878837640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0874161af0 con 0x7f0874073420 2024-04-28T13:08:27.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.227+0000 7f0878837640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f08740cfce0 con 0x7f087406f860 2024-04-28T13:08:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.227+0000 7f0872d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0874146ba0 0x7f087413e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.227+0000 7f0872d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0874146ba0 0x7f087413e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33200/0 (socket says 172.21.15.114:33200) 2024-04-28T13:08:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.227+0000 7f0872d9d640 1 -- 172.21.15.114:0/3166666070 learned_addr learned my addr 172.21.15.114:0/3166666070 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.227+0000 7f087259c640 1 --2- 172.21.15.114:0/3166666070 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f087406f860 0x7f0874154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.227+0000 7f0871d9b640 1 --2- 172.21.15.114:0/3166666070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0874073420 0x7f087413e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.227+0000 7f0872d9d640 1 -- 172.21.15.114:0/3166666070 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f087406f860 msgr2=0x7f0874154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.227+0000 7f0872d9d640 1 --2- 172.21.15.114:0/3166666070 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f087406f860 0x7f0874154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.227+0000 7f0872d9d640 1 -- 172.21.15.114:0/3166666070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0874073420 msgr2=0x7f087413e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.227+0000 7f0872d9d640 1 --2- 172.21.15.114:0/3166666070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0874073420 0x7f087413e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.227+0000 7f0872d9d640 1 -- 172.21.15.114:0/3166666070 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08740cb300 con 0x7f0874146ba0 2024-04-28T13:08:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.227+0000 7f0872d9d640 1 --2- 172.21.15.114:0/3166666070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0874146ba0 0x7f087413e570 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f086c009e50 tx=0x7f086c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.227+0000 7f0862ffd640 1 -- 172.21.15.114:0/3166666070 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086c040070 con 0x7f0874146ba0 2024-04-28T13:08:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.227+0000 7f0862ffd640 1 -- 172.21.15.114:0/3166666070 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f086c031bf0 con 0x7f0874146ba0 2024-04-28T13:08:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.227+0000 7f0878837640 1 -- 172.21.15.114:0/3166666070 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08740cb5e0 con 0x7f0874146ba0 2024-04-28T13:08:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.227+0000 7f0862ffd640 1 -- 172.21.15.114:0/3166666070 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086c045460 con 0x7f0874146ba0 2024-04-28T13:08:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.227+0000 7f0878837640 1 -- 172.21.15.114:0/3166666070 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08740cbba0 con 0x7f0874146ba0 2024-04-28T13:08:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.228+0000 7f0878837640 1 -- 172.21.15.114:0/3166666070 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f087406a3d0 con 0x7f0874146ba0 2024-04-28T13:08:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.229+0000 7f0862ffd640 1 -- 172.21.15.114:0/3166666070 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f086c039040 con 0x7f0874146ba0 2024-04-28T13:08:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.229+0000 7f0862ffd640 1 --2- 172.21.15.114:0/3166666070 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f085406c920 0x7f085406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.229+0000 7f0862ffd640 1 -- 172.21.15.114:0/3166666070 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f086c0ad480 con 0x7f0874146ba0 2024-04-28T13:08:27.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.229+0000 7f087259c640 1 --2- 172.21.15.114:0/3166666070 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f085406c920 0x7f085406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:27.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.230+0000 7f087259c640 1 --2- 172.21.15.114:0/3166666070 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f085406c920 0x7f085406ede0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0864000f60 tx=0x7f0864009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:27.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.234+0000 7f0862ffd640 1 -- 172.21.15.114:0/3166666070 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f086c07b8b0 con 0x7f0874146ba0 2024-04-28T13:08:27.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.408+0000 7f0878837640 1 -- 172.21.15.114:0/3166666070 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f08741461a0 con 0x7f0874146ba0 2024-04-28T13:08:27.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.409+0000 7f0862ffd640 1 -- 172.21.15.114:0/3166666070 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f086c07b1b0 con 0x7f0874146ba0 2024-04-28T13:08:27.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.411+0000 7f0878837640 1 -- 172.21.15.114:0/3166666070 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f085406c920 msgr2=0x7f085406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:27.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.411+0000 7f0878837640 1 --2- 172.21.15.114:0/3166666070 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f085406c920 0x7f085406ede0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0864000f60 tx=0x7f0864009040 comp rx=0 tx=0).stop 2024-04-28T13:08:27.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.411+0000 7f0878837640 1 -- 172.21.15.114:0/3166666070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0874146ba0 msgr2=0x7f087413e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:27.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.411+0000 7f0878837640 1 --2- 172.21.15.114:0/3166666070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0874146ba0 0x7f087413e570 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f086c009e50 tx=0x7f086c004a40 comp rx=0 tx=0).stop 2024-04-28T13:08:27.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.411+0000 7f0878837640 1 -- 172.21.15.114:0/3166666070 shutdown_connections 2024-04-28T13:08:27.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.411+0000 7f0878837640 1 --2- 172.21.15.114:0/3166666070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0874146ba0 0x7f087413e570 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.411+0000 7f0878837640 1 --2- 172.21.15.114:0/3166666070 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f085406c920 0x7f085406ede0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.411+0000 7f0878837640 1 --2- 172.21.15.114:0/3166666070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0874073420 0x7f087413e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.411+0000 7f0878837640 1 --2- 172.21.15.114:0/3166666070 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f087406f860 0x7f0874154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.411+0000 7f0878837640 1 -- 172.21.15.114:0/3166666070 >> 172.21.15.114:0/3166666070 conn(0x7f087406c980 msgr2=0x7f08740b47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:27.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.411+0000 7f0878837640 1 -- 172.21.15.114:0/3166666070 shutdown_connections 2024-04-28T13:08:27.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.411+0000 7f0878837640 1 -- 172.21.15.114:0/3166666070 wait complete. 2024-04-28T13:08:27.422 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs subvol_grp50760 2024-04-28T13:08:27.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.521+0000 7f5545191640 1 Processor -- start 2024-04-28T13:08:27.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.521+0000 7f5545191640 1 -- start start 2024-04-28T13:08:27.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.522+0000 7f5545191640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f554015f430 0x7f55400d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:27.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.522+0000 7f5545191640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f55400d1fc0 0x7f55400d5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:27.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.522+0000 7f5545191640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f55400baf40 0x7f55400d56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:27.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.522+0000 7f5545191640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f554015f810 con 0x7f55400baf40 2024-04-28T13:08:27.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.522+0000 7f5545191640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f55400d36d0 con 0x7f55400d1fc0 2024-04-28T13:08:27.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.522+0000 7f5545191640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f55400d2a40 con 0x7f554015f430 2024-04-28T13:08:27.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.522+0000 7f553f59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f55400baf40 0x7f55400d56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:27.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.522+0000 7f553f59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f55400baf40 0x7f55400d56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33212/0 (socket says 172.21.15.114:33212) 2024-04-28T13:08:27.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.522+0000 7f553f59e640 1 -- 172.21.15.114:0/2561082705 learned_addr learned my addr 172.21.15.114:0/2561082705 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:27.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.523+0000 7f553ed9d640 1 --2- 172.21.15.114:0/2561082705 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f554015f430 0x7f55400d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:27.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.523+0000 7f553e59c640 1 --2- 172.21.15.114:0/2561082705 >> v2:172.21.15.134:3300/0 conn(0x7f55400d1fc0 0x7f55400d5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:27.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.523+0000 7f553f59e640 1 -- 172.21.15.114:0/2561082705 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f554015f430 msgr2=0x7f55400d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:27.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.523+0000 7f553f59e640 1 --2- 172.21.15.114:0/2561082705 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f554015f430 0x7f55400d1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.523+0000 7f553f59e640 1 -- 172.21.15.114:0/2561082705 >> v2:172.21.15.134:3300/0 conn(0x7f55400d1fc0 msgr2=0x7f55400d5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:27.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.523+0000 7f553f59e640 1 --2- 172.21.15.114:0/2561082705 >> v2:172.21.15.134:3300/0 conn(0x7f55400d1fc0 0x7f55400d5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.523+0000 7f553f59e640 1 -- 172.21.15.114:0/2561082705 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55400d2480 con 0x7f55400baf40 2024-04-28T13:08:27.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.523+0000 7f553ed9d640 1 --2- 172.21.15.114:0/2561082705 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f554015f430 0x7f55400d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:27.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.523+0000 7f553e59c640 1 --2- 172.21.15.114:0/2561082705 >> v2:172.21.15.134:3300/0 conn(0x7f55400d1fc0 0x7f55400d5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:27.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.523+0000 7f553f59e640 1 --2- 172.21.15.114:0/2561082705 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55400baf40 0x7f55400d56a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f55400d2c60 tx=0x7f553802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815ee9eb77252f2c server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:27.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.523+0000 7f553dd9b640 1 -- 172.21.15.114:0/2561082705 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5538037070 con 0x7f55400baf40 2024-04-28T13:08:27.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.523+0000 7f553dd9b640 1 -- 172.21.15.114:0/2561082705 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5538032440 con 0x7f55400baf40 2024-04-28T13:08:27.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.523+0000 7f553dd9b640 1 -- 172.21.15.114:0/2561082705 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5538032810 con 0x7f55400baf40 2024-04-28T13:08:27.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.524+0000 7f5545191640 1 -- 172.21.15.114:0/2561082705 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55400baf40 msgr2=0x7f55400d56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:27.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.524+0000 7f5545191640 1 --2- 172.21.15.114:0/2561082705 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55400baf40 0x7f55400d56a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f55400d2c60 tx=0x7f553802a1e0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.524+0000 7f5545191640 1 -- 172.21.15.114:0/2561082705 shutdown_connections 2024-04-28T13:08:27.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.524+0000 7f5545191640 1 --2- 172.21.15.114:0/2561082705 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55400baf40 0x7f55400d56a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.524+0000 7f5545191640 1 --2- 172.21.15.114:0/2561082705 >> v2:172.21.15.134:3300/0 conn(0x7f55400d1fc0 0x7f55400d5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.524+0000 7f5545191640 1 --2- 172.21.15.114:0/2561082705 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f554015f430 0x7f55400d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.524+0000 7f5545191640 1 -- 172.21.15.114:0/2561082705 >> 172.21.15.114:0/2561082705 conn(0x7f55400633a0 msgr2=0x7f554006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:27.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.524+0000 7f5545191640 1 -- 172.21.15.114:0/2561082705 shutdown_connections 2024-04-28T13:08:27.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.524+0000 7f5545191640 1 -- 172.21.15.114:0/2561082705 wait complete. 2024-04-28T13:08:27.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.525+0000 7f5545191640 1 Processor -- start 2024-04-28T13:08:27.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.525+0000 7f5545191640 1 -- start start 2024-04-28T13:08:27.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.526+0000 7f5545191640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55400baf40 0x7f5540155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:27.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.526+0000 7f5545191640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55400d1fc0 0x7f554015b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:27.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.526+0000 7f5545191640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f554015f430 0x7f5540161670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:27.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.526+0000 7f5545191640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5540162ee0 con 0x7f55400baf40 2024-04-28T13:08:27.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.526+0000 7f5545191640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f55400d3360 con 0x7f55400d1fc0 2024-04-28T13:08:27.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.526+0000 7f5545191640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f5540163060 con 0x7f554015f430 2024-04-28T13:08:27.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.526+0000 7f553ed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55400baf40 0x7f5540155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:27.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.526+0000 7f553ed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55400baf40 0x7f5540155440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33218/0 (socket says 172.21.15.114:33218) 2024-04-28T13:08:27.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.526+0000 7f553ed9d640 1 -- 172.21.15.114:0/2604546065 learned_addr learned my addr 172.21.15.114:0/2604546065 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:27.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.526+0000 7f553f59e640 1 --2- 172.21.15.114:0/2604546065 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f554015f430 0x7f5540161670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:27.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.526+0000 7f553e59c640 1 --2- 172.21.15.114:0/2604546065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55400d1fc0 0x7f554015b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:27.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.526+0000 7f553ed9d640 1 -- 172.21.15.114:0/2604546065 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f554015f430 msgr2=0x7f5540161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:27.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.526+0000 7f553ed9d640 1 --2- 172.21.15.114:0/2604546065 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f554015f430 0x7f5540161670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.526+0000 7f553ed9d640 1 -- 172.21.15.114:0/2604546065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55400d1fc0 msgr2=0x7f554015b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:27.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.526+0000 7f553ed9d640 1 --2- 172.21.15.114:0/2604546065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55400d1fc0 0x7f554015b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.526+0000 7f553ed9d640 1 -- 172.21.15.114:0/2604546065 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55400ccc80 con 0x7f55400baf40 2024-04-28T13:08:27.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.527+0000 7f553ed9d640 1 --2- 172.21.15.114:0/2604546065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55400baf40 0x7f5540155440 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f553000ce00 tx=0x7f553000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:27.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.527+0000 7f55277fe640 1 -- 172.21.15.114:0/2604546065 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553000f890 con 0x7f55400baf40 2024-04-28T13:08:27.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.527+0000 7f55277fe640 1 -- 172.21.15.114:0/2604546065 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f553000fa30 con 0x7f55400baf40 2024-04-28T13:08:27.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.527+0000 7f5545191640 1 -- 172.21.15.114:0/2604546065 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f554015c360 con 0x7f55400baf40 2024-04-28T13:08:27.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.527+0000 7f55277fe640 1 -- 172.21.15.114:0/2604546065 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553000fe40 con 0x7f55400baf40 2024-04-28T13:08:27.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.527+0000 7f5545191640 1 -- 172.21.15.114:0/2604546065 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55400ccf00 con 0x7f55400baf40 2024-04-28T13:08:27.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.528+0000 7f5545191640 1 -- 172.21.15.114:0/2604546065 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f554006a3d0 con 0x7f55400baf40 2024-04-28T13:08:27.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.528+0000 7f55277fe640 1 -- 172.21.15.114:0/2604546065 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5530018400 con 0x7f55400baf40 2024-04-28T13:08:27.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.529+0000 7f55277fe640 1 --2- 172.21.15.114:0/2604546065 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f552c06c8f0 0x7f552c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:27.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.529+0000 7f55277fe640 1 -- 172.21.15.114:0/2604546065 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f553008c7d0 con 0x7f55400baf40 2024-04-28T13:08:27.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.529+0000 7f553e59c640 1 --2- 172.21.15.114:0/2604546065 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f552c06c8f0 0x7f552c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:27.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.529+0000 7f553e59c640 1 --2- 172.21.15.114:0/2604546065 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f552c06c8f0 0x7f552c06edb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f55400d05c0 tx=0x7f5534008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:27.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.533+0000 7f55277fe640 1 -- 172.21.15.114:0/2604546065 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f55400ccc80 con 0x7f55400baf40 2024-04-28T13:08:27.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.731+0000 7f5545191640 1 -- 172.21.15.114:0/2604546065 --> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "subvol_grp50760", "target": ["mon-mgr", ""]}) -- 0x7f55400d48f0 con 0x7f552c06c8f0 2024-04-28T13:08:27.735 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:08:27.735+0000 7f7e30768640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-28T13:08:27.735 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:08:27.735+0000 7f7e30768640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-28T13:08:27.735 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:08:27.735+0000 7f7e30768640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-28T13:08:27.735 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:08:27.735+0000 7f7e30768640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-28T13:08:27.735 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:08:27.735+0000 7f7e30768640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-28T13:08:27.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.747+0000 7f55277fe640 1 -- 172.21.15.114:0/2604546065 <== mgr.4104 v2:172.21.15.114:6832/2240257326 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f55400d48f0 con 0x7f552c06c8f0 2024-04-28T13:08:27.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.749+0000 7f5545191640 1 -- 172.21.15.114:0/2604546065 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f552c06c8f0 msgr2=0x7f552c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:27.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.749+0000 7f5545191640 1 --2- 172.21.15.114:0/2604546065 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f552c06c8f0 0x7f552c06edb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f55400d05c0 tx=0x7f5534008040 comp rx=0 tx=0).stop 2024-04-28T13:08:27.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.749+0000 7f5545191640 1 -- 172.21.15.114:0/2604546065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55400baf40 msgr2=0x7f5540155440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:27.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.749+0000 7f5545191640 1 --2- 172.21.15.114:0/2604546065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55400baf40 0x7f5540155440 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f553000ce00 tx=0x7f553000a650 comp rx=0 tx=0).stop 2024-04-28T13:08:27.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.749+0000 7f5545191640 1 -- 172.21.15.114:0/2604546065 shutdown_connections 2024-04-28T13:08:27.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.749+0000 7f5545191640 1 --2- 172.21.15.114:0/2604546065 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f554015f430 0x7f5540161670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.749+0000 7f5545191640 1 --2- 172.21.15.114:0/2604546065 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f552c06c8f0 0x7f552c06edb0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.749+0000 7f5545191640 1 --2- 172.21.15.114:0/2604546065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55400d1fc0 0x7f554015b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.749+0000 7f5545191640 1 --2- 172.21.15.114:0/2604546065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55400baf40 0x7f5540155440 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.749+0000 7f5545191640 1 -- 172.21.15.114:0/2604546065 >> 172.21.15.114:0/2604546065 conn(0x7f55400633a0 msgr2=0x7f5540157840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:27.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.749+0000 7f5545191640 1 -- 172.21.15.114:0/2604546065 shutdown_connections 2024-04-28T13:08:27.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.750+0000 7f5545191640 1 -- 172.21.15.114:0/2604546065 wait complete. 2024-04-28T13:08:27.760 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup snapshot create cephfs subvol_grp50760 subvol_snap43860 2024-04-28T13:08:27.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.862+0000 7f4d58daf640 1 Processor -- start 2024-04-28T13:08:27.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.862+0000 7f4d58daf640 1 -- start start 2024-04-28T13:08:27.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.863+0000 7f4d58daf640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d54159a70 0x7f4d540b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:27.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.863+0000 7f4d58daf640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4d540b0f90 0x7f4d5415f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:27.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.863+0000 7f4d58daf640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4d540735e0 0x7f4d54073a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:27.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.863+0000 7f4d58daf640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f4d54073f50 con 0x7f4d540735e0 2024-04-28T13:08:27.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.863+0000 7f4d58daf640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f4d54160270 con 0x7f4d540b0f90 2024-04-28T13:08:27.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.863+0000 7f4d58daf640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f4d54160550 con 0x7f4d54159a70 2024-04-28T13:08:27.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.863+0000 7f4d52d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4d540735e0 0x7f4d54073a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:27.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.863+0000 7f4d52d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4d540735e0 0x7f4d54073a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33242/0 (socket says 172.21.15.114:33242) 2024-04-28T13:08:27.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.863+0000 7f4d52d9d640 1 -- 172.21.15.114:0/2218624305 learned_addr learned my addr 172.21.15.114:0/2218624305 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:27.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.864+0000 7f4d51d9b640 1 --2- 172.21.15.114:0/2218624305 >> v2:172.21.15.134:3300/0 conn(0x7f4d540b0f90 0x7f4d5415f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:27.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.864+0000 7f4d5259c640 1 --2- 172.21.15.114:0/2218624305 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d54159a70 0x7f4d540b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:27.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.864+0000 7f4d52d9d640 1 -- 172.21.15.114:0/2218624305 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d54159a70 msgr2=0x7f4d540b50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:27.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.864+0000 7f4d52d9d640 1 --2- 172.21.15.114:0/2218624305 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d54159a70 0x7f4d540b50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.864+0000 7f4d52d9d640 1 -- 172.21.15.114:0/2218624305 >> v2:172.21.15.134:3300/0 conn(0x7f4d540b0f90 msgr2=0x7f4d5415f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:27.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.864+0000 7f4d52d9d640 1 --2- 172.21.15.114:0/2218624305 >> v2:172.21.15.134:3300/0 conn(0x7f4d540b0f90 0x7f4d5415f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.864+0000 7f4d52d9d640 1 -- 172.21.15.114:0/2218624305 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d540af850 con 0x7f4d540735e0 2024-04-28T13:08:27.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.864+0000 7f4d51d9b640 1 --2- 172.21.15.114:0/2218624305 >> v2:172.21.15.134:3300/0 conn(0x7f4d540b0f90 0x7f4d5415f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:27.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.864+0000 7f4d5259c640 1 --2- 172.21.15.114:0/2218624305 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d54159a70 0x7f4d540b50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:27.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.864+0000 7f4d52d9d640 1 --2- 172.21.15.114:0/2218624305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d540735e0 0x7f4d54073a10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4d5406d3e0 tx=0x7f4d4c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7a966cf46d0a4a server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:27.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.865+0000 7f4d5159a640 1 -- 172.21.15.114:0/2218624305 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c037070 con 0x7f4d540735e0 2024-04-28T13:08:27.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.865+0000 7f4d5159a640 1 -- 172.21.15.114:0/2218624305 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d4c032440 con 0x7f4d540735e0 2024-04-28T13:08:27.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.865+0000 7f4d5159a640 1 -- 172.21.15.114:0/2218624305 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c032810 con 0x7f4d540735e0 2024-04-28T13:08:27.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.865+0000 7f4d58daf640 1 -- 172.21.15.114:0/2218624305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d540735e0 msgr2=0x7f4d54073a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:27.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.865+0000 7f4d58daf640 1 --2- 172.21.15.114:0/2218624305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d540735e0 0x7f4d54073a10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4d5406d3e0 tx=0x7f4d4c02a1e0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.865+0000 7f4d58daf640 1 -- 172.21.15.114:0/2218624305 shutdown_connections 2024-04-28T13:08:27.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.865+0000 7f4d58daf640 1 --2- 172.21.15.114:0/2218624305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d540735e0 0x7f4d54073a10 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.865+0000 7f4d58daf640 1 --2- 172.21.15.114:0/2218624305 >> v2:172.21.15.134:3300/0 conn(0x7f4d540b0f90 0x7f4d5415f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.865+0000 7f4d58daf640 1 --2- 172.21.15.114:0/2218624305 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d54159a70 0x7f4d540b50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.865+0000 7f4d58daf640 1 -- 172.21.15.114:0/2218624305 >> 172.21.15.114:0/2218624305 conn(0x7f4d5406d460 msgr2=0x7f4d5406d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:27.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.865+0000 7f4d58daf640 1 -- 172.21.15.114:0/2218624305 shutdown_connections 2024-04-28T13:08:27.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.865+0000 7f4d58daf640 1 -- 172.21.15.114:0/2218624305 wait complete. 2024-04-28T13:08:27.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.867+0000 7f4d58daf640 1 Processor -- start 2024-04-28T13:08:27.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.867+0000 7f4d58daf640 1 -- start start 2024-04-28T13:08:27.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.867+0000 7f4d58daf640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d540735e0 0x7f4d54155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:27.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.867+0000 7f4d58daf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d540b0f90 0x7f4d54146bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:27.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.867+0000 7f4d58daf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d54159a70 0x7f4d541579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:27.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.867+0000 7f4d58daf640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4d540b5600 con 0x7f4d540b0f90 2024-04-28T13:08:27.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.867+0000 7f4d58daf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4d54160830 con 0x7f4d54159a70 2024-04-28T13:08:27.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.867+0000 7f4d58daf640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f4d540b5780 con 0x7f4d540735e0 2024-04-28T13:08:27.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.867+0000 7f4d51d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d540b0f90 0x7f4d54146bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:27.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.867+0000 7f4d51d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d540b0f90 0x7f4d54146bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33252/0 (socket says 172.21.15.114:33252) 2024-04-28T13:08:27.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.867+0000 7f4d51d9b640 1 -- 172.21.15.114:0/3167918132 learned_addr learned my addr 172.21.15.114:0/3167918132 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:27.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.868+0000 7f4d5259c640 1 --2- 172.21.15.114:0/3167918132 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d540735e0 0x7f4d54155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:27.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.868+0000 7f4d52d9d640 1 --2- 172.21.15.114:0/3167918132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d54159a70 0x7f4d541579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:27.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.868+0000 7f4d51d9b640 1 -- 172.21.15.114:0/3167918132 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d540735e0 msgr2=0x7f4d54155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:27.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.868+0000 7f4d51d9b640 1 --2- 172.21.15.114:0/3167918132 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d540735e0 0x7f4d54155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.868+0000 7f4d51d9b640 1 -- 172.21.15.114:0/3167918132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d54159a70 msgr2=0x7f4d541579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:27.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.868+0000 7f4d51d9b640 1 --2- 172.21.15.114:0/3167918132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d54159a70 0x7f4d541579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:27.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.868+0000 7f4d51d9b640 1 -- 172.21.15.114:0/3167918132 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d5415aba0 con 0x7f4d540b0f90 2024-04-28T13:08:27.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.868+0000 7f4d5259c640 1 --2- 172.21.15.114:0/3167918132 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d540735e0 0x7f4d54155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:27.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.868+0000 7f4d51d9b640 1 --2- 172.21.15.114:0/3167918132 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d540b0f90 0x7f4d54146bd0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4d4800c7f0 tx=0x7f4d4800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:27.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.868+0000 7f4d42ffd640 1 -- 172.21.15.114:0/3167918132 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d48015070 con 0x7f4d540b0f90 2024-04-28T13:08:27.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.868+0000 7f4d42ffd640 1 -- 172.21.15.114:0/3167918132 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d48007a30 con 0x7f4d540b0f90 2024-04-28T13:08:27.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.868+0000 7f4d42ffd640 1 -- 172.21.15.114:0/3167918132 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d48007e00 con 0x7f4d540b0f90 2024-04-28T13:08:27.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.868+0000 7f4d58daf640 1 -- 172.21.15.114:0/3167918132 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d5415ae80 con 0x7f4d540b0f90 2024-04-28T13:08:27.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.868+0000 7f4d58daf640 1 -- 172.21.15.114:0/3167918132 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d541555e0 con 0x7f4d540b0f90 2024-04-28T13:08:27.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.869+0000 7f4d58daf640 1 -- 172.21.15.114:0/3167918132 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d5406a440 con 0x7f4d540b0f90 2024-04-28T13:08:27.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.869+0000 7f4d42ffd640 1 -- 172.21.15.114:0/3167918132 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4d48018070 con 0x7f4d540b0f90 2024-04-28T13:08:27.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.870+0000 7f4d42ffd640 1 --2- 172.21.15.114:0/3167918132 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f4d3406c920 0x7f4d3406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:27.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.870+0000 7f4d42ffd640 1 -- 172.21.15.114:0/3167918132 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f4d4808baf0 con 0x7f4d540b0f90 2024-04-28T13:08:27.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.870+0000 7f4d5259c640 1 --2- 172.21.15.114:0/3167918132 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f4d3406c920 0x7f4d3406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:27.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.870+0000 7f4d5259c640 1 --2- 172.21.15.114:0/3167918132 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f4d3406c920 0x7f4d3406ede0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4d44007130 tx=0x7f4d44007060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:27.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:27.874+0000 7f4d42ffd640 1 -- 172.21.15.114:0/3167918132 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4d48059f20 con 0x7f4d540b0f90 2024-04-28T13:08:28.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.080+0000 7f4d58daf640 1 -- 172.21.15.114:0/3167918132 --> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup snapshot create", "vol_name": "cephfs", "group_name": "subvol_grp50760", "snap_name": "subvol_snap43860", "target": ["mon-mgr", ""]}) -- 0x7f4d540ae9b0 con 0x7f4d3406c920 2024-04-28T13:08:28.081 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:08:28.081+0000 7f7e30768640 -1 mgr.server reply reply (38) Function not implemented subvolume group snapshots are not supported 2024-04-28T13:08:28.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.081+0000 7f4d42ffd640 1 -- 172.21.15.114:0/3167918132 <== mgr.4104 v2:172.21.15.114:6832/2240257326 1 ==== mgr_command_reply(tid 0: -38 subvolume group snapshots are not supported) ==== 51+0+0 (secure 0 0 0) 0x7f4d540ae9b0 con 0x7f4d3406c920 2024-04-28T13:08:28.081 INFO:teuthology.orchestra.run.smithi114.stderr:Error ENOSYS: subvolume group snapshots are not supported 2024-04-28T13:08:28.087 DEBUG:teuthology.orchestra.run:got remote process result: 38 2024-04-28T13:08:28.087 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp50760 2024-04-28T13:08:28.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.187+0000 7f9c07846640 1 Processor -- start 2024-04-28T13:08:28.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.187+0000 7f9c07846640 1 -- start start 2024-04-28T13:08:28.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.188+0000 7f9c07846640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9c00148dc0 0x7f9c000d0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:28.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.188+0000 7f9c07846640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9c000d1270 0x7f9c000c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:28.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.188+0000 7f9c07846640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c000c8e70 con 0x7f9c000c8610 2024-04-28T13:08:28.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.188+0000 7f9c07846640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f9c000d16d0 con 0x7f9c000d1270 2024-04-28T13:08:28.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.188+0000 7f9c07846640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f9c000c9150 con 0x7f9c00148dc0 2024-04-28T13:08:28.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.188+0000 7f9c04de1640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9c000d1270 0x7f9c000c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:28.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.188+0000 7f9c04de1640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9c000d1270 0x7f9c000c80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33260/0 (socket says 172.21.15.114:33260) 2024-04-28T13:08:28.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.188+0000 7f9c04de1640 1 -- 172.21.15.114:0/3383644608 learned_addr learned my addr 172.21.15.114:0/3383644608 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:28.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.188+0000 7f9c055e2640 1 --2- 172.21.15.114:0/3383644608 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9c00148dc0 0x7f9c000d0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:28.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.188+0000 7f9c04de1640 1 -- 172.21.15.114:0/3383644608 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9c00148dc0 msgr2=0x7f9c000d0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:28.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.188+0000 7f9c04de1640 1 --2- 172.21.15.114:0/3383644608 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9c00148dc0 0x7f9c000d0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:28.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.188+0000 7f9c04de1640 1 -- 172.21.15.114:0/3383644608 >> v1:172.21.15.134:6789/0 conn(0x7f9c000c8610 legacy=0x7f9c000cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:28.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.188+0000 7f9c04de1640 1 -- 172.21.15.114:0/3383644608 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c000c9430 con 0x7f9c000d1270 2024-04-28T13:08:28.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.189+0000 7f9c04de1640 1 --2- 172.21.15.114:0/3383644608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c000d1270 0x7f9c000c80d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0009870 tx=0x7f9bf002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40702464830b3b3f server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:28.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.189+0000 7f9bf7fff640 1 -- 172.21.15.114:0/3383644608 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0037070 con 0x7f9c000d1270 2024-04-28T13:08:28.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.189+0000 7f9bf7fff640 1 -- 172.21.15.114:0/3383644608 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bf0032440 con 0x7f9c000d1270 2024-04-28T13:08:28.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.189+0000 7f9bf7fff640 1 -- 172.21.15.114:0/3383644608 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0032810 con 0x7f9c000d1270 2024-04-28T13:08:28.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.189+0000 7f9c07846640 1 -- 172.21.15.114:0/3383644608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c000d1270 msgr2=0x7f9c000c80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:28.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.189+0000 7f9c07846640 1 --2- 172.21.15.114:0/3383644608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c000d1270 0x7f9c000c80d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0009870 tx=0x7f9bf002a180 comp rx=0 tx=0).stop 2024-04-28T13:08:28.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.190+0000 7f9c07846640 1 -- 172.21.15.114:0/3383644608 shutdown_connections 2024-04-28T13:08:28.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.190+0000 7f9c07846640 1 --2- 172.21.15.114:0/3383644608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c000d1270 0x7f9c000c80d0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:28.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.190+0000 7f9c07846640 1 --2- 172.21.15.114:0/3383644608 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9c00148dc0 0x7f9c000d0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:28.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.190+0000 7f9c07846640 1 -- 172.21.15.114:0/3383644608 >> 172.21.15.114:0/3383644608 conn(0x7f9c000706f0 msgr2=0x7f9c00070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:28.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.190+0000 7f9c07846640 1 -- 172.21.15.114:0/3383644608 shutdown_connections 2024-04-28T13:08:28.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.190+0000 7f9c07846640 1 -- 172.21.15.114:0/3383644608 wait complete. 2024-04-28T13:08:28.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.191+0000 7f9c07846640 1 Processor -- start 2024-04-28T13:08:28.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.191+0000 7f9c07846640 1 -- start start 2024-04-28T13:08:28.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.192+0000 7f9c07846640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c000c8610 0x7f9c00145880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:28.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.192+0000 7f9c07846640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c000d1270 0x7f9c00143060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:28.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.192+0000 7f9c07846640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9c00148dc0 0x7f9c000ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:28.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.192+0000 7f9c07846640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9c000c8a80 con 0x7f9c000c8610 2024-04-28T13:08:28.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.192+0000 7f9c07846640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9c000cd850 con 0x7f9c000d1270 2024-04-28T13:08:28.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.192+0000 7f9c07846640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f9c000c8c00 con 0x7f9c00148dc0 2024-04-28T13:08:28.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.192+0000 7f9c055e2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c000c8610 0x7f9c00145880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:28.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.192+0000 7f9c055e2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c000c8610 0x7f9c00145880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33266/0 (socket says 172.21.15.114:33266) 2024-04-28T13:08:28.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.192+0000 7f9c055e2640 1 -- 172.21.15.114:0/1567665072 learned_addr learned my addr 172.21.15.114:0/1567665072 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:28.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.192+0000 7f9c05de3640 1 --2- 172.21.15.114:0/1567665072 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9c00148dc0 0x7f9c000ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:28.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.192+0000 7f9c04de1640 1 --2- 172.21.15.114:0/1567665072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c000d1270 0x7f9c00143060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:28.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.192+0000 7f9c055e2640 1 -- 172.21.15.114:0/1567665072 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9c00148dc0 msgr2=0x7f9c000ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:28.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.192+0000 7f9c055e2640 1 --2- 172.21.15.114:0/1567665072 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9c00148dc0 0x7f9c000ca230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:28.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.192+0000 7f9c055e2640 1 -- 172.21.15.114:0/1567665072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c000d1270 msgr2=0x7f9c00143060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:28.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.192+0000 7f9c055e2640 1 --2- 172.21.15.114:0/1567665072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c000d1270 0x7f9c00143060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:28.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.192+0000 7f9c055e2640 1 -- 172.21.15.114:0/1567665072 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c0013e7e0 con 0x7f9c000c8610 2024-04-28T13:08:28.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.192+0000 7f9c05de3640 1 --2- 172.21.15.114:0/1567665072 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9c00148dc0 0x7f9c000ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:28.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.192+0000 7f9c04de1640 1 --2- 172.21.15.114:0/1567665072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c000d1270 0x7f9c00143060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:28.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.192+0000 7f9c055e2640 1 --2- 172.21.15.114:0/1567665072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c000c8610 0x7f9c00145880 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc00d620 tx=0x7f9bfc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:28.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.192+0000 7f9bf5ffb640 1 -- 172.21.15.114:0/1567665072 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc00b620 con 0x7f9c000c8610 2024-04-28T13:08:28.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.192+0000 7f9bf5ffb640 1 -- 172.21.15.114:0/1567665072 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bfc019070 con 0x7f9c000c8610 2024-04-28T13:08:28.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.192+0000 7f9bf5ffb640 1 -- 172.21.15.114:0/1567665072 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc00ba00 con 0x7f9c000c8610 2024-04-28T13:08:28.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.192+0000 7f9c07846640 1 -- 172.21.15.114:0/1567665072 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c0013eac0 con 0x7f9c000c8610 2024-04-28T13:08:28.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.193+0000 7f9c07846640 1 -- 172.21.15.114:0/1567665072 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c0013f080 con 0x7f9c000c8610 2024-04-28T13:08:28.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.193+0000 7f9c07846640 1 -- 172.21.15.114:0/1567665072 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c0006a3d0 con 0x7f9c000c8610 2024-04-28T13:08:28.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.194+0000 7f9bf5ffb640 1 -- 172.21.15.114:0/1567665072 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9bfc00bba0 con 0x7f9c000c8610 2024-04-28T13:08:28.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.194+0000 7f9bf5ffb640 1 --2- 172.21.15.114:0/1567665072 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9be406c920 0x7f9be406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:28.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.194+0000 7f9bf5ffb640 1 -- 172.21.15.114:0/1567665072 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f9bfc08be80 con 0x7f9c000c8610 2024-04-28T13:08:28.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.194+0000 7f9c04de1640 1 --2- 172.21.15.114:0/1567665072 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9be406c920 0x7f9be406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:28.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.195+0000 7f9c04de1640 1 --2- 172.21.15.114:0/1567665072 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9be406c920 0x7f9be406ede0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0034000 tx=0x7f9bf002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:28.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.198+0000 7f9bf5ffb640 1 -- 172.21.15.114:0/1567665072 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9bfc05a340 con 0x7f9c000c8610 2024-04-28T13:08:28.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.395+0000 7f9c07846640 1 -- 172.21.15.114:0/1567665072 --> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp50760", "target": ["mon-mgr", ""]}) -- 0x7f9c000c82e0 con 0x7f9be406c920 2024-04-28T13:08:28.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.400+0000 7f9bf5ffb640 1 -- 172.21.15.114:0/1567665072 <== mgr.4104 v2:172.21.15.114:6832/2240257326 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9c000c82e0 con 0x7f9be406c920 2024-04-28T13:08:28.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.401+0000 7f9c07846640 1 -- 172.21.15.114:0/1567665072 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9be406c920 msgr2=0x7f9be406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:28.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.401+0000 7f9c07846640 1 --2- 172.21.15.114:0/1567665072 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9be406c920 0x7f9be406ede0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0034000 tx=0x7f9bf002e000 comp rx=0 tx=0).stop 2024-04-28T13:08:28.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.401+0000 7f9c07846640 1 -- 172.21.15.114:0/1567665072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c000c8610 msgr2=0x7f9c00145880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:28.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.401+0000 7f9c07846640 1 --2- 172.21.15.114:0/1567665072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c000c8610 0x7f9c00145880 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc00d620 tx=0x7f9bfc00dae0 comp rx=0 tx=0).stop 2024-04-28T13:08:28.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.402+0000 7f9c07846640 1 -- 172.21.15.114:0/1567665072 shutdown_connections 2024-04-28T13:08:28.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.402+0000 7f9c07846640 1 --2- 172.21.15.114:0/1567665072 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9c00148dc0 0x7f9c000ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:28.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.402+0000 7f9c07846640 1 --2- 172.21.15.114:0/1567665072 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9be406c920 0x7f9be406ede0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:28.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.402+0000 7f9c07846640 1 --2- 172.21.15.114:0/1567665072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c000d1270 0x7f9c00143060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:28.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.402+0000 7f9c07846640 1 --2- 172.21.15.114:0/1567665072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c000c8610 0x7f9c00145880 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:28.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.402+0000 7f9c07846640 1 -- 172.21.15.114:0/1567665072 >> 172.21.15.114:0/1567665072 conn(0x7f9c000706f0 msgr2=0x7f9c0006ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:28.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.402+0000 7f9c07846640 1 -- 172.21.15.114:0/1567665072 shutdown_connections 2024-04-28T13:08:28.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.402+0000 7f9c07846640 1 -- 172.21.15.114:0/1567665072 wait complete. 2024-04-28T13:08:28.412 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-28T13:08:28.412 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-28T13:08:28.458 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-28T13:08:28.502 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-28T13:08:28.502 INFO:tasks.cephfs.mount:Terminating background process 2024-04-28T13:08:28.502 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:08:28.502 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-28T13:08:28.519 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:08:28.519 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-28T13:08:28.574 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:08:28.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.711+0000 7f1ab5d14640 1 Processor -- start 2024-04-28T13:08:28.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.711+0000 7f1ab5d14640 1 -- start start 2024-04-28T13:08:28.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.711+0000 7f1ab5d14640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1ab0146b90 0x7f1ab00cf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:28.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.711+0000 7f1ab5d14640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1ab0073290 0x7f1ab006c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:28.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.712+0000 7f1ab5d14640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ab00737f0 con 0x7f1ab006c890 2024-04-28T13:08:28.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.712+0000 7f1ab5d14640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f1ab0074400 con 0x7f1ab0146b90 2024-04-28T13:08:28.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.712+0000 7f1ab5d14640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1ab0073ad0 con 0x7f1ab0073290 2024-04-28T13:08:28.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.712+0000 7f1aaf7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1ab0146b90 0x7f1ab00cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:28.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.712+0000 7f1aa7fff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1ab0073290 0x7f1ab006c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:28.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.712+0000 7f1aa7fff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1ab0073290 0x7f1ab006c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:33774/0 (socket says 172.21.15.114:33774) 2024-04-28T13:08:28.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.712+0000 7f1aaf7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1ab0146b90 0x7f1ab00cf250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:58700/0 (socket says 172.21.15.114:58700) 2024-04-28T13:08:28.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.712+0000 7f1aa7fff640 1 -- 172.21.15.114:0/2511069043 learned_addr learned my addr 172.21.15.114:0/2511069043 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:28.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.712+0000 7f1aa7fff640 1 -- 172.21.15.114:0/2511069043 >> v2:172.21.15.134:3300/0 conn(0x7f1ab0146b90 msgr2=0x7f1ab00cf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:28.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.712+0000 7f1aa7fff640 1 --2- 172.21.15.114:0/2511069043 >> v2:172.21.15.134:3300/0 conn(0x7f1ab0146b90 0x7f1ab00cf250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:28.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.712+0000 7f1aa7fff640 1 -- 172.21.15.114:0/2511069043 >> v1:172.21.15.134:6789/0 conn(0x7f1ab006c890 legacy=0x7f1ab00d0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:28.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.712+0000 7f1aa7fff640 1 -- 172.21.15.114:0/2511069043 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab0073db0 con 0x7f1ab0073290 2024-04-28T13:08:28.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.712+0000 7f1aaf7fe640 1 --2- 172.21.15.114:0/2511069043 >> v2:172.21.15.134:3300/0 conn(0x7f1ab0146b90 0x7f1ab00cf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:08:28.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.713+0000 7f1aa7fff640 1 --2- 172.21.15.114:0/2511069043 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1ab0073290 0x7f1ab006c350 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1a98009870 tx=0x7f1a9802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b89a875f6ff3caa7 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:28.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.713+0000 7f1aaeffd640 1 -- 172.21.15.114:0/2511069043 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a98037070 con 0x7f1ab0073290 2024-04-28T13:08:28.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.713+0000 7f1aaeffd640 1 -- 172.21.15.114:0/2511069043 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a98032440 con 0x7f1ab0073290 2024-04-28T13:08:28.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.713+0000 7f1aaeffd640 1 -- 172.21.15.114:0/2511069043 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a98032810 con 0x7f1ab0073290 2024-04-28T13:08:28.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.714+0000 7f1ab5d14640 1 -- 172.21.15.114:0/2511069043 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1ab0073290 msgr2=0x7f1ab006c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:28.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.714+0000 7f1ab5d14640 1 --2- 172.21.15.114:0/2511069043 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1ab0073290 0x7f1ab006c350 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1a98009870 tx=0x7f1a9802a270 comp rx=0 tx=0).stop 2024-04-28T13:08:28.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.714+0000 7f1ab5d14640 1 -- 172.21.15.114:0/2511069043 shutdown_connections 2024-04-28T13:08:28.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.714+0000 7f1ab5d14640 1 --2- 172.21.15.114:0/2511069043 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1ab0073290 0x7f1ab006c350 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:28.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.714+0000 7f1ab5d14640 1 --2- 172.21.15.114:0/2511069043 >> v2:172.21.15.134:3300/0 conn(0x7f1ab0146b90 0x7f1ab00cf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:28.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.714+0000 7f1ab5d14640 1 -- 172.21.15.114:0/2511069043 >> 172.21.15.114:0/2511069043 conn(0x7f1ab00b3d50 msgr2=0x7f1ab00b4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:28.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.714+0000 7f1ab5d14640 1 -- 172.21.15.114:0/2511069043 shutdown_connections 2024-04-28T13:08:28.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.714+0000 7f1ab5d14640 1 -- 172.21.15.114:0/2511069043 wait complete. 2024-04-28T13:08:28.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.715+0000 7f1ab5d14640 1 Processor -- start 2024-04-28T13:08:28.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.715+0000 7f1ab5d14640 1 -- start start 2024-04-28T13:08:28.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.716+0000 7f1ab5d14640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1ab006c890 0x7f1ab0133d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:28.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.716+0000 7f1ab5d14640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ab0073290 0x7f1ab015cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:28.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.716+0000 7f1ab5d14640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ab0146b90 0x7f1ab0142ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:28.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.716+0000 7f1ab5d14640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab00b19d0 con 0x7f1ab0073290 2024-04-28T13:08:28.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.716+0000 7f1ab5d14640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab0146f70 con 0x7f1ab0146b90 2024-04-28T13:08:28.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.716+0000 7f1ab5d14640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1ab0071740 con 0x7f1ab006c890 2024-04-28T13:08:28.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.716+0000 7f1aa7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ab0073290 0x7f1ab015cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:28.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.716+0000 7f1aa7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ab0073290 0x7f1ab015cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33278/0 (socket says 172.21.15.114:33278) 2024-04-28T13:08:28.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.716+0000 7f1aa7fff640 1 -- 172.21.15.114:0/4077043197 learned_addr learned my addr 172.21.15.114:0/4077043197 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:28.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.716+0000 7f1aaf7fe640 1 --2- 172.21.15.114:0/4077043197 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1ab006c890 0x7f1ab0133d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:28.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.716+0000 7f1aaffff640 1 --2- 172.21.15.114:0/4077043197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ab0146b90 0x7f1ab0142ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:28.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.716+0000 7f1aa7fff640 1 -- 172.21.15.114:0/4077043197 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1ab006c890 msgr2=0x7f1ab0133d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:28.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.716+0000 7f1aa7fff640 1 --2- 172.21.15.114:0/4077043197 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1ab006c890 0x7f1ab0133d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:28.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.716+0000 7f1aa7fff640 1 -- 172.21.15.114:0/4077043197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ab0146b90 msgr2=0x7f1ab0142ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:28.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.716+0000 7f1aa7fff640 1 --2- 172.21.15.114:0/4077043197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ab0146b90 0x7f1ab0142ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:28.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.716+0000 7f1aa7fff640 1 -- 172.21.15.114:0/4077043197 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab01343a0 con 0x7f1ab0073290 2024-04-28T13:08:28.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.716+0000 7f1aaffff640 1 --2- 172.21.15.114:0/4077043197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ab0146b90 0x7f1ab0142ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:28.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.716+0000 7f1aa7fff640 1 --2- 172.21.15.114:0/4077043197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ab0073290 0x7f1ab015cae0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1a9802a2b0 tx=0x7f1a980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:28.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.716+0000 7f1aacff9640 1 -- 172.21.15.114:0/4077043197 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a98037040 con 0x7f1ab0073290 2024-04-28T13:08:28.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.716+0000 7f1aacff9640 1 -- 172.21.15.114:0/4077043197 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a98042070 con 0x7f1ab0073290 2024-04-28T13:08:28.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.716+0000 7f1ab5d14640 1 -- 172.21.15.114:0/4077043197 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ab0134680 con 0x7f1ab0073290 2024-04-28T13:08:28.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.716+0000 7f1aacff9640 1 -- 172.21.15.114:0/4077043197 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a98030880 con 0x7f1ab0073290 2024-04-28T13:08:28.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.717+0000 7f1ab5d14640 1 -- 172.21.15.114:0/4077043197 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ab0134c40 con 0x7f1ab0073290 2024-04-28T13:08:28.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.717+0000 7f1ab5d14640 1 -- 172.21.15.114:0/4077043197 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ab006a3d0 con 0x7f1ab0073290 2024-04-28T13:08:28.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.718+0000 7f1aacff9640 1 -- 172.21.15.114:0/4077043197 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1a98030a20 con 0x7f1ab0073290 2024-04-28T13:08:28.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.718+0000 7f1aacff9640 1 --2- 172.21.15.114:0/4077043197 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1a9006c8f0 0x7f1a9006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:28.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.718+0000 7f1aacff9640 1 -- 172.21.15.114:0/4077043197 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f1a980ac380 con 0x7f1ab0073290 2024-04-28T13:08:28.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.718+0000 7f1aaf7fe640 1 --2- 172.21.15.114:0/4077043197 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1a9006c8f0 0x7f1a9006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:28.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.719+0000 7f1aaf7fe640 1 --2- 172.21.15.114:0/4077043197 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1a9006c8f0 0x7f1a9006edb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0009a30 tx=0x7f1aa0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:28.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.723+0000 7f1aacff9640 1 -- 172.21.15.114:0/4077043197 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1a98045360 con 0x7f1ab0073290 2024-04-28T13:08:28.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.792+0000 7f1aacff9640 1 -- 172.21.15.114:0/4077043197 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f1a98030d10 con 0x7f1ab0073290 2024-04-28T13:08:28.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.906+0000 7f1ab5d14640 1 -- 172.21.15.114:0/4077043197 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ab01430e0 con 0x7f1ab0073290 2024-04-28T13:08:28.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.907+0000 7f1aacff9640 1 -- 172.21.15.114:0/4077043197 <== mon.0 v2:172.21.15.114:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16717 (secure 0 0 0) 0x7f1a9807a840 con 0x7f1ab0073290 2024-04-28T13:08:28.907 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:28.907 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":34,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:08:19.691257+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-28T13:08:16.244962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-28T13:08:16.991345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:08:28.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.909+0000 7f1ab5d14640 1 -- 172.21.15.114:0/4077043197 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1a9006c8f0 msgr2=0x7f1a9006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:28.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.909+0000 7f1ab5d14640 1 --2- 172.21.15.114:0/4077043197 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1a9006c8f0 0x7f1a9006edb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0009a30 tx=0x7f1aa0008040 comp rx=0 tx=0).stop 2024-04-28T13:08:28.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.909+0000 7f1ab5d14640 1 -- 172.21.15.114:0/4077043197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ab0073290 msgr2=0x7f1ab015cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:28.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.909+0000 7f1ab5d14640 1 --2- 172.21.15.114:0/4077043197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ab0073290 0x7f1ab015cae0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1a9802a2b0 tx=0x7f1a980046c0 comp rx=0 tx=0).stop 2024-04-28T13:08:28.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.909+0000 7f1ab5d14640 1 -- 172.21.15.114:0/4077043197 shutdown_connections 2024-04-28T13:08:28.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.909+0000 7f1ab5d14640 1 --2- 172.21.15.114:0/4077043197 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1a9006c8f0 0x7f1a9006edb0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:28.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.909+0000 7f1ab5d14640 1 --2- 172.21.15.114:0/4077043197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ab0146b90 0x7f1ab0142ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:28.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.909+0000 7f1ab5d14640 1 --2- 172.21.15.114:0/4077043197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ab0073290 0x7f1ab015cae0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:28.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.909+0000 7f1ab5d14640 1 --2- 172.21.15.114:0/4077043197 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1ab006c890 0x7f1ab0133d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:28.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.909+0000 7f1ab5d14640 1 -- 172.21.15.114:0/4077043197 >> 172.21.15.114:0/4077043197 conn(0x7f1ab00b3d50 msgr2=0x7f1ab0144480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:28.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.909+0000 7f1ab5d14640 1 -- 172.21.15.114:0/4077043197 shutdown_connections 2024-04-28T13:08:28.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:28.909+0000 7f1ab5d14640 1 -- 172.21.15.114:0/4077043197 wait complete. 2024-04-28T13:08:28.920 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-28T13:07:14.721860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-28T13:08:16.244962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-28T13:08:16.991345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-28T13:08:28.920 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-28T13:08:29.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.020+0000 7f943da6d640 1 Processor -- start 2024-04-28T13:08:29.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.020+0000 7f943da6d640 1 -- start start 2024-04-28T13:08:29.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.020+0000 7f943da6d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f94380b4850 0x7f94380b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:29.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.020+0000 7f943da6d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9438072e30 0x7f94380732b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:29.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.020+0000 7f943da6d640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94380cedc0 con 0x7f94380cf2a0 2024-04-28T13:08:29.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.020+0000 7f943da6d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f94380b5170 con 0x7f94380b4850 2024-04-28T13:08:29.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.020+0000 7f943da6d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f9438073cc0 con 0x7f9438072e30 2024-04-28T13:08:29.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.021+0000 7f9437fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f94380cf2a0 0x7f94380cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53002/0 (socket says 172.21.15.114:53002) 2024-04-28T13:08:29.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.021+0000 7f9437fff640 1 -- 172.21.15.114:0/9605159 learned_addr learned my addr 172.21.15.114:0/9605159 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:29.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.021+0000 7f942effd640 1 --2- 172.21.15.114:0/9605159 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9438072e30 0x7f94380732b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:29.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.021+0000 7f94377fe640 1 --2- 172.21.15.114:0/9605159 >> v2:172.21.15.134:3300/0 conn(0x7f94380b4850 0x7f94380b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:29.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.021+0000 7f9436ffd640 1 -- 172.21.15.114:0/9605159 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2641050104 0 0) 0x7f94380cedc0 con 0x7f94380cf2a0 2024-04-28T13:08:29.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.021+0000 7f9436ffd640 1 -- 172.21.15.114:0/9605159 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9424003520 con 0x7f94380cf2a0 2024-04-28T13:08:29.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.021+0000 7f9436ffd640 1 -- 172.21.15.114:0/9605159 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1666153133 0 0) 0x7f9424003520 con 0x7f94380cf2a0 2024-04-28T13:08:29.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.021+0000 7f9436ffd640 1 -- 172.21.15.114:0/9605159 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9438072e30 msgr2=0x7f94380732b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:29.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.021+0000 7f9436ffd640 1 --2- 172.21.15.114:0/9605159 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9438072e30 0x7f94380732b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:29.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.021+0000 7f9436ffd640 1 -- 172.21.15.114:0/9605159 >> v2:172.21.15.134:3300/0 conn(0x7f94380b4850 msgr2=0x7f94380b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:29.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.021+0000 7f9436ffd640 1 --2- 172.21.15.114:0/9605159 >> v2:172.21.15.134:3300/0 conn(0x7f94380b4850 0x7f94380b4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:29.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.021+0000 7f9436ffd640 1 -- 172.21.15.114:0/9605159 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9438073fa0 con 0x7f94380cf2a0 2024-04-28T13:08:29.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.021+0000 7f9436ffd640 1 -- 172.21.15.114:0/9605159 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f94300019f0 con 0x7f94380cf2a0 2024-04-28T13:08:29.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.021+0000 7f9436ffd640 1 -- 172.21.15.114:0/9605159 >> v1:172.21.15.114:6789/0 conn(0x7f94380cf2a0 legacy=0x7f94380cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:29.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.021+0000 7f9436ffd640 1 --2- 172.21.15.114:0/9605159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94240039b0 0x7f9424003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:29.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.021+0000 7f9436ffd640 1 --2- 172.21.15.114:0/9605159 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9438072e30 0x7f9424004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:29.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.021+0000 7f9436ffd640 1 --2- 172.21.15.114:0/9605159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9424004d40 0x7f94240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:29.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.021+0000 7f9436ffd640 1 -- 172.21.15.114:0/9605159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f94380b5170 con 0x7f9424004d40 2024-04-28T13:08:29.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.021+0000 7f9436ffd640 1 -- 172.21.15.114:0/9605159 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9438073cc0 con 0x7f94240039b0 2024-04-28T13:08:29.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.021+0000 7f9436ffd640 1 -- 172.21.15.114:0/9605159 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f942400b9c0 con 0x7f9438072e30 2024-04-28T13:08:29.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.021+0000 7f9437fff640 1 --2- 172.21.15.114:0/9605159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9424004d40 0x7f94240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:29.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.021+0000 7f942effd640 1 --2- 172.21.15.114:0/9605159 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9438072e30 0x7f9424004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:29.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.021+0000 7f94377fe640 1 --2- 172.21.15.114:0/9605159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94240039b0 0x7f9424003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:29.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.022+0000 7f9437fff640 1 -- 172.21.15.114:0/9605159 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9438072e30 msgr2=0x7f9424004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:29.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.022+0000 7f9437fff640 1 --2- 172.21.15.114:0/9605159 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9438072e30 0x7f9424004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:29.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.022+0000 7f9437fff640 1 -- 172.21.15.114:0/9605159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94240039b0 msgr2=0x7f9424003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:29.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.022+0000 7f9437fff640 1 --2- 172.21.15.114:0/9605159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94240039b0 0x7f9424003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:29.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.022+0000 7f9437fff640 1 -- 172.21.15.114:0/9605159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9424003520 con 0x7f9424004d40 2024-04-28T13:08:29.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.022+0000 7f94377fe640 1 --2- 172.21.15.114:0/9605159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94240039b0 0x7f9424003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:29.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.022+0000 7f9437fff640 1 --2- 172.21.15.114:0/9605159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9424004d40 0x7f94240051c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f943000a870 tx=0x7f9424005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451acc25b03780d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:29.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.022+0000 7f9436ffd640 1 -- 172.21.15.114:0/9605159 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943000a4c0 con 0x7f9424004d40 2024-04-28T13:08:29.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.022+0000 7f9436ffd640 1 -- 172.21.15.114:0/9605159 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f943002f070 con 0x7f9424004d40 2024-04-28T13:08:29.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.022+0000 7f9436ffd640 1 -- 172.21.15.114:0/9605159 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943002bcc0 con 0x7f9424004d40 2024-04-28T13:08:29.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.023+0000 7f943da6d640 1 -- 172.21.15.114:0/9605159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9424004d40 msgr2=0x7f94240051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:29.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.023+0000 7f943da6d640 1 --2- 172.21.15.114:0/9605159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9424004d40 0x7f94240051c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f943000a870 tx=0x7f9424005830 comp rx=0 tx=0).stop 2024-04-28T13:08:29.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.023+0000 7f9437fff640 1 -- 172.21.15.114:0/9605159 reap_dead start 2024-04-28T13:08:29.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.023+0000 7f943da6d640 1 -- 172.21.15.114:0/9605159 shutdown_connections 2024-04-28T13:08:29.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.023+0000 7f943da6d640 1 -- 172.21.15.114:0/9605159 >> 172.21.15.114:0/9605159 conn(0x7f943806c980 msgr2=0x7f94380b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:29.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.023+0000 7f943da6d640 1 -- 172.21.15.114:0/9605159 shutdown_connections 2024-04-28T13:08:29.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.023+0000 7f943da6d640 1 -- 172.21.15.114:0/9605159 wait complete. 2024-04-28T13:08:29.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.024+0000 7f943da6d640 1 Processor -- start 2024-04-28T13:08:29.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.024+0000 7f943da6d640 1 -- start start 2024-04-28T13:08:29.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.025+0000 7f943da6d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f943814b480 0x7f94380af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:29.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.025+0000 7f943da6d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94380af7e0 0x7f943815d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:29.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.025+0000 7f943da6d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f943815dc00 0x7f94381e8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:29.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.025+0000 7f943da6d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f943806e3e0 con 0x7f943814b480 2024-04-28T13:08:29.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.025+0000 7f943da6d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9438074560 con 0x7f943815dc00 2024-04-28T13:08:29.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.025+0000 7f943da6d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f943815d380 con 0x7f94380af7e0 2024-04-28T13:08:29.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.025+0000 7f94377fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f943814b480 0x7f94380af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:29.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.025+0000 7f94377fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f943814b480 0x7f94380af2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33296/0 (socket says 172.21.15.114:33296) 2024-04-28T13:08:29.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.025+0000 7f94377fe640 1 -- 172.21.15.114:0/3613044633 learned_addr learned my addr 172.21.15.114:0/3613044633 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:29.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.025+0000 7f942effd640 1 --2- 172.21.15.114:0/3613044633 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94380af7e0 0x7f943815d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:29.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.025+0000 7f9437fff640 1 --2- 172.21.15.114:0/3613044633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f943815dc00 0x7f94381e8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:29.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.025+0000 7f94377fe640 1 -- 172.21.15.114:0/3613044633 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94380af7e0 msgr2=0x7f943815d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:29.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.025+0000 7f94377fe640 1 --2- 172.21.15.114:0/3613044633 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94380af7e0 0x7f943815d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:29.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.025+0000 7f94377fe640 1 -- 172.21.15.114:0/3613044633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f943815dc00 msgr2=0x7f94381e8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:29.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.025+0000 7f94377fe640 1 --2- 172.21.15.114:0/3613044633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f943815dc00 0x7f94381e8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:29.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.025+0000 7f94377fe640 1 -- 172.21.15.114:0/3613044633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94380b0340 con 0x7f943814b480 2024-04-28T13:08:29.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.025+0000 7f9437fff640 1 --2- 172.21.15.114:0/3613044633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f943815dc00 0x7f94381e8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:29.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.025+0000 7f94377fe640 1 --2- 172.21.15.114:0/3613044633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f943814b480 0x7f94380af2a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f94280116d0 tx=0x7f9428011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:29.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.026+0000 7f9434ff9640 1 -- 172.21.15.114:0/3613044633 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942800f9c0 con 0x7f943814b480 2024-04-28T13:08:29.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.026+0000 7f9434ff9640 1 -- 172.21.15.114:0/3613044633 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f942800fb60 con 0x7f943814b480 2024-04-28T13:08:29.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.026+0000 7f943da6d640 1 -- 172.21.15.114:0/3613044633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94380afd80 con 0x7f943814b480 2024-04-28T13:08:29.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.026+0000 7f9434ff9640 1 -- 172.21.15.114:0/3613044633 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9428015460 con 0x7f943814b480 2024-04-28T13:08:29.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.026+0000 7f943da6d640 1 -- 172.21.15.114:0/3613044633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94380aaa10 con 0x7f943814b480 2024-04-28T13:08:29.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.027+0000 7f943da6d640 1 -- 172.21.15.114:0/3613044633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f943806a3d0 con 0x7f943814b480 2024-04-28T13:08:29.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.027+0000 7f9434ff9640 1 -- 172.21.15.114:0/3613044633 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f9428015600 con 0x7f943814b480 2024-04-28T13:08:29.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.027+0000 7f9434ff9640 1 --2- 172.21.15.114:0/3613044633 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f941806c980 0x7f941806ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:29.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.027+0000 7f9434ff9640 1 -- 172.21.15.114:0/3613044633 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f942808c580 con 0x7f943814b480 2024-04-28T13:08:29.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.027+0000 7f942effd640 1 --2- 172.21.15.114:0/3613044633 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f941806c980 0x7f941806ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:29.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.028+0000 7f942effd640 1 --2- 172.21.15.114:0/3613044633 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f941806c980 0x7f941806ee40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f94380b2ae0 tx=0x7f9420008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:29.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.032+0000 7f9434ff9640 1 -- 172.21.15.114:0/3613044633 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9428019030 con 0x7f943814b480 2024-04-28T13:08:29.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.209+0000 7f943da6d640 1 -- 172.21.15.114:0/3613044633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9438069720 con 0x7f943814b480 2024-04-28T13:08:29.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.209+0000 7f9434ff9640 1 -- 172.21.15.114:0/3613044633 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) ==== 93+0+10 (secure 0 0 0) 0x7f942805a9c0 con 0x7f943814b480 2024-04-28T13:08:29.209 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-28T13:08:29.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.211+0000 7f943da6d640 1 -- 172.21.15.114:0/3613044633 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f941806c980 msgr2=0x7f941806ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:29.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.211+0000 7f943da6d640 1 --2- 172.21.15.114:0/3613044633 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f941806c980 0x7f941806ee40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f94380b2ae0 tx=0x7f9420008040 comp rx=0 tx=0).stop 2024-04-28T13:08:29.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.211+0000 7f943da6d640 1 -- 172.21.15.114:0/3613044633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f943814b480 msgr2=0x7f94380af2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:29.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.211+0000 7f943da6d640 1 --2- 172.21.15.114:0/3613044633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f943814b480 0x7f94380af2a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f94280116d0 tx=0x7f9428011b90 comp rx=0 tx=0).stop 2024-04-28T13:08:29.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.211+0000 7f943da6d640 1 -- 172.21.15.114:0/3613044633 shutdown_connections 2024-04-28T13:08:29.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.211+0000 7f943da6d640 1 --2- 172.21.15.114:0/3613044633 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f941806c980 0x7f941806ee40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:29.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.211+0000 7f943da6d640 1 --2- 172.21.15.114:0/3613044633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f943815dc00 0x7f94381e8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:29.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.211+0000 7f943da6d640 1 --2- 172.21.15.114:0/3613044633 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94380af7e0 0x7f943815d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:29.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.211+0000 7f943da6d640 1 --2- 172.21.15.114:0/3613044633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f943814b480 0x7f94380af2a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:29.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.211+0000 7f943da6d640 1 -- 172.21.15.114:0/3613044633 >> 172.21.15.114:0/3613044633 conn(0x7f943806c980 msgr2=0x7f943815e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:29.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.212+0000 7f943da6d640 1 -- 172.21.15.114:0/3613044633 shutdown_connections 2024-04-28T13:08:29.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.212+0000 7f943da6d640 1 -- 172.21.15.114:0/3613044633 wait complete. 2024-04-28T13:08:29.222 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-28T13:08:29.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.323+0000 7f1c421c8640 1 Processor -- start 2024-04-28T13:08:29.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.323+0000 7f1c421c8640 1 -- start start 2024-04-28T13:08:29.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.323+0000 7f1c421c8640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1c3c15f3d0 0x7f1c3c0b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:29.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.323+0000 7f1c421c8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1c3c162fb0 0x7f1c3c1633f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:29.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.323+0000 7f1c421c8640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c3c0b6050 con 0x7f1c3c0cf280 2024-04-28T13:08:29.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.323+0000 7f1c421c8640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f1c3c0b6940 con 0x7f1c3c15f3d0 2024-04-28T13:08:29.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.323+0000 7f1c421c8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f1c3c0b4c40 con 0x7f1c3c162fb0 2024-04-28T13:08:29.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.324+0000 7f1c3bfff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1c3c0cf280 0x7f1c3c0cf6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53016/0 (socket says 172.21.15.114:53016) 2024-04-28T13:08:29.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.324+0000 7f1c3b7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1c3c15f3d0 0x7f1c3c0b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:29.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.324+0000 7f1c3bfff640 1 -- 172.21.15.114:0/4230882609 learned_addr learned my addr 172.21.15.114:0/4230882609 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:29.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.324+0000 7f1c3affd640 1 -- 172.21.15.114:0/4230882609 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 909381678 0 0) 0x7f1c3c0b6050 con 0x7f1c3c0cf280 2024-04-28T13:08:29.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.324+0000 7f1c33fff640 1 --2- 172.21.15.114:0/4230882609 >> v2:172.21.15.134:3300/0 conn(0x7f1c3c162fb0 0x7f1c3c1633f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:29.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.324+0000 7f1c3affd640 1 -- 172.21.15.114:0/4230882609 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c28003520 con 0x7f1c3c0cf280 2024-04-28T13:08:29.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.324+0000 7f1c3b7fe640 1 -- 172.21.15.114:0/4230882609 >> v2:172.21.15.134:3300/0 conn(0x7f1c3c162fb0 msgr2=0x7f1c3c1633f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:29.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.324+0000 7f1c3b7fe640 1 --2- 172.21.15.114:0/4230882609 >> v2:172.21.15.134:3300/0 conn(0x7f1c3c162fb0 0x7f1c3c1633f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:29.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.324+0000 7f1c3b7fe640 1 -- 172.21.15.114:0/4230882609 >> v1:172.21.15.114:6789/0 conn(0x7f1c3c0cf280 legacy=0x7f1c3c0cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:29.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.324+0000 7f1c3b7fe640 1 -- 172.21.15.114:0/4230882609 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c3c0d0630 con 0x7f1c3c15f3d0 2024-04-28T13:08:29.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.325+0000 7f1c3b7fe640 1 --2- 172.21.15.114:0/4230882609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c3c15f3d0 0x7f1c3c0b4700 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0b6220 tx=0x7f1c2c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b3d7be95669a6c server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:29.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.325+0000 7f1c3affd640 1 -- 172.21.15.114:0/4230882609 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c037070 con 0x7f1c3c15f3d0 2024-04-28T13:08:29.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.325+0000 7f1c3affd640 1 -- 172.21.15.114:0/4230882609 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c2c032440 con 0x7f1c3c15f3d0 2024-04-28T13:08:29.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.325+0000 7f1c3affd640 1 -- 172.21.15.114:0/4230882609 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c032810 con 0x7f1c3c15f3d0 2024-04-28T13:08:29.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.325+0000 7f1c421c8640 1 -- 172.21.15.114:0/4230882609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c3c15f3d0 msgr2=0x7f1c3c0b4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:29.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.325+0000 7f1c421c8640 1 --2- 172.21.15.114:0/4230882609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c3c15f3d0 0x7f1c3c0b4700 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0b6220 tx=0x7f1c2c02a1a0 comp rx=0 tx=0).stop 2024-04-28T13:08:29.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.325+0000 7f1c421c8640 1 -- 172.21.15.114:0/4230882609 shutdown_connections 2024-04-28T13:08:29.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.325+0000 7f1c421c8640 1 --2- 172.21.15.114:0/4230882609 >> v2:172.21.15.134:3300/0 conn(0x7f1c3c162fb0 0x7f1c3c1633f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:29.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.325+0000 7f1c421c8640 1 --2- 172.21.15.114:0/4230882609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c3c15f3d0 0x7f1c3c0b4700 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:29.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.325+0000 7f1c421c8640 1 -- 172.21.15.114:0/4230882609 >> 172.21.15.114:0/4230882609 conn(0x7f1c3c0d16b0 msgr2=0x7f1c3c0d1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:29.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.325+0000 7f1c421c8640 1 -- 172.21.15.114:0/4230882609 shutdown_connections 2024-04-28T13:08:29.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.325+0000 7f1c421c8640 1 -- 172.21.15.114:0/4230882609 wait complete. 2024-04-28T13:08:29.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.327+0000 7f1c421c8640 1 Processor -- start 2024-04-28T13:08:29.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.327+0000 7f1c421c8640 1 -- start start 2024-04-28T13:08:29.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.327+0000 7f1c421c8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c3c0cf280 0x7f1c3c0ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:29.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.327+0000 7f1c421c8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c3c15f3d0 0x7f1c3c1f8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:29.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.327+0000 7f1c421c8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c3c162fb0 0x7f1c3c1579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:29.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.327+0000 7f1c421c8640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1c3c0b65d0 con 0x7f1c3c162fb0 2024-04-28T13:08:29.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.327+0000 7f1c421c8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1c3c163930 con 0x7f1c3c15f3d0 2024-04-28T13:08:29.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.327+0000 7f1c421c8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1c3c15f7b0 con 0x7f1c3c0cf280 2024-04-28T13:08:29.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.327+0000 7f1c3bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c3c162fb0 0x7f1c3c1579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:29.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.327+0000 7f1c3bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c3c162fb0 0x7f1c3c1579b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33306/0 (socket says 172.21.15.114:33306) 2024-04-28T13:08:29.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.327+0000 7f1c3bfff640 1 -- 172.21.15.114:0/1976514968 learned_addr learned my addr 172.21.15.114:0/1976514968 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:29.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.328+0000 7f1c3b7fe640 1 --2- 172.21.15.114:0/1976514968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c3c0cf280 0x7f1c3c0ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:29.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.328+0000 7f1c3bfff640 1 -- 172.21.15.114:0/1976514968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c3c0cf280 msgr2=0x7f1c3c0ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:29.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.328+0000 7f1c3bfff640 1 --2- 172.21.15.114:0/1976514968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c3c0cf280 0x7f1c3c0ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:29.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.328+0000 7f1c3bfff640 1 -- 172.21.15.114:0/1976514968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c3c15f3d0 msgr2=0x7f1c3c1f8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:29.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.328+0000 7f1c3bfff640 1 --2- 172.21.15.114:0/1976514968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c3c15f3d0 0x7f1c3c1f8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:29.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.328+0000 7f1c3bfff640 1 -- 172.21.15.114:0/1976514968 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c3c1f94e0 con 0x7f1c3c162fb0 2024-04-28T13:08:29.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.328+0000 7f1c3b7fe640 1 --2- 172.21.15.114:0/1976514968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c3c0cf280 0x7f1c3c0ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:29.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.328+0000 7f1c3bfff640 1 --2- 172.21.15.114:0/1976514968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c3c162fb0 0x7f1c3c1579b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1c3400cb40 tx=0x7f1c3400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:29.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.328+0000 7f1c38ff9640 1 -- 172.21.15.114:0/1976514968 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c34017070 con 0x7f1c3c162fb0 2024-04-28T13:08:29.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.328+0000 7f1c38ff9640 1 -- 172.21.15.114:0/1976514968 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c3400aca0 con 0x7f1c3c162fb0 2024-04-28T13:08:29.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.328+0000 7f1c38ff9640 1 -- 172.21.15.114:0/1976514968 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c34012620 con 0x7f1c3c162fb0 2024-04-28T13:08:29.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.328+0000 7f1c421c8640 1 -- 172.21.15.114:0/1976514968 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c3c0aee30 con 0x7f1c3c162fb0 2024-04-28T13:08:29.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.328+0000 7f1c421c8640 1 -- 172.21.15.114:0/1976514968 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c3c0af3f0 con 0x7f1c3c162fb0 2024-04-28T13:08:29.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.329+0000 7f1c421c8640 1 -- 172.21.15.114:0/1976514968 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c3c06a3d0 con 0x7f1c3c162fb0 2024-04-28T13:08:29.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.329+0000 7f1c38ff9640 1 -- 172.21.15.114:0/1976514968 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f1c3401a070 con 0x7f1c3c162fb0 2024-04-28T13:08:29.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.330+0000 7f1c38ff9640 1 --2- 172.21.15.114:0/1976514968 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1c1c06c980 0x7f1c1c06ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:29.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.330+0000 7f1c3b7fe640 1 --2- 172.21.15.114:0/1976514968 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1c1c06c980 0x7f1c1c06ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:29.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.330+0000 7f1c38ff9640 1 -- 172.21.15.114:0/1976514968 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f1c3408b980 con 0x7f1c3c162fb0 2024-04-28T13:08:29.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.330+0000 7f1c3b7fe640 1 --2- 172.21.15.114:0/1976514968 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1c1c06c980 0x7f1c1c06ee40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c034000 tx=0x7f1c2c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:29.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.334+0000 7f1c38ff9640 1 -- 172.21.15.114:0/1976514968 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1c3c1f94e0 con 0x7f1c3c162fb0 2024-04-28T13:08:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.508+0000 7f1c421c8640 1 -- 172.21.15.114:0/1976514968 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1c3c0732b0 con 0x7f1c3c162fb0 2024-04-28T13:08:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.508+0000 7f1c38ff9640 1 -- 172.21.15.114:0/1976514968 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) ==== 104+0+11 (secure 0 0 0) 0x7f1c34059e50 con 0x7f1c3c162fb0 2024-04-28T13:08:29.508 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-04-28T13:08:29.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.510+0000 7f1c421c8640 1 -- 172.21.15.114:0/1976514968 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1c1c06c980 msgr2=0x7f1c1c06ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:29.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.510+0000 7f1c421c8640 1 --2- 172.21.15.114:0/1976514968 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1c1c06c980 0x7f1c1c06ee40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c034000 tx=0x7f1c2c02e000 comp rx=0 tx=0).stop 2024-04-28T13:08:29.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.510+0000 7f1c421c8640 1 -- 172.21.15.114:0/1976514968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c3c162fb0 msgr2=0x7f1c3c1579b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:29.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.510+0000 7f1c421c8640 1 --2- 172.21.15.114:0/1976514968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c3c162fb0 0x7f1c3c1579b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1c3400cb40 tx=0x7f1c3400a060 comp rx=0 tx=0).stop 2024-04-28T13:08:29.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.510+0000 7f1c421c8640 1 -- 172.21.15.114:0/1976514968 shutdown_connections 2024-04-28T13:08:29.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.510+0000 7f1c421c8640 1 --2- 172.21.15.114:0/1976514968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c3c162fb0 0x7f1c3c1579b0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:29.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.510+0000 7f1c421c8640 1 --2- 172.21.15.114:0/1976514968 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1c1c06c980 0x7f1c1c06ee40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:29.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.510+0000 7f1c421c8640 1 --2- 172.21.15.114:0/1976514968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c3c15f3d0 0x7f1c3c1f8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:29.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.510+0000 7f1c421c8640 1 --2- 172.21.15.114:0/1976514968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c3c0cf280 0x7f1c3c0ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:29.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.510+0000 7f1c421c8640 1 -- 172.21.15.114:0/1976514968 >> 172.21.15.114:0/1976514968 conn(0x7f1c3c0d16b0 msgr2=0x7f1c3c15e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:29.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.510+0000 7f1c421c8640 1 -- 172.21.15.114:0/1976514968 shutdown_connections 2024-04-28T13:08:29.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.510+0000 7f1c421c8640 1 -- 172.21.15.114:0/1976514968 wait complete. 2024-04-28T13:08:29.521 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-28T13:08:29.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.620+0000 7f1bf339e640 1 Processor -- start 2024-04-28T13:08:29.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.620+0000 7f1bf339e640 1 -- start start 2024-04-28T13:08:29.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.621+0000 7f1bf339e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bec15f240 0x7f1bec0cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:29.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.621+0000 7f1bf339e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bec0d01c0 con 0x7f1bec0d2f10 2024-04-28T13:08:29.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.621+0000 7f1bf339e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bec0d3ce0 con 0x7f1bec0d4e20 2024-04-28T13:08:29.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.621+0000 7f1bf339e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1bec0d3ab0 con 0x7f1bec15f240 2024-04-28T13:08:29.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.621+0000 7f1bf2b9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1bec0d2f10 0x7f1bec0d33a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53028/0 (socket says 172.21.15.114:53028) 2024-04-28T13:08:29.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.621+0000 7f1bf2b9d640 1 -- 172.21.15.114:0/595696513 learned_addr learned my addr 172.21.15.114:0/595696513 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:29.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.621+0000 7f1bf239c640 1 --2- 172.21.15.114:0/595696513 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bec15f240 0x7f1bec0cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:29.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.621+0000 7f1bf139a640 1 -- 172.21.15.114:0/595696513 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2569911660 0 0) 0x7f1bec0d01c0 con 0x7f1bec0d2f10 2024-04-28T13:08:29.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.622+0000 7f1bf139a640 1 -- 172.21.15.114:0/595696513 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bd8003520 con 0x7f1bec0d2f10 2024-04-28T13:08:29.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.622+0000 7f1bf139a640 1 -- 172.21.15.114:0/595696513 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1102749548 0 0) 0x7f1bd8003520 con 0x7f1bec0d2f10 2024-04-28T13:08:29.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.622+0000 7f1bf239c640 1 -- 172.21.15.114:0/595696513 >> v1:172.21.15.134:6789/0 conn(0x7f1bec0d4e20 legacy=0x7f1bec0d5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:29.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.622+0000 7f1bf239c640 1 -- 172.21.15.114:0/595696513 >> v1:172.21.15.114:6789/0 conn(0x7f1bec0d2f10 legacy=0x7f1bec0d33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:29.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.622+0000 7f1bf239c640 1 -- 172.21.15.114:0/595696513 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bec0d3fc0 con 0x7f1bec15f240 2024-04-28T13:08:29.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.622+0000 7f1bf239c640 1 --2- 172.21.15.114:0/595696513 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bec15f240 0x7f1bec0cfc80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1be8009dc0 tx=0x7f1be802a580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=358a347c32cf9bb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:29.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.623+0000 7f1bf139a640 1 -- 172.21.15.114:0/595696513 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be8035020 con 0x7f1bec15f240 2024-04-28T13:08:29.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.623+0000 7f1bf139a640 1 -- 172.21.15.114:0/595696513 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1be8007540 con 0x7f1bec15f240 2024-04-28T13:08:29.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.623+0000 7f1bf139a640 1 -- 172.21.15.114:0/595696513 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be4001670 con 0x7f1bec15f240 2024-04-28T13:08:29.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.623+0000 7f1bf339e640 1 -- 172.21.15.114:0/595696513 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bec15f240 msgr2=0x7f1bec0cfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:29.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.623+0000 7f1bf339e640 1 --2- 172.21.15.114:0/595696513 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bec15f240 0x7f1bec0cfc80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1be8009dc0 tx=0x7f1be802a580 comp rx=0 tx=0).stop 2024-04-28T13:08:29.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.623+0000 7f1bf339e640 1 -- 172.21.15.114:0/595696513 shutdown_connections 2024-04-28T13:08:29.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.623+0000 7f1bf339e640 1 --2- 172.21.15.114:0/595696513 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bec15f240 0x7f1bec0cfc80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:29.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.623+0000 7f1bf339e640 1 -- 172.21.15.114:0/595696513 >> 172.21.15.114:0/595696513 conn(0x7f1bec08eb30 msgr2=0x7f1bec09e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:29.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.623+0000 7f1bf339e640 1 -- 172.21.15.114:0/595696513 shutdown_connections 2024-04-28T13:08:29.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.623+0000 7f1bf339e640 1 -- 172.21.15.114:0/595696513 wait complete. 2024-04-28T13:08:29.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.625+0000 7f1bf339e640 1 Processor -- start 2024-04-28T13:08:29.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.625+0000 7f1bf339e640 1 -- start start 2024-04-28T13:08:29.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.625+0000 7f1bf339e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bec0d2f10 0x7f1bec15dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:29.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.625+0000 7f1bf339e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bec0d4e20 0x7f1bec0cd480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:29.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.625+0000 7f1bf339e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bec15f240 0x7f1bec0b2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:29.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.625+0000 7f1bf339e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec0b4db0 con 0x7f1bec15f240 2024-04-28T13:08:29.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.625+0000 7f1bf339e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec0b5120 con 0x7f1bec0d2f10 2024-04-28T13:08:29.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.625+0000 7f1bf339e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1bec15f620 con 0x7f1bec0d4e20 2024-04-28T13:08:29.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.625+0000 7f1bf2b9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bec15f240 0x7f1bec0b2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:29.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.625+0000 7f1bf2b9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bec15f240 0x7f1bec0b2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33318/0 (socket says 172.21.15.114:33318) 2024-04-28T13:08:29.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.625+0000 7f1bf2b9d640 1 -- 172.21.15.114:0/219453220 learned_addr learned my addr 172.21.15.114:0/219453220 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:29.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.626+0000 7f1bf239c640 1 --2- 172.21.15.114:0/219453220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bec0d2f10 0x7f1bec15dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:29.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.626+0000 7f1bf1b9b640 1 --2- 172.21.15.114:0/219453220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bec0d4e20 0x7f1bec0cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:29.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.626+0000 7f1bf2b9d640 1 -- 172.21.15.114:0/219453220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bec0d4e20 msgr2=0x7f1bec0cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:29.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.626+0000 7f1bf2b9d640 1 --2- 172.21.15.114:0/219453220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bec0d4e20 0x7f1bec0cd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:29.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.626+0000 7f1bf2b9d640 1 -- 172.21.15.114:0/219453220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bec0d2f10 msgr2=0x7f1bec15dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:29.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.626+0000 7f1bf2b9d640 1 --2- 172.21.15.114:0/219453220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bec0d2f10 0x7f1bec15dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:29.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.626+0000 7f1bf2b9d640 1 -- 172.21.15.114:0/219453220 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bec0cdeb0 con 0x7f1bec15f240 2024-04-28T13:08:29.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.626+0000 7f1bf239c640 1 --2- 172.21.15.114:0/219453220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bec0d2f10 0x7f1bec15dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:29.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.626+0000 7f1bf2b9d640 1 --2- 172.21.15.114:0/219453220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bec15f240 0x7f1bec0b2fc0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1be400c480 tx=0x7f1be400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:29.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.626+0000 7f1be2ffd640 1 -- 172.21.15.114:0/219453220 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be4018070 con 0x7f1bec15f240 2024-04-28T13:08:29.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.626+0000 7f1be2ffd640 1 -- 172.21.15.114:0/219453220 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1be40074e0 con 0x7f1bec15f240 2024-04-28T13:08:29.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.626+0000 7f1bf339e640 1 -- 172.21.15.114:0/219453220 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bec0ce150 con 0x7f1bec15f240 2024-04-28T13:08:29.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.626+0000 7f1be2ffd640 1 -- 172.21.15.114:0/219453220 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be4004a20 con 0x7f1bec15f240 2024-04-28T13:08:29.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.626+0000 7f1bf339e640 1 -- 172.21.15.114:0/219453220 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bec0ce710 con 0x7f1bec15f240 2024-04-28T13:08:29.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.627+0000 7f1bf339e640 1 -- 172.21.15.114:0/219453220 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bec076830 con 0x7f1bec15f240 2024-04-28T13:08:29.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.628+0000 7f1be2ffd640 1 -- 172.21.15.114:0/219453220 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f1be401b070 con 0x7f1bec15f240 2024-04-28T13:08:29.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.628+0000 7f1be2ffd640 1 --2- 172.21.15.114:0/219453220 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1bd006c980 0x7f1bd006ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:29.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.628+0000 7f1be2ffd640 1 -- 172.21.15.114:0/219453220 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f1be408add0 con 0x7f1bec15f240 2024-04-28T13:08:29.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.628+0000 7f1bf239c640 1 --2- 172.21.15.114:0/219453220 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1bd006c980 0x7f1bd006ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:29.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.628+0000 7f1bf239c640 1 --2- 172.21.15.114:0/219453220 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1bd006c980 0x7f1bd006ee40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1be8033000 tx=0x7f1be802f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:29.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.632+0000 7f1be2ffd640 1 -- 172.21.15.114:0/219453220 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1be4058c50 con 0x7f1bec15f240 2024-04-28T13:08:29.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.808+0000 7f1bf339e640 1 -- 172.21.15.114:0/219453220 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1bec08f1e0 con 0x7f1bec15f240 2024-04-28T13:08:29.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.808+0000 7f1be2ffd640 1 -- 172.21.15.114:0/219453220 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) ==== 100+0+11 (secure 0 0 0) 0x7f1be405cf50 con 0x7f1bec15f240 2024-04-28T13:08:29.808 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-04-28T13:08:29.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.810+0000 7f1bf339e640 1 -- 172.21.15.114:0/219453220 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1bd006c980 msgr2=0x7f1bd006ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:29.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.810+0000 7f1bf339e640 1 --2- 172.21.15.114:0/219453220 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1bd006c980 0x7f1bd006ee40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1be8033000 tx=0x7f1be802f000 comp rx=0 tx=0).stop 2024-04-28T13:08:29.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.810+0000 7f1bf339e640 1 -- 172.21.15.114:0/219453220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bec15f240 msgr2=0x7f1bec0b2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:29.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.810+0000 7f1bf339e640 1 --2- 172.21.15.114:0/219453220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bec15f240 0x7f1bec0b2fc0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1be400c480 tx=0x7f1be400c940 comp rx=0 tx=0).stop 2024-04-28T13:08:29.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.810+0000 7f1bf339e640 1 -- 172.21.15.114:0/219453220 shutdown_connections 2024-04-28T13:08:29.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.810+0000 7f1bf339e640 1 --2- 172.21.15.114:0/219453220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bec15f240 0x7f1bec0b2fc0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:29.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.810+0000 7f1bf339e640 1 --2- 172.21.15.114:0/219453220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bec0d4e20 0x7f1bec0cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:29.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.810+0000 7f1bf339e640 1 --2- 172.21.15.114:0/219453220 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1bd006c980 0x7f1bd006ee40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:29.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.810+0000 7f1bf339e640 1 --2- 172.21.15.114:0/219453220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bec0d2f10 0x7f1bec15dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:29.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.810+0000 7f1bf339e640 1 -- 172.21.15.114:0/219453220 >> 172.21.15.114:0/219453220 conn(0x7f1bec08eb30 msgr2=0x7f1bec0b5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:29.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.810+0000 7f1bf339e640 1 -- 172.21.15.114:0/219453220 shutdown_connections 2024-04-28T13:08:29.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.810+0000 7f1bf339e640 1 -- 172.21.15.114:0/219453220 wait complete. 2024-04-28T13:08:29.821 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-28T13:08:29.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.917+0000 7f9ef4bda640 1 Processor -- start 2024-04-28T13:08:29.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.917+0000 7f9ef4bda640 1 -- start start 2024-04-28T13:08:29.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.918+0000 7f9ef4bda640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9ef015f230 0x7f9ef00bac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:29.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.918+0000 7f9ef4bda640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ef00ba670 con 0x7f9ef00d22a0 2024-04-28T13:08:29.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.918+0000 7f9ef4bda640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ef00b9af0 con 0x7f9ef015f610 2024-04-28T13:08:29.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.918+0000 7f9ef4bda640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f9ef00b9dd0 con 0x7f9ef015f230 2024-04-28T13:08:29.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.918+0000 7f9eeed9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9ef00d22a0 0x7f9ef00b82e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53038/0 (socket says 172.21.15.114:53038) 2024-04-28T13:08:29.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.918+0000 7f9eeed9d640 1 -- 172.21.15.114:0/3465245716 learned_addr learned my addr 172.21.15.114:0/3465245716 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:29.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.919+0000 7f9eee59c640 1 --2- 172.21.15.114:0/3465245716 >> v2:172.21.15.134:3300/0 conn(0x7f9ef015f230 0x7f9ef00bac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:29.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.919+0000 7f9eed59a640 1 -- 172.21.15.114:0/3465245716 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4260633015 0 0) 0x7f9ef00ba670 con 0x7f9ef00d22a0 2024-04-28T13:08:29.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.919+0000 7f9eed59a640 1 -- 172.21.15.114:0/3465245716 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ed8003520 con 0x7f9ef00d22a0 2024-04-28T13:08:29.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.919+0000 7f9eed59a640 1 -- 172.21.15.114:0/3465245716 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 170920314 0 0) 0x7f9ed8003520 con 0x7f9ef00d22a0 2024-04-28T13:08:29.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.919+0000 7f9eee59c640 1 -- 172.21.15.114:0/3465245716 >> v1:172.21.15.134:6789/0 conn(0x7f9ef015f610 legacy=0x7f9ef00d1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:29.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.919+0000 7f9eee59c640 1 -- 172.21.15.114:0/3465245716 >> v1:172.21.15.114:6789/0 conn(0x7f9ef00d22a0 legacy=0x7f9ef00b82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:29.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.919+0000 7f9eee59c640 1 -- 172.21.15.114:0/3465245716 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ef00ba0b0 con 0x7f9ef015f230 2024-04-28T13:08:29.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.920+0000 7f9eee59c640 1 --2- 172.21.15.114:0/3465245716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ef015f230 0x7f9ef00bac90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009d90 tx=0x7f9ee002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d5e85571b8f140b server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:29.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.920+0000 7f9eed59a640 1 -- 172.21.15.114:0/3465245716 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee8001670 con 0x7f9ef015f230 2024-04-28T13:08:29.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.920+0000 7f9eed59a640 1 -- 172.21.15.114:0/3465245716 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ee0007540 con 0x7f9ef015f230 2024-04-28T13:08:29.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.920+0000 7f9eed59a640 1 -- 172.21.15.114:0/3465245716 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee00078f0 con 0x7f9ef015f230 2024-04-28T13:08:29.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.920+0000 7f9ef4bda640 1 -- 172.21.15.114:0/3465245716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ef015f230 msgr2=0x7f9ef00bac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:29.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.920+0000 7f9ef4bda640 1 --2- 172.21.15.114:0/3465245716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ef015f230 0x7f9ef00bac90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009d90 tx=0x7f9ee002a680 comp rx=0 tx=0).stop 2024-04-28T13:08:29.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.921+0000 7f9ef4bda640 1 -- 172.21.15.114:0/3465245716 shutdown_connections 2024-04-28T13:08:29.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.921+0000 7f9ef4bda640 1 --2- 172.21.15.114:0/3465245716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ef015f230 0x7f9ef00bac90 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:29.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.921+0000 7f9ef4bda640 1 -- 172.21.15.114:0/3465245716 >> 172.21.15.114:0/3465245716 conn(0x7f9ef0063190 msgr2=0x7f9ef00635a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:29.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.921+0000 7f9ef4bda640 1 -- 172.21.15.114:0/3465245716 shutdown_connections 2024-04-28T13:08:29.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.921+0000 7f9ef4bda640 1 -- 172.21.15.114:0/3465245716 wait complete. 2024-04-28T13:08:29.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.922+0000 7f9ef4bda640 1 Processor -- start 2024-04-28T13:08:29.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.922+0000 7f9ef4bda640 1 -- start start 2024-04-28T13:08:29.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.923+0000 7f9ef4bda640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ef00d22a0 0x7f9ef00cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:29.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.923+0000 7f9ef4bda640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ef015f230 0x7f9ef0162490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:29.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.923+0000 7f9ef4bda640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ef015f610 0x7f9ef00cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:29.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.923+0000 7f9ef4bda640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef00d4710 con 0x7f9ef015f610 2024-04-28T13:08:29.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.923+0000 7f9ef4bda640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef00d4590 con 0x7f9ef00d22a0 2024-04-28T13:08:29.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.923+0000 7f9ef4bda640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f9ef00d4890 con 0x7f9ef015f230 2024-04-28T13:08:29.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.923+0000 7f9eeed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ef015f610 0x7f9ef00cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:29.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.923+0000 7f9eeed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ef015f610 0x7f9ef00cdbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33322/0 (socket says 172.21.15.114:33322) 2024-04-28T13:08:29.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.923+0000 7f9eeed9d640 1 -- 172.21.15.114:0/3555963937 learned_addr learned my addr 172.21.15.114:0/3555963937 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:29.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.923+0000 7f9eee59c640 1 --2- 172.21.15.114:0/3555963937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ef00d22a0 0x7f9ef00cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:29.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.923+0000 7f9eedd9b640 1 --2- 172.21.15.114:0/3555963937 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ef015f230 0x7f9ef0162490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:29.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.923+0000 7f9eeed9d640 1 -- 172.21.15.114:0/3555963937 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ef015f230 msgr2=0x7f9ef0162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:29.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.923+0000 7f9eeed9d640 1 --2- 172.21.15.114:0/3555963937 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ef015f230 0x7f9ef0162490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:29.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.923+0000 7f9eeed9d640 1 -- 172.21.15.114:0/3555963937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ef00d22a0 msgr2=0x7f9ef00cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:29.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.923+0000 7f9eeed9d640 1 --2- 172.21.15.114:0/3555963937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ef00d22a0 0x7f9ef00cedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:29.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.923+0000 7f9eeed9d640 1 -- 172.21.15.114:0/3555963937 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ef01629d0 con 0x7f9ef015f610 2024-04-28T13:08:29.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.923+0000 7f9eeed9d640 1 --2- 172.21.15.114:0/3555963937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ef015f610 0x7f9ef00cdbb0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9ee800c480 tx=0x7f9ee800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:29.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.923+0000 7f9edeffd640 1 -- 172.21.15.114:0/3555963937 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee8017070 con 0x7f9ef015f610 2024-04-28T13:08:29.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.923+0000 7f9edeffd640 1 -- 172.21.15.114:0/3555963937 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ee8005d00 con 0x7f9ef015f610 2024-04-28T13:08:29.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.923+0000 7f9ef4bda640 1 -- 172.21.15.114:0/3555963937 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ef01535e0 con 0x7f9ef015f610 2024-04-28T13:08:29.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.923+0000 7f9edeffd640 1 -- 172.21.15.114:0/3555963937 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee80072b0 con 0x7f9ef015f610 2024-04-28T13:08:29.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.923+0000 7f9ef4bda640 1 -- 172.21.15.114:0/3555963937 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ef0153ba0 con 0x7f9ef015f610 2024-04-28T13:08:29.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.924+0000 7f9ef4bda640 1 -- 172.21.15.114:0/3555963937 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ef0075c40 con 0x7f9ef015f610 2024-04-28T13:08:29.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.925+0000 7f9edeffd640 1 -- 172.21.15.114:0/3555963937 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f9ee801a070 con 0x7f9ef015f610 2024-04-28T13:08:29.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.925+0000 7f9edeffd640 1 --2- 172.21.15.114:0/3555963937 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9ed006c980 0x7f9ed006ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:29.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.925+0000 7f9edeffd640 1 -- 172.21.15.114:0/3555963937 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f9ee808b010 con 0x7f9ef015f610 2024-04-28T13:08:29.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.925+0000 7f9eee59c640 1 --2- 172.21.15.114:0/3555963937 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9ed006c980 0x7f9ed006ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:29.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.925+0000 7f9eee59c640 1 --2- 172.21.15.114:0/3555963937 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9ed006c980 0x7f9ed006ee40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0034000 tx=0x7f9ee002f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:29.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:29.929+0000 7f9edeffd640 1 -- 172.21.15.114:0/3555963937 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9ee8059460 con 0x7f9ef015f610 2024-04-28T13:08:30.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.116+0000 7f9ef4bda640 1 -- 172.21.15.114:0/3555963937 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9ef0154ef0 con 0x7f9ef015f610 2024-04-28T13:08:30.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.116+0000 7f9edeffd640 1 -- 172.21.15.114:0/3555963937 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7f9ee8058d60 con 0x7f9ef015f610 2024-04-28T13:08:30.116 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-04-28T13:08:30.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.118+0000 7f9ef4bda640 1 -- 172.21.15.114:0/3555963937 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9ed006c980 msgr2=0x7f9ed006ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:30.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.118+0000 7f9ef4bda640 1 --2- 172.21.15.114:0/3555963937 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9ed006c980 0x7f9ed006ee40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0034000 tx=0x7f9ee002f000 comp rx=0 tx=0).stop 2024-04-28T13:08:30.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.118+0000 7f9ef4bda640 1 -- 172.21.15.114:0/3555963937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ef015f610 msgr2=0x7f9ef00cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:30.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.118+0000 7f9ef4bda640 1 --2- 172.21.15.114:0/3555963937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ef015f610 0x7f9ef00cdbb0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9ee800c480 tx=0x7f9ee800c940 comp rx=0 tx=0).stop 2024-04-28T13:08:30.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.118+0000 7f9ef4bda640 1 -- 172.21.15.114:0/3555963937 shutdown_connections 2024-04-28T13:08:30.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.118+0000 7f9ef4bda640 1 --2- 172.21.15.114:0/3555963937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ef015f610 0x7f9ef00cdbb0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:30.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.118+0000 7f9ef4bda640 1 --2- 172.21.15.114:0/3555963937 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ef015f230 0x7f9ef0162490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:30.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.118+0000 7f9ef4bda640 1 --2- 172.21.15.114:0/3555963937 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9ed006c980 0x7f9ed006ee40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:30.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.118+0000 7f9ef4bda640 1 --2- 172.21.15.114:0/3555963937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ef00d22a0 0x7f9ef00cedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:30.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.118+0000 7f9ef4bda640 1 -- 172.21.15.114:0/3555963937 >> 172.21.15.114:0/3555963937 conn(0x7f9ef0063190 msgr2=0x7f9ef00d4c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:30.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.118+0000 7f9ef4bda640 1 -- 172.21.15.114:0/3555963937 shutdown_connections 2024-04-28T13:08:30.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.118+0000 7f9ef4bda640 1 -- 172.21.15.114:0/3555963937 wait complete. 2024-04-28T13:08:30.129 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-28T13:08:30.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:30.129 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-28T13:08:30.156 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-04-28T13:08:30.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:30.157 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-28T13:08:30.211 INFO:tasks.cephfs.mount:Terminating background process 2024-04-28T13:08:30.211 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:08:30.212 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-28T13:08:30.230 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:08:30.230 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-28T13:08:30.288 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:08:30.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.385+0000 7f83cd379640 1 Processor -- start 2024-04-28T13:08:30.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.385+0000 7f83cd379640 1 -- start start 2024-04-28T13:08:30.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.386+0000 7f83cd379640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f83c80b73d0 0x7f83c80d27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:30.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.386+0000 7f83cd379640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f83c80722a0 0x7f83c8070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:30.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.386+0000 7f83cd379640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83c8072830 con 0x7f83c8070710 2024-04-28T13:08:30.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.386+0000 7f83cd379640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f83c8072b10 con 0x7f83c80722a0 2024-04-28T13:08:30.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.386+0000 7f83cd379640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f83c80d1d10 con 0x7f83c80b73d0 2024-04-28T13:08:30.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.386+0000 7f83c77fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f83c80722a0 0x7f83c8070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:30.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.386+0000 7f83c77fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f83c80722a0 0x7f83c8070ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33328/0 (socket says 172.21.15.114:33328) 2024-04-28T13:08:30.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.386+0000 7f83c77fe640 1 -- 172.21.15.114:0/863448783 learned_addr learned my addr 172.21.15.114:0/863448783 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:30.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.386+0000 7f83c6ffd640 1 --2- 172.21.15.114:0/863448783 >> v2:172.21.15.134:3300/0 conn(0x7f83c80b73d0 0x7f83c80d27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:30.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.386+0000 7f83c77fe640 1 -- 172.21.15.114:0/863448783 >> v2:172.21.15.134:3300/0 conn(0x7f83c80b73d0 msgr2=0x7f83c80d27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:30.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.386+0000 7f83c77fe640 1 --2- 172.21.15.114:0/863448783 >> v2:172.21.15.134:3300/0 conn(0x7f83c80b73d0 0x7f83c80d27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:30.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.386+0000 7f83c77fe640 1 -- 172.21.15.114:0/863448783 >> v1:172.21.15.134:6789/0 conn(0x7f83c8070710 legacy=0x7f83c8071b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:30.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.386+0000 7f83c77fe640 1 -- 172.21.15.114:0/863448783 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c80d1ff0 con 0x7f83c80722a0 2024-04-28T13:08:30.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.387+0000 7f83c77fe640 1 --2- 172.21.15.114:0/863448783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83c80722a0 0x7f83c8070ba0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f83c8076160 tx=0x7f83c002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3fd863a22fc36d server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:30.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.387+0000 7f83c5ffb640 1 -- 172.21.15.114:0/863448783 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c0036070 con 0x7f83c80722a0 2024-04-28T13:08:30.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.387+0000 7f83c5ffb640 1 -- 172.21.15.114:0/863448783 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83c0031600 con 0x7f83c80722a0 2024-04-28T13:08:30.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.387+0000 7f83c5ffb640 1 -- 172.21.15.114:0/863448783 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c00319d0 con 0x7f83c80722a0 2024-04-28T13:08:30.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.388+0000 7f83cd379640 1 -- 172.21.15.114:0/863448783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83c80722a0 msgr2=0x7f83c8070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:30.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.388+0000 7f83cd379640 1 --2- 172.21.15.114:0/863448783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83c80722a0 0x7f83c8070ba0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f83c8076160 tx=0x7f83c002a730 comp rx=0 tx=0).stop 2024-04-28T13:08:30.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.388+0000 7f83cd379640 1 -- 172.21.15.114:0/863448783 shutdown_connections 2024-04-28T13:08:30.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.388+0000 7f83cd379640 1 --2- 172.21.15.114:0/863448783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83c80722a0 0x7f83c8070ba0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:30.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.388+0000 7f83cd379640 1 --2- 172.21.15.114:0/863448783 >> v2:172.21.15.134:3300/0 conn(0x7f83c80b73d0 0x7f83c80d27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:30.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.388+0000 7f83cd379640 1 -- 172.21.15.114:0/863448783 >> 172.21.15.114:0/863448783 conn(0x7f83c80b4c60 msgr2=0x7f83c80b5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:30.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.388+0000 7f83cd379640 1 -- 172.21.15.114:0/863448783 shutdown_connections 2024-04-28T13:08:30.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.388+0000 7f83cd379640 1 -- 172.21.15.114:0/863448783 wait complete. 2024-04-28T13:08:30.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.389+0000 7f83cd379640 1 Processor -- start 2024-04-28T13:08:30.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.389+0000 7f83cd379640 1 -- start start 2024-04-28T13:08:30.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.390+0000 7f83cd379640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83c8070710 0x7f83c81f4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:30.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.390+0000 7f83cd379640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83c80722a0 0x7f83c815a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:30.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.390+0000 7f83cd379640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83c80b73d0 0x7f83c815a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:30.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.390+0000 7f83cd379640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f83c80d2eb0 con 0x7f83c80722a0 2024-04-28T13:08:30.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.390+0000 7f83cd379640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f83c80d2d30 con 0x7f83c80b73d0 2024-04-28T13:08:30.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.390+0000 7f83cd379640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f83c80b77b0 con 0x7f83c8070710 2024-04-28T13:08:30.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.390+0000 7f83c67fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83c80722a0 0x7f83c815a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:30.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.390+0000 7f83c67fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83c80722a0 0x7f83c815a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33344/0 (socket says 172.21.15.114:33344) 2024-04-28T13:08:30.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.390+0000 7f83c67fc640 1 -- 172.21.15.114:0/2361368128 learned_addr learned my addr 172.21.15.114:0/2361368128 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:30.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.390+0000 7f83c77fe640 1 --2- 172.21.15.114:0/2361368128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83c80b73d0 0x7f83c815a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:30.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.390+0000 7f83c6ffd640 1 --2- 172.21.15.114:0/2361368128 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83c8070710 0x7f83c81f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:30.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.390+0000 7f83c67fc640 1 -- 172.21.15.114:0/2361368128 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83c8070710 msgr2=0x7f83c81f4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:30.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.390+0000 7f83c67fc640 1 --2- 172.21.15.114:0/2361368128 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83c8070710 0x7f83c81f4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:30.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.390+0000 7f83c67fc640 1 -- 172.21.15.114:0/2361368128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83c80b73d0 msgr2=0x7f83c815a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:30.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.390+0000 7f83c67fc640 1 --2- 172.21.15.114:0/2361368128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83c80b73d0 0x7f83c815a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:30.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.390+0000 7f83c67fc640 1 -- 172.21.15.114:0/2361368128 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c806e1a0 con 0x7f83c80722a0 2024-04-28T13:08:30.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.390+0000 7f83c77fe640 1 --2- 172.21.15.114:0/2361368128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83c80b73d0 0x7f83c815a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:30.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.390+0000 7f83c6ffd640 1 --2- 172.21.15.114:0/2361368128 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83c8070710 0x7f83c81f4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:30.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.390+0000 7f83c67fc640 1 --2- 172.21.15.114:0/2361368128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83c80722a0 0x7f83c815a030 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00c400 tx=0x7f83bc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:30.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.390+0000 7f83af7fe640 1 -- 172.21.15.114:0/2361368128 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc0052d0 con 0x7f83c80722a0 2024-04-28T13:08:30.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.391+0000 7f83af7fe640 1 -- 172.21.15.114:0/2361368128 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83bc005490 con 0x7f83c80722a0 2024-04-28T13:08:30.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.391+0000 7f83af7fe640 1 -- 172.21.15.114:0/2361368128 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc007260 con 0x7f83c80722a0 2024-04-28T13:08:30.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.391+0000 7f83cd379640 1 -- 172.21.15.114:0/2361368128 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83c806e480 con 0x7f83c80722a0 2024-04-28T13:08:30.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.391+0000 7f83cd379640 1 -- 172.21.15.114:0/2361368128 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83c806ea40 con 0x7f83c80722a0 2024-04-28T13:08:30.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.391+0000 7f83cd379640 1 -- 172.21.15.114:0/2361368128 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83c806a3d0 con 0x7f83c80722a0 2024-04-28T13:08:30.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.392+0000 7f83af7fe640 1 -- 172.21.15.114:0/2361368128 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f83bc007400 con 0x7f83c80722a0 2024-04-28T13:08:30.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.392+0000 7f83af7fe640 1 --2- 172.21.15.114:0/2361368128 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f83b406c980 0x7f83b406ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:30.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.392+0000 7f83af7fe640 1 -- 172.21.15.114:0/2361368128 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f83bc08b050 con 0x7f83c80722a0 2024-04-28T13:08:30.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.392+0000 7f83c6ffd640 1 --2- 172.21.15.114:0/2361368128 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f83b406c980 0x7f83b406ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:30.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.393+0000 7f83c6ffd640 1 --2- 172.21.15.114:0/2361368128 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f83b406c980 0x7f83b406ee40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f83b8006fd0 tx=0x7f83b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:30.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.397+0000 7f83af7fe640 1 -- 172.21.15.114:0/2361368128 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f83bc059520 con 0x7f83c80722a0 2024-04-28T13:08:30.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.573+0000 7f83cd379640 1 -- 172.21.15.114:0/2361368128 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83c80b6bd0 con 0x7f83c80722a0 2024-04-28T13:08:30.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.574+0000 7f83af7fe640 1 -- 172.21.15.114:0/2361368128 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16717 (secure 0 0 0) 0x7f83bc058e20 con 0x7f83c80722a0 2024-04-28T13:08:30.574 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:30.574 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":34,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:08:19.691257+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-28T13:08:16.244962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-28T13:08:16.991345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:08:30.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.576+0000 7f83cd379640 1 -- 172.21.15.114:0/2361368128 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f83b406c980 msgr2=0x7f83b406ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:30.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.576+0000 7f83cd379640 1 --2- 172.21.15.114:0/2361368128 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f83b406c980 0x7f83b406ee40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f83b8006fd0 tx=0x7f83b8008040 comp rx=0 tx=0).stop 2024-04-28T13:08:30.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.576+0000 7f83cd379640 1 -- 172.21.15.114:0/2361368128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83c80722a0 msgr2=0x7f83c815a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:30.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.576+0000 7f83cd379640 1 --2- 172.21.15.114:0/2361368128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83c80722a0 0x7f83c815a030 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00c400 tx=0x7f83bc00c8c0 comp rx=0 tx=0).stop 2024-04-28T13:08:30.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.576+0000 7f83cd379640 1 -- 172.21.15.114:0/2361368128 shutdown_connections 2024-04-28T13:08:30.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.576+0000 7f83cd379640 1 --2- 172.21.15.114:0/2361368128 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f83b406c980 0x7f83b406ee40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:30.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.576+0000 7f83cd379640 1 --2- 172.21.15.114:0/2361368128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83c80b73d0 0x7f83c815a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:30.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.576+0000 7f83cd379640 1 --2- 172.21.15.114:0/2361368128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83c80722a0 0x7f83c815a030 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:30.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.576+0000 7f83cd379640 1 --2- 172.21.15.114:0/2361368128 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83c8070710 0x7f83c81f4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:30.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.576+0000 7f83cd379640 1 -- 172.21.15.114:0/2361368128 >> 172.21.15.114:0/2361368128 conn(0x7f83c80b4c60 msgr2=0x7f83c80b5250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:30.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.576+0000 7f83cd379640 1 -- 172.21.15.114:0/2361368128 shutdown_connections 2024-04-28T13:08:30.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.576+0000 7f83cd379640 1 -- 172.21.15.114:0/2361368128 wait complete. 2024-04-28T13:08:30.587 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-28T13:07:14.721860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-28T13:08:16.244962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-28T13:08:16.991345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-28T13:08:30.588 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-28T13:08:30.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.689+0000 7fd0dcb9e640 1 Processor -- start 2024-04-28T13:08:30.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.689+0000 7fd0dcb9e640 1 -- start start 2024-04-28T13:08:30.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.690+0000 7fd0dcb9e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0d80d3e30 0x7fd0d80d5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:30.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.690+0000 7fd0dcb9e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd0d80d2f90 0x7fd0d80d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:30.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.690+0000 7fd0dcb9e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0d80d0080 con 0x7fd0d815f3c0 2024-04-28T13:08:30.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.690+0000 7fd0dcb9e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fd0d80d0360 con 0x7fd0d80d2f90 2024-04-28T13:08:30.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.690+0000 7fd0dcb9e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fd0d80d0640 con 0x7fd0d80d3e30 2024-04-28T13:08:30.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.690+0000 7fd0d7fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd0d80d2f90 0x7fd0d80d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:30.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.690+0000 7fd0d7fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd0d80d2f90 0x7fd0d80d18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42928/0 (socket says 172.21.15.114:42928) 2024-04-28T13:08:30.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.690+0000 7fd0d7fff640 1 -- 172.21.15.114:0/4072273786 learned_addr learned my addr 172.21.15.114:0/4072273786 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:30.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.690+0000 7fd0d6ffd640 1 --2- 172.21.15.114:0/4072273786 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0d80d3e30 0x7fd0d80d5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:30.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.690+0000 7fd0d7fff640 1 -- 172.21.15.114:0/4072273786 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0d80d3e30 msgr2=0x7fd0d80d5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:30.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.690+0000 7fd0d7fff640 1 --2- 172.21.15.114:0/4072273786 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0d80d3e30 0x7fd0d80d5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:30.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.690+0000 7fd0d7fff640 1 -- 172.21.15.114:0/4072273786 >> v1:172.21.15.134:6789/0 conn(0x7fd0d815f3c0 legacy=0x7fd0d80d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:30.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.690+0000 7fd0d7fff640 1 -- 172.21.15.114:0/4072273786 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d80d0920 con 0x7fd0d80d2f90 2024-04-28T13:08:30.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.691+0000 7fd0d7fff640 1 --2- 172.21.15.114:0/4072273786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0d80d2f90 0x7fd0d80d18e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0009e50 tx=0x7fd0d002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eff2519a5bd7960 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:30.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.691+0000 7fd0d67fc640 1 -- 172.21.15.114:0/4072273786 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d0036070 con 0x7fd0d80d2f90 2024-04-28T13:08:30.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.691+0000 7fd0d67fc640 1 -- 172.21.15.114:0/4072273786 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0d0031600 con 0x7fd0d80d2f90 2024-04-28T13:08:30.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.691+0000 7fd0d67fc640 1 -- 172.21.15.114:0/4072273786 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d00319d0 con 0x7fd0d80d2f90 2024-04-28T13:08:30.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.692+0000 7fd0dcb9e640 1 -- 172.21.15.114:0/4072273786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0d80d2f90 msgr2=0x7fd0d80d18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:30.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.692+0000 7fd0dcb9e640 1 --2- 172.21.15.114:0/4072273786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0d80d2f90 0x7fd0d80d18e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0009e50 tx=0x7fd0d002a710 comp rx=0 tx=0).stop 2024-04-28T13:08:30.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.692+0000 7fd0dcb9e640 1 -- 172.21.15.114:0/4072273786 shutdown_connections 2024-04-28T13:08:30.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.692+0000 7fd0dcb9e640 1 --2- 172.21.15.114:0/4072273786 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0d80d3e30 0x7fd0d80d5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:30.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.692+0000 7fd0dcb9e640 1 --2- 172.21.15.114:0/4072273786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0d80d2f90 0x7fd0d80d18e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:30.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.692+0000 7fd0dcb9e640 1 -- 172.21.15.114:0/4072273786 >> 172.21.15.114:0/4072273786 conn(0x7fd0d80d5140 msgr2=0x7fd0d80d5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:30.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.692+0000 7fd0dcb9e640 1 -- 172.21.15.114:0/4072273786 shutdown_connections 2024-04-28T13:08:30.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.692+0000 7fd0dcb9e640 1 -- 172.21.15.114:0/4072273786 wait complete. 2024-04-28T13:08:30.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.693+0000 7fd0dcb9e640 1 Processor -- start 2024-04-28T13:08:30.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.693+0000 7fd0dcb9e640 1 -- start start 2024-04-28T13:08:30.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.694+0000 7fd0dcb9e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0d80d2f90 0x7fd0d8159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:30.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.694+0000 7fd0dcb9e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0d80d3e30 0x7fd0d8153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:30.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.694+0000 7fd0dcb9e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0d815f3c0 0x7fd0d8159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:30.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.694+0000 7fd0dcb9e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d80cfe40 con 0x7fd0d80d3e30 2024-04-28T13:08:30.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.694+0000 7fd0dcb9e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d80cfcc0 con 0x7fd0d815f3c0 2024-04-28T13:08:30.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.694+0000 7fd0dcb9e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fd0d815f7a0 con 0x7fd0d80d2f90 2024-04-28T13:08:30.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.694+0000 7fd0d6ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0d80d3e30 0x7fd0d8153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:30.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.694+0000 7fd0d6ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0d80d3e30 0x7fd0d8153750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42934/0 (socket says 172.21.15.114:42934) 2024-04-28T13:08:30.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.694+0000 7fd0d6ffd640 1 -- 172.21.15.114:0/3967863738 learned_addr learned my addr 172.21.15.114:0/3967863738 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:30.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.694+0000 7fd0d7fff640 1 --2- 172.21.15.114:0/3967863738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0d815f3c0 0x7fd0d8159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:30.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.694+0000 7fd0d77fe640 1 --2- 172.21.15.114:0/3967863738 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0d80d2f90 0x7fd0d8159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.694+0000 7fd0d6ffd640 1 -- 172.21.15.114:0/3967863738 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0d80d2f90 msgr2=0x7fd0d8159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.694+0000 7fd0d6ffd640 1 --2- 172.21.15.114:0/3967863738 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0d80d2f90 0x7fd0d8159770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.694+0000 7fd0d6ffd640 1 -- 172.21.15.114:0/3967863738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0d815f3c0 msgr2=0x7fd0d8159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.694+0000 7fd0d6ffd640 1 --2- 172.21.15.114:0/3967863738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0d815f3c0 0x7fd0d8159f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.694+0000 7fd0d6ffd640 1 -- 172.21.15.114:0/3967863738 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d81586d0 con 0x7fd0d80d3e30 2024-04-28T13:08:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.694+0000 7fd0d7fff640 1 --2- 172.21.15.114:0/3967863738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0d815f3c0 0x7fd0d8159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.694+0000 7fd0d77fe640 1 --2- 172.21.15.114:0/3967863738 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0d80d2f90 0x7fd0d8159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.694+0000 7fd0d6ffd640 1 --2- 172.21.15.114:0/3967863738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0d80d3e30 0x7fd0d8153750 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc00e8a0 tx=0x7fd0cc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.694+0000 7fd0bffff640 1 -- 172.21.15.114:0/3967863738 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc017070 con 0x7fd0d80d3e30 2024-04-28T13:08:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.694+0000 7fd0bffff640 1 -- 172.21.15.114:0/3967863738 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0cc00c940 con 0x7fd0d80d3e30 2024-04-28T13:08:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.695+0000 7fd0bffff640 1 -- 172.21.15.114:0/3967863738 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc00cd30 con 0x7fd0d80d3e30 2024-04-28T13:08:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.695+0000 7fd0dcb9e640 1 -- 172.21.15.114:0/3967863738 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0d81589b0 con 0x7fd0d80d3e30 2024-04-28T13:08:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.695+0000 7fd0dcb9e640 1 -- 172.21.15.114:0/3967863738 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0d8158f70 con 0x7fd0d80d3e30 2024-04-28T13:08:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.696+0000 7fd0dcb9e640 1 -- 172.21.15.114:0/3967863738 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0d8076830 con 0x7fd0d80d3e30 2024-04-28T13:08:30.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.696+0000 7fd0bffff640 1 -- 172.21.15.114:0/3967863738 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7fd0cc01a070 con 0x7fd0d80d3e30 2024-04-28T13:08:30.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.696+0000 7fd0bffff640 1 --2- 172.21.15.114:0/3967863738 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd0c406c980 0x7fd0c406ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:30.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.696+0000 7fd0bffff640 1 -- 172.21.15.114:0/3967863738 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd0cc08be60 con 0x7fd0d80d3e30 2024-04-28T13:08:30.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.696+0000 7fd0d77fe640 1 --2- 172.21.15.114:0/3967863738 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd0c406c980 0x7fd0c406ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:30.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.697+0000 7fd0d77fe640 1 --2- 172.21.15.114:0/3967863738 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd0c406c980 0x7fd0c406ee40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8007fd0 tx=0x7fd0c8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:30.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.701+0000 7fd0bffff640 1 -- 172.21.15.114:0/3967863738 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd0cc05a210 con 0x7fd0d80d3e30 2024-04-28T13:08:30.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.882+0000 7fd0dcb9e640 1 -- 172.21.15.114:0/3967863738 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd0d80d3500 con 0x7fd0d80d3e30 2024-04-28T13:08:30.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.883+0000 7fd0bffff640 1 -- 172.21.15.114:0/3967863738 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) ==== 93+0+10 (secure 0 0 0) 0x7fd0cc059b10 con 0x7fd0d80d3e30 2024-04-28T13:08:30.883 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-28T13:08:30.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.885+0000 7fd0dcb9e640 1 -- 172.21.15.114:0/3967863738 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd0c406c980 msgr2=0x7fd0c406ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:30.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.885+0000 7fd0dcb9e640 1 --2- 172.21.15.114:0/3967863738 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd0c406c980 0x7fd0c406ee40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8007fd0 tx=0x7fd0c8009040 comp rx=0 tx=0).stop 2024-04-28T13:08:30.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.885+0000 7fd0dcb9e640 1 -- 172.21.15.114:0/3967863738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0d80d3e30 msgr2=0x7fd0d8153750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:30.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.885+0000 7fd0dcb9e640 1 --2- 172.21.15.114:0/3967863738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0d80d3e30 0x7fd0d8153750 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc00e8a0 tx=0x7fd0cc00ed60 comp rx=0 tx=0).stop 2024-04-28T13:08:30.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.885+0000 7fd0dcb9e640 1 -- 172.21.15.114:0/3967863738 shutdown_connections 2024-04-28T13:08:30.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.885+0000 7fd0dcb9e640 1 --2- 172.21.15.114:0/3967863738 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd0c406c980 0x7fd0c406ee40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:30.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.885+0000 7fd0dcb9e640 1 --2- 172.21.15.114:0/3967863738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0d815f3c0 0x7fd0d8159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:30.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.885+0000 7fd0dcb9e640 1 --2- 172.21.15.114:0/3967863738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0d80d3e30 0x7fd0d8153750 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:30.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.885+0000 7fd0dcb9e640 1 --2- 172.21.15.114:0/3967863738 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0d80d2f90 0x7fd0d8159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:30.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.885+0000 7fd0dcb9e640 1 -- 172.21.15.114:0/3967863738 >> 172.21.15.114:0/3967863738 conn(0x7fd0d80d5140 msgr2=0x7fd0d806e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:30.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.885+0000 7fd0dcb9e640 1 -- 172.21.15.114:0/3967863738 shutdown_connections 2024-04-28T13:08:30.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.885+0000 7fd0dcb9e640 1 -- 172.21.15.114:0/3967863738 wait complete. 2024-04-28T13:08:30.896 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-28T13:08:30.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.996+0000 7fdc50683640 1 Processor -- start 2024-04-28T13:08:30.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.996+0000 7fdc50683640 1 -- start start 2024-04-28T13:08:30.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.997+0000 7fdc50683640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdc480baf40 0x7fdc480d5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:30.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.997+0000 7fdc50683640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc480d2a40 con 0x7fdc4815f430 2024-04-28T13:08:30.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.997+0000 7fdc50683640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc480d2480 con 0x7fdc480d56a0 2024-04-28T13:08:30.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.997+0000 7fdc50683640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fdc4815f810 con 0x7fdc480baf40 2024-04-28T13:08:30.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.997+0000 7fdc4dc1e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdc480baf40 0x7fdc480d5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:30.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.997+0000 7fdc4dc1e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdc480baf40 0x7fdc480d5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42948/0 (socket says 172.21.15.114:42948) 2024-04-28T13:08:30.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.997+0000 7fdc4dc1e640 1 -- 172.21.15.114:0/2391139451 learned_addr learned my addr 172.21.15.114:0/2391139451 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:30.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.997+0000 7fdc4e41f640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fdc4815f430 0x7fdc480d1a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:54338/0 (socket says 172.21.15.114:54338) 2024-04-28T13:08:30.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.998+0000 7fdc4dc1e640 1 -- 172.21.15.114:0/2391139451 >> v1:172.21.15.134:6789/0 conn(0x7fdc480d56a0 legacy=0x7fdc480d3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:30.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.998+0000 7fdc4dc1e640 1 -- 172.21.15.114:0/2391139451 >> v1:172.21.15.114:6789/0 conn(0x7fdc4815f430 legacy=0x7fdc480d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:30.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.998+0000 7fdc4d41d640 1 -- 172.21.15.114:0/2391139451 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1098258295 0 0) 0x7fdc480d2a40 con 0x7fdc4815f430 2024-04-28T13:08:30.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.998+0000 7fdc4dc1e640 1 -- 172.21.15.114:0/2391139451 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc480d2760 con 0x7fdc480baf40 2024-04-28T13:08:30.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.998+0000 7fdc4dc1e640 1 --2- 172.21.15.114:0/2391139451 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc480baf40 0x7fdc480d5160 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fdc38009870 tx=0x7fdc3802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9510712f00ae2908 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:31.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.999+0000 7fdc4d41d640 1 -- 172.21.15.114:0/2391139451 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc38037070 con 0x7fdc480baf40 2024-04-28T13:08:31.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.999+0000 7fdc4d41d640 1 -- 172.21.15.114:0/2391139451 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc38032440 con 0x7fdc480baf40 2024-04-28T13:08:31.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.999+0000 7fdc4d41d640 1 -- 172.21.15.114:0/2391139451 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc38032810 con 0x7fdc480baf40 2024-04-28T13:08:31.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.999+0000 7fdc50683640 1 -- 172.21.15.114:0/2391139451 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc480baf40 msgr2=0x7fdc480d5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:31.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.999+0000 7fdc50683640 1 --2- 172.21.15.114:0/2391139451 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc480baf40 0x7fdc480d5160 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fdc38009870 tx=0x7fdc3802a2a0 comp rx=0 tx=0).stop 2024-04-28T13:08:31.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.999+0000 7fdc50683640 1 -- 172.21.15.114:0/2391139451 shutdown_connections 2024-04-28T13:08:31.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.999+0000 7fdc50683640 1 --2- 172.21.15.114:0/2391139451 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc480baf40 0x7fdc480d5160 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:31.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.999+0000 7fdc50683640 1 -- 172.21.15.114:0/2391139451 >> 172.21.15.114:0/2391139451 conn(0x7fdc480633a0 msgr2=0x7fdc4806d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:31.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.999+0000 7fdc50683640 1 -- 172.21.15.114:0/2391139451 shutdown_connections 2024-04-28T13:08:31.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:30.999+0000 7fdc50683640 1 -- 172.21.15.114:0/2391139451 wait complete. 2024-04-28T13:08:31.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.000+0000 7fdc50683640 1 Processor -- start 2024-04-28T13:08:31.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.000+0000 7fdc50683640 1 -- start start 2024-04-28T13:08:31.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.001+0000 7fdc50683640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc480baf40 0x7fdc48147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:31.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.001+0000 7fdc50683640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc480d56a0 0x7fdc48157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:31.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.001+0000 7fdc50683640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc4815f430 0x7fdc480cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:31.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.001+0000 7fdc50683640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdc480d36d0 con 0x7fdc4815f430 2024-04-28T13:08:31.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.001+0000 7fdc50683640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdc480d5af0 con 0x7fdc480baf40 2024-04-28T13:08:31.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.001+0000 7fdc50683640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fdc480d2190 con 0x7fdc480d56a0 2024-04-28T13:08:31.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.001+0000 7fdc4ec20640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc4815f430 0x7fdc480cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:31.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.001+0000 7fdc4ec20640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc4815f430 0x7fdc480cb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42960/0 (socket says 172.21.15.114:42960) 2024-04-28T13:08:31.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.001+0000 7fdc4ec20640 1 -- 172.21.15.114:0/4191952578 learned_addr learned my addr 172.21.15.114:0/4191952578 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:31.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.001+0000 7fdc4e41f640 1 --2- 172.21.15.114:0/4191952578 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc480baf40 0x7fdc48147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:31.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.001+0000 7fdc4dc1e640 1 --2- 172.21.15.114:0/4191952578 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc480d56a0 0x7fdc48157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:31.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.001+0000 7fdc4ec20640 1 -- 172.21.15.114:0/4191952578 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc480d56a0 msgr2=0x7fdc48157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:31.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.001+0000 7fdc4ec20640 1 --2- 172.21.15.114:0/4191952578 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc480d56a0 0x7fdc48157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:31.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.001+0000 7fdc4ec20640 1 -- 172.21.15.114:0/4191952578 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc480baf40 msgr2=0x7fdc48147bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:31.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.001+0000 7fdc4ec20640 1 --2- 172.21.15.114:0/4191952578 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc480baf40 0x7fdc48147bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:31.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.001+0000 7fdc4ec20640 1 -- 172.21.15.114:0/4191952578 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc480ca4d0 con 0x7fdc4815f430 2024-04-28T13:08:31.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.002+0000 7fdc4ec20640 1 --2- 172.21.15.114:0/4191952578 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc4815f430 0x7fdc480cb530 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fdc4000c780 tx=0x7fdc4000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:31.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.002+0000 7fdc3effd640 1 -- 172.21.15.114:0/4191952578 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc40004b60 con 0x7fdc4815f430 2024-04-28T13:08:31.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.002+0000 7fdc3effd640 1 -- 172.21.15.114:0/4191952578 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc40004d00 con 0x7fdc4815f430 2024-04-28T13:08:31.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.002+0000 7fdc50683640 1 -- 172.21.15.114:0/4191952578 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc48148130 con 0x7fdc4815f430 2024-04-28T13:08:31.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.002+0000 7fdc3effd640 1 -- 172.21.15.114:0/4191952578 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4000aa90 con 0x7fdc4815f430 2024-04-28T13:08:31.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.002+0000 7fdc50683640 1 -- 172.21.15.114:0/4191952578 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc480caa50 con 0x7fdc4815f430 2024-04-28T13:08:31.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.003+0000 7fdc50683640 1 -- 172.21.15.114:0/4191952578 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc4806a3d0 con 0x7fdc4815f430 2024-04-28T13:08:31.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.003+0000 7fdc3effd640 1 -- 172.21.15.114:0/4191952578 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7fdc4000ac30 con 0x7fdc4815f430 2024-04-28T13:08:31.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.003+0000 7fdc3effd640 1 --2- 172.21.15.114:0/4191952578 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fdc2c06c980 0x7fdc2c06ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:31.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.004+0000 7fdc3effd640 1 -- 172.21.15.114:0/4191952578 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fdc4008bdc0 con 0x7fdc4815f430 2024-04-28T13:08:31.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.004+0000 7fdc4e41f640 1 --2- 172.21.15.114:0/4191952578 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fdc2c06c980 0x7fdc2c06ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:31.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.004+0000 7fdc4e41f640 1 --2- 172.21.15.114:0/4191952578 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fdc2c06c980 0x7fdc2c06ee40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdc44007fd0 tx=0x7fdc44007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:31.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.008+0000 7fdc3effd640 1 -- 172.21.15.114:0/4191952578 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fdc40020070 con 0x7fdc4815f430 2024-04-28T13:08:31.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.181+0000 7fdc50683640 1 -- 172.21.15.114:0/4191952578 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fdc4806d7b0 con 0x7fdc4815f430 2024-04-28T13:08:31.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.181+0000 7fdc3effd640 1 -- 172.21.15.114:0/4191952578 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) ==== 104+0+11 (secure 0 0 0) 0x7fdc40059b20 con 0x7fdc4815f430 2024-04-28T13:08:31.181 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-04-28T13:08:31.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.183+0000 7fdc50683640 1 -- 172.21.15.114:0/4191952578 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fdc2c06c980 msgr2=0x7fdc2c06ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:31.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.183+0000 7fdc50683640 1 --2- 172.21.15.114:0/4191952578 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fdc2c06c980 0x7fdc2c06ee40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdc44007fd0 tx=0x7fdc44007de0 comp rx=0 tx=0).stop 2024-04-28T13:08:31.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.183+0000 7fdc50683640 1 -- 172.21.15.114:0/4191952578 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc4815f430 msgr2=0x7fdc480cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:31.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.183+0000 7fdc50683640 1 --2- 172.21.15.114:0/4191952578 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc4815f430 0x7fdc480cb530 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fdc4000c780 tx=0x7fdc4000cc40 comp rx=0 tx=0).stop 2024-04-28T13:08:31.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.183+0000 7fdc50683640 1 -- 172.21.15.114:0/4191952578 shutdown_connections 2024-04-28T13:08:31.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.183+0000 7fdc50683640 1 --2- 172.21.15.114:0/4191952578 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc4815f430 0x7fdc480cb530 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:31.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.183+0000 7fdc50683640 1 --2- 172.21.15.114:0/4191952578 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc480d56a0 0x7fdc48157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:31.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.183+0000 7fdc50683640 1 --2- 172.21.15.114:0/4191952578 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fdc2c06c980 0x7fdc2c06ee40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:31.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.183+0000 7fdc50683640 1 --2- 172.21.15.114:0/4191952578 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc480baf40 0x7fdc48147bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:31.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.183+0000 7fdc50683640 1 -- 172.21.15.114:0/4191952578 >> 172.21.15.114:0/4191952578 conn(0x7fdc480633a0 msgr2=0x7fdc480b9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:31.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.183+0000 7fdc50683640 1 -- 172.21.15.114:0/4191952578 shutdown_connections 2024-04-28T13:08:31.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.183+0000 7fdc50683640 1 -- 172.21.15.114:0/4191952578 wait complete. 2024-04-28T13:08:31.193 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-28T13:08:31.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.292+0000 7f85054d1640 1 Processor -- start 2024-04-28T13:08:31.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.292+0000 7f85054d1640 1 -- start start 2024-04-28T13:08:31.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.293+0000 7f85054d1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f850015f430 0x7f85000d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:31.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.293+0000 7f85054d1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f85000d5870 0x7f85000d3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:31.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.293+0000 7f85054d1640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85000d2a40 con 0x7f85000d1fc0 2024-04-28T13:08:31.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.293+0000 7f85054d1640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f850015f810 con 0x7f850015f430 2024-04-28T13:08:31.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.293+0000 7f85054d1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f85000d36d0 con 0x7f85000d5870 2024-04-28T13:08:31.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.293+0000 7f84ff7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f85000d5870 0x7f85000d3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:31.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.293+0000 7f84feffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f850015f430 0x7f85000d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:31.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.293+0000 7f84feffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f850015f430 0x7f85000d1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:43316/0 (socket says 172.21.15.114:43316) 2024-04-28T13:08:31.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.293+0000 7f84ff7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f85000d5870 0x7f85000d3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:45758/0 (socket says 172.21.15.114:45758) 2024-04-28T13:08:31.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.293+0000 7f84feffd640 1 -- 172.21.15.114:0/2306092549 learned_addr learned my addr 172.21.15.114:0/2306092549 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:31.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.293+0000 7f84fe7fc640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f85000d1fc0 0x7f85000d5160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:45366/0 (socket says 172.21.15.114:45366) 2024-04-28T13:08:31.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.293+0000 7f84feffd640 1 -- 172.21.15.114:0/2306092549 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f85000d5870 msgr2=0x7f85000d3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:31.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.293+0000 7f84feffd640 1 --2- 172.21.15.114:0/2306092549 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f85000d5870 0x7f85000d3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:31.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.293+0000 7f84feffd640 1 -- 172.21.15.114:0/2306092549 >> v1:172.21.15.134:6789/0 conn(0x7f85000d1fc0 legacy=0x7f85000d5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:31.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.293+0000 7f84feffd640 1 -- 172.21.15.114:0/2306092549 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85000d2480 con 0x7f850015f430 2024-04-28T13:08:31.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.293+0000 7f84ff7fe640 1 --2- 172.21.15.114:0/2306092549 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f85000d5870 0x7f85000d3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:08:31.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.294+0000 7f84feffd640 1 --2- 172.21.15.114:0/2306092549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f850015f430 0x7f85000d1a80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f84f0009e50 tx=0x7f84f002a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25a5077bd489061c server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:31.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.294+0000 7f84fdffb640 1 -- 172.21.15.114:0/2306092549 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f0036070 con 0x7f850015f430 2024-04-28T13:08:31.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.294+0000 7f84fdffb640 1 -- 172.21.15.114:0/2306092549 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84f0031600 con 0x7f850015f430 2024-04-28T13:08:31.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.294+0000 7f84fdffb640 1 -- 172.21.15.114:0/2306092549 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f00319d0 con 0x7f850015f430 2024-04-28T13:08:31.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.295+0000 7f85054d1640 1 -- 172.21.15.114:0/2306092549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f850015f430 msgr2=0x7f85000d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:31.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.295+0000 7f85054d1640 1 --2- 172.21.15.114:0/2306092549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f850015f430 0x7f85000d1a80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f84f0009e50 tx=0x7f84f002a710 comp rx=0 tx=0).stop 2024-04-28T13:08:31.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.295+0000 7f85054d1640 1 -- 172.21.15.114:0/2306092549 shutdown_connections 2024-04-28T13:08:31.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.295+0000 7f85054d1640 1 --2- 172.21.15.114:0/2306092549 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f85000d5870 0x7f85000d3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:31.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.295+0000 7f85054d1640 1 --2- 172.21.15.114:0/2306092549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f850015f430 0x7f85000d1a80 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:31.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.295+0000 7f85054d1640 1 -- 172.21.15.114:0/2306092549 >> 172.21.15.114:0/2306092549 conn(0x7f85000633a0 msgr2=0x7f850006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:31.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.295+0000 7f85054d1640 1 -- 172.21.15.114:0/2306092549 shutdown_connections 2024-04-28T13:08:31.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.295+0000 7f85054d1640 1 -- 172.21.15.114:0/2306092549 wait complete. 2024-04-28T13:08:31.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.296+0000 7f85054d1640 1 Processor -- start 2024-04-28T13:08:31.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.296+0000 7f85054d1640 1 -- start start 2024-04-28T13:08:31.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.297+0000 7f85054d1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85000d1fc0 0x7f85000cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:31.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.297+0000 7f85054d1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85000d5870 0x7f85001ead70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:31.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.297+0000 7f85054d1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f850015f430 0x7f85001eb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:31.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.297+0000 7f85054d1640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f85000baf40 con 0x7f85000d1fc0 2024-04-28T13:08:31.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.297+0000 7f85054d1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f85000d3360 con 0x7f85000d5870 2024-04-28T13:08:31.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.297+0000 7f85054d1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f85000bb0c0 con 0x7f850015f430 2024-04-28T13:08:31.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.297+0000 7f84feffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85000d1fc0 0x7f85000cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:31.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.297+0000 7f84feffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85000d1fc0 0x7f85000cc6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42972/0 (socket says 172.21.15.114:42972) 2024-04-28T13:08:31.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.297+0000 7f84feffd640 1 -- 172.21.15.114:0/401690919 learned_addr learned my addr 172.21.15.114:0/401690919 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:31.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.297+0000 7f84ff7fe640 1 --2- 172.21.15.114:0/401690919 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f850015f430 0x7f85001eb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:31.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.297+0000 7f84fe7fc640 1 --2- 172.21.15.114:0/401690919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85000d5870 0x7f85001ead70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:31.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.297+0000 7f84feffd640 1 -- 172.21.15.114:0/401690919 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f850015f430 msgr2=0x7f85001eb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:31.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.297+0000 7f84feffd640 1 --2- 172.21.15.114:0/401690919 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f850015f430 0x7f85001eb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:31.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.297+0000 7f84feffd640 1 -- 172.21.15.114:0/401690919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85000d5870 msgr2=0x7f85001ead70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:31.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.297+0000 7f84feffd640 1 --2- 172.21.15.114:0/401690919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85000d5870 0x7f85001ead70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:31.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.297+0000 7f84feffd640 1 -- 172.21.15.114:0/401690919 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85000c96c0 con 0x7f85000d1fc0 2024-04-28T13:08:31.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.298+0000 7f84feffd640 1 --2- 172.21.15.114:0/401690919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85000d1fc0 0x7f85000cc6d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f84f0034040 tx=0x7f84f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:31.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.298+0000 7f84e77fe640 1 -- 172.21.15.114:0/401690919 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f0036050 con 0x7f85000d1fc0 2024-04-28T13:08:31.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.298+0000 7f84e77fe640 1 -- 172.21.15.114:0/401690919 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84f0042070 con 0x7f85000d1fc0 2024-04-28T13:08:31.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.298+0000 7f85054d1640 1 -- 172.21.15.114:0/401690919 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85000c99a0 con 0x7f85000d1fc0 2024-04-28T13:08:31.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.298+0000 7f84e77fe640 1 -- 172.21.15.114:0/401690919 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f0009510 con 0x7f85000d1fc0 2024-04-28T13:08:31.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.298+0000 7f85054d1640 1 -- 172.21.15.114:0/401690919 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85000c9f60 con 0x7f85000d1fc0 2024-04-28T13:08:31.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.299+0000 7f85054d1640 1 -- 172.21.15.114:0/401690919 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8500075c40 con 0x7f85000d1fc0 2024-04-28T13:08:31.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.299+0000 7f84e77fe640 1 -- 172.21.15.114:0/401690919 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f84f0007c70 con 0x7f85000d1fc0 2024-04-28T13:08:31.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.299+0000 7f84e77fe640 1 --2- 172.21.15.114:0/401690919 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f84ec06c980 0x7f84ec06ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:31.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.300+0000 7f84e77fe640 1 -- 172.21.15.114:0/401690919 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f84f00aca00 con 0x7f85000d1fc0 2024-04-28T13:08:31.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.300+0000 7f84fe7fc640 1 --2- 172.21.15.114:0/401690919 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f84ec06c980 0x7f84ec06ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:31.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.300+0000 7f84fe7fc640 1 --2- 172.21.15.114:0/401690919 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f84ec06c980 0x7f84ec06ee40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f85000cc3c0 tx=0x7f84f4007e20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:31.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.304+0000 7f84e77fe640 1 -- 172.21.15.114:0/401690919 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f84f007acb0 con 0x7f85000d1fc0 2024-04-28T13:08:31.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.477+0000 7f85054d1640 1 -- 172.21.15.114:0/401690919 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f850006a3d0 con 0x7f85000d1fc0 2024-04-28T13:08:31.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.478+0000 7f84e77fe640 1 -- 172.21.15.114:0/401690919 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) ==== 100+0+11 (secure 0 0 0) 0x7f84f007a5b0 con 0x7f85000d1fc0 2024-04-28T13:08:31.478 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-04-28T13:08:31.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.480+0000 7f85054d1640 1 -- 172.21.15.114:0/401690919 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f84ec06c980 msgr2=0x7f84ec06ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:31.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.480+0000 7f85054d1640 1 --2- 172.21.15.114:0/401690919 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f84ec06c980 0x7f84ec06ee40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f85000cc3c0 tx=0x7f84f4007e20 comp rx=0 tx=0).stop 2024-04-28T13:08:31.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.480+0000 7f85054d1640 1 -- 172.21.15.114:0/401690919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85000d1fc0 msgr2=0x7f85000cc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:31.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.480+0000 7f85054d1640 1 --2- 172.21.15.114:0/401690919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85000d1fc0 0x7f85000cc6d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f84f0034040 tx=0x7f84f0004a40 comp rx=0 tx=0).stop 2024-04-28T13:08:31.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.480+0000 7f85054d1640 1 -- 172.21.15.114:0/401690919 shutdown_connections 2024-04-28T13:08:31.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.480+0000 7f85054d1640 1 --2- 172.21.15.114:0/401690919 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f850015f430 0x7f85001eb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:31.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.480+0000 7f85054d1640 1 --2- 172.21.15.114:0/401690919 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f84ec06c980 0x7f84ec06ee40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:31.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.480+0000 7f85054d1640 1 --2- 172.21.15.114:0/401690919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85000d5870 0x7f85001ead70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:31.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.480+0000 7f85054d1640 1 --2- 172.21.15.114:0/401690919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85000d1fc0 0x7f85000cc6d0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:31.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.480+0000 7f85054d1640 1 -- 172.21.15.114:0/401690919 >> 172.21.15.114:0/401690919 conn(0x7f85000633a0 msgr2=0x7f8500161b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:31.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.480+0000 7f85054d1640 1 -- 172.21.15.114:0/401690919 shutdown_connections 2024-04-28T13:08:31.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.480+0000 7f85054d1640 1 -- 172.21.15.114:0/401690919 wait complete. 2024-04-28T13:08:31.490 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-28T13:08:31.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.589+0000 7f7d02828640 1 Processor -- start 2024-04-28T13:08:31.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.589+0000 7f7d02828640 1 -- start start 2024-04-28T13:08:31.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.589+0000 7f7d02828640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7cfc09b9e0 0x7f7cfc09bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:31.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.589+0000 7f7d02828640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7cfc15fa10 0x7f7cfc0cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:31.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.589+0000 7f7d02828640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7cfc06ea40 0x7f7cfc0d24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:31.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.589+0000 7f7d02828640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f7cfc0d2050 con 0x7f7cfc09b9e0 2024-04-28T13:08:31.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.589+0000 7f7d02828640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f7cfc0d1480 con 0x7f7cfc15fa10 2024-04-28T13:08:31.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.589+0000 7f7d02828640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f7cfc09c300 con 0x7f7cfc06ea40 2024-04-28T13:08:31.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.590+0000 7f7cfbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7cfc09b9e0 0x7f7cfc09bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:31.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.590+0000 7f7cfbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7cfc09b9e0 0x7f7cfc09bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42984/0 (socket says 172.21.15.114:42984) 2024-04-28T13:08:31.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.590+0000 7f7cfbfff640 1 -- 172.21.15.114:0/2945460409 learned_addr learned my addr 172.21.15.114:0/2945460409 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:31.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.590+0000 7f7cfb7fe640 1 --2- 172.21.15.114:0/2945460409 >> v2:172.21.15.134:3300/0 conn(0x7f7cfc15fa10 0x7f7cfc0cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:31.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.590+0000 7f7d00dc5640 1 --2- 172.21.15.114:0/2945460409 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7cfc06ea40 0x7f7cfc0d24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:31.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.590+0000 7f7cfbfff640 1 -- 172.21.15.114:0/2945460409 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7cfc06ea40 msgr2=0x7f7cfc0d24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:31.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.590+0000 7f7cfbfff640 1 --2- 172.21.15.114:0/2945460409 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7cfc06ea40 0x7f7cfc0d24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:31.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.590+0000 7f7cfbfff640 1 -- 172.21.15.114:0/2945460409 >> v2:172.21.15.134:3300/0 conn(0x7f7cfc15fa10 msgr2=0x7f7cfc0cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:31.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.590+0000 7f7cfbfff640 1 --2- 172.21.15.114:0/2945460409 >> v2:172.21.15.134:3300/0 conn(0x7f7cfc15fa10 0x7f7cfc0cd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:31.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.590+0000 7f7cfbfff640 1 -- 172.21.15.114:0/2945460409 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cfc0d1720 con 0x7f7cfc09b9e0 2024-04-28T13:08:31.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.590+0000 7f7d00dc5640 1 --2- 172.21.15.114:0/2945460409 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7cfc06ea40 0x7f7cfc0d24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:31.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.590+0000 7f7cfbfff640 1 --2- 172.21.15.114:0/2945460409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cfc09b9e0 0x7f7cfc09bdc0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc073a30 tx=0x7f7cec02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d736165ae32d05a server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:31.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.591+0000 7f7cfaffd640 1 -- 172.21.15.114:0/2945460409 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec037070 con 0x7f7cfc09b9e0 2024-04-28T13:08:31.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.591+0000 7f7cfaffd640 1 -- 172.21.15.114:0/2945460409 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cec032440 con 0x7f7cfc09b9e0 2024-04-28T13:08:31.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.591+0000 7f7cfaffd640 1 -- 172.21.15.114:0/2945460409 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec032810 con 0x7f7cfc09b9e0 2024-04-28T13:08:31.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.591+0000 7f7d02828640 1 -- 172.21.15.114:0/2945460409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cfc09b9e0 msgr2=0x7f7cfc09bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:31.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.591+0000 7f7d02828640 1 --2- 172.21.15.114:0/2945460409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cfc09b9e0 0x7f7cfc09bdc0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc073a30 tx=0x7f7cec02a1e0 comp rx=0 tx=0).stop 2024-04-28T13:08:31.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.591+0000 7f7d02828640 1 -- 172.21.15.114:0/2945460409 shutdown_connections 2024-04-28T13:08:31.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.591+0000 7f7d02828640 1 --2- 172.21.15.114:0/2945460409 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7cfc06ea40 0x7f7cfc0d24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:31.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.591+0000 7f7d02828640 1 --2- 172.21.15.114:0/2945460409 >> v2:172.21.15.134:3300/0 conn(0x7f7cfc15fa10 0x7f7cfc0cd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:31.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.591+0000 7f7d02828640 1 --2- 172.21.15.114:0/2945460409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cfc09b9e0 0x7f7cfc09bdc0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:31.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.591+0000 7f7d02828640 1 -- 172.21.15.114:0/2945460409 >> 172.21.15.114:0/2945460409 conn(0x7f7cfc0b4a50 msgr2=0x7f7cfc0b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:31.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.591+0000 7f7d02828640 1 -- 172.21.15.114:0/2945460409 shutdown_connections 2024-04-28T13:08:31.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.591+0000 7f7d02828640 1 -- 172.21.15.114:0/2945460409 wait complete. 2024-04-28T13:08:31.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.592+0000 7f7d02828640 1 Processor -- start 2024-04-28T13:08:31.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.593+0000 7f7d02828640 1 -- start start 2024-04-28T13:08:31.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.593+0000 7f7d02828640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cfc06ea40 0x7f7cfc160d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:31.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.593+0000 7f7d02828640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7cfc09b9e0 0x7f7cfc158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:31.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.593+0000 7f7d02828640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cfc15fa10 0x7f7cfc071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:31.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.593+0000 7f7d02828640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7cfc0b2350 con 0x7f7cfc06ea40 2024-04-28T13:08:31.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.593+0000 7f7d02828640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7cfc0d1ce0 con 0x7f7cfc15fa10 2024-04-28T13:08:31.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.593+0000 7f7d02828640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f7cfc0b24d0 con 0x7f7cfc09b9e0 2024-04-28T13:08:31.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.593+0000 7f7cfbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cfc06ea40 0x7f7cfc160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:31.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.593+0000 7f7cfbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cfc06ea40 0x7f7cfc160d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42994/0 (socket says 172.21.15.114:42994) 2024-04-28T13:08:31.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.593+0000 7f7cfbfff640 1 -- 172.21.15.114:0/3911700337 learned_addr learned my addr 172.21.15.114:0/3911700337 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:31.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.593+0000 7f7d00dc5640 1 --2- 172.21.15.114:0/3911700337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cfc15fa10 0x7f7cfc071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:31.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.593+0000 7f7cfb7fe640 1 --2- 172.21.15.114:0/3911700337 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7cfc09b9e0 0x7f7cfc158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:31.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.594+0000 7f7cfbfff640 1 -- 172.21.15.114:0/3911700337 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7cfc09b9e0 msgr2=0x7f7cfc158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:31.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.594+0000 7f7cfbfff640 1 --2- 172.21.15.114:0/3911700337 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7cfc09b9e0 0x7f7cfc158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:31.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.594+0000 7f7cfbfff640 1 -- 172.21.15.114:0/3911700337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cfc15fa10 msgr2=0x7f7cfc071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:31.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.594+0000 7f7cfbfff640 1 --2- 172.21.15.114:0/3911700337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cfc15fa10 0x7f7cfc071550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:31.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.594+0000 7f7cfbfff640 1 -- 172.21.15.114:0/3911700337 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cfc161430 con 0x7f7cfc06ea40 2024-04-28T13:08:31.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.594+0000 7f7cfbfff640 1 --2- 172.21.15.114:0/3911700337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cfc06ea40 0x7f7cfc160d90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7cec02a220 tx=0x7f7cec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:31.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.594+0000 7f7cf8ff9640 1 -- 172.21.15.114:0/3911700337 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec037040 con 0x7f7cfc06ea40 2024-04-28T13:08:31.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.594+0000 7f7cf8ff9640 1 -- 172.21.15.114:0/3911700337 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cec042070 con 0x7f7cfc06ea40 2024-04-28T13:08:31.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.594+0000 7f7d02828640 1 -- 172.21.15.114:0/3911700337 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cfc161710 con 0x7f7cfc06ea40 2024-04-28T13:08:31.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.594+0000 7f7cf8ff9640 1 -- 172.21.15.114:0/3911700337 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec030880 con 0x7f7cfc06ea40 2024-04-28T13:08:31.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.594+0000 7f7d02828640 1 -- 172.21.15.114:0/3911700337 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cfc161cd0 con 0x7f7cfc06ea40 2024-04-28T13:08:31.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.595+0000 7f7d02828640 1 -- 172.21.15.114:0/3911700337 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cfc06a3d0 con 0x7f7cfc06ea40 2024-04-28T13:08:31.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.596+0000 7f7cf8ff9640 1 -- 172.21.15.114:0/3911700337 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f7cec030a20 con 0x7f7cfc06ea40 2024-04-28T13:08:31.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.596+0000 7f7cf8ff9640 1 --2- 172.21.15.114:0/3911700337 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7ce806c980 0x7f7ce806ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:31.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.596+0000 7f7cf8ff9640 1 -- 172.21.15.114:0/3911700337 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f7cec0ac380 con 0x7f7cfc06ea40 2024-04-28T13:08:31.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.596+0000 7f7cfb7fe640 1 --2- 172.21.15.114:0/3911700337 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7ce806c980 0x7f7ce806ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:31.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.597+0000 7f7cfb7fe640 1 --2- 172.21.15.114:0/3911700337 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7ce806c980 0x7f7ce806ee40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc0b1fe0 tx=0x7f7cf0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:31.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.601+0000 7f7cf8ff9640 1 -- 172.21.15.114:0/3911700337 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7cec07a0e0 con 0x7f7cfc06ea40 2024-04-28T13:08:31.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.786+0000 7f7d02828640 1 -- 172.21.15.114:0/3911700337 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7cfc09c7c0 con 0x7f7cfc06ea40 2024-04-28T13:08:31.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.786+0000 7f7cf8ff9640 1 -- 172.21.15.114:0/3911700337 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7f7cec07e3e0 con 0x7f7cfc06ea40 2024-04-28T13:08:31.786 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-04-28T13:08:31.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.788+0000 7f7d02828640 1 -- 172.21.15.114:0/3911700337 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7ce806c980 msgr2=0x7f7ce806ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:31.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.788+0000 7f7d02828640 1 --2- 172.21.15.114:0/3911700337 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7ce806c980 0x7f7ce806ee40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc0b1fe0 tx=0x7f7cf0009190 comp rx=0 tx=0).stop 2024-04-28T13:08:31.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.788+0000 7f7d02828640 1 -- 172.21.15.114:0/3911700337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cfc06ea40 msgr2=0x7f7cfc160d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:31.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.788+0000 7f7d02828640 1 --2- 172.21.15.114:0/3911700337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cfc06ea40 0x7f7cfc160d90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7cec02a220 tx=0x7f7cec0046c0 comp rx=0 tx=0).stop 2024-04-28T13:08:31.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.788+0000 7f7d02828640 1 -- 172.21.15.114:0/3911700337 shutdown_connections 2024-04-28T13:08:31.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.788+0000 7f7d02828640 1 --2- 172.21.15.114:0/3911700337 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7ce806c980 0x7f7ce806ee40 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:31.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.788+0000 7f7d02828640 1 --2- 172.21.15.114:0/3911700337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cfc15fa10 0x7f7cfc071550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:31.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.788+0000 7f7d02828640 1 --2- 172.21.15.114:0/3911700337 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7cfc09b9e0 0x7f7cfc158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:31.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.788+0000 7f7d02828640 1 --2- 172.21.15.114:0/3911700337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cfc06ea40 0x7f7cfc160d90 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:31.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.788+0000 7f7d02828640 1 -- 172.21.15.114:0/3911700337 >> 172.21.15.114:0/3911700337 conn(0x7f7cfc0b4a50 msgr2=0x7f7cfc0b0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:31.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.788+0000 7f7d02828640 1 -- 172.21.15.114:0/3911700337 shutdown_connections 2024-04-28T13:08:31.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:31.788+0000 7f7d02828640 1 -- 172.21.15.114:0/3911700337 wait complete. 2024-04-28T13:08:31.799 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-28T13:08:31.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:31.799 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-04-28T13:08:31.830 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2024-04-28T13:08:31.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:31.830 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-28T13:08:31.886 INFO:tasks.cephfs.mount:Terminating background process 2024-04-28T13:08:31.886 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:08:31.886 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-28T13:08:31.902 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19608 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-28T13:08:31.902 INFO:tasks.cephfs.mount:Terminating background process 2024-04-28T13:08:31.902 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:08:31.902 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-28T13:08:31.943 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056112,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13795 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248848k,nr_inodes=812212,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-28T13:08:31.943 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-28T13:08:32.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.040+0000 7ff69316a640 1 Processor -- start 2024-04-28T13:08:32.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.040+0000 7ff69316a640 1 -- start start 2024-04-28T13:08:32.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.041+0000 7ff69316a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff68c153330 0x7ff68c15d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:32.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.041+0000 7ff69316a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff68c0723d0 0x7ff68c073bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:32.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.041+0000 7ff69316a640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff68c153710 con 0x7ff68c0740f0 2024-04-28T13:08:32.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.041+0000 7ff69316a640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7ff68c074560 con 0x7ff68c0723d0 2024-04-28T13:08:32.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.041+0000 7ff69316a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff68c0b4a60 con 0x7ff68c153330 2024-04-28T13:08:32.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.041+0000 7ff68bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff68c0723d0 0x7ff68c073bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:32.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.041+0000 7ff691707640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff68c0740f0 0x7ff68c15fe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:54346/0 (socket says 172.21.15.114:54346) 2024-04-28T13:08:32.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.041+0000 7ff691707640 1 -- 172.21.15.114:0/821321940 learned_addr learned my addr 172.21.15.114:0/821321940 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:32.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.041+0000 7ff690f06640 1 --2- 172.21.15.114:0/821321940 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff68c153330 0x7ff68c15d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:32.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.041+0000 7ff68bfff640 1 -- 172.21.15.114:0/821321940 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff68c153330 msgr2=0x7ff68c15d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:32.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.041+0000 7ff68bfff640 1 --2- 172.21.15.114:0/821321940 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff68c153330 0x7ff68c15d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.041+0000 7ff68bfff640 1 -- 172.21.15.114:0/821321940 >> v1:172.21.15.114:6789/0 conn(0x7ff68c0740f0 legacy=0x7ff68c15fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:32.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.041+0000 7ff68bfff640 1 -- 172.21.15.114:0/821321940 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff68c072990 con 0x7ff68c0723d0 2024-04-28T13:08:32.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.041+0000 7ff68b7fe640 1 -- 172.21.15.114:0/821321940 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3013730171 0 0) 0x7ff684001490 con 0x7ff68c0740f0 2024-04-28T13:08:32.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.041+0000 7ff690f06640 1 --2- 172.21.15.114:0/821321940 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff68c153330 0x7ff68c15d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:32.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.042+0000 7ff68bfff640 1 --2- 172.21.15.114:0/821321940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff68c0723d0 0x7ff68c073bb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff6780097a0 tx=0x7ff67802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddee45001432a7c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:32.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.042+0000 7ff68b7fe640 1 -- 172.21.15.114:0/821321940 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678037070 con 0x7ff68c0723d0 2024-04-28T13:08:32.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.042+0000 7ff68b7fe640 1 -- 172.21.15.114:0/821321940 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff678032440 con 0x7ff68c0723d0 2024-04-28T13:08:32.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.042+0000 7ff68b7fe640 1 -- 172.21.15.114:0/821321940 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678032810 con 0x7ff68c0723d0 2024-04-28T13:08:32.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.043+0000 7ff69316a640 1 -- 172.21.15.114:0/821321940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff68c0723d0 msgr2=0x7ff68c073bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:32.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.043+0000 7ff69316a640 1 --2- 172.21.15.114:0/821321940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff68c0723d0 0x7ff68c073bb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff6780097a0 tx=0x7ff67802a180 comp rx=0 tx=0).stop 2024-04-28T13:08:32.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.043+0000 7ff69316a640 1 -- 172.21.15.114:0/821321940 shutdown_connections 2024-04-28T13:08:32.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.043+0000 7ff69316a640 1 --2- 172.21.15.114:0/821321940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff68c0723d0 0x7ff68c073bb0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.043+0000 7ff69316a640 1 --2- 172.21.15.114:0/821321940 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff68c153330 0x7ff68c15d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.043+0000 7ff69316a640 1 -- 172.21.15.114:0/821321940 >> 172.21.15.114:0/821321940 conn(0x7ff68c06c980 msgr2=0x7ff68c0b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:32.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.043+0000 7ff69316a640 1 -- 172.21.15.114:0/821321940 shutdown_connections 2024-04-28T13:08:32.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.043+0000 7ff69316a640 1 -- 172.21.15.114:0/821321940 wait complete. 2024-04-28T13:08:32.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.044+0000 7ff69316a640 1 Processor -- start 2024-04-28T13:08:32.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.044+0000 7ff69316a640 1 -- start start 2024-04-28T13:08:32.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.045+0000 7ff69316a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff68c0723d0 0x7ff68c145960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:32.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.045+0000 7ff69316a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff68c0740f0 0x7ff68c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:32.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.045+0000 7ff69316a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff68c153330 0x7ff68c06f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:32.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.045+0000 7ff69316a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff68c073230 con 0x7ff68c153330 2024-04-28T13:08:32.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.045+0000 7ff69316a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff68c072f50 con 0x7ff68c0740f0 2024-04-28T13:08:32.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.045+0000 7ff69316a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff68c073510 con 0x7ff68c0723d0 2024-04-28T13:08:32.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.045+0000 7ff691707640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff68c153330 0x7ff68c06f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:32.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.045+0000 7ff691707640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff68c153330 0x7ff68c06f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43024/0 (socket says 172.21.15.114:43024) 2024-04-28T13:08:32.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.045+0000 7ff691707640 1 -- 172.21.15.114:0/1263448612 learned_addr learned my addr 172.21.15.114:0/1263448612 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:32.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.045+0000 7ff690f06640 1 --2- 172.21.15.114:0/1263448612 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff68c0723d0 0x7ff68c145960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:32.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.045+0000 7ff68bfff640 1 --2- 172.21.15.114:0/1263448612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff68c0740f0 0x7ff68c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:32.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.045+0000 7ff691707640 1 -- 172.21.15.114:0/1263448612 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff68c0723d0 msgr2=0x7ff68c145960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:32.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.045+0000 7ff691707640 1 --2- 172.21.15.114:0/1263448612 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff68c0723d0 0x7ff68c145960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.045+0000 7ff691707640 1 -- 172.21.15.114:0/1263448612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff68c0740f0 msgr2=0x7ff68c06f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:32.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.045+0000 7ff691707640 1 --2- 172.21.15.114:0/1263448612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff68c0740f0 0x7ff68c06f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.045+0000 7ff691707640 1 -- 172.21.15.114:0/1263448612 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff68c156100 con 0x7ff68c153330 2024-04-28T13:08:32.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.045+0000 7ff690f06640 1 --2- 172.21.15.114:0/1263448612 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff68c0723d0 0x7ff68c145960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:32.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.045+0000 7ff68bfff640 1 --2- 172.21.15.114:0/1263448612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff68c0740f0 0x7ff68c06f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:32.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.045+0000 7ff691707640 1 --2- 172.21.15.114:0/1263448612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff68c153330 0x7ff68c06f970 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff68400c7f0 tx=0x7ff68400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:32.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.045+0000 7ff6897fa640 1 -- 172.21.15.114:0/1263448612 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff684018070 con 0x7ff68c153330 2024-04-28T13:08:32.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.045+0000 7ff6897fa640 1 -- 172.21.15.114:0/1263448612 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff68400a5e0 con 0x7ff68c153330 2024-04-28T13:08:32.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.046+0000 7ff69316a640 1 -- 172.21.15.114:0/1263448612 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff68c15d1c0 con 0x7ff68c153330 2024-04-28T13:08:32.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.046+0000 7ff6897fa640 1 -- 172.21.15.114:0/1263448612 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68400aa10 con 0x7ff68c153330 2024-04-28T13:08:32.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.046+0000 7ff69316a640 1 -- 172.21.15.114:0/1263448612 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff68c15d780 con 0x7ff68c153330 2024-04-28T13:08:32.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.046+0000 7ff69316a640 1 -- 172.21.15.114:0/1263448612 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff68c06a3d0 con 0x7ff68c153330 2024-04-28T13:08:32.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.047+0000 7ff6897fa640 1 -- 172.21.15.114:0/1263448612 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7ff68401b070 con 0x7ff68c153330 2024-04-28T13:08:32.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.047+0000 7ff6897fa640 1 --2- 172.21.15.114:0/1263448612 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff67006c980 0x7ff67006ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:32.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.048+0000 7ff6897fa640 1 -- 172.21.15.114:0/1263448612 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff68408b1b0 con 0x7ff68c153330 2024-04-28T13:08:32.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.048+0000 7ff690f06640 1 --2- 172.21.15.114:0/1263448612 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff67006c980 0x7ff67006ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:32.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.048+0000 7ff690f06640 1 --2- 172.21.15.114:0/1263448612 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff67006c980 0x7ff67006ee40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff680006fd0 tx=0x7ff680008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:32.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.052+0000 7ff6897fa640 1 -- 172.21.15.114:0/1263448612 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff68c153710 con 0x7ff68c153330 2024-04-28T13:08:32.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.260+0000 7ff69316a640 1 -- 172.21.15.114:0/1263448612 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff68c15fbc0 con 0x7ff68c153330 2024-04-28T13:08:32.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.260+0000 7ff6897fa640 1 -- 172.21.15.114:0/1263448612 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5192 (secure 0 0 0) 0x7ff6840595f0 con 0x7ff68c153330 2024-04-28T13:08:32.262 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:32.263 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3832267996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":3832267996},{"type":"v1","addr":"172.21.15.134:6835","nonce":3832267996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5130,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2035724706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2035724706},{"type":"v1","addr":"172.21.15.114:6836","nonce":2035724706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":5133,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3180452801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3180452801},{"type":"v1","addr":"172.21.15.114:6837","nonce":3180452801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-28T13:08:18.038213+0000","modified":"2024-04-28T13:08:20.039019+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5145":{"gid":5145,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6834/1155749661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1155749661},{"type":"v1","addr":"172.21.15.134:6834","nonce":1155749661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5145,"qdb_cluster":[5145]},"id":2}]} 2024-04-28T13:08:32.263 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 14 2024-04-28T13:08:32.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.262+0000 7ff69316a640 1 -- 172.21.15.114:0/1263448612 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff67006c980 msgr2=0x7ff67006ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:32.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.262+0000 7ff69316a640 1 --2- 172.21.15.114:0/1263448612 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff67006c980 0x7ff67006ee40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff680006fd0 tx=0x7ff680008040 comp rx=0 tx=0).stop 2024-04-28T13:08:32.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.262+0000 7ff69316a640 1 -- 172.21.15.114:0/1263448612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff68c153330 msgr2=0x7ff68c06f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:32.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.262+0000 7ff69316a640 1 --2- 172.21.15.114:0/1263448612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff68c153330 0x7ff68c06f970 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff68400c7f0 tx=0x7ff68400ccb0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.262+0000 7ff69316a640 1 -- 172.21.15.114:0/1263448612 shutdown_connections 2024-04-28T13:08:32.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.262+0000 7ff69316a640 1 --2- 172.21.15.114:0/1263448612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff68c153330 0x7ff68c06f970 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.262+0000 7ff69316a640 1 --2- 172.21.15.114:0/1263448612 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff67006c980 0x7ff67006ee40 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.262+0000 7ff69316a640 1 --2- 172.21.15.114:0/1263448612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff68c0740f0 0x7ff68c06f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.262+0000 7ff69316a640 1 --2- 172.21.15.114:0/1263448612 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff68c0723d0 0x7ff68c145960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.262+0000 7ff69316a640 1 -- 172.21.15.114:0/1263448612 >> 172.21.15.114:0/1263448612 conn(0x7ff68c06c980 msgr2=0x7ff68c0cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:32.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.262+0000 7ff69316a640 1 -- 172.21.15.114:0/1263448612 shutdown_connections 2024-04-28T13:08:32.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.262+0000 7ff69316a640 1 -- 172.21.15.114:0/1263448612 wait complete. 2024-04-28T13:08:32.273 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:08:32.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.369+0000 7fef52b46640 1 Processor -- start 2024-04-28T13:08:32.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.370+0000 7fef52b46640 1 -- start start 2024-04-28T13:08:32.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.370+0000 7fef52b46640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef4c146c00 0x7fef4c15eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:32.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.370+0000 7fef52b46640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fef4c0ced60 0x7fef4c15e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:32.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.370+0000 7fef52b46640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef4c146fe0 con 0x7fef4c0cd850 2024-04-28T13:08:32.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.370+0000 7fef52b46640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fef4c0cf1e0 con 0x7fef4c0ced60 2024-04-28T13:08:32.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.370+0000 7fef52b46640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fef4c0cff80 con 0x7fef4c146c00 2024-04-28T13:08:32.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.370+0000 7fef510e3640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fef4c0cd850 0x7fef4c073920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:54354/0 (socket says 172.21.15.114:54354) 2024-04-28T13:08:32.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.370+0000 7fef510e3640 1 -- 172.21.15.114:0/2614160472 learned_addr learned my addr 172.21.15.114:0/2614160472 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:32.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.371+0000 7fef508e2640 1 --2- 172.21.15.114:0/2614160472 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef4c146c00 0x7fef4c15eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:32.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.371+0000 7fef4bfff640 1 --2- 172.21.15.114:0/2614160472 >> v2:172.21.15.134:3300/0 conn(0x7fef4c0ced60 0x7fef4c15e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:32.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.371+0000 7fef4b7fe640 1 -- 172.21.15.114:0/2614160472 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1512412947 0 0) 0x7fef44001490 con 0x7fef4c0cd850 2024-04-28T13:08:32.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.371+0000 7fef4b7fe640 1 -- 172.21.15.114:0/2614160472 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef3c003520 con 0x7fef4c0cd850 2024-04-28T13:08:32.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.371+0000 7fef4b7fe640 1 -- 172.21.15.114:0/2614160472 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2674118278 0 0) 0x7fef3c003520 con 0x7fef4c0cd850 2024-04-28T13:08:32.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.371+0000 7fef4b7fe640 1 -- 172.21.15.114:0/2614160472 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef4c146c00 msgr2=0x7fef4c15eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:32.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.371+0000 7fef4b7fe640 1 --2- 172.21.15.114:0/2614160472 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef4c146c00 0x7fef4c15eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.371+0000 7fef4b7fe640 1 -- 172.21.15.114:0/2614160472 >> v2:172.21.15.134:3300/0 conn(0x7fef4c0ced60 msgr2=0x7fef4c15e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:32.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.371+0000 7fef4b7fe640 1 --2- 172.21.15.114:0/2614160472 >> v2:172.21.15.134:3300/0 conn(0x7fef4c0ced60 0x7fef4c15e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.371+0000 7fef4b7fe640 1 -- 172.21.15.114:0/2614160472 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef4c073440 con 0x7fef4c0cd850 2024-04-28T13:08:32.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.371+0000 7fef4b7fe640 1 -- 172.21.15.114:0/2614160472 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7fef44001be0 con 0x7fef4c0cd850 2024-04-28T13:08:32.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.371+0000 7fef4b7fe640 1 -- 172.21.15.114:0/2614160472 >> v1:172.21.15.114:6789/0 conn(0x7fef4c0cd850 legacy=0x7fef4c073920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:32.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.371+0000 7fef4b7fe640 1 --2- 172.21.15.114:0/2614160472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef3c0039b0 0x7fef3c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:32.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.371+0000 7fef4b7fe640 1 --2- 172.21.15.114:0/2614160472 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef4c146c00 0x7fef3c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:32.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.371+0000 7fef4b7fe640 1 --2- 172.21.15.114:0/2614160472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef3c004d40 0x7fef3c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:32.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.371+0000 7fef4b7fe640 1 -- 172.21.15.114:0/2614160472 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c0cf1e0 con 0x7fef3c0039b0 2024-04-28T13:08:32.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.371+0000 7fef4b7fe640 1 -- 172.21.15.114:0/2614160472 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fef3c00b9c0 con 0x7fef3c004d40 2024-04-28T13:08:32.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.371+0000 7fef4b7fe640 1 -- 172.21.15.114:0/2614160472 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fef3c00bb40 con 0x7fef4c146c00 2024-04-28T13:08:32.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.371+0000 7fef508e2640 1 --2- 172.21.15.114:0/2614160472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef3c0039b0 0x7fef3c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:32.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.371+0000 7fef4bfff640 1 --2- 172.21.15.114:0/2614160472 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef4c146c00 0x7fef3c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:32.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.371+0000 7fef510e3640 1 --2- 172.21.15.114:0/2614160472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef3c004d40 0x7fef3c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:32.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.371+0000 7fef508e2640 1 -- 172.21.15.114:0/2614160472 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef4c146c00 msgr2=0x7fef3c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:32.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.371+0000 7fef508e2640 1 --2- 172.21.15.114:0/2614160472 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef4c146c00 0x7fef3c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.371+0000 7fef508e2640 1 -- 172.21.15.114:0/2614160472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef3c004d40 msgr2=0x7fef3c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:32.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.371+0000 7fef508e2640 1 --2- 172.21.15.114:0/2614160472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef3c004d40 0x7fef3c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.371+0000 7fef508e2640 1 -- 172.21.15.114:0/2614160472 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef3c003520 con 0x7fef3c0039b0 2024-04-28T13:08:32.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.371+0000 7fef4bfff640 1 --2- 172.21.15.114:0/2614160472 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef4c146c00 0x7fef3c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:32.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.371+0000 7fef510e3640 1 --2- 172.21.15.114:0/2614160472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef3c004d40 0x7fef3c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:32.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.372+0000 7fef508e2640 1 --2- 172.21.15.114:0/2614160472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef3c0039b0 0x7fef3c003dd0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fef40009ac0 tx=0x7fef3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eab9cfbaef1bc8d server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:32.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.372+0000 7fef4b7fe640 1 -- 172.21.15.114:0/2614160472 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef40036070 con 0x7fef3c0039b0 2024-04-28T13:08:32.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.372+0000 7fef4b7fe640 1 -- 172.21.15.114:0/2614160472 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef40031400 con 0x7fef3c0039b0 2024-04-28T13:08:32.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.372+0000 7fef4b7fe640 1 -- 172.21.15.114:0/2614160472 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef40009690 con 0x7fef3c0039b0 2024-04-28T13:08:32.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.373+0000 7fef52b46640 1 -- 172.21.15.114:0/2614160472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef3c0039b0 msgr2=0x7fef3c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:32.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.373+0000 7fef52b46640 1 --2- 172.21.15.114:0/2614160472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef3c0039b0 0x7fef3c003dd0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fef40009ac0 tx=0x7fef3c005830 comp rx=0 tx=0).stop 2024-04-28T13:08:32.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.373+0000 7fef510e3640 1 -- 172.21.15.114:0/2614160472 reap_dead start 2024-04-28T13:08:32.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.373+0000 7fef52b46640 1 -- 172.21.15.114:0/2614160472 shutdown_connections 2024-04-28T13:08:32.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.373+0000 7fef52b46640 1 -- 172.21.15.114:0/2614160472 >> 172.21.15.114:0/2614160472 conn(0x7fef4c06c980 msgr2=0x7fef4c0b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:32.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.373+0000 7fef52b46640 1 -- 172.21.15.114:0/2614160472 shutdown_connections 2024-04-28T13:08:32.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.373+0000 7fef52b46640 1 -- 172.21.15.114:0/2614160472 wait complete. 2024-04-28T13:08:32.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.374+0000 7fef52b46640 1 Processor -- start 2024-04-28T13:08:32.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.374+0000 7fef52b46640 1 -- start start 2024-04-28T13:08:32.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.375+0000 7fef52b46640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef3c0039b0 0x7fef4c06edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:32.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.375+0000 7fef52b46640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef4c15fe30 0x7fef4c0b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:32.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.375+0000 7fef52b46640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef4c138240 0x7fef4c1386c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:32.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.375+0000 7fef52b46640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c0cf9c0 con 0x7fef3c0039b0 2024-04-28T13:08:32.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.375+0000 7fef52b46640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c0cf6e0 con 0x7fef4c138240 2024-04-28T13:08:32.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.375+0000 7fef52b46640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fef4c0cfca0 con 0x7fef4c15fe30 2024-04-28T13:08:32.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.375+0000 7fef508e2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef3c0039b0 0x7fef4c06edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:32.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.375+0000 7fef508e2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef3c0039b0 0x7fef4c06edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43050/0 (socket says 172.21.15.114:43050) 2024-04-28T13:08:32.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.375+0000 7fef508e2640 1 -- 172.21.15.114:0/3013824936 learned_addr learned my addr 172.21.15.114:0/3013824936 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:32.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.375+0000 7fef510e3640 1 --2- 172.21.15.114:0/3013824936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef4c138240 0x7fef4c1386c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:32.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.375+0000 7fef4bfff640 1 --2- 172.21.15.114:0/3013824936 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef4c15fe30 0x7fef4c0b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:32.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.375+0000 7fef508e2640 1 -- 172.21.15.114:0/3013824936 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef4c15fe30 msgr2=0x7fef4c0b2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:32.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.375+0000 7fef508e2640 1 --2- 172.21.15.114:0/3013824936 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef4c15fe30 0x7fef4c0b2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.375+0000 7fef508e2640 1 -- 172.21.15.114:0/3013824936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef4c138240 msgr2=0x7fef4c1386c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:32.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.375+0000 7fef508e2640 1 --2- 172.21.15.114:0/3013824936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef4c138240 0x7fef4c1386c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.375+0000 7fef508e2640 1 -- 172.21.15.114:0/3013824936 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef4c1f95e0 con 0x7fef3c0039b0 2024-04-28T13:08:32.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.375+0000 7fef4bfff640 1 --2- 172.21.15.114:0/3013824936 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef4c15fe30 0x7fef4c0b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:32.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.375+0000 7fef510e3640 1 --2- 172.21.15.114:0/3013824936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef4c138240 0x7fef4c1386c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:32.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.375+0000 7fef508e2640 1 --2- 172.21.15.114:0/3013824936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef3c0039b0 0x7fef4c06edf0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fef40009ac0 tx=0x7fef40004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:32.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.375+0000 7fef497fa640 1 -- 172.21.15.114:0/3013824936 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef40040020 con 0x7fef3c0039b0 2024-04-28T13:08:32.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.375+0000 7fef497fa640 1 -- 172.21.15.114:0/3013824936 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef40003bc0 con 0x7fef3c0039b0 2024-04-28T13:08:32.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.375+0000 7fef52b46640 1 -- 172.21.15.114:0/3013824936 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef4c138c00 con 0x7fef3c0039b0 2024-04-28T13:08:32.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.375+0000 7fef497fa640 1 -- 172.21.15.114:0/3013824936 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef40036040 con 0x7fef3c0039b0 2024-04-28T13:08:32.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.375+0000 7fef52b46640 1 -- 172.21.15.114:0/3013824936 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef4c1f8b00 con 0x7fef3c0039b0 2024-04-28T13:08:32.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.376+0000 7fef52b46640 1 -- 172.21.15.114:0/3013824936 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef4c06a3d0 con 0x7fef3c0039b0 2024-04-28T13:08:32.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.377+0000 7fef497fa640 1 -- 172.21.15.114:0/3013824936 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7fef40043020 con 0x7fef3c0039b0 2024-04-28T13:08:32.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.377+0000 7fef497fa640 1 --2- 172.21.15.114:0/3013824936 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fef3006c9b0 0x7fef3006ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:32.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.377+0000 7fef497fa640 1 -- 172.21.15.114:0/3013824936 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fef400abc30 con 0x7fef3c0039b0 2024-04-28T13:08:32.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.377+0000 7fef4bfff640 1 --2- 172.21.15.114:0/3013824936 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fef3006c9b0 0x7fef3006ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:32.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.378+0000 7fef4bfff640 1 --2- 172.21.15.114:0/3013824936 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fef3006c9b0 0x7fef3006ee70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fef4c0705c0 tx=0x7fef38008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:32.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.382+0000 7fef497fa640 1 -- 172.21.15.114:0/3013824936 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fef4004a070 con 0x7fef3c0039b0 2024-04-28T13:08:32.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.558+0000 7fef52b46640 1 -- 172.21.15.114:0/3013824936 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fef4c0ccdb0 con 0x7fef3c0039b0 2024-04-28T13:08:32.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.560+0000 7fef497fa640 1 -- 172.21.15.114:0/3013824936 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16717 (secure 0 0 0) 0x7fef400044e0 con 0x7fef3c0039b0 2024-04-28T13:08:32.559 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:32.560 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":34,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:08:19.691257+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-28T13:08:16.244962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-28T13:08:16.991345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:08:32.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.561+0000 7fef52b46640 1 -- 172.21.15.114:0/3013824936 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fef3006c9b0 msgr2=0x7fef3006ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:32.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.561+0000 7fef52b46640 1 --2- 172.21.15.114:0/3013824936 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fef3006c9b0 0x7fef3006ee70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fef4c0705c0 tx=0x7fef38008040 comp rx=0 tx=0).stop 2024-04-28T13:08:32.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.561+0000 7fef52b46640 1 -- 172.21.15.114:0/3013824936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef3c0039b0 msgr2=0x7fef4c06edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:32.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.561+0000 7fef52b46640 1 --2- 172.21.15.114:0/3013824936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef3c0039b0 0x7fef4c06edf0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fef40009ac0 tx=0x7fef40004730 comp rx=0 tx=0).stop 2024-04-28T13:08:32.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.562+0000 7fef52b46640 1 -- 172.21.15.114:0/3013824936 shutdown_connections 2024-04-28T13:08:32.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.562+0000 7fef52b46640 1 --2- 172.21.15.114:0/3013824936 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fef3006c9b0 0x7fef3006ee70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.562+0000 7fef52b46640 1 --2- 172.21.15.114:0/3013824936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef4c138240 0x7fef4c1386c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.562+0000 7fef52b46640 1 --2- 172.21.15.114:0/3013824936 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef4c15fe30 0x7fef4c0b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.562+0000 7fef52b46640 1 --2- 172.21.15.114:0/3013824936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef3c0039b0 0x7fef4c06edf0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.562+0000 7fef52b46640 1 -- 172.21.15.114:0/3013824936 >> 172.21.15.114:0/3013824936 conn(0x7fef4c06c980 msgr2=0x7fef4c160e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:32.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.562+0000 7fef52b46640 1 -- 172.21.15.114:0/3013824936 shutdown_connections 2024-04-28T13:08:32.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.562+0000 7fef52b46640 1 -- 172.21.15.114:0/3013824936 wait complete. 2024-04-28T13:08:32.572 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-28T13:07:14.721860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-28T13:08:16.244962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-28T13:08:16.991345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-28T13:08:32.573 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-28T13:08:32.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.672+0000 7f2a9f415640 1 Processor -- start 2024-04-28T13:08:32.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.672+0000 7f2a9f415640 1 -- start start 2024-04-28T13:08:32.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.673+0000 7f2a9f415640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2a981404e0 0x7f2a980d0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:32.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.673+0000 7f2a9f415640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a9815d860 0x7f2a9815dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:32.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.673+0000 7f2a9f415640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2a980d0d30 0x7f2a980d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:32.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.673+0000 7f2a9f415640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f2a9815e200 con 0x7f2a981404e0 2024-04-28T13:08:32.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.673+0000 7f2a9f415640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f2a980d16c0 con 0x7f2a980d0d30 2024-04-28T13:08:32.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.673+0000 7f2a9f415640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2a980d00d0 con 0x7f2a9815d860 2024-04-28T13:08:32.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.673+0000 7f2a9d1b1640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2a981404e0 0x7f2a980d0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:32.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.673+0000 7f2a9d1b1640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2a981404e0 0x7f2a980d0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43052/0 (socket says 172.21.15.114:43052) 2024-04-28T13:08:32.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.673+0000 7f2a9d1b1640 1 -- 172.21.15.114:0/16091194 learned_addr learned my addr 172.21.15.114:0/16091194 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:32.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.673+0000 7f2a9c9b0640 1 --2- 172.21.15.114:0/16091194 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a9815d860 0x7f2a9815dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:32.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.673+0000 7f2a9d9b2640 1 --2- 172.21.15.114:0/16091194 >> v2:172.21.15.134:3300/0 conn(0x7f2a980d0d30 0x7f2a980d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:32.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.673+0000 7f2a9d1b1640 1 -- 172.21.15.114:0/16091194 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a9815d860 msgr2=0x7f2a9815dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:32.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.673+0000 7f2a9d1b1640 1 --2- 172.21.15.114:0/16091194 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a9815d860 0x7f2a9815dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.673+0000 7f2a9d1b1640 1 -- 172.21.15.114:0/16091194 >> v2:172.21.15.134:3300/0 conn(0x7f2a980d0d30 msgr2=0x7f2a980d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:32.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.673+0000 7f2a9d1b1640 1 --2- 172.21.15.114:0/16091194 >> v2:172.21.15.134:3300/0 conn(0x7f2a980d0d30 0x7f2a980d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.673+0000 7f2a9d1b1640 1 -- 172.21.15.114:0/16091194 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a98142d80 con 0x7f2a981404e0 2024-04-28T13:08:32.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.674+0000 7f2a9d1b1640 1 --2- 172.21.15.114:0/16091194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a981404e0 0x7f2a980d0560 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2a98074370 tx=0x7f2a9402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c73bfc214976b91 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:32.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.674+0000 7f2a8ffff640 1 -- 172.21.15.114:0/16091194 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a94037070 con 0x7f2a981404e0 2024-04-28T13:08:32.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.674+0000 7f2a8ffff640 1 -- 172.21.15.114:0/16091194 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a94032440 con 0x7f2a981404e0 2024-04-28T13:08:32.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.674+0000 7f2a8ffff640 1 -- 172.21.15.114:0/16091194 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a94032810 con 0x7f2a981404e0 2024-04-28T13:08:32.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.674+0000 7f2a9f415640 1 -- 172.21.15.114:0/16091194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a981404e0 msgr2=0x7f2a980d0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:32.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.674+0000 7f2a9f415640 1 --2- 172.21.15.114:0/16091194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a981404e0 0x7f2a980d0560 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2a98074370 tx=0x7f2a9402a1e0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.675+0000 7f2a9f415640 1 -- 172.21.15.114:0/16091194 shutdown_connections 2024-04-28T13:08:32.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.675+0000 7f2a9f415640 1 --2- 172.21.15.114:0/16091194 >> v2:172.21.15.134:3300/0 conn(0x7f2a980d0d30 0x7f2a980d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.675+0000 7f2a9f415640 1 --2- 172.21.15.114:0/16091194 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a9815d860 0x7f2a9815dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.675+0000 7f2a9f415640 1 --2- 172.21.15.114:0/16091194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a981404e0 0x7f2a980d0560 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.675+0000 7f2a9f415640 1 -- 172.21.15.114:0/16091194 >> 172.21.15.114:0/16091194 conn(0x7f2a980706f0 msgr2=0x7f2a98070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:32.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.675+0000 7f2a9f415640 1 -- 172.21.15.114:0/16091194 shutdown_connections 2024-04-28T13:08:32.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.675+0000 7f2a9f415640 1 -- 172.21.15.114:0/16091194 wait complete. 2024-04-28T13:08:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.676+0000 7f2a9f415640 1 Processor -- start 2024-04-28T13:08:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.676+0000 7f2a9f415640 1 -- start start 2024-04-28T13:08:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.676+0000 7f2a9f415640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a980d0d30 0x7f2a980cab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.676+0000 7f2a9f415640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a981404e0 0x7f2a981f6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.676+0000 7f2a9f415640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a9815d860 0x7f2a980cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.676+0000 7f2a9f415640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2a980cfa80 con 0x7f2a9815d860 2024-04-28T13:08:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.677+0000 7f2a9f415640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9815e710 con 0x7f2a981404e0 2024-04-28T13:08:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.677+0000 7f2a9f415640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2a980cfd60 con 0x7f2a980d0d30 2024-04-28T13:08:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.677+0000 7f2a9d9b2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a9815d860 0x7f2a980cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.677+0000 7f2a9d9b2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a9815d860 0x7f2a980cdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43062/0 (socket says 172.21.15.114:43062) 2024-04-28T13:08:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.677+0000 7f2a9d9b2640 1 -- 172.21.15.114:0/2729064245 learned_addr learned my addr 172.21.15.114:0/2729064245 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:32.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.677+0000 7f2a9d1b1640 1 --2- 172.21.15.114:0/2729064245 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a980d0d30 0x7f2a980cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:32.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.677+0000 7f2a9c9b0640 1 --2- 172.21.15.114:0/2729064245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a981404e0 0x7f2a981f6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:32.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.677+0000 7f2a9d9b2640 1 -- 172.21.15.114:0/2729064245 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a980d0d30 msgr2=0x7f2a980cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:32.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.677+0000 7f2a9d9b2640 1 --2- 172.21.15.114:0/2729064245 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a980d0d30 0x7f2a980cab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.677+0000 7f2a9d9b2640 1 -- 172.21.15.114:0/2729064245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a981404e0 msgr2=0x7f2a981f6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:32.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.677+0000 7f2a9d9b2640 1 --2- 172.21.15.114:0/2729064245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a981404e0 0x7f2a981f6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.677+0000 7f2a9d9b2640 1 -- 172.21.15.114:0/2729064245 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a981f6950 con 0x7f2a9815d860 2024-04-28T13:08:32.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.677+0000 7f2a9d1b1640 1 --2- 172.21.15.114:0/2729064245 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a980d0d30 0x7f2a980cab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:32.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.677+0000 7f2a9c9b0640 1 --2- 172.21.15.114:0/2729064245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a981404e0 0x7f2a981f6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:32.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.677+0000 7f2a9d9b2640 1 --2- 172.21.15.114:0/2729064245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a9815d860 0x7f2a980cdbd0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2a90007e60 tx=0x7f2a9000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:32.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.677+0000 7f2a8dffb640 1 -- 172.21.15.114:0/2729064245 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a90014620 con 0x7f2a9815d860 2024-04-28T13:08:32.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.677+0000 7f2a8dffb640 1 -- 172.21.15.114:0/2729064245 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a90019070 con 0x7f2a9815d860 2024-04-28T13:08:32.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.677+0000 7f2a8dffb640 1 -- 172.21.15.114:0/2729064245 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a90014a20 con 0x7f2a9815d860 2024-04-28T13:08:32.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.677+0000 7f2a9f415640 1 -- 172.21.15.114:0/2729064245 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a981f6c30 con 0x7f2a9815d860 2024-04-28T13:08:32.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.677+0000 7f2a9f415640 1 -- 172.21.15.114:0/2729064245 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a980cb0a0 con 0x7f2a9815d860 2024-04-28T13:08:32.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.679+0000 7f2a9f415640 1 -- 172.21.15.114:0/2729064245 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a9806a3d0 con 0x7f2a9815d860 2024-04-28T13:08:32.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.679+0000 7f2a8dffb640 1 -- 172.21.15.114:0/2729064245 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f2a90014bc0 con 0x7f2a9815d860 2024-04-28T13:08:32.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.679+0000 7f2a8dffb640 1 --2- 172.21.15.114:0/2729064245 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2a7c06c9b0 0x7f2a7c06ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:32.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.679+0000 7f2a8dffb640 1 -- 172.21.15.114:0/2729064245 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f2a9008c340 con 0x7f2a9815d860 2024-04-28T13:08:32.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.679+0000 7f2a9d1b1640 1 --2- 172.21.15.114:0/2729064245 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2a7c06c9b0 0x7f2a7c06ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:32.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.680+0000 7f2a9d1b1640 1 --2- 172.21.15.114:0/2729064245 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2a7c06c9b0 0x7f2a7c06ee70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2a94034000 tx=0x7f2a9402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:32.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.683+0000 7f2a8dffb640 1 -- 172.21.15.114:0/2729064245 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2a9005a810 con 0x7f2a9815d860 2024-04-28T13:08:32.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.863+0000 7f2a9f415640 1 -- 172.21.15.114:0/2729064245 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2a9806f670 con 0x7f2a9815d860 2024-04-28T13:08:32.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.863+0000 7f2a8dffb640 1 -- 172.21.15.114:0/2729064245 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) ==== 93+0+10 (secure 0 0 0) 0x7f2a9005a110 con 0x7f2a9815d860 2024-04-28T13:08:32.863 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-28T13:08:32.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.865+0000 7f2a9f415640 1 -- 172.21.15.114:0/2729064245 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2a7c06c9b0 msgr2=0x7f2a7c06ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:32.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.865+0000 7f2a9f415640 1 --2- 172.21.15.114:0/2729064245 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2a7c06c9b0 0x7f2a7c06ee70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2a94034000 tx=0x7f2a9402e000 comp rx=0 tx=0).stop 2024-04-28T13:08:32.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.865+0000 7f2a9f415640 1 -- 172.21.15.114:0/2729064245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a9815d860 msgr2=0x7f2a980cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:32.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.865+0000 7f2a9f415640 1 --2- 172.21.15.114:0/2729064245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a9815d860 0x7f2a980cdbd0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2a90007e60 tx=0x7f2a9000e4b0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.865+0000 7f2a9f415640 1 -- 172.21.15.114:0/2729064245 shutdown_connections 2024-04-28T13:08:32.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.865+0000 7f2a9f415640 1 --2- 172.21.15.114:0/2729064245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a9815d860 0x7f2a980cdbd0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.865+0000 7f2a9f415640 1 --2- 172.21.15.114:0/2729064245 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2a7c06c9b0 0x7f2a7c06ee70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.865+0000 7f2a9f415640 1 --2- 172.21.15.114:0/2729064245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a981404e0 0x7f2a981f6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.865+0000 7f2a9f415640 1 --2- 172.21.15.114:0/2729064245 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a980d0d30 0x7f2a980cab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.865+0000 7f2a9f415640 1 -- 172.21.15.114:0/2729064245 >> 172.21.15.114:0/2729064245 conn(0x7f2a980706f0 msgr2=0x7f2a981577d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:32.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.865+0000 7f2a9f415640 1 -- 172.21.15.114:0/2729064245 shutdown_connections 2024-04-28T13:08:32.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.865+0000 7f2a9f415640 1 -- 172.21.15.114:0/2729064245 wait complete. 2024-04-28T13:08:32.875 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-28T13:08:32.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.976+0000 7fd19eb97640 1 Processor -- start 2024-04-28T13:08:32.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.976+0000 7fd19eb97640 1 -- start start 2024-04-28T13:08:32.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.977+0000 7fd19eb97640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1980b0d90 0x7fd1981613c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:32.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.977+0000 7fd19eb97640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd19806ca10 0x7fd19806cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:32.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.977+0000 7fd19eb97640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd198070ba0 con 0x7fd19815d140 2024-04-28T13:08:32.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.977+0000 7fd19eb97640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fd1980b11f0 con 0x7fd19806ca10 2024-04-28T13:08:32.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.977+0000 7fd19eb97640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fd19806c580 con 0x7fd1980b0d90 2024-04-28T13:08:32.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.977+0000 7fd19c933640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd19815d140 0x7fd198160cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:54360/0 (socket says 172.21.15.114:54360) 2024-04-28T13:08:32.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.977+0000 7fd19c933640 1 -- 172.21.15.114:0/204125602 learned_addr learned my addr 172.21.15.114:0/204125602 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:32.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.977+0000 7fd1977fe640 1 -- 172.21.15.114:0/204125602 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 740047931 0 0) 0x7fd198070ba0 con 0x7fd19815d140 2024-04-28T13:08:32.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.977+0000 7fd1977fe640 1 -- 172.21.15.114:0/204125602 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd188003520 con 0x7fd19815d140 2024-04-28T13:08:32.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.977+0000 7fd19d134640 1 --2- 172.21.15.114:0/204125602 >> v2:172.21.15.134:3300/0 conn(0x7fd19806ca10 0x7fd19806cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:32.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.977+0000 7fd197fff640 1 --2- 172.21.15.114:0/204125602 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1980b0d90 0x7fd1981613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:32.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.977+0000 7fd1977fe640 1 -- 172.21.15.114:0/204125602 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 665908986 0 0) 0x7fd188003520 con 0x7fd19815d140 2024-04-28T13:08:32.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.977+0000 7fd1977fe640 1 -- 172.21.15.114:0/204125602 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1980b0d90 msgr2=0x7fd1981613c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:32.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.977+0000 7fd1977fe640 1 --2- 172.21.15.114:0/204125602 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1980b0d90 0x7fd1981613c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.977+0000 7fd1977fe640 1 -- 172.21.15.114:0/204125602 >> v2:172.21.15.134:3300/0 conn(0x7fd19806ca10 msgr2=0x7fd19806cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:32.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.977+0000 7fd1977fe640 1 --2- 172.21.15.114:0/204125602 >> v2:172.21.15.134:3300/0 conn(0x7fd19806ca10 0x7fd19806cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.977+0000 7fd1977fe640 1 -- 172.21.15.114:0/204125602 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd198070e80 con 0x7fd19815d140 2024-04-28T13:08:32.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.977+0000 7fd1977fe640 1 -- 172.21.15.114:0/204125602 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7fd18c001670 con 0x7fd19815d140 2024-04-28T13:08:32.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.977+0000 7fd197fff640 1 --2- 172.21.15.114:0/204125602 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1980b0d90 0x7fd1981613c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:32.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.977+0000 7fd1977fe640 1 -- 172.21.15.114:0/204125602 >> v1:172.21.15.114:6789/0 conn(0x7fd19815d140 legacy=0x7fd198160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:32.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.977+0000 7fd1977fe640 1 --2- 172.21.15.114:0/204125602 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1980b0d90 0x7fd1880039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:32.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.977+0000 7fd1977fe640 1 --2- 172.21.15.114:0/204125602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd188003ef0 0x7fd188004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:32.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.977+0000 7fd1977fe640 1 --2- 172.21.15.114:0/204125602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd188004d40 0x7fd1880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:32.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.977+0000 7fd1977fe640 1 -- 172.21.15.114:0/204125602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd1980b11f0 con 0x7fd188004d40 2024-04-28T13:08:32.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.977+0000 7fd1977fe640 1 -- 172.21.15.114:0/204125602 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd19806c580 con 0x7fd188003ef0 2024-04-28T13:08:32.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.977+0000 7fd1977fe640 1 -- 172.21.15.114:0/204125602 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fd18800b9f0 con 0x7fd1980b0d90 2024-04-28T13:08:32.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.977+0000 7fd19d134640 1 --2- 172.21.15.114:0/204125602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd188004d40 0x7fd1880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:32.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.978+0000 7fd19c933640 1 --2- 172.21.15.114:0/204125602 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1980b0d90 0x7fd1880039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:32.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.978+0000 7fd197fff640 1 --2- 172.21.15.114:0/204125602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd188003ef0 0x7fd188004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:32.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.978+0000 7fd19d134640 1 -- 172.21.15.114:0/204125602 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1980b0d90 msgr2=0x7fd1880039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:32.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.978+0000 7fd19d134640 1 --2- 172.21.15.114:0/204125602 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1980b0d90 0x7fd1880039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.978+0000 7fd19d134640 1 -- 172.21.15.114:0/204125602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd188003ef0 msgr2=0x7fd188004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:32.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.978+0000 7fd19d134640 1 --2- 172.21.15.114:0/204125602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd188003ef0 0x7fd188004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.978+0000 7fd19d134640 1 -- 172.21.15.114:0/204125602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd188003520 con 0x7fd188004d40 2024-04-28T13:08:32.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.978+0000 7fd197fff640 1 --2- 172.21.15.114:0/204125602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd188003ef0 0x7fd188004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:32.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.978+0000 7fd19d134640 1 --2- 172.21.15.114:0/204125602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd188004d40 0x7fd1880051c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd190009fc0 tx=0x7fd188005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c4ffbea7d1c203 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:32.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.978+0000 7fd1977fe640 1 -- 172.21.15.114:0/204125602 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd190009c10 con 0x7fd188004d40 2024-04-28T13:08:32.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.978+0000 7fd1977fe640 1 -- 172.21.15.114:0/204125602 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd190036070 con 0x7fd188004d40 2024-04-28T13:08:32.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.978+0000 7fd1977fe640 1 -- 172.21.15.114:0/204125602 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19002d070 con 0x7fd188004d40 2024-04-28T13:08:32.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.979+0000 7fd19eb97640 1 -- 172.21.15.114:0/204125602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd188004d40 msgr2=0x7fd1880051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:32.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.979+0000 7fd19eb97640 1 --2- 172.21.15.114:0/204125602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd188004d40 0x7fd1880051c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd190009fc0 tx=0x7fd188005830 comp rx=0 tx=0).stop 2024-04-28T13:08:32.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.979+0000 7fd19d134640 1 -- 172.21.15.114:0/204125602 reap_dead start 2024-04-28T13:08:32.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.979+0000 7fd19eb97640 1 -- 172.21.15.114:0/204125602 shutdown_connections 2024-04-28T13:08:32.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.979+0000 7fd19eb97640 1 -- 172.21.15.114:0/204125602 >> 172.21.15.114:0/204125602 conn(0x7fd1980d16b0 msgr2=0x7fd1980d1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:32.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.979+0000 7fd19eb97640 1 -- 172.21.15.114:0/204125602 shutdown_connections 2024-04-28T13:08:32.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.979+0000 7fd19eb97640 1 -- 172.21.15.114:0/204125602 wait complete. 2024-04-28T13:08:32.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.980+0000 7fd19eb97640 1 Processor -- start 2024-04-28T13:08:32.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.980+0000 7fd19eb97640 1 -- start start 2024-04-28T13:08:32.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.981+0000 7fd19eb97640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd188004d40 0x7fd19814a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:32.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.981+0000 7fd19eb97640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd198158e20 0x7fd19815b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:32.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.981+0000 7fd19eb97640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd198072b90 0x7fd198073010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:32.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.981+0000 7fd19eb97640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd19815e6b0 con 0x7fd188004d40 2024-04-28T13:08:32.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.981+0000 7fd19eb97640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd19815e530 con 0x7fd198158e20 2024-04-28T13:08:32.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.981+0000 7fd19eb97640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fd1981613c0 con 0x7fd198072b90 2024-04-28T13:08:32.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.981+0000 7fd19c933640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd188004d40 0x7fd19814a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:32.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.981+0000 7fd19c933640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd188004d40 0x7fd19814a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43082/0 (socket says 172.21.15.114:43082) 2024-04-28T13:08:32.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.981+0000 7fd19c933640 1 -- 172.21.15.114:0/3246694197 learned_addr learned my addr 172.21.15.114:0/3246694197 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:32.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.981+0000 7fd19d134640 1 --2- 172.21.15.114:0/3246694197 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd198072b90 0x7fd198073010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:32.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.981+0000 7fd197fff640 1 --2- 172.21.15.114:0/3246694197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd198158e20 0x7fd19815b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:32.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.981+0000 7fd19c933640 1 -- 172.21.15.114:0/3246694197 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd198072b90 msgr2=0x7fd198073010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:32.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.981+0000 7fd19c933640 1 --2- 172.21.15.114:0/3246694197 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd198072b90 0x7fd198073010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.981+0000 7fd19c933640 1 -- 172.21.15.114:0/3246694197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd198158e20 msgr2=0x7fd19815b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:32.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.981+0000 7fd19c933640 1 --2- 172.21.15.114:0/3246694197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd198158e20 0x7fd19815b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:32.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.981+0000 7fd19c933640 1 -- 172.21.15.114:0/3246694197 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd19815ba60 con 0x7fd188004d40 2024-04-28T13:08:32.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.982+0000 7fd19c933640 1 --2- 172.21.15.114:0/3246694197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd188004d40 0x7fd19814a830 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd18c007370 tx=0x7fd18c007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:32.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.982+0000 7fd1957fa640 1 -- 172.21.15.114:0/3246694197 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18c01a070 con 0x7fd188004d40 2024-04-28T13:08:32.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.982+0000 7fd1957fa640 1 -- 172.21.15.114:0/3246694197 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd18c00f9a0 con 0x7fd188004d40 2024-04-28T13:08:32.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.982+0000 7fd19eb97640 1 -- 172.21.15.114:0/3246694197 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd198151dd0 con 0x7fd188004d40 2024-04-28T13:08:32.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.982+0000 7fd1957fa640 1 -- 172.21.15.114:0/3246694197 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18c00fd90 con 0x7fd188004d40 2024-04-28T13:08:32.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.982+0000 7fd19eb97640 1 -- 172.21.15.114:0/3246694197 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd198152390 con 0x7fd188004d40 2024-04-28T13:08:32.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.983+0000 7fd19eb97640 1 -- 172.21.15.114:0/3246694197 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd198073550 con 0x7fd188004d40 2024-04-28T13:08:32.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.983+0000 7fd1957fa640 1 -- 172.21.15.114:0/3246694197 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7fd18c01d070 con 0x7fd188004d40 2024-04-28T13:08:32.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.984+0000 7fd1957fa640 1 --2- 172.21.15.114:0/3246694197 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd17c06c9b0 0x7fd17c06ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:32.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.984+0000 7fd1957fa640 1 -- 172.21.15.114:0/3246694197 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd18c08b5e0 con 0x7fd188004d40 2024-04-28T13:08:32.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.984+0000 7fd197fff640 1 --2- 172.21.15.114:0/3246694197 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd17c06c9b0 0x7fd17c06ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:32.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.984+0000 7fd197fff640 1 --2- 172.21.15.114:0/3246694197 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd17c06c9b0 0x7fd17c06ee70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd1981f62d0 tx=0x7fd184008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:32.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:32.988+0000 7fd1957fa640 1 -- 172.21.15.114:0/3246694197 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd18c059a20 con 0x7fd188004d40 2024-04-28T13:08:33.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.162+0000 7fd19eb97640 1 -- 172.21.15.114:0/3246694197 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd19806a3d0 con 0x7fd188004d40 2024-04-28T13:08:33.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.162+0000 7fd1957fa640 1 -- 172.21.15.114:0/3246694197 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) ==== 104+0+11 (secure 0 0 0) 0x7fd18c059320 con 0x7fd188004d40 2024-04-28T13:08:33.162 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-04-28T13:08:33.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.164+0000 7fd19eb97640 1 -- 172.21.15.114:0/3246694197 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd17c06c9b0 msgr2=0x7fd17c06ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:33.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.164+0000 7fd19eb97640 1 --2- 172.21.15.114:0/3246694197 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd17c06c9b0 0x7fd17c06ee70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd1981f62d0 tx=0x7fd184008040 comp rx=0 tx=0).stop 2024-04-28T13:08:33.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.164+0000 7fd19eb97640 1 -- 172.21.15.114:0/3246694197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd188004d40 msgr2=0x7fd19814a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:33.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.164+0000 7fd19eb97640 1 --2- 172.21.15.114:0/3246694197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd188004d40 0x7fd19814a830 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd18c007370 tx=0x7fd18c007830 comp rx=0 tx=0).stop 2024-04-28T13:08:33.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.164+0000 7fd19eb97640 1 -- 172.21.15.114:0/3246694197 shutdown_connections 2024-04-28T13:08:33.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.164+0000 7fd19eb97640 1 --2- 172.21.15.114:0/3246694197 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd198072b90 0x7fd198073010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:33.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.164+0000 7fd19eb97640 1 --2- 172.21.15.114:0/3246694197 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fd17c06c9b0 0x7fd17c06ee70 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:33.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.164+0000 7fd19eb97640 1 --2- 172.21.15.114:0/3246694197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd198158e20 0x7fd19815b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:33.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.164+0000 7fd19eb97640 1 --2- 172.21.15.114:0/3246694197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd188004d40 0x7fd19814a830 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:33.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.164+0000 7fd19eb97640 1 -- 172.21.15.114:0/3246694197 >> 172.21.15.114:0/3246694197 conn(0x7fd1980d16b0 msgr2=0x7fd198157cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:33.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.164+0000 7fd19eb97640 1 -- 172.21.15.114:0/3246694197 shutdown_connections 2024-04-28T13:08:33.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.164+0000 7fd19eb97640 1 -- 172.21.15.114:0/3246694197 wait complete. 2024-04-28T13:08:33.175 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-28T13:08:33.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.275+0000 7f6c6a912640 1 Processor -- start 2024-04-28T13:08:33.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.275+0000 7f6c6a912640 1 -- start start 2024-04-28T13:08:33.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.275+0000 7f6c6a912640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6c6406c350 0x7f6c640b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:33.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.275+0000 7f6c6a912640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6c640ce9a0 0x7f6c64162f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:33.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.275+0000 7f6c6a912640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c64163600 con 0x7f6c6406c730 2024-04-28T13:08:33.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.275+0000 7f6c6a912640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f6c64163ea0 con 0x7f6c6406c350 2024-04-28T13:08:33.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.275+0000 7f6c6a912640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f6c641638e0 con 0x7f6c640ce9a0 2024-04-28T13:08:33.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.276+0000 7f6c63fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6c6406c350 0x7f6c640b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:33.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.276+0000 7f6c63fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6c6406c350 0x7f6c640b59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43092/0 (socket says 172.21.15.114:43092) 2024-04-28T13:08:33.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.276+0000 7f6c63fff640 1 -- 172.21.15.114:0/217510861 learned_addr learned my addr 172.21.15.114:0/217510861 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:33.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.276+0000 7f6c637fe640 1 --2- 172.21.15.114:0/217510861 >> v2:172.21.15.134:3300/0 conn(0x7f6c640ce9a0 0x7f6c64162f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:33.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.276+0000 7f6c63fff640 1 -- 172.21.15.114:0/217510861 >> v2:172.21.15.134:3300/0 conn(0x7f6c640ce9a0 msgr2=0x7f6c64162f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:33.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.276+0000 7f6c63fff640 1 --2- 172.21.15.114:0/217510861 >> v2:172.21.15.134:3300/0 conn(0x7f6c640ce9a0 0x7f6c64162f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:33.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.276+0000 7f6c63fff640 1 -- 172.21.15.114:0/217510861 >> v1:172.21.15.134:6789/0 conn(0x7f6c6406c730 legacy=0x7f6c64070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:33.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.276+0000 7f6c63fff640 1 -- 172.21.15.114:0/217510861 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c64163bc0 con 0x7f6c6406c350 2024-04-28T13:08:33.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.276+0000 7f6c63fff640 1 --2- 172.21.15.114:0/217510861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c6406c350 0x7f6c640b59a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6c64076230 tx=0x7f6c5802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e42655b193e1b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:33.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.277+0000 7f6c62ffd640 1 -- 172.21.15.114:0/217510861 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c58037070 con 0x7f6c6406c350 2024-04-28T13:08:33.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.277+0000 7f6c62ffd640 1 -- 172.21.15.114:0/217510861 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c58032440 con 0x7f6c6406c350 2024-04-28T13:08:33.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.277+0000 7f6c62ffd640 1 -- 172.21.15.114:0/217510861 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c58032810 con 0x7f6c6406c350 2024-04-28T13:08:33.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.277+0000 7f6c6a912640 1 -- 172.21.15.114:0/217510861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c6406c350 msgr2=0x7f6c640b59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:33.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.277+0000 7f6c6a912640 1 --2- 172.21.15.114:0/217510861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c6406c350 0x7f6c640b59a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6c64076230 tx=0x7f6c5802a1a0 comp rx=0 tx=0).stop 2024-04-28T13:08:33.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.277+0000 7f6c6a912640 1 -- 172.21.15.114:0/217510861 shutdown_connections 2024-04-28T13:08:33.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.277+0000 7f6c6a912640 1 --2- 172.21.15.114:0/217510861 >> v2:172.21.15.134:3300/0 conn(0x7f6c640ce9a0 0x7f6c64162f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:33.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.277+0000 7f6c6a912640 1 --2- 172.21.15.114:0/217510861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c6406c350 0x7f6c640b59a0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:33.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.277+0000 7f6c6a912640 1 -- 172.21.15.114:0/217510861 >> 172.21.15.114:0/217510861 conn(0x7f6c6406f4f0 msgr2=0x7f6c6406f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:33.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.277+0000 7f6c6a912640 1 -- 172.21.15.114:0/217510861 shutdown_connections 2024-04-28T13:08:33.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.277+0000 7f6c6a912640 1 -- 172.21.15.114:0/217510861 wait complete. 2024-04-28T13:08:33.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.278+0000 7f6c6a912640 1 Processor -- start 2024-04-28T13:08:33.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.279+0000 7f6c6a912640 1 -- start start 2024-04-28T13:08:33.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.279+0000 7f6c6a912640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c6406c350 0x7f6c6413d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:33.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.279+0000 7f6c6a912640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c6406c730 0x7f6c64161d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:33.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.279+0000 7f6c6a912640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c640ce9a0 0x7f6c64162240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:33.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.279+0000 7f6c6a912640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6c64148f40 con 0x7f6c640ce9a0 2024-04-28T13:08:33.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.279+0000 7f6c6a912640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6c64148dc0 con 0x7f6c6406c730 2024-04-28T13:08:33.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.279+0000 7f6c6a912640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f6c64071540 con 0x7f6c6406c350 2024-04-28T13:08:33.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.279+0000 7f6c68eaf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c640ce9a0 0x7f6c64162240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:33.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.279+0000 7f6c68eaf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c640ce9a0 0x7f6c64162240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43104/0 (socket says 172.21.15.114:43104) 2024-04-28T13:08:33.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.279+0000 7f6c68eaf640 1 -- 172.21.15.114:0/1561665582 learned_addr learned my addr 172.21.15.114:0/1561665582 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:33.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.279+0000 7f6c637fe640 1 --2- 172.21.15.114:0/1561665582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c6406c730 0x7f6c64161d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:33.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.279+0000 7f6c63fff640 1 --2- 172.21.15.114:0/1561665582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c6406c350 0x7f6c6413d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:33.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.280+0000 7f6c68eaf640 1 -- 172.21.15.114:0/1561665582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c6406c350 msgr2=0x7f6c6413d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:33.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.280+0000 7f6c68eaf640 1 --2- 172.21.15.114:0/1561665582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c6406c350 0x7f6c6413d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:33.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.280+0000 7f6c68eaf640 1 -- 172.21.15.114:0/1561665582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c6406c730 msgr2=0x7f6c64161d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:33.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.280+0000 7f6c68eaf640 1 --2- 172.21.15.114:0/1561665582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c6406c730 0x7f6c64161d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:33.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.280+0000 7f6c68eaf640 1 -- 172.21.15.114:0/1561665582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c641629c0 con 0x7f6c640ce9a0 2024-04-28T13:08:33.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.280+0000 7f6c637fe640 1 --2- 172.21.15.114:0/1561665582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c6406c730 0x7f6c64161d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:33.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.280+0000 7f6c68eaf640 1 --2- 172.21.15.114:0/1561665582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c640ce9a0 0x7f6c64162240 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00c780 tx=0x7f6c5c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:33.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.280+0000 7f6c60ff9640 1 -- 172.21.15.114:0/1561665582 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c004b60 con 0x7f6c640ce9a0 2024-04-28T13:08:33.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.280+0000 7f6c60ff9640 1 -- 172.21.15.114:0/1561665582 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c5c004d00 con 0x7f6c640ce9a0 2024-04-28T13:08:33.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.280+0000 7f6c6a912640 1 -- 172.21.15.114:0/1561665582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c64162ca0 con 0x7f6c640ce9a0 2024-04-28T13:08:33.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.280+0000 7f6c60ff9640 1 -- 172.21.15.114:0/1561665582 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c00aa90 con 0x7f6c640ce9a0 2024-04-28T13:08:33.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.280+0000 7f6c6a912640 1 -- 172.21.15.114:0/1561665582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c641419b0 con 0x7f6c640ce9a0 2024-04-28T13:08:33.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.281+0000 7f6c6a912640 1 -- 172.21.15.114:0/1561665582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c64069d60 con 0x7f6c640ce9a0 2024-04-28T13:08:33.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.281+0000 7f6c60ff9640 1 -- 172.21.15.114:0/1561665582 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f6c5c00ac30 con 0x7f6c640ce9a0 2024-04-28T13:08:33.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.282+0000 7f6c60ff9640 1 --2- 172.21.15.114:0/1561665582 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6c5006c980 0x7f6c5006ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:33.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.282+0000 7f6c60ff9640 1 -- 172.21.15.114:0/1561665582 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f6c5c08c100 con 0x7f6c640ce9a0 2024-04-28T13:08:33.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.282+0000 7f6c63fff640 1 --2- 172.21.15.114:0/1561665582 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6c5006c980 0x7f6c5006ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:33.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.282+0000 7f6c63fff640 1 --2- 172.21.15.114:0/1561665582 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6c5006c980 0x7f6c5006ee40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6c58034000 tx=0x7f6c5802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:33.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.286+0000 7f6c60ff9640 1 -- 172.21.15.114:0/1561665582 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6c64069d60 con 0x7f6c640ce9a0 2024-04-28T13:08:33.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.460+0000 7f6c6a912640 1 -- 172.21.15.114:0/1561665582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6c6406a3d0 con 0x7f6c640ce9a0 2024-04-28T13:08:33.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.460+0000 7f6c60ff9640 1 -- 172.21.15.114:0/1561665582 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) ==== 100+0+11 (secure 0 0 0) 0x7f6c5c05a5d0 con 0x7f6c640ce9a0 2024-04-28T13:08:33.460 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-04-28T13:08:33.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.462+0000 7f6c6a912640 1 -- 172.21.15.114:0/1561665582 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6c5006c980 msgr2=0x7f6c5006ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:33.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.462+0000 7f6c6a912640 1 --2- 172.21.15.114:0/1561665582 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6c5006c980 0x7f6c5006ee40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6c58034000 tx=0x7f6c5802e000 comp rx=0 tx=0).stop 2024-04-28T13:08:33.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.462+0000 7f6c6a912640 1 -- 172.21.15.114:0/1561665582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c640ce9a0 msgr2=0x7f6c64162240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:33.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.462+0000 7f6c6a912640 1 --2- 172.21.15.114:0/1561665582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c640ce9a0 0x7f6c64162240 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00c780 tx=0x7f6c5c00cc40 comp rx=0 tx=0).stop 2024-04-28T13:08:33.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.462+0000 7f6c6a912640 1 -- 172.21.15.114:0/1561665582 shutdown_connections 2024-04-28T13:08:33.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.462+0000 7f6c6a912640 1 --2- 172.21.15.114:0/1561665582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c640ce9a0 0x7f6c64162240 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:33.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.462+0000 7f6c6a912640 1 --2- 172.21.15.114:0/1561665582 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6c5006c980 0x7f6c5006ee40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:33.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.462+0000 7f6c6a912640 1 --2- 172.21.15.114:0/1561665582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c6406c730 0x7f6c64161d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:33.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.462+0000 7f6c6a912640 1 --2- 172.21.15.114:0/1561665582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c6406c350 0x7f6c6413d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:33.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.462+0000 7f6c6a912640 1 -- 172.21.15.114:0/1561665582 >> 172.21.15.114:0/1561665582 conn(0x7f6c6406f4f0 msgr2=0x7f6c640afd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:33.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.462+0000 7f6c6a912640 1 -- 172.21.15.114:0/1561665582 shutdown_connections 2024-04-28T13:08:33.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.462+0000 7f6c6a912640 1 -- 172.21.15.114:0/1561665582 wait complete. 2024-04-28T13:08:33.473 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-28T13:08:33.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.570+0000 7f53896e3640 1 Processor -- start 2024-04-28T13:08:33.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.570+0000 7f53896e3640 1 -- start start 2024-04-28T13:08:33.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.571+0000 7f53896e3640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5384148c70 0x7f53840ae850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:33.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.571+0000 7f53896e3640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f538406ca60 0x7f5384071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:33.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.571+0000 7f53896e3640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5384163900 con 0x7f5384162f20 2024-04-28T13:08:33.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.571+0000 7f53896e3640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f5384070c80 con 0x7f538406ca60 2024-04-28T13:08:33.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.571+0000 7f53896e3640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f5384163be0 con 0x7f5384148c70 2024-04-28T13:08:33.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.571+0000 7f53837fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f538406ca60 0x7f5384071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:33.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.571+0000 7f53827fc640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f5384162f20 0x7f538406c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:54368/0 (socket says 172.21.15.114:54368) 2024-04-28T13:08:33.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.571+0000 7f53827fc640 1 -- 172.21.15.114:0/146226978 learned_addr learned my addr 172.21.15.114:0/146226978 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:33.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.571+0000 7f5381ffb640 1 -- 172.21.15.114:0/146226978 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4040984440 0 0) 0x7f5384163900 con 0x7f5384162f20 2024-04-28T13:08:33.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.571+0000 7f5382ffd640 1 --2- 172.21.15.114:0/146226978 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5384148c70 0x7f53840ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:33.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.571+0000 7f5381ffb640 1 -- 172.21.15.114:0/146226978 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f536c003520 con 0x7f5384162f20 2024-04-28T13:08:33.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.572+0000 7f53837fe640 1 -- 172.21.15.114:0/146226978 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5384148c70 msgr2=0x7f53840ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:33.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.572+0000 7f53837fe640 1 --2- 172.21.15.114:0/146226978 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5384148c70 0x7f53840ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:33.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.572+0000 7f53837fe640 1 -- 172.21.15.114:0/146226978 >> v1:172.21.15.114:6789/0 conn(0x7f5384162f20 legacy=0x7f538406c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:33.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.572+0000 7f53837fe640 1 -- 172.21.15.114:0/146226978 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5384070910 con 0x7f538406ca60 2024-04-28T13:08:33.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.572+0000 7f5382ffd640 1 --2- 172.21.15.114:0/146226978 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5384148c70 0x7f53840ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:33.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.572+0000 7f53837fe640 1 --2- 172.21.15.114:0/146226978 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f538406ca60 0x7f5384071110 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f537c0097a0 tx=0x7f537c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1905bfed2ce05e79 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:33.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.572+0000 7f5381ffb640 1 -- 172.21.15.114:0/146226978 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537c037070 con 0x7f538406ca60 2024-04-28T13:08:33.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.572+0000 7f5381ffb640 1 -- 172.21.15.114:0/146226978 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f537c032440 con 0x7f538406ca60 2024-04-28T13:08:33.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.572+0000 7f5381ffb640 1 -- 172.21.15.114:0/146226978 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537c0327f0 con 0x7f538406ca60 2024-04-28T13:08:33.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.573+0000 7f53896e3640 1 -- 172.21.15.114:0/146226978 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f538406ca60 msgr2=0x7f5384071110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:33.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.573+0000 7f53896e3640 1 --2- 172.21.15.114:0/146226978 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f538406ca60 0x7f5384071110 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f537c0097a0 tx=0x7f537c02a180 comp rx=0 tx=0).stop 2024-04-28T13:08:33.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.573+0000 7f53896e3640 1 -- 172.21.15.114:0/146226978 shutdown_connections 2024-04-28T13:08:33.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.573+0000 7f53896e3640 1 --2- 172.21.15.114:0/146226978 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f538406ca60 0x7f5384071110 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:33.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.573+0000 7f53896e3640 1 --2- 172.21.15.114:0/146226978 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5384148c70 0x7f53840ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:33.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.573+0000 7f53896e3640 1 -- 172.21.15.114:0/146226978 >> 172.21.15.114:0/146226978 conn(0x7f53840d1fe0 msgr2=0x7f53840d23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:33.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.573+0000 7f53896e3640 1 -- 172.21.15.114:0/146226978 shutdown_connections 2024-04-28T13:08:33.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.573+0000 7f53896e3640 1 -- 172.21.15.114:0/146226978 wait complete. 2024-04-28T13:08:33.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.574+0000 7f53896e3640 1 Processor -- start 2024-04-28T13:08:33.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.574+0000 7f53896e3640 1 -- start start 2024-04-28T13:08:33.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.575+0000 7f53896e3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f538406ca60 0x7f538415ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:33.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.575+0000 7f53896e3640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5384148c70 0x7f5384142900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:33.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.575+0000 7f53896e3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5384162f20 0x7f53840b1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:33.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.575+0000 7f53896e3640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f53840740c0 con 0x7f538406ca60 2024-04-28T13:08:33.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.575+0000 7f53896e3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5384149050 con 0x7f5384162f20 2024-04-28T13:08:33.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.575+0000 7f53896e3640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f5384074240 con 0x7f5384148c70 2024-04-28T13:08:33.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.575+0000 7f5382ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f538406ca60 0x7f538415ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:33.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.575+0000 7f5382ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f538406ca60 0x7f538415ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43126/0 (socket says 172.21.15.114:43126) 2024-04-28T13:08:33.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.575+0000 7f5382ffd640 1 -- 172.21.15.114:0/2152695276 learned_addr learned my addr 172.21.15.114:0/2152695276 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:33.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.575+0000 7f53837fe640 1 --2- 172.21.15.114:0/2152695276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5384162f20 0x7f53840b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:33.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.575+0000 7f53827fc640 1 --2- 172.21.15.114:0/2152695276 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5384148c70 0x7f5384142900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:33.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.575+0000 7f5382ffd640 1 -- 172.21.15.114:0/2152695276 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5384148c70 msgr2=0x7f5384142900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:33.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.575+0000 7f5382ffd640 1 --2- 172.21.15.114:0/2152695276 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5384148c70 0x7f5384142900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:33.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.575+0000 7f5382ffd640 1 -- 172.21.15.114:0/2152695276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5384162f20 msgr2=0x7f53840b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:33.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.575+0000 7f5382ffd640 1 --2- 172.21.15.114:0/2152695276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5384162f20 0x7f53840b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:33.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.575+0000 7f5382ffd640 1 -- 172.21.15.114:0/2152695276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f538415fdc0 con 0x7f538406ca60 2024-04-28T13:08:33.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.575+0000 7f53837fe640 1 --2- 172.21.15.114:0/2152695276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5384162f20 0x7f53840b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:33.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.575+0000 7f53827fc640 1 --2- 172.21.15.114:0/2152695276 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5384148c70 0x7f5384142900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:33.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.575+0000 7f5382ffd640 1 --2- 172.21.15.114:0/2152695276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f538406ca60 0x7f538415ee30 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f537400cf60 tx=0x7f537400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:33.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.576+0000 7f536b7fe640 1 -- 172.21.15.114:0/2152695276 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537401a070 con 0x7f538406ca60 2024-04-28T13:08:33.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.576+0000 7f536b7fe640 1 -- 172.21.15.114:0/2152695276 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f537400d840 con 0x7f538406ca60 2024-04-28T13:08:33.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.576+0000 7f53896e3640 1 -- 172.21.15.114:0/2152695276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53841600a0 con 0x7f538406ca60 2024-04-28T13:08:33.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.576+0000 7f536b7fe640 1 -- 172.21.15.114:0/2152695276 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537400dc10 con 0x7f538406ca60 2024-04-28T13:08:33.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.576+0000 7f53896e3640 1 -- 172.21.15.114:0/2152695276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5384160660 con 0x7f538406ca60 2024-04-28T13:08:33.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.577+0000 7f53896e3640 1 -- 172.21.15.114:0/2152695276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f538406a3d0 con 0x7f538406ca60 2024-04-28T13:08:33.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.577+0000 7f536b7fe640 1 -- 172.21.15.114:0/2152695276 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f537401d070 con 0x7f538406ca60 2024-04-28T13:08:33.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.577+0000 7f536b7fe640 1 --2- 172.21.15.114:0/2152695276 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f537006c980 0x7f537006ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:33.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.577+0000 7f536b7fe640 1 -- 172.21.15.114:0/2152695276 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f537408c2c0 con 0x7f538406ca60 2024-04-28T13:08:33.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.577+0000 7f53827fc640 1 --2- 172.21.15.114:0/2152695276 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f537006c980 0x7f537006ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:33.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.578+0000 7f53827fc640 1 --2- 172.21.15.114:0/2152695276 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f537006c980 0x7f537006ee40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f53840c79f0 tx=0x7f5378009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:33.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.582+0000 7f536b7fe640 1 -- 172.21.15.114:0/2152695276 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f537405a140 con 0x7f538406ca60 2024-04-28T13:08:33.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.796+0000 7f53896e3640 1 -- 172.21.15.114:0/2152695276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5384073b20 con 0x7f538406ca60 2024-04-28T13:08:33.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.796+0000 7f536b7fe640 1 -- 172.21.15.114:0/2152695276 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5192 (secure 0 0 0) 0x7f537405e440 con 0x7f538406ca60 2024-04-28T13:08:33.796 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:33.796 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3832267996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":3832267996},{"type":"v1","addr":"172.21.15.134:6835","nonce":3832267996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5130,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2035724706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2035724706},{"type":"v1","addr":"172.21.15.114:6836","nonce":2035724706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":5133,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3180452801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3180452801},{"type":"v1","addr":"172.21.15.114:6837","nonce":3180452801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-28T13:08:18.038213+0000","modified":"2024-04-28T13:08:20.039019+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5145":{"gid":5145,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6834/1155749661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1155749661},{"type":"v1","addr":"172.21.15.134:6834","nonce":1155749661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5145,"qdb_cluster":[5145]},"id":2}]} 2024-04-28T13:08:33.796 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 14 2024-04-28T13:08:33.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.798+0000 7f53896e3640 1 -- 172.21.15.114:0/2152695276 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f537006c980 msgr2=0x7f537006ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:33.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.798+0000 7f53896e3640 1 --2- 172.21.15.114:0/2152695276 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f537006c980 0x7f537006ee40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f53840c79f0 tx=0x7f5378009040 comp rx=0 tx=0).stop 2024-04-28T13:08:33.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.798+0000 7f53896e3640 1 -- 172.21.15.114:0/2152695276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f538406ca60 msgr2=0x7f538415ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:33.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.798+0000 7f53896e3640 1 --2- 172.21.15.114:0/2152695276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f538406ca60 0x7f538415ee30 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f537400cf60 tx=0x7f537400cf90 comp rx=0 tx=0).stop 2024-04-28T13:08:33.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.798+0000 7f53896e3640 1 -- 172.21.15.114:0/2152695276 shutdown_connections 2024-04-28T13:08:33.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.798+0000 7f53896e3640 1 --2- 172.21.15.114:0/2152695276 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f537006c980 0x7f537006ee40 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:33.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.798+0000 7f53896e3640 1 --2- 172.21.15.114:0/2152695276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5384162f20 0x7f53840b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:33.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.798+0000 7f53896e3640 1 --2- 172.21.15.114:0/2152695276 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5384148c70 0x7f5384142900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:33.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.798+0000 7f53896e3640 1 --2- 172.21.15.114:0/2152695276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f538406ca60 0x7f538415ee30 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:33.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.798+0000 7f53896e3640 1 -- 172.21.15.114:0/2152695276 >> 172.21.15.114:0/2152695276 conn(0x7f53840d1fe0 msgr2=0x7f5384147ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:33.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.798+0000 7f53896e3640 1 -- 172.21.15.114:0/2152695276 shutdown_connections 2024-04-28T13:08:33.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.798+0000 7f53896e3640 1 -- 172.21.15.114:0/2152695276 wait complete. 2024-04-28T13:08:33.809 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:08:33.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.905+0000 7f95a3883640 1 Processor -- start 2024-04-28T13:08:33.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.906+0000 7f95a3883640 1 -- start start 2024-04-28T13:08:33.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.906+0000 7f95a3883640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f959c1595c0 0x7f959c0cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:33.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.906+0000 7f95a3883640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f959c0cdfa0 0x7f959c15c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:33.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.906+0000 7f95a3883640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f959c1599a0 con 0x7f959c15bf30 2024-04-28T13:08:33.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.906+0000 7f95a3883640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f959c15cf80 con 0x7f959c0cdfa0 2024-04-28T13:08:33.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.906+0000 7f95a3883640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f959c15c9c0 con 0x7f959c1595c0 2024-04-28T13:08:33.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.907+0000 7f95a1e20640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f959c0cdfa0 0x7f959c15c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:33.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.907+0000 7f95a1e20640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f959c0cdfa0 0x7f959c15c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43130/0 (socket says 172.21.15.114:43130) 2024-04-28T13:08:33.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.907+0000 7f95a1e20640 1 -- 172.21.15.114:0/2957117893 learned_addr learned my addr 172.21.15.114:0/2957117893 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:33.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.907+0000 7f95a161f640 1 --2- 172.21.15.114:0/2957117893 >> v2:172.21.15.134:3300/0 conn(0x7f959c1595c0 0x7f959c0cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:33.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.907+0000 7f95a1e20640 1 -- 172.21.15.114:0/2957117893 >> v2:172.21.15.134:3300/0 conn(0x7f959c1595c0 msgr2=0x7f959c0cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:33.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.907+0000 7f95a1e20640 1 --2- 172.21.15.114:0/2957117893 >> v2:172.21.15.134:3300/0 conn(0x7f959c1595c0 0x7f959c0cf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:33.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.907+0000 7f95a1e20640 1 -- 172.21.15.114:0/2957117893 >> v1:172.21.15.134:6789/0 conn(0x7f959c15bf30 legacy=0x7f959c0cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:33.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.907+0000 7f95a1e20640 1 -- 172.21.15.114:0/2957117893 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959c15cca0 con 0x7f959c0cdfa0 2024-04-28T13:08:33.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.908+0000 7f95a1e20640 1 --2- 172.21.15.114:0/2957117893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f959c0cdfa0 0x7f959c15c3b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f959c0ce6f0 tx=0x7f959402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e23cfe8c9f3a96 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:33.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.908+0000 7f958ffff640 1 -- 172.21.15.114:0/2957117893 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9594036070 con 0x7f959c0cdfa0 2024-04-28T13:08:33.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.908+0000 7f958ffff640 1 -- 172.21.15.114:0/2957117893 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9594031600 con 0x7f959c0cdfa0 2024-04-28T13:08:33.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.908+0000 7f958ffff640 1 -- 172.21.15.114:0/2957117893 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95940319d0 con 0x7f959c0cdfa0 2024-04-28T13:08:33.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.908+0000 7f95a3883640 1 -- 172.21.15.114:0/2957117893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f959c0cdfa0 msgr2=0x7f959c15c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:33.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.908+0000 7f95a3883640 1 --2- 172.21.15.114:0/2957117893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f959c0cdfa0 0x7f959c15c3b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f959c0ce6f0 tx=0x7f959402a6a0 comp rx=0 tx=0).stop 2024-04-28T13:08:33.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.908+0000 7f95a3883640 1 -- 172.21.15.114:0/2957117893 shutdown_connections 2024-04-28T13:08:33.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.908+0000 7f95a3883640 1 --2- 172.21.15.114:0/2957117893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f959c0cdfa0 0x7f959c15c3b0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:33.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.908+0000 7f95a3883640 1 --2- 172.21.15.114:0/2957117893 >> v2:172.21.15.134:3300/0 conn(0x7f959c1595c0 0x7f959c0cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:33.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.908+0000 7f95a3883640 1 -- 172.21.15.114:0/2957117893 >> 172.21.15.114:0/2957117893 conn(0x7f959c06c980 msgr2=0x7f959c0b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:33.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.908+0000 7f95a3883640 1 -- 172.21.15.114:0/2957117893 shutdown_connections 2024-04-28T13:08:33.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.908+0000 7f95a3883640 1 -- 172.21.15.114:0/2957117893 wait complete. 2024-04-28T13:08:33.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.910+0000 7f95a3883640 1 Processor -- start 2024-04-28T13:08:33.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.910+0000 7f95a3883640 1 -- start start 2024-04-28T13:08:33.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.910+0000 7f95a3883640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f959c0cdfa0 0x7f959c140c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:33.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.910+0000 7f95a3883640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f959c1595c0 0x7f959c152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:33.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.910+0000 7f95a3883640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f959c15bf30 0x7f959c0ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:33.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.910+0000 7f95a3883640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f959c0b6150 con 0x7f959c15bf30 2024-04-28T13:08:33.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.910+0000 7f95a3883640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f959c0cf170 con 0x7f959c1595c0 2024-04-28T13:08:33.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.910+0000 7f95a3883640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f959c0b62d0 con 0x7f959c0cdfa0 2024-04-28T13:08:33.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.910+0000 7f95a1e20640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f959c15bf30 0x7f959c0ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:33.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.910+0000 7f95a1e20640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f959c15bf30 0x7f959c0ae850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43142/0 (socket says 172.21.15.114:43142) 2024-04-28T13:08:33.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.910+0000 7f95a1e20640 1 -- 172.21.15.114:0/2093545223 learned_addr learned my addr 172.21.15.114:0/2093545223 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:33.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.911+0000 7f95a1e20640 1 -- 172.21.15.114:0/2093545223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f959c0cdfa0 msgr2=0x7f959c140c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:33.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.911+0000 7f95a0e1e640 1 --2- 172.21.15.114:0/2093545223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f959c1595c0 0x7f959c152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:33.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.911+0000 7f95a161f640 1 --2- 172.21.15.114:0/2093545223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f959c0cdfa0 0x7f959c140c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:33.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.911+0000 7f95a1e20640 1 --2- 172.21.15.114:0/2093545223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f959c0cdfa0 0x7f959c140c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:33.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.911+0000 7f95a1e20640 1 -- 172.21.15.114:0/2093545223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f959c1595c0 msgr2=0x7f959c152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:33.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.911+0000 7f95a1e20640 1 --2- 172.21.15.114:0/2093545223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f959c1595c0 0x7f959c152b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:33.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.911+0000 7f95a1e20640 1 -- 172.21.15.114:0/2093545223 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959c14f500 con 0x7f959c15bf30 2024-04-28T13:08:33.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.911+0000 7f95a1e20640 1 --2- 172.21.15.114:0/2093545223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f959c15bf30 0x7f959c0ae850 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9594009f40 tx=0x7f9594004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:33.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.911+0000 7f958dffb640 1 -- 172.21.15.114:0/2093545223 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9594036050 con 0x7f959c15bf30 2024-04-28T13:08:33.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.911+0000 7f958dffb640 1 -- 172.21.15.114:0/2093545223 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9594042070 con 0x7f959c15bf30 2024-04-28T13:08:33.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.911+0000 7f958dffb640 1 -- 172.21.15.114:0/2093545223 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9594009510 con 0x7f959c15bf30 2024-04-28T13:08:33.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.911+0000 7f95a3883640 1 -- 172.21.15.114:0/2093545223 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f959c0afec0 con 0x7f959c15bf30 2024-04-28T13:08:33.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.911+0000 7f95a3883640 1 -- 172.21.15.114:0/2093545223 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f959c0afae0 con 0x7f959c15bf30 2024-04-28T13:08:33.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.912+0000 7f95a3883640 1 -- 172.21.15.114:0/2093545223 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f959c06a3d0 con 0x7f959c15bf30 2024-04-28T13:08:33.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.913+0000 7f958dffb640 1 -- 172.21.15.114:0/2093545223 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f9594007bd0 con 0x7f959c15bf30 2024-04-28T13:08:33.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.913+0000 7f958dffb640 1 --2- 172.21.15.114:0/2093545223 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f958006c980 0x7f958006ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:33.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.913+0000 7f958dffb640 1 -- 172.21.15.114:0/2093545223 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f95940acaf0 con 0x7f959c15bf30 2024-04-28T13:08:33.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.913+0000 7f95a161f640 1 --2- 172.21.15.114:0/2093545223 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f958006c980 0x7f958006ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:33.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.913+0000 7f95a161f640 1 --2- 172.21.15.114:0/2093545223 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f958006c980 0x7f958006ee40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9590006fd0 tx=0x7f9590008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:33.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:33.917+0000 7f958dffb640 1 -- 172.21.15.114:0/2093545223 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9594045360 con 0x7f959c15bf30 2024-04-28T13:08:34.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.091+0000 7f95a3883640 1 -- 172.21.15.114:0/2093545223 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f959c06e630 con 0x7f959c15bf30 2024-04-28T13:08:34.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.092+0000 7f958dffb640 1 -- 172.21.15.114:0/2093545223 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16717 (secure 0 0 0) 0x7f959407aeb0 con 0x7f959c15bf30 2024-04-28T13:08:34.092 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:34.092 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":34,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:08:19.691257+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-28T13:08:16.244962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-28T13:08:16.991345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:08:34.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.094+0000 7f95a3883640 1 -- 172.21.15.114:0/2093545223 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f958006c980 msgr2=0x7f958006ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:34.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.094+0000 7f95a3883640 1 --2- 172.21.15.114:0/2093545223 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f958006c980 0x7f958006ee40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9590006fd0 tx=0x7f9590008040 comp rx=0 tx=0).stop 2024-04-28T13:08:34.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.094+0000 7f95a3883640 1 -- 172.21.15.114:0/2093545223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f959c15bf30 msgr2=0x7f959c0ae850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:34.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.094+0000 7f95a3883640 1 --2- 172.21.15.114:0/2093545223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f959c15bf30 0x7f959c0ae850 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9594009f40 tx=0x7f9594004a40 comp rx=0 tx=0).stop 2024-04-28T13:08:34.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.094+0000 7f95a3883640 1 -- 172.21.15.114:0/2093545223 shutdown_connections 2024-04-28T13:08:34.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.094+0000 7f95a3883640 1 --2- 172.21.15.114:0/2093545223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f959c15bf30 0x7f959c0ae850 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:34.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.094+0000 7f95a3883640 1 --2- 172.21.15.114:0/2093545223 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f958006c980 0x7f958006ee40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:34.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.094+0000 7f95a3883640 1 --2- 172.21.15.114:0/2093545223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f959c1595c0 0x7f959c152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:34.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.094+0000 7f95a3883640 1 --2- 172.21.15.114:0/2093545223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f959c0cdfa0 0x7f959c140c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:34.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.094+0000 7f95a3883640 1 -- 172.21.15.114:0/2093545223 >> 172.21.15.114:0/2093545223 conn(0x7f959c06c980 msgr2=0x7f959c0b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:34.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.094+0000 7f95a3883640 1 -- 172.21.15.114:0/2093545223 shutdown_connections 2024-04-28T13:08:34.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.094+0000 7f95a3883640 1 -- 172.21.15.114:0/2093545223 wait complete. 2024-04-28T13:08:34.105 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-28T13:08:34.105 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-28T13:08:34.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.202+0000 7efeb4a2a640 1 Processor -- start 2024-04-28T13:08:34.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.202+0000 7efeb4a2a640 1 -- start start 2024-04-28T13:08:34.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.203+0000 7efeb4a2a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efeb00d0670 0x7efeb00baaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:34.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.203+0000 7efeb4a2a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efeb00b4380 0x7efeb00b8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:34.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.203+0000 7efeb4a2a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efeb00d3650 con 0x7efeb015f410 2024-04-28T13:08:34.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.203+0000 7efeb4a2a640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7efeb00d3f10 con 0x7efeb00d0670 2024-04-28T13:08:34.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.203+0000 7efeb4a2a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7efeb00b8840 con 0x7efeb00b4380 2024-04-28T13:08:34.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.203+0000 7efeadd9b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efeb00d0670 0x7efeb00baaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:34.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.203+0000 7efeadd9b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efeb00d0670 0x7efeb00baaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43146/0 (socket says 172.21.15.114:43146) 2024-04-28T13:08:34.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.203+0000 7efeadd9b640 1 -- 172.21.15.114:0/1018837265 learned_addr learned my addr 172.21.15.114:0/1018837265 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:34.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.203+0000 7efeaed9d640 1 --2- 172.21.15.114:0/1018837265 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efeb00b4380 0x7efeb00b8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:34.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.203+0000 7efeadd9b640 1 -- 172.21.15.114:0/1018837265 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efeb00b4380 msgr2=0x7efeb00b8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:34.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.203+0000 7efeadd9b640 1 --2- 172.21.15.114:0/1018837265 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efeb00b4380 0x7efeb00b8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:34.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.203+0000 7efeadd9b640 1 -- 172.21.15.114:0/1018837265 >> v1:172.21.15.134:6789/0 conn(0x7efeb015f410 legacy=0x7efeb00cff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:34.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.203+0000 7efeadd9b640 1 -- 172.21.15.114:0/1018837265 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb015f7f0 con 0x7efeb00d0670 2024-04-28T13:08:34.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.203+0000 7efeaed9d640 1 --2- 172.21.15.114:0/1018837265 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efeb00b4380 0x7efeb00b8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:34.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.204+0000 7efeadd9b640 1 --2- 172.21.15.114:0/1018837265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efeb00d0670 0x7efeb00baaf0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7efea4009870 tx=0x7efea402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=825bc6dba54c1f35 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:34.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.204+0000 7efead59a640 1 -- 172.21.15.114:0/1018837265 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea4037070 con 0x7efeb00d0670 2024-04-28T13:08:34.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.204+0000 7efead59a640 1 -- 172.21.15.114:0/1018837265 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efea4032440 con 0x7efeb00d0670 2024-04-28T13:08:34.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.204+0000 7efead59a640 1 -- 172.21.15.114:0/1018837265 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea4032810 con 0x7efeb00d0670 2024-04-28T13:08:34.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.205+0000 7efeb4a2a640 1 -- 172.21.15.114:0/1018837265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efeb00d0670 msgr2=0x7efeb00baaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:34.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.205+0000 7efeb4a2a640 1 --2- 172.21.15.114:0/1018837265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efeb00d0670 0x7efeb00baaf0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7efea4009870 tx=0x7efea402a2a0 comp rx=0 tx=0).stop 2024-04-28T13:08:34.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.205+0000 7efeb4a2a640 1 -- 172.21.15.114:0/1018837265 shutdown_connections 2024-04-28T13:08:34.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.205+0000 7efeb4a2a640 1 --2- 172.21.15.114:0/1018837265 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efeb00b4380 0x7efeb00b8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:34.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.205+0000 7efeb4a2a640 1 --2- 172.21.15.114:0/1018837265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efeb00d0670 0x7efeb00baaf0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:34.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.205+0000 7efeb4a2a640 1 -- 172.21.15.114:0/1018837265 >> 172.21.15.114:0/1018837265 conn(0x7efeb00633a0 msgr2=0x7efeb00d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:34.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.205+0000 7efeb4a2a640 1 -- 172.21.15.114:0/1018837265 shutdown_connections 2024-04-28T13:08:34.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.205+0000 7efeb4a2a640 1 -- 172.21.15.114:0/1018837265 wait complete. 2024-04-28T13:08:34.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.206+0000 7efeb4a2a640 1 Processor -- start 2024-04-28T13:08:34.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.206+0000 7efeb4a2a640 1 -- start start 2024-04-28T13:08:34.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.207+0000 7efeb4a2a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efeb00b4380 0x7efeb01595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:34.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.207+0000 7efeb4a2a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efeb00d0670 0x7efeb00cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:34.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.207+0000 7efeb4a2a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efeb015f410 0x7efeb00b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:34.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.207+0000 7efeb4a2a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7efeb00d3ba0 con 0x7efeb015f410 2024-04-28T13:08:34.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.207+0000 7efeb4a2a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efeb00d2570 con 0x7efeb00d0670 2024-04-28T13:08:34.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.207+0000 7efeb4a2a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7efeb00bb180 con 0x7efeb00b4380 2024-04-28T13:08:34.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.207+0000 7efeaed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efeb015f410 0x7efeb00b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:34.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.207+0000 7efeaed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efeb015f410 0x7efeb00b32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43160/0 (socket says 172.21.15.114:43160) 2024-04-28T13:08:34.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.207+0000 7efeaed9d640 1 -- 172.21.15.114:0/259085493 learned_addr learned my addr 172.21.15.114:0/259085493 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:34.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.207+0000 7efeadd9b640 1 --2- 172.21.15.114:0/259085493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efeb00d0670 0x7efeb00cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:34.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.207+0000 7efeae59c640 1 --2- 172.21.15.114:0/259085493 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efeb00b4380 0x7efeb01595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:34.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.207+0000 7efeaed9d640 1 -- 172.21.15.114:0/259085493 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efeb00b4380 msgr2=0x7efeb01595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:34.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.207+0000 7efeaed9d640 1 --2- 172.21.15.114:0/259085493 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efeb00b4380 0x7efeb01595b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:34.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.207+0000 7efeaed9d640 1 -- 172.21.15.114:0/259085493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efeb00d0670 msgr2=0x7efeb00cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:34.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.207+0000 7efeaed9d640 1 --2- 172.21.15.114:0/259085493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efeb00d0670 0x7efeb00cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:34.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.207+0000 7efeaed9d640 1 -- 172.21.15.114:0/259085493 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb0159af0 con 0x7efeb015f410 2024-04-28T13:08:34.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.208+0000 7efeaed9d640 1 --2- 172.21.15.114:0/259085493 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efeb015f410 0x7efeb00b32f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7efea800c7f0 tx=0x7efea800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:34.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.208+0000 7efe9effd640 1 -- 172.21.15.114:0/259085493 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8015070 con 0x7efeb015f410 2024-04-28T13:08:34.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.208+0000 7efe9effd640 1 -- 172.21.15.114:0/259085493 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efea8007820 con 0x7efeb015f410 2024-04-28T13:08:34.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.208+0000 7efeb4a2a640 1 -- 172.21.15.114:0/259085493 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb00ccd40 con 0x7efeb015f410 2024-04-28T13:08:34.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.208+0000 7efe9effd640 1 -- 172.21.15.114:0/259085493 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8007c50 con 0x7efeb015f410 2024-04-28T13:08:34.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.208+0000 7efeb4a2a640 1 -- 172.21.15.114:0/259085493 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb00cd300 con 0x7efeb015f410 2024-04-28T13:08:34.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.209+0000 7efeb4a2a640 1 -- 172.21.15.114:0/259085493 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeb006a3d0 con 0x7efeb015f410 2024-04-28T13:08:34.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.209+0000 7efe9effd640 1 -- 172.21.15.114:0/259085493 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7efea8018070 con 0x7efeb015f410 2024-04-28T13:08:34.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.209+0000 7efe9effd640 1 --2- 172.21.15.114:0/259085493 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7efe9006c980 0x7efe9006ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:34.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.210+0000 7efeae59c640 1 --2- 172.21.15.114:0/259085493 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7efe9006c980 0x7efe9006ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:34.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.210+0000 7efe9effd640 1 -- 172.21.15.114:0/259085493 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7efea808bd20 con 0x7efeb015f410 2024-04-28T13:08:34.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.210+0000 7efeae59c640 1 --2- 172.21.15.114:0/259085493 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7efe9006c980 0x7efe9006ee40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efeb00b7860 tx=0x7efea000d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:34.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.214+0000 7efe9effd640 1 -- 172.21.15.114:0/259085493 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7efea8059a90 con 0x7efeb015f410 2024-04-28T13:08:34.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.423+0000 7efeb4a2a640 1 -- 172.21.15.114:0/259085493 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efeb00d4430 con 0x7efeb015f410 2024-04-28T13:08:34.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.423+0000 7efe9effd640 1 -- 172.21.15.114:0/259085493 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5192 (secure 0 0 0) 0x7efea805dd90 con 0x7efeb015f410 2024-04-28T13:08:34.423 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:34.423 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3832267996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":3832267996},{"type":"v1","addr":"172.21.15.134:6835","nonce":3832267996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5130,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2035724706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2035724706},{"type":"v1","addr":"172.21.15.114:6836","nonce":2035724706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":5133,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3180452801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3180452801},{"type":"v1","addr":"172.21.15.114:6837","nonce":3180452801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-28T13:08:18.038213+0000","modified":"2024-04-28T13:08:20.039019+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5145":{"gid":5145,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6834/1155749661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1155749661},{"type":"v1","addr":"172.21.15.134:6834","nonce":1155749661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5145,"qdb_cluster":[5145]},"id":2}]} 2024-04-28T13:08:34.423 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 14 2024-04-28T13:08:34.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.425+0000 7efeb4a2a640 1 -- 172.21.15.114:0/259085493 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7efe9006c980 msgr2=0x7efe9006ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:34.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.425+0000 7efeb4a2a640 1 --2- 172.21.15.114:0/259085493 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7efe9006c980 0x7efe9006ee40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efeb00b7860 tx=0x7efea000d040 comp rx=0 tx=0).stop 2024-04-28T13:08:34.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.425+0000 7efeb4a2a640 1 -- 172.21.15.114:0/259085493 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efeb015f410 msgr2=0x7efeb00b32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:34.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.425+0000 7efeb4a2a640 1 --2- 172.21.15.114:0/259085493 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efeb015f410 0x7efeb00b32f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7efea800c7f0 tx=0x7efea800ccb0 comp rx=0 tx=0).stop 2024-04-28T13:08:34.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.425+0000 7efeb4a2a640 1 -- 172.21.15.114:0/259085493 shutdown_connections 2024-04-28T13:08:34.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.425+0000 7efeb4a2a640 1 --2- 172.21.15.114:0/259085493 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efeb015f410 0x7efeb00b32f0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:34.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.425+0000 7efeb4a2a640 1 --2- 172.21.15.114:0/259085493 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7efe9006c980 0x7efe9006ee40 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:34.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.425+0000 7efeb4a2a640 1 --2- 172.21.15.114:0/259085493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efeb00d0670 0x7efeb00cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:34.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.425+0000 7efeb4a2a640 1 --2- 172.21.15.114:0/259085493 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efeb00b4380 0x7efeb01595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:34.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.425+0000 7efeb4a2a640 1 -- 172.21.15.114:0/259085493 >> 172.21.15.114:0/259085493 conn(0x7efeb00633a0 msgr2=0x7efeb00b89f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:34.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.425+0000 7efeb4a2a640 1 -- 172.21.15.114:0/259085493 shutdown_connections 2024-04-28T13:08:34.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.425+0000 7efeb4a2a640 1 -- 172.21.15.114:0/259085493 wait complete. 2024-04-28T13:08:34.436 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-28T13:08:34.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.533+0000 7fe6e71f7640 1 Processor -- start 2024-04-28T13:08:34.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.533+0000 7fe6e71f7640 1 -- start start 2024-04-28T13:08:34.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.533+0000 7fe6e71f7640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6e00b53f0 0x7fe6e00b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:34.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.533+0000 7fe6e71f7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe6e0070d80 0x7fe6e0071210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:34.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.533+0000 7fe6e71f7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6e0073ce0 con 0x7fe6e01487f0 2024-04-28T13:08:34.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.533+0000 7fe6e71f7640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fe6e00b5de0 con 0x7fe6e0070d80 2024-04-28T13:08:34.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.533+0000 7fe6e71f7640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fe6e0074580 con 0x7fe6e00b53f0 2024-04-28T13:08:34.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.534+0000 7fe6e5794640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe6e0070d80 0x7fe6e0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:34.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.534+0000 7fe6e5794640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe6e0070d80 0x7fe6e0071210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43172/0 (socket says 172.21.15.114:43172) 2024-04-28T13:08:34.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.534+0000 7fe6e5794640 1 -- 172.21.15.114:0/760133439 learned_addr learned my addr 172.21.15.114:0/760133439 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:34.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.534+0000 7fe6dffff640 1 --2- 172.21.15.114:0/760133439 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6e00b53f0 0x7fe6e00b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:34.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.534+0000 7fe6e5794640 1 -- 172.21.15.114:0/760133439 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6e00b53f0 msgr2=0x7fe6e00b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:34.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.534+0000 7fe6e5794640 1 --2- 172.21.15.114:0/760133439 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6e00b53f0 0x7fe6e00b58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:34.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.534+0000 7fe6e5794640 1 -- 172.21.15.114:0/760133439 >> v1:172.21.15.134:6789/0 conn(0x7fe6e01487f0 legacy=0x7fe6e0073290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:34.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.534+0000 7fe6e5794640 1 -- 172.21.15.114:0/760133439 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e0073fc0 con 0x7fe6e0070d80 2024-04-28T13:08:34.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.534+0000 7fe6e5794640 1 --2- 172.21.15.114:0/760133439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6e0070d80 0x7fe6e0071210 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8009e50 tx=0x7fe6d802a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7712831b6472bad5 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:34.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.535+0000 7fe6df7fe640 1 -- 172.21.15.114:0/760133439 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8036070 con 0x7fe6e0070d80 2024-04-28T13:08:34.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.535+0000 7fe6df7fe640 1 -- 172.21.15.114:0/760133439 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6d8031600 con 0x7fe6e0070d80 2024-04-28T13:08:34.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.535+0000 7fe6df7fe640 1 -- 172.21.15.114:0/760133439 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d80319d0 con 0x7fe6e0070d80 2024-04-28T13:08:34.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.535+0000 7fe6e71f7640 1 -- 172.21.15.114:0/760133439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6e0070d80 msgr2=0x7fe6e0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:34.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.535+0000 7fe6e71f7640 1 --2- 172.21.15.114:0/760133439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6e0070d80 0x7fe6e0071210 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8009e50 tx=0x7fe6d802a630 comp rx=0 tx=0).stop 2024-04-28T13:08:34.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.535+0000 7fe6e71f7640 1 -- 172.21.15.114:0/760133439 shutdown_connections 2024-04-28T13:08:34.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.535+0000 7fe6e71f7640 1 --2- 172.21.15.114:0/760133439 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6e00b53f0 0x7fe6e00b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:34.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.535+0000 7fe6e71f7640 1 --2- 172.21.15.114:0/760133439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6e0070d80 0x7fe6e0071210 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:34.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.535+0000 7fe6e71f7640 1 -- 172.21.15.114:0/760133439 >> 172.21.15.114:0/760133439 conn(0x7fe6e00b3d50 msgr2=0x7fe6e00b4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:34.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.535+0000 7fe6e71f7640 1 -- 172.21.15.114:0/760133439 shutdown_connections 2024-04-28T13:08:34.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.535+0000 7fe6e71f7640 1 -- 172.21.15.114:0/760133439 wait complete. 2024-04-28T13:08:34.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.536+0000 7fe6e71f7640 1 Processor -- start 2024-04-28T13:08:34.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.536+0000 7fe6e71f7640 1 -- start start 2024-04-28T13:08:34.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.537+0000 7fe6e71f7640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6e0070d80 0x7fe6e014dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:34.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.537+0000 7fe6e71f7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6e00b53f0 0x7fe6e013eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:34.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.537+0000 7fe6e71f7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6e01487f0 0x7fe6e01eaf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:34.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.537+0000 7fe6e71f7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e00739a0 con 0x7fe6e01487f0 2024-04-28T13:08:34.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.537+0000 7fe6e71f7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e0070860 con 0x7fe6e00b53f0 2024-04-28T13:08:34.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.537+0000 7fe6e71f7640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fe6e00ae850 con 0x7fe6e0070d80 2024-04-28T13:08:34.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.537+0000 7fe6e5794640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6e01487f0 0x7fe6e01eaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:34.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.537+0000 7fe6e5794640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6e01487f0 0x7fe6e01eaf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43180/0 (socket says 172.21.15.114:43180) 2024-04-28T13:08:34.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.537+0000 7fe6e5794640 1 -- 172.21.15.114:0/1852221591 learned_addr learned my addr 172.21.15.114:0/1852221591 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:34.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.537+0000 7fe6dffff640 1 --2- 172.21.15.114:0/1852221591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6e00b53f0 0x7fe6e013eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:34.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.537+0000 7fe6e4f93640 1 --2- 172.21.15.114:0/1852221591 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6e0070d80 0x7fe6e014dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:34.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.538+0000 7fe6e5794640 1 -- 172.21.15.114:0/1852221591 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6e0070d80 msgr2=0x7fe6e014dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:34.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.538+0000 7fe6e5794640 1 --2- 172.21.15.114:0/1852221591 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6e0070d80 0x7fe6e014dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:34.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.538+0000 7fe6e5794640 1 -- 172.21.15.114:0/1852221591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6e00b53f0 msgr2=0x7fe6e013eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:34.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.538+0000 7fe6e5794640 1 --2- 172.21.15.114:0/1852221591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6e00b53f0 0x7fe6e013eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:34.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.538+0000 7fe6e5794640 1 -- 172.21.15.114:0/1852221591 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e0148e00 con 0x7fe6e01487f0 2024-04-28T13:08:34.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.538+0000 7fe6dffff640 1 --2- 172.21.15.114:0/1852221591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6e00b53f0 0x7fe6e013eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:34.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.538+0000 7fe6e5794640 1 --2- 172.21.15.114:0/1852221591 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6e01487f0 0x7fe6e01eaf90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8009e50 tx=0x7fe6d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:34.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.538+0000 7fe6dd7fa640 1 -- 172.21.15.114:0/1852221591 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8036050 con 0x7fe6e01487f0 2024-04-28T13:08:34.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.538+0000 7fe6dd7fa640 1 -- 172.21.15.114:0/1852221591 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6d8042070 con 0x7fe6e01487f0 2024-04-28T13:08:34.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.538+0000 7fe6e71f7640 1 -- 172.21.15.114:0/1852221591 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6e014e290 con 0x7fe6e01487f0 2024-04-28T13:08:34.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.538+0000 7fe6dd7fa640 1 -- 172.21.15.114:0/1852221591 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8009510 con 0x7fe6e01487f0 2024-04-28T13:08:34.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.538+0000 7fe6e71f7640 1 -- 172.21.15.114:0/1852221591 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6e014b550 con 0x7fe6e01487f0 2024-04-28T13:08:34.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.539+0000 7fe6e71f7640 1 -- 172.21.15.114:0/1852221591 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6e006a3d0 con 0x7fe6e01487f0 2024-04-28T13:08:34.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.539+0000 7fe6dd7fa640 1 -- 172.21.15.114:0/1852221591 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7fe6d8007bd0 con 0x7fe6e01487f0 2024-04-28T13:08:34.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.540+0000 7fe6dd7fa640 1 --2- 172.21.15.114:0/1852221591 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fe6c406c9b0 0x7fe6c406ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:34.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.540+0000 7fe6dd7fa640 1 -- 172.21.15.114:0/1852221591 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fe6d80acc20 con 0x7fe6e01487f0 2024-04-28T13:08:34.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.540+0000 7fe6e4f93640 1 --2- 172.21.15.114:0/1852221591 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fe6c406c9b0 0x7fe6c406ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:34.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.540+0000 7fe6e4f93640 1 --2- 172.21.15.114:0/1852221591 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fe6c406c9b0 0x7fe6c406ee70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0160c30 tx=0x7fe6d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:34.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.544+0000 7fe6dd7fa640 1 -- 172.21.15.114:0/1852221591 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe6e0148e00 con 0x7fe6e01487f0 2024-04-28T13:08:34.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.760+0000 7fe6e71f7640 1 -- 172.21.15.114:0/1852221591 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe6e00b4840 con 0x7fe6e01487f0 2024-04-28T13:08:34.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.761+0000 7fe6dd7fa640 1 -- 172.21.15.114:0/1852221591 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5192 (secure 0 0 0) 0x7fe6d8045360 con 0x7fe6e01487f0 2024-04-28T13:08:34.761 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:34.762 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3832267996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":3832267996},{"type":"v1","addr":"172.21.15.134:6835","nonce":3832267996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5130,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2035724706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2035724706},{"type":"v1","addr":"172.21.15.114:6836","nonce":2035724706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":5133,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3180452801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3180452801},{"type":"v1","addr":"172.21.15.114:6837","nonce":3180452801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-28T13:08:18.038213+0000","modified":"2024-04-28T13:08:20.039019+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5145":{"gid":5145,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6834/1155749661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1155749661},{"type":"v1","addr":"172.21.15.134:6834","nonce":1155749661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5145,"qdb_cluster":[5145]},"id":2}]} 2024-04-28T13:08:34.763 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 14 2024-04-28T13:08:34.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.763+0000 7fe6e71f7640 1 -- 172.21.15.114:0/1852221591 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fe6c406c9b0 msgr2=0x7fe6c406ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:34.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.763+0000 7fe6e71f7640 1 --2- 172.21.15.114:0/1852221591 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fe6c406c9b0 0x7fe6c406ee70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0160c30 tx=0x7fe6d4009040 comp rx=0 tx=0).stop 2024-04-28T13:08:34.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.763+0000 7fe6e71f7640 1 -- 172.21.15.114:0/1852221591 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6e01487f0 msgr2=0x7fe6e01eaf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:34.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.763+0000 7fe6e71f7640 1 --2- 172.21.15.114:0/1852221591 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6e01487f0 0x7fe6e01eaf90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8009e50 tx=0x7fe6d8004a40 comp rx=0 tx=0).stop 2024-04-28T13:08:34.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.763+0000 7fe6e71f7640 1 -- 172.21.15.114:0/1852221591 shutdown_connections 2024-04-28T13:08:34.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.763+0000 7fe6e71f7640 1 --2- 172.21.15.114:0/1852221591 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6e01487f0 0x7fe6e01eaf90 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:34.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.763+0000 7fe6e71f7640 1 --2- 172.21.15.114:0/1852221591 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fe6c406c9b0 0x7fe6c406ee70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:34.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.763+0000 7fe6e71f7640 1 --2- 172.21.15.114:0/1852221591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6e00b53f0 0x7fe6e013eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:34.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.763+0000 7fe6e71f7640 1 --2- 172.21.15.114:0/1852221591 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6e0070d80 0x7fe6e014dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:34.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.763+0000 7fe6e71f7640 1 -- 172.21.15.114:0/1852221591 >> 172.21.15.114:0/1852221591 conn(0x7fe6e00b3d50 msgr2=0x7fe6e0143ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:34.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.763+0000 7fe6e71f7640 1 -- 172.21.15.114:0/1852221591 shutdown_connections 2024-04-28T13:08:34.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.763+0000 7fe6e71f7640 1 -- 172.21.15.114:0/1852221591 wait complete. 2024-04-28T13:08:34.774 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:08:34.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.873+0000 7fda68a64640 1 Processor -- start 2024-04-28T13:08:34.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.873+0000 7fda68a64640 1 -- start start 2024-04-28T13:08:34.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.874+0000 7fda68a64640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fda64153330 0x7fda6415d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:34.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.874+0000 7fda68a64640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda64153710 con 0x7fda640742c0 2024-04-28T13:08:34.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.874+0000 7fda68a64640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda640b4a60 con 0x7fda640723d0 2024-04-28T13:08:34.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.874+0000 7fda68a64640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fda64072990 con 0x7fda64153330 2024-04-28T13:08:34.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.874+0000 7fda6259c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fda64153330 0x7fda6415d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:34.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.874+0000 7fda62d9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fda640742c0 0x7fda640cedf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:54378/0 (socket says 172.21.15.114:54378) 2024-04-28T13:08:34.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.874+0000 7fda62d9d640 1 -- 172.21.15.114:0/935839264 learned_addr learned my addr 172.21.15.114:0/935839264 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:34.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.874+0000 7fda6259c640 1 -- 172.21.15.114:0/935839264 >> v1:172.21.15.134:6789/0 conn(0x7fda640723d0 legacy=0x7fda64073bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:34.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.874+0000 7fda6259c640 1 -- 172.21.15.114:0/935839264 >> v1:172.21.15.114:6789/0 conn(0x7fda640742c0 legacy=0x7fda640cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:34.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.874+0000 7fda6259c640 1 -- 172.21.15.114:0/935839264 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda64072c70 con 0x7fda64153330 2024-04-28T13:08:34.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.874+0000 7fda61d9b640 1 -- 172.21.15.114:0/935839264 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1819379332 0 0) 0x7fda5c001490 con 0x7fda640742c0 2024-04-28T13:08:34.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.875+0000 7fda6259c640 1 --2- 172.21.15.114:0/935839264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda64153330 0x7fda6415d2e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fda540097a0 tx=0x7fda5402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ef17c39248adbe server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:34.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.875+0000 7fda61d9b640 1 -- 172.21.15.114:0/935839264 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda54037070 con 0x7fda64153330 2024-04-28T13:08:34.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.875+0000 7fda61d9b640 1 -- 172.21.15.114:0/935839264 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda5402ae50 con 0x7fda64153330 2024-04-28T13:08:34.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.875+0000 7fda61d9b640 1 -- 172.21.15.114:0/935839264 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda54032660 con 0x7fda64153330 2024-04-28T13:08:34.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.875+0000 7fda68a64640 1 -- 172.21.15.114:0/935839264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda64153330 msgr2=0x7fda6415d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:34.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.875+0000 7fda68a64640 1 --2- 172.21.15.114:0/935839264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda64153330 0x7fda6415d2e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fda540097a0 tx=0x7fda5402a140 comp rx=0 tx=0).stop 2024-04-28T13:08:34.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.875+0000 7fda68a64640 1 -- 172.21.15.114:0/935839264 shutdown_connections 2024-04-28T13:08:34.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.875+0000 7fda68a64640 1 --2- 172.21.15.114:0/935839264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda64153330 0x7fda6415d2e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:34.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.875+0000 7fda68a64640 1 -- 172.21.15.114:0/935839264 >> 172.21.15.114:0/935839264 conn(0x7fda6406c980 msgr2=0x7fda640b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:34.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.875+0000 7fda68a64640 1 -- 172.21.15.114:0/935839264 shutdown_connections 2024-04-28T13:08:34.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.875+0000 7fda68a64640 1 -- 172.21.15.114:0/935839264 wait complete. 2024-04-28T13:08:34.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.877+0000 7fda68a64640 1 Processor -- start 2024-04-28T13:08:34.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.877+0000 7fda68a64640 1 -- start start 2024-04-28T13:08:34.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.877+0000 7fda68a64640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda640723d0 0x7fda6415e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:34.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.877+0000 7fda68a64640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda640742c0 0x7fda641f5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:34.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.877+0000 7fda68a64640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fda64153330 0x7fda6406ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:34.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.877+0000 7fda68a64640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fda64073510 con 0x7fda640742c0 2024-04-28T13:08:34.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.877+0000 7fda68a64640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fda64073230 con 0x7fda640723d0 2024-04-28T13:08:34.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.877+0000 7fda68a64640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fda640cf500 con 0x7fda64153330 2024-04-28T13:08:34.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.878+0000 7fda5bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda640742c0 0x7fda641f5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:34.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.878+0000 7fda5bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda640742c0 0x7fda641f5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43190/0 (socket says 172.21.15.114:43190) 2024-04-28T13:08:34.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.878+0000 7fda5bfff640 1 -- 172.21.15.114:0/661952191 learned_addr learned my addr 172.21.15.114:0/661952191 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:34.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.878+0000 7fda5bfff640 1 -- 172.21.15.114:0/661952191 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fda64153330 msgr2=0x7fda6406ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:34.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.878+0000 7fda6259c640 1 --2- 172.21.15.114:0/661952191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda640723d0 0x7fda6415e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:34.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.878+0000 7fda5bfff640 1 --2- 172.21.15.114:0/661952191 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fda64153330 0x7fda6406ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:34.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.878+0000 7fda5bfff640 1 -- 172.21.15.114:0/661952191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda640723d0 msgr2=0x7fda6415e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:34.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.878+0000 7fda5bfff640 1 --2- 172.21.15.114:0/661952191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda640723d0 0x7fda6415e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:34.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.878+0000 7fda5bfff640 1 -- 172.21.15.114:0/661952191 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda640af820 con 0x7fda640742c0 2024-04-28T13:08:34.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.878+0000 7fda5bfff640 1 --2- 172.21.15.114:0/661952191 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda640742c0 0x7fda641f5200 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fda4c00c410 tx=0x7fda4c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:34.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.878+0000 7fda5affd640 1 -- 172.21.15.114:0/661952191 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4c017070 con 0x7fda640742c0 2024-04-28T13:08:34.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.878+0000 7fda5affd640 1 -- 172.21.15.114:0/661952191 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda4c0035f0 con 0x7fda640742c0 2024-04-28T13:08:34.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.878+0000 7fda5affd640 1 -- 172.21.15.114:0/661952191 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4c003a20 con 0x7fda640742c0 2024-04-28T13:08:34.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.878+0000 7fda68a64640 1 -- 172.21.15.114:0/661952191 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda640afb00 con 0x7fda640742c0 2024-04-28T13:08:34.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.878+0000 7fda68a64640 1 -- 172.21.15.114:0/661952191 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda64157980 con 0x7fda640742c0 2024-04-28T13:08:34.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.879+0000 7fda68a64640 1 -- 172.21.15.114:0/661952191 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda6406a3d0 con 0x7fda640742c0 2024-04-28T13:08:34.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.880+0000 7fda5affd640 1 -- 172.21.15.114:0/661952191 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7fda4c01a070 con 0x7fda640742c0 2024-04-28T13:08:34.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.880+0000 7fda5affd640 1 --2- 172.21.15.114:0/661952191 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fda4406c980 0x7fda4406ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:34.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.880+0000 7fda5affd640 1 -- 172.21.15.114:0/661952191 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fda4c08afe0 con 0x7fda640742c0 2024-04-28T13:08:34.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.880+0000 7fda6259c640 1 --2- 172.21.15.114:0/661952191 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fda4406c980 0x7fda4406ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:34.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.880+0000 7fda6259c640 1 --2- 172.21.15.114:0/661952191 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fda4406c980 0x7fda4406ee40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fda54034000 tx=0x7fda5402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:34.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:34.884+0000 7fda5affd640 1 -- 172.21.15.114:0/661952191 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fda4c0594b0 con 0x7fda640742c0 2024-04-28T13:08:35.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.058+0000 7fda68a64640 1 -- 172.21.15.114:0/661952191 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fda64157b50 con 0x7fda640742c0 2024-04-28T13:08:35.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.059+0000 7fda5affd640 1 -- 172.21.15.114:0/661952191 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16717 (secure 0 0 0) 0x7fda4c058db0 con 0x7fda640742c0 2024-04-28T13:08:35.060 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:35.060 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":34,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:08:19.691257+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-28T13:08:16.244962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-28T13:08:16.991345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:08:35.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.061+0000 7fda68a64640 1 -- 172.21.15.114:0/661952191 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fda4406c980 msgr2=0x7fda4406ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:35.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.061+0000 7fda68a64640 1 --2- 172.21.15.114:0/661952191 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fda4406c980 0x7fda4406ee40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fda54034000 tx=0x7fda5402e000 comp rx=0 tx=0).stop 2024-04-28T13:08:35.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.061+0000 7fda68a64640 1 -- 172.21.15.114:0/661952191 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda640742c0 msgr2=0x7fda641f5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:35.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.061+0000 7fda68a64640 1 --2- 172.21.15.114:0/661952191 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda640742c0 0x7fda641f5200 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fda4c00c410 tx=0x7fda4c00c8d0 comp rx=0 tx=0).stop 2024-04-28T13:08:35.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.061+0000 7fda68a64640 1 -- 172.21.15.114:0/661952191 shutdown_connections 2024-04-28T13:08:35.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.061+0000 7fda68a64640 1 --2- 172.21.15.114:0/661952191 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fda64153330 0x7fda6406ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:35.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.061+0000 7fda68a64640 1 --2- 172.21.15.114:0/661952191 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda640742c0 0x7fda641f5200 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:35.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.061+0000 7fda68a64640 1 --2- 172.21.15.114:0/661952191 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fda4406c980 0x7fda4406ee40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:35.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.061+0000 7fda68a64640 1 --2- 172.21.15.114:0/661952191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda640723d0 0x7fda6415e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:35.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.061+0000 7fda68a64640 1 -- 172.21.15.114:0/661952191 >> 172.21.15.114:0/661952191 conn(0x7fda6406c980 msgr2=0x7fda6415a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:35.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.062+0000 7fda68a64640 1 -- 172.21.15.114:0/661952191 shutdown_connections 2024-04-28T13:08:35.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.062+0000 7fda68a64640 1 -- 172.21.15.114:0/661952191 wait complete. 2024-04-28T13:08:35.072 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-28T13:08:35.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.170+0000 7f80c0e7b640 1 Processor -- start 2024-04-28T13:08:35.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.170+0000 7f80c0e7b640 1 -- start start 2024-04-28T13:08:35.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.171+0000 7f80c0e7b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f80bc15ac50 0x7f80bc0b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:35.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.171+0000 7f80c0e7b640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80bc160c60 con 0x7f80bc15e390 2024-04-28T13:08:35.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.171+0000 7f80c0e7b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80bc160f40 con 0x7f80bc0d1490 2024-04-28T13:08:35.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.171+0000 7f80c0e7b640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f80bc161220 con 0x7f80bc15ac50 2024-04-28T13:08:35.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.171+0000 7f80ba59c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f80bc15ac50 0x7f80bc0b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:35.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.171+0000 7f80b9d9b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f80bc15e390 0x7f80bc0d0d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:54388/0 (socket says 172.21.15.114:54388) 2024-04-28T13:08:35.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.171+0000 7f80ba59c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f80bc15ac50 0x7f80bc0b3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43196/0 (socket says 172.21.15.114:43196) 2024-04-28T13:08:35.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.171+0000 7f80b9d9b640 1 -- 172.21.15.114:0/1443187576 learned_addr learned my addr 172.21.15.114:0/1443187576 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:35.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.171+0000 7f80ba59c640 1 -- 172.21.15.114:0/1443187576 >> v1:172.21.15.134:6789/0 conn(0x7f80bc0d1490 legacy=0x7f80bc145f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:35.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.172+0000 7f80b959a640 1 -- 172.21.15.114:0/1443187576 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1779478598 0 0) 0x7f80bc160c60 con 0x7f80bc15e390 2024-04-28T13:08:35.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.172+0000 7f80ba59c640 1 -- 172.21.15.114:0/1443187576 >> v1:172.21.15.114:6789/0 conn(0x7f80bc15e390 legacy=0x7f80bc0d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:35.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.172+0000 7f80ba59c640 1 -- 172.21.15.114:0/1443187576 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80bc161500 con 0x7f80bc15ac50 2024-04-28T13:08:35.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.172+0000 7f80ba59c640 1 --2- 172.21.15.114:0/1443187576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80bc15ac50 0x7f80bc0b3e60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f80ac009d90 tx=0x7f80ac02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af8c8473a66e8e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:35.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.172+0000 7f80b959a640 1 -- 172.21.15.114:0/1443187576 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac007740 con 0x7f80bc15ac50 2024-04-28T13:08:35.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.172+0000 7f80b959a640 1 -- 172.21.15.114:0/1443187576 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80ac0078e0 con 0x7f80bc15ac50 2024-04-28T13:08:35.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.172+0000 7f80b959a640 1 -- 172.21.15.114:0/1443187576 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac007cb0 con 0x7f80bc15ac50 2024-04-28T13:08:35.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.173+0000 7f80c0e7b640 1 -- 172.21.15.114:0/1443187576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80bc15ac50 msgr2=0x7f80bc0b3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:35.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.173+0000 7f80c0e7b640 1 --2- 172.21.15.114:0/1443187576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80bc15ac50 0x7f80bc0b3e60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f80ac009d90 tx=0x7f80ac02a6a0 comp rx=0 tx=0).stop 2024-04-28T13:08:35.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.173+0000 7f80c0e7b640 1 -- 172.21.15.114:0/1443187576 shutdown_connections 2024-04-28T13:08:35.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.173+0000 7f80c0e7b640 1 --2- 172.21.15.114:0/1443187576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80bc15ac50 0x7f80bc0b3e60 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:35.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.173+0000 7f80c0e7b640 1 -- 172.21.15.114:0/1443187576 >> 172.21.15.114:0/1443187576 conn(0x7f80bc0cd8b0 msgr2=0x7f80bc0cdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:35.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.173+0000 7f80c0e7b640 1 -- 172.21.15.114:0/1443187576 shutdown_connections 2024-04-28T13:08:35.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.173+0000 7f80c0e7b640 1 -- 172.21.15.114:0/1443187576 wait complete. 2024-04-28T13:08:35.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.174+0000 7f80c0e7b640 1 Processor -- start 2024-04-28T13:08:35.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.174+0000 7f80c0e7b640 1 -- start start 2024-04-28T13:08:35.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.175+0000 7f80c0e7b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80bc0d1490 0x7f80bc149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:35.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.175+0000 7f80c0e7b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80bc15ac50 0x7f80bc15c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:35.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.175+0000 7f80c0e7b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80bc15e390 0x7f80bc15c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:35.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.175+0000 7f80c0e7b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc0b43a0 con 0x7f80bc0d1490 2024-04-28T13:08:35.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.175+0000 7f80c0e7b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc15b030 con 0x7f80bc15ac50 2024-04-28T13:08:35.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.175+0000 7f80c0e7b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f80bc0b4520 con 0x7f80bc15e390 2024-04-28T13:08:35.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.175+0000 7f80ba59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80bc0d1490 0x7f80bc149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:35.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.175+0000 7f80ba59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80bc0d1490 0x7f80bc149700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43198/0 (socket says 172.21.15.114:43198) 2024-04-28T13:08:35.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.175+0000 7f80ba59c640 1 -- 172.21.15.114:0/1756034045 learned_addr learned my addr 172.21.15.114:0/1756034045 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:35.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.175+0000 7f80b9d9b640 1 --2- 172.21.15.114:0/1756034045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80bc15ac50 0x7f80bc15c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:35.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.175+0000 7f80ba59c640 1 -- 172.21.15.114:0/1756034045 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80bc15e390 msgr2=0x7f80bc15c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:35.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.175+0000 7f80bad9d640 1 --2- 172.21.15.114:0/1756034045 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80bc15e390 0x7f80bc15c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:35.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.175+0000 7f80ba59c640 1 --2- 172.21.15.114:0/1756034045 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80bc15e390 0x7f80bc15c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:35.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.175+0000 7f80ba59c640 1 -- 172.21.15.114:0/1756034045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80bc15ac50 msgr2=0x7f80bc15c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:35.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.175+0000 7f80ba59c640 1 --2- 172.21.15.114:0/1756034045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80bc15ac50 0x7f80bc15c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:35.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.175+0000 7f80ba59c640 1 -- 172.21.15.114:0/1756034045 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80bc15fdc0 con 0x7f80bc0d1490 2024-04-28T13:08:35.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.175+0000 7f80b9d9b640 1 --2- 172.21.15.114:0/1756034045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80bc15ac50 0x7f80bc15c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:35.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.175+0000 7f80bad9d640 1 --2- 172.21.15.114:0/1756034045 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80bc15e390 0x7f80bc15c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:35.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.176+0000 7f80ba59c640 1 --2- 172.21.15.114:0/1756034045 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80bc0d1490 0x7f80bc149700 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f80ac009d90 tx=0x7f80ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:35.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.176+0000 7f80aaffd640 1 -- 172.21.15.114:0/1756034045 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac040070 con 0x7f80bc0d1490 2024-04-28T13:08:35.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.176+0000 7f80aaffd640 1 -- 172.21.15.114:0/1756034045 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80ac031c40 con 0x7f80bc0d1490 2024-04-28T13:08:35.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.176+0000 7f80c0e7b640 1 -- 172.21.15.114:0/1756034045 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80bc15f520 con 0x7f80bc0d1490 2024-04-28T13:08:35.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.176+0000 7f80aaffd640 1 -- 172.21.15.114:0/1756034045 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac003990 con 0x7f80bc0d1490 2024-04-28T13:08:35.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.176+0000 7f80c0e7b640 1 -- 172.21.15.114:0/1756034045 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80bc15fae0 con 0x7f80bc0d1490 2024-04-28T13:08:35.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.177+0000 7f80c0e7b640 1 -- 172.21.15.114:0/1756034045 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80bc06a3d0 con 0x7f80bc0d1490 2024-04-28T13:08:35.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.177+0000 7f80aaffd640 1 -- 172.21.15.114:0/1756034045 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f80ac039040 con 0x7f80bc0d1490 2024-04-28T13:08:35.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.177+0000 7f80aaffd640 1 --2- 172.21.15.114:0/1756034045 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f809c06c980 0x7f809c06ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:35.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.178+0000 7f80aaffd640 1 -- 172.21.15.114:0/1756034045 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f80ac0ad000 con 0x7f80bc0d1490 2024-04-28T13:08:35.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.178+0000 7f80b9d9b640 1 --2- 172.21.15.114:0/1756034045 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f809c06c980 0x7f809c06ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:35.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.178+0000 7f80b9d9b640 1 --2- 172.21.15.114:0/1756034045 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f809c06c980 0x7f809c06ee40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f80bc06eea0 tx=0x7f80b0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:35.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.182+0000 7f80aaffd640 1 -- 172.21.15.114:0/1756034045 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f80ac07b330 con 0x7f80bc0d1490 2024-04-28T13:08:35.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.395+0000 7f80c0e7b640 1 -- 172.21.15.114:0/1756034045 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f80bc0b08b0 con 0x7f80bc0d1490 2024-04-28T13:08:35.395 INFO:tasks.ceph.mon.a.smithi114.stderr:2024-04-28T13:08:35.395+0000 7fb8b63d7640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-28T13:08:35.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.396+0000 7f80aaffd640 1 -- 172.21.15.114:0/1756034045 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) ==== 161+0+0 (secure 0 0 0) 0x7f80ac07ac30 con 0x7f80bc0d1490 2024-04-28T13:08:35.396 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-28T13:08:35.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.399+0000 7f80c0e7b640 1 -- 172.21.15.114:0/1756034045 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f809c06c980 msgr2=0x7f809c06ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:35.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.399+0000 7f80c0e7b640 1 --2- 172.21.15.114:0/1756034045 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f809c06c980 0x7f809c06ee40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f80bc06eea0 tx=0x7f80b0009040 comp rx=0 tx=0).stop 2024-04-28T13:08:35.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.399+0000 7f80c0e7b640 1 -- 172.21.15.114:0/1756034045 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80bc0d1490 msgr2=0x7f80bc149700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:35.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.399+0000 7f80c0e7b640 1 --2- 172.21.15.114:0/1756034045 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80bc0d1490 0x7f80bc149700 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f80ac009d90 tx=0x7f80ac004a40 comp rx=0 tx=0).stop 2024-04-28T13:08:35.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.399+0000 7f80c0e7b640 1 -- 172.21.15.114:0/1756034045 shutdown_connections 2024-04-28T13:08:35.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.399+0000 7f80c0e7b640 1 --2- 172.21.15.114:0/1756034045 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80bc15e390 0x7f80bc15c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:35.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.399+0000 7f80c0e7b640 1 --2- 172.21.15.114:0/1756034045 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f809c06c980 0x7f809c06ee40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:35.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.399+0000 7f80c0e7b640 1 --2- 172.21.15.114:0/1756034045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80bc15ac50 0x7f80bc15c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:35.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.399+0000 7f80c0e7b640 1 --2- 172.21.15.114:0/1756034045 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80bc0d1490 0x7f80bc149700 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:35.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.399+0000 7f80c0e7b640 1 -- 172.21.15.114:0/1756034045 >> 172.21.15.114:0/1756034045 conn(0x7f80bc0cd8b0 msgr2=0x7f80bc0b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:35.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.399+0000 7f80c0e7b640 1 -- 172.21.15.114:0/1756034045 shutdown_connections 2024-04-28T13:08:35.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.399+0000 7f80c0e7b640 1 -- 172.21.15.114:0/1756034045 wait complete. 2024-04-28T13:08:35.402 INFO:tasks.ceph.mds.d.smithi134.stderr: -4113> 2024-04-28T13:08:23.461+0000 7f8e4eb48640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-28T13:08:35.410 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-28T13:08:35.434 INFO:tasks.ceph.mds.d.smithi134.stdout:starting mds.d at 2024-04-28T13:08:35.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.510+0000 7f6820712640 1 Processor -- start 2024-04-28T13:08:35.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.510+0000 7f6820712640 1 -- start start 2024-04-28T13:08:35.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.511+0000 7f6820712640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6818072e30 0x7f68180732b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:35.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.511+0000 7f6820712640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68180d02b0 con 0x7f68180b4850 2024-04-28T13:08:35.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.511+0000 7f6820712640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68180cedc0 con 0x7f681815c370 2024-04-28T13:08:35.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.511+0000 7f6820712640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f6818073cc0 con 0x7f6818072e30 2024-04-28T13:08:35.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.511+0000 7f681e4ae640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f68180b4850 0x7f68180b4c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:54396/0 (socket says 172.21.15.114:54396) 2024-04-28T13:08:35.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.511+0000 7f681e4ae640 1 -- 172.21.15.114:0/2777342775 learned_addr learned my addr 172.21.15.114:0/2777342775 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:35.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.511+0000 7f681dcad640 1 --2- 172.21.15.114:0/2777342775 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6818072e30 0x7f68180732b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:35.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.511+0000 7f681d4ac640 1 -- 172.21.15.114:0/2777342775 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3758513765 0 0) 0x7f68180d02b0 con 0x7f68180b4850 2024-04-28T13:08:35.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.511+0000 7f681d4ac640 1 -- 172.21.15.114:0/2777342775 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6804005730 con 0x7f68180b4850 2024-04-28T13:08:35.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.511+0000 7f681d4ac640 1 -- 172.21.15.114:0/2777342775 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1086779046 0 0) 0x7f68180cedc0 con 0x7f681815c370 2024-04-28T13:08:35.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.511+0000 7f681dcad640 1 -- 172.21.15.114:0/2777342775 >> v1:172.21.15.134:6789/0 conn(0x7f681815c370 legacy=0x7f681815c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:35.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.511+0000 7f681dcad640 1 -- 172.21.15.114:0/2777342775 >> v1:172.21.15.114:6789/0 conn(0x7f68180b4850 legacy=0x7f68180b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:35.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.511+0000 7f681dcad640 1 -- 172.21.15.114:0/2777342775 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6818073fa0 con 0x7f6818072e30 2024-04-28T13:08:35.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.512+0000 7f681dcad640 1 --2- 172.21.15.114:0/2777342775 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6818072e30 0x7f68180732b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f68080097d0 tx=0x7f680802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d082856890027013 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:35.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.512+0000 7f681d4ac640 1 -- 172.21.15.114:0/2777342775 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6808037070 con 0x7f6818072e30 2024-04-28T13:08:35.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.512+0000 7f681d4ac640 1 -- 172.21.15.114:0/2777342775 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6808032440 con 0x7f6818072e30 2024-04-28T13:08:35.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.512+0000 7f681d4ac640 1 -- 172.21.15.114:0/2777342775 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6808032810 con 0x7f6818072e30 2024-04-28T13:08:35.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.513+0000 7f6820712640 1 -- 172.21.15.114:0/2777342775 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6818072e30 msgr2=0x7f68180732b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:35.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.513+0000 7f6820712640 1 --2- 172.21.15.114:0/2777342775 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6818072e30 0x7f68180732b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f68080097d0 tx=0x7f680802a180 comp rx=0 tx=0).stop 2024-04-28T13:08:35.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.513+0000 7f6820712640 1 -- 172.21.15.114:0/2777342775 shutdown_connections 2024-04-28T13:08:35.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.513+0000 7f6820712640 1 --2- 172.21.15.114:0/2777342775 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6818072e30 0x7f68180732b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:35.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.513+0000 7f6820712640 1 -- 172.21.15.114:0/2777342775 >> 172.21.15.114:0/2777342775 conn(0x7f681806c980 msgr2=0x7f68180b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:35.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.513+0000 7f6820712640 1 -- 172.21.15.114:0/2777342775 shutdown_connections 2024-04-28T13:08:35.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.513+0000 7f6820712640 1 -- 172.21.15.114:0/2777342775 wait complete. 2024-04-28T13:08:35.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.514+0000 7f6820712640 1 Processor -- start 2024-04-28T13:08:35.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.514+0000 7f6820712640 1 -- start start 2024-04-28T13:08:35.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.515+0000 7f6820712640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6818072e30 0x7f6818142710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:35.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.515+0000 7f6820712640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68180b4850 0x7f6818159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:35.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.515+0000 7f6820712640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f681815c370 0x7f68181599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:35.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.515+0000 7f6820712640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f681806e3e0 con 0x7f6818072e30 2024-04-28T13:08:35.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.515+0000 7f6820712640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6818074560 con 0x7f68180b4850 2024-04-28T13:08:35.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.515+0000 7f6820712640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f681815cf10 con 0x7f681815c370 2024-04-28T13:08:35.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.515+0000 7f681e4ae640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6818072e30 0x7f6818142710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:35.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.515+0000 7f681e4ae640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6818072e30 0x7f6818142710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43214/0 (socket says 172.21.15.114:43214) 2024-04-28T13:08:35.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.515+0000 7f681e4ae640 1 -- 172.21.15.114:0/1728331443 learned_addr learned my addr 172.21.15.114:0/1728331443 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:35.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.515+0000 7f681dcad640 1 --2- 172.21.15.114:0/1728331443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68180b4850 0x7f6818159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:35.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.515+0000 7f681ecaf640 1 --2- 172.21.15.114:0/1728331443 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f681815c370 0x7f68181599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:35.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.515+0000 7f681e4ae640 1 -- 172.21.15.114:0/1728331443 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f681815c370 msgr2=0x7f68181599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:35.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.515+0000 7f681e4ae640 1 --2- 172.21.15.114:0/1728331443 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f681815c370 0x7f68181599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:35.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.515+0000 7f681e4ae640 1 -- 172.21.15.114:0/1728331443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68180b4850 msgr2=0x7f6818159460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:35.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.515+0000 7f681e4ae640 1 --2- 172.21.15.114:0/1728331443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68180b4850 0x7f6818159460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.515+0000 7f681e4ae640 1 -- 172.21.15.114:0/1728331443 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f681815e030 con 0x7f6818072e30 2024-04-28T13:08:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.515+0000 7f681ecaf640 1 --2- 172.21.15.114:0/1728331443 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f681815c370 0x7f68181599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.515+0000 7f681e4ae640 1 --2- 172.21.15.114:0/1728331443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6818072e30 0x7f6818142710 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f681400c430 tx=0x7f681400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.515+0000 7f680effd640 1 -- 172.21.15.114:0/1728331443 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6814017070 con 0x7f6818072e30 2024-04-28T13:08:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.515+0000 7f680effd640 1 -- 172.21.15.114:0/1728331443 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6814005ce0 con 0x7f6818072e30 2024-04-28T13:08:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.515+0000 7f6820712640 1 -- 172.21.15.114:0/1728331443 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f681815e310 con 0x7f6818072e30 2024-04-28T13:08:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.515+0000 7f680effd640 1 -- 172.21.15.114:0/1728331443 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68140072f0 con 0x7f6818072e30 2024-04-28T13:08:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.515+0000 7f6820712640 1 -- 172.21.15.114:0/1728331443 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f681815e8d0 con 0x7f6818072e30 2024-04-28T13:08:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.516+0000 7f6820712640 1 -- 172.21.15.114:0/1728331443 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f681815ec00 con 0x7f6818072e30 2024-04-28T13:08:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.517+0000 7f680effd640 1 -- 172.21.15.114:0/1728331443 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f681401a070 con 0x7f6818072e30 2024-04-28T13:08:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.517+0000 7f680effd640 1 --2- 172.21.15.114:0/1728331443 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f67fc06c9b0 0x7f67fc06ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.517+0000 7f680effd640 1 -- 172.21.15.114:0/1728331443 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7f681408b130 con 0x7f6818072e30 2024-04-28T13:08:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.517+0000 7f681dcad640 1 --2- 172.21.15.114:0/1728331443 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f67fc06c9b0 0x7f67fc06ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:35.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.518+0000 7f681dcad640 1 --2- 172.21.15.114:0/1728331443 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f67fc06c9b0 0x7f67fc06ee70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6808034000 tx=0x7f680802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:35.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.522+0000 7f680effd640 1 -- 172.21.15.114:0/1728331443 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6814059480 con 0x7f6818072e30 2024-04-28T13:08:35.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:35.733+0000 7f6820712640 1 -- 172.21.15.114:0/1728331443 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f681814e1c0 con 0x7f6818072e30 2024-04-28T13:08:36.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.398+0000 7f680effd640 1 -- 172.21.15.114:0/1728331443 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v16) ==== 104+0+0 (secure 0 0 0) 0x7f681814e1c0 con 0x7f6818072e30 2024-04-28T13:08:36.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.401+0000 7f6820712640 1 -- 172.21.15.114:0/1728331443 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f67fc06c9b0 msgr2=0x7f67fc06ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:36.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.401+0000 7f6820712640 1 --2- 172.21.15.114:0/1728331443 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f67fc06c9b0 0x7f67fc06ee70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6808034000 tx=0x7f680802e000 comp rx=0 tx=0).stop 2024-04-28T13:08:36.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.401+0000 7f6820712640 1 -- 172.21.15.114:0/1728331443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6818072e30 msgr2=0x7f6818142710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:36.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.401+0000 7f6820712640 1 --2- 172.21.15.114:0/1728331443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6818072e30 0x7f6818142710 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f681400c430 tx=0x7f681400c8f0 comp rx=0 tx=0).stop 2024-04-28T13:08:36.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.401+0000 7f6820712640 1 -- 172.21.15.114:0/1728331443 shutdown_connections 2024-04-28T13:08:36.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.401+0000 7f6820712640 1 --2- 172.21.15.114:0/1728331443 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f681815c370 0x7f68181599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:36.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.401+0000 7f6820712640 1 --2- 172.21.15.114:0/1728331443 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f67fc06c9b0 0x7f67fc06ee70 secure :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6808034000 tx=0x7f680802e000 comp rx=0 tx=0).stop 2024-04-28T13:08:36.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.401+0000 7f6820712640 1 --2- 172.21.15.114:0/1728331443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68180b4850 0x7f6818159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:36.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.401+0000 7f6820712640 1 --2- 172.21.15.114:0/1728331443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6818072e30 0x7f6818142710 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:36.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.401+0000 7f6820712640 1 -- 172.21.15.114:0/1728331443 >> 172.21.15.114:0/1728331443 conn(0x7f681806c980 msgr2=0x7f68180cf4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:36.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.401+0000 7f6820712640 1 -- 172.21.15.114:0/1728331443 shutdown_connections 2024-04-28T13:08:36.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.401+0000 7f6820712640 1 -- 172.21.15.114:0/1728331443 wait complete. 2024-04-28T13:08:36.414 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-28T13:08:36.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.520+0000 7fc00815f640 1 Processor -- start 2024-04-28T13:08:36.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.520+0000 7fc00815f640 1 -- start start 2024-04-28T13:08:36.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.521+0000 7fc00815f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc0000b6900 0x7fc000162e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:36.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.521+0000 7fc00815f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc000163360 0x7fc000155950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:36.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.521+0000 7fc00815f640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0000b5860 con 0x7fc000070f70 2024-04-28T13:08:36.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.521+0000 7fc00815f640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fc0001637b0 con 0x7fc0000b6900 2024-04-28T13:08:36.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.521+0000 7fc00815f640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc0000b5b40 con 0x7fc000163360 2024-04-28T13:08:36.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.521+0000 7fc0056fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc0000b6900 0x7fc000162e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:36.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.521+0000 7fc005efb640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc000070f70 0x7fc0000af6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:54402/0 (socket says 172.21.15.114:54402) 2024-04-28T13:08:36.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.521+0000 7fc005efb640 1 -- 172.21.15.114:0/2041163523 learned_addr learned my addr 172.21.15.114:0/2041163523 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:36.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.521+0000 7fc0056fa640 1 --2- 172.21.15.114:0/2041163523 >> v2:172.21.15.114:3300/0 conn(0x7fc0000b6900 0x7fc000162e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43218/0 (socket says 172.21.15.114:43218) 2024-04-28T13:08:36.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.522+0000 7fc0056fa640 1 -- 172.21.15.114:0/2041163523 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc000163360 msgr2=0x7fc000155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:36.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.522+0000 7fc0056fa640 1 --2- 172.21.15.114:0/2041163523 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc000163360 0x7fc000155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:36.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.522+0000 7fc0056fa640 1 -- 172.21.15.114:0/2041163523 >> v1:172.21.15.114:6789/0 conn(0x7fc000070f70 legacy=0x7fc0000af6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:36.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.522+0000 7fc0056fa640 1 -- 172.21.15.114:0/2041163523 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0000b5e20 con 0x7fc0000b6900 2024-04-28T13:08:36.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.522+0000 7fc004ef9640 1 -- 172.21.15.114:0/2041163523 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 975842028 0 0) 0x7fc0000b5860 con 0x7fc000070f70 2024-04-28T13:08:36.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.522+0000 7fc0056fa640 1 --2- 172.21.15.114:0/2041163523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0000b6900 0x7fc000162e20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fbff00097a0 tx=0x7fbff002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bf498bbfedd1b24 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:36.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.522+0000 7fc004ef9640 1 -- 172.21.15.114:0/2041163523 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff0037070 con 0x7fc0000b6900 2024-04-28T13:08:36.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.522+0000 7fc004ef9640 1 -- 172.21.15.114:0/2041163523 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff0032440 con 0x7fc0000b6900 2024-04-28T13:08:36.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.522+0000 7fc004ef9640 1 -- 172.21.15.114:0/2041163523 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff0032810 con 0x7fc0000b6900 2024-04-28T13:08:36.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.523+0000 7fc00815f640 1 -- 172.21.15.114:0/2041163523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0000b6900 msgr2=0x7fc000162e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:36.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.523+0000 7fc00815f640 1 --2- 172.21.15.114:0/2041163523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0000b6900 0x7fc000162e20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fbff00097a0 tx=0x7fbff002a180 comp rx=0 tx=0).stop 2024-04-28T13:08:36.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.523+0000 7fc00815f640 1 -- 172.21.15.114:0/2041163523 shutdown_connections 2024-04-28T13:08:36.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.523+0000 7fc00815f640 1 --2- 172.21.15.114:0/2041163523 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc000163360 0x7fc000155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:36.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.523+0000 7fc00815f640 1 --2- 172.21.15.114:0/2041163523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0000b6900 0x7fc000162e20 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:36.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.523+0000 7fc00815f640 1 -- 172.21.15.114:0/2041163523 >> 172.21.15.114:0/2041163523 conn(0x7fc0000d18d0 msgr2=0x7fc0000d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:36.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.523+0000 7fc00815f640 1 -- 172.21.15.114:0/2041163523 shutdown_connections 2024-04-28T13:08:36.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.523+0000 7fc00815f640 1 -- 172.21.15.114:0/2041163523 wait complete. 2024-04-28T13:08:36.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.524+0000 7fc00815f640 1 Processor -- start 2024-04-28T13:08:36.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.524+0000 7fc00815f640 1 -- start start 2024-04-28T13:08:36.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.525+0000 7fc00815f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc000070f70 0x7fc000142500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:36.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.525+0000 7fc00815f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0000b6900 0x7fc000156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:36.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.525+0000 7fc00815f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc000163360 0x7fc000157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:36.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.525+0000 7fc00815f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc000071350 con 0x7fc0000b6900 2024-04-28T13:08:36.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.525+0000 7fc00815f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc0000b63e0 con 0x7fc000070f70 2024-04-28T13:08:36.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.525+0000 7fc00815f640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc0000afdc0 con 0x7fc000163360 2024-04-28T13:08:36.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.525+0000 7fc0056fa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0000b6900 0x7fc000156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:36.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.525+0000 7fc0056fa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0000b6900 0x7fc000156b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43228/0 (socket says 172.21.15.114:43228) 2024-04-28T13:08:36.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.525+0000 7fc0056fa640 1 -- 172.21.15.114:0/2394625271 learned_addr learned my addr 172.21.15.114:0/2394625271 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:36.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.525+0000 7fc0056fa640 1 -- 172.21.15.114:0/2394625271 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc000163360 msgr2=0x7fc000157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:36.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.525+0000 7fc0056fa640 1 --2- 172.21.15.114:0/2394625271 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc000163360 0x7fc000157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:36.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.525+0000 7fc0056fa640 1 -- 172.21.15.114:0/2394625271 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc000070f70 msgr2=0x7fc000142500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:36.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.525+0000 7fc005efb640 1 --2- 172.21.15.114:0/2394625271 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc000070f70 0x7fc000142500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:36.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.525+0000 7fc0056fa640 1 --2- 172.21.15.114:0/2394625271 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc000070f70 0x7fc000142500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:36.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.525+0000 7fc0056fa640 1 -- 172.21.15.114:0/2394625271 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc000157660 con 0x7fc0000b6900 2024-04-28T13:08:36.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.525+0000 7fc0056fa640 1 --2- 172.21.15.114:0/2394625271 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0000b6900 0x7fc000156b10 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fbff00097a0 tx=0x7fbff00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:36.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.526+0000 7fbff67fc640 1 -- 172.21.15.114:0/2394625271 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff0041070 con 0x7fc0000b6900 2024-04-28T13:08:36.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.526+0000 7fbff67fc640 1 -- 172.21.15.114:0/2394625271 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff003c870 con 0x7fc0000b6900 2024-04-28T13:08:36.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.526+0000 7fbff67fc640 1 -- 172.21.15.114:0/2394625271 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff0037040 con 0x7fc0000b6900 2024-04-28T13:08:36.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.526+0000 7fc00815f640 1 -- 172.21.15.114:0/2394625271 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc000157940 con 0x7fc0000b6900 2024-04-28T13:08:36.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.526+0000 7fc00815f640 1 -- 172.21.15.114:0/2394625271 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0000b11f0 con 0x7fc0000b6900 2024-04-28T13:08:36.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.527+0000 7fc00815f640 1 -- 172.21.15.114:0/2394625271 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc000063580 con 0x7fc0000b6900 2024-04-28T13:08:36.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.527+0000 7fbff67fc640 1 -- 172.21.15.114:0/2394625271 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7fbff0044070 con 0x7fc0000b6900 2024-04-28T13:08:36.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.527+0000 7fbff67fc640 1 --2- 172.21.15.114:0/2394625271 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbfe406c980 0x7fbfe406ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:36.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.528+0000 7fc005efb640 1 --2- 172.21.15.114:0/2394625271 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbfe406c980 0x7fbfe406ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:36.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.528+0000 7fbff67fc640 1 -- 172.21.15.114:0/2394625271 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7fbff00ac750 con 0x7fc0000b6900 2024-04-28T13:08:36.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.528+0000 7fc005efb640 1 --2- 172.21.15.114:0/2394625271 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbfe406c980 0x7fbfe406ee40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbffc0012e0 tx=0x7fbffc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:36.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.532+0000 7fbff67fc640 1 -- 172.21.15.114:0/2394625271 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbff007ace0 con 0x7fc0000b6900 2024-04-28T13:08:36.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:36.707+0000 7fc00815f640 1 -- 172.21.15.114:0/2394625271 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc00006a440 con 0x7fc0000b6900 2024-04-28T13:08:37.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.401+0000 7fbff67fc640 1 -- 172.21.15.114:0/2394625271 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) ==== 181+0+0 (secure 0 0 0) 0x7fbff007a5e0 con 0x7fc0000b6900 2024-04-28T13:08:37.402 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' removed 2024-04-28T13:08:37.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.405+0000 7fc00815f640 1 -- 172.21.15.114:0/2394625271 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbfe406c980 msgr2=0x7fbfe406ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:37.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.405+0000 7fc00815f640 1 --2- 172.21.15.114:0/2394625271 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbfe406c980 0x7fbfe406ee40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbffc0012e0 tx=0x7fbffc009040 comp rx=0 tx=0).stop 2024-04-28T13:08:37.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.405+0000 7fc00815f640 1 -- 172.21.15.114:0/2394625271 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0000b6900 msgr2=0x7fc000156b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:37.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.405+0000 7fc00815f640 1 --2- 172.21.15.114:0/2394625271 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0000b6900 0x7fc000156b10 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fbff00097a0 tx=0x7fbff00046c0 comp rx=0 tx=0).stop 2024-04-28T13:08:37.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.405+0000 7fc00815f640 1 -- 172.21.15.114:0/2394625271 shutdown_connections 2024-04-28T13:08:37.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.405+0000 7fc00815f640 1 --2- 172.21.15.114:0/2394625271 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc000163360 0x7fc000157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:37.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.405+0000 7fc00815f640 1 --2- 172.21.15.114:0/2394625271 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0000b6900 0x7fc000156b10 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:37.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.405+0000 7fc00815f640 1 --2- 172.21.15.114:0/2394625271 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbfe406c980 0x7fbfe406ee40 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:37.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.405+0000 7fc00815f640 1 --2- 172.21.15.114:0/2394625271 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc000070f70 0x7fc000142500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:37.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.405+0000 7fc00815f640 1 -- 172.21.15.114:0/2394625271 >> 172.21.15.114:0/2394625271 conn(0x7fc0000d18d0 msgr2=0x7fc00015f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:37.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.405+0000 7fc00815f640 1 -- 172.21.15.114:0/2394625271 shutdown_connections 2024-04-28T13:08:37.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.405+0000 7fc00815f640 1 -- 172.21.15.114:0/2394625271 wait complete. 2024-04-28T13:08:37.419 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-28T13:08:37.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.522+0000 7f17c8ff7640 1 Processor -- start 2024-04-28T13:08:37.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.522+0000 7f17c8ff7640 1 -- start start 2024-04-28T13:08:37.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.523+0000 7f17c8ff7640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17c4155fd0 0x7f17c406e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:37.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.523+0000 7f17c8ff7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f17c406e860 0x7f17c40b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:37.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.523+0000 7f17c8ff7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f17c40d0530 0x7f17c40b4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:37.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.523+0000 7f17c8ff7640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f17c41563b0 con 0x7f17c40d0530 2024-04-28T13:08:37.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.523+0000 7f17c8ff7640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f17c4072cf0 con 0x7f17c406e860 2024-04-28T13:08:37.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.523+0000 7f17c8ff7640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f17c4072fd0 con 0x7f17c4155fd0 2024-04-28T13:08:37.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.523+0000 7f17c2d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f17c40d0530 0x7f17c40b4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:37.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.523+0000 7f17c2d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f17c40d0530 0x7f17c40b4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43244/0 (socket says 172.21.15.114:43244) 2024-04-28T13:08:37.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.523+0000 7f17c2d9d640 1 -- 172.21.15.114:0/51303618 learned_addr learned my addr 172.21.15.114:0/51303618 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:37.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.523+0000 7f17c2d9d640 1 -- 172.21.15.114:0/51303618 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17c4155fd0 msgr2=0x7f17c406e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:37.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.523+0000 7f17c2d9d640 1 --2- 172.21.15.114:0/51303618 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17c4155fd0 0x7f17c406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:37.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.523+0000 7f17c2d9d640 1 -- 172.21.15.114:0/51303618 >> v2:172.21.15.134:3300/0 conn(0x7f17c406e860 msgr2=0x7f17c40b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:37.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.523+0000 7f17c2d9d640 1 --2- 172.21.15.114:0/51303618 >> v2:172.21.15.134:3300/0 conn(0x7f17c406e860 0x7f17c40b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:37.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.523+0000 7f17c2d9d640 1 -- 172.21.15.114:0/51303618 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c40732b0 con 0x7f17c40d0530 2024-04-28T13:08:37.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.524+0000 7f17c2d9d640 1 --2- 172.21.15.114:0/51303618 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17c40d0530 0x7f17c40b4be0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f17c40d1b30 tx=0x7f17bc02c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=debf35bebbc9bb2f server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:37.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.524+0000 7f17c1d9b640 1 -- 172.21.15.114:0/51303618 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17bc00b2e0 con 0x7f17c40d0530 2024-04-28T13:08:37.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.524+0000 7f17c1d9b640 1 -- 172.21.15.114:0/51303618 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17bc009600 con 0x7f17c40d0530 2024-04-28T13:08:37.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.524+0000 7f17c1d9b640 1 -- 172.21.15.114:0/51303618 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17bc00b480 con 0x7f17c40d0530 2024-04-28T13:08:37.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.524+0000 7f17c8ff7640 1 -- 172.21.15.114:0/51303618 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17c40d0530 msgr2=0x7f17c40b4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:37.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.524+0000 7f17c8ff7640 1 --2- 172.21.15.114:0/51303618 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17c40d0530 0x7f17c40b4be0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f17c40d1b30 tx=0x7f17bc02c8a0 comp rx=0 tx=0).stop 2024-04-28T13:08:37.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.525+0000 7f17c8ff7640 1 -- 172.21.15.114:0/51303618 shutdown_connections 2024-04-28T13:08:37.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.525+0000 7f17c8ff7640 1 --2- 172.21.15.114:0/51303618 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17c40d0530 0x7f17c40b4be0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:37.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.525+0000 7f17c8ff7640 1 --2- 172.21.15.114:0/51303618 >> v2:172.21.15.134:3300/0 conn(0x7f17c406e860 0x7f17c40b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:37.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.525+0000 7f17c8ff7640 1 --2- 172.21.15.114:0/51303618 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17c4155fd0 0x7f17c406e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:37.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.525+0000 7f17c8ff7640 1 -- 172.21.15.114:0/51303618 >> 172.21.15.114:0/51303618 conn(0x7f17c406c530 msgr2=0x7f17c406c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:37.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.525+0000 7f17c8ff7640 1 -- 172.21.15.114:0/51303618 shutdown_connections 2024-04-28T13:08:37.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.525+0000 7f17c8ff7640 1 -- 172.21.15.114:0/51303618 wait complete. 2024-04-28T13:08:37.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.526+0000 7f17c8ff7640 1 Processor -- start 2024-04-28T13:08:37.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.526+0000 7f17c8ff7640 1 -- start start 2024-04-28T13:08:37.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.527+0000 7f17c8ff7640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17c406e860 0x7f17c4150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:37.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.527+0000 7f17c8ff7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17c40d0530 0x7f17c40cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:37.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.527+0000 7f17c8ff7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17c4155fd0 0x7f17c40b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:37.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.527+0000 7f17c8ff7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f17c40b5500 con 0x7f17c4155fd0 2024-04-28T13:08:37.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.527+0000 7f17c8ff7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f17c40b5380 con 0x7f17c40d0530 2024-04-28T13:08:37.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.527+0000 7f17c8ff7640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f17c415c900 con 0x7f17c406e860 2024-04-28T13:08:37.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.527+0000 7f17c2d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17c4155fd0 0x7f17c40b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:37.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.527+0000 7f17c2d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17c4155fd0 0x7f17c40b0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43248/0 (socket says 172.21.15.114:43248) 2024-04-28T13:08:37.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.527+0000 7f17c2d9d640 1 -- 172.21.15.114:0/2947137661 learned_addr learned my addr 172.21.15.114:0/2947137661 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:37.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.527+0000 7f17bbfff640 1 --2- 172.21.15.114:0/2947137661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17c40d0530 0x7f17c40cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:37.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.527+0000 7f17c259c640 1 --2- 172.21.15.114:0/2947137661 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17c406e860 0x7f17c4150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:37.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.527+0000 7f17c2d9d640 1 -- 172.21.15.114:0/2947137661 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17c406e860 msgr2=0x7f17c4150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:37.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.527+0000 7f17c2d9d640 1 --2- 172.21.15.114:0/2947137661 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17c406e860 0x7f17c4150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:37.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.527+0000 7f17c2d9d640 1 -- 172.21.15.114:0/2947137661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17c40d0530 msgr2=0x7f17c40cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:37.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.527+0000 7f17c2d9d640 1 --2- 172.21.15.114:0/2947137661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17c40d0530 0x7f17c40cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:37.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.527+0000 7f17c2d9d640 1 -- 172.21.15.114:0/2947137661 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c40b2f40 con 0x7f17c4155fd0 2024-04-28T13:08:37.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.527+0000 7f17c259c640 1 --2- 172.21.15.114:0/2947137661 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17c406e860 0x7f17c4150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:37.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.527+0000 7f17c2d9d640 1 --2- 172.21.15.114:0/2947137661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17c4155fd0 0x7f17c40b0b40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f17bc02ce90 tx=0x7f17bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:37.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.527+0000 7f17baffd640 1 -- 172.21.15.114:0/2947137661 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17bc041070 con 0x7f17c4155fd0 2024-04-28T13:08:37.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.527+0000 7f17baffd640 1 -- 172.21.15.114:0/2947137661 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17bc03d820 con 0x7f17c4155fd0 2024-04-28T13:08:37.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.527+0000 7f17baffd640 1 -- 172.21.15.114:0/2947137661 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17bc03dbd0 con 0x7f17c4155fd0 2024-04-28T13:08:37.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.527+0000 7f17c8ff7640 1 -- 172.21.15.114:0/2947137661 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17c40b3220 con 0x7f17c4155fd0 2024-04-28T13:08:37.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.527+0000 7f17c8ff7640 1 -- 172.21.15.114:0/2947137661 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17c40b37e0 con 0x7f17c4155fd0 2024-04-28T13:08:37.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.528+0000 7f17c8ff7640 1 -- 172.21.15.114:0/2947137661 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17c406a440 con 0x7f17c4155fd0 2024-04-28T13:08:37.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.529+0000 7f17baffd640 1 -- 172.21.15.114:0/2947137661 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f17bc003990 con 0x7f17c4155fd0 2024-04-28T13:08:37.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.529+0000 7f17baffd640 1 --2- 172.21.15.114:0/2947137661 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f17a406c9b0 0x7f17a406ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:37.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.529+0000 7f17baffd640 1 -- 172.21.15.114:0/2947137661 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5357+0+0 (secure 0 0 0) 0x7f17bc030070 con 0x7f17c4155fd0 2024-04-28T13:08:37.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.529+0000 7f17c259c640 1 --2- 172.21.15.114:0/2947137661 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f17a406c9b0 0x7f17a406ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:37.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.530+0000 7f17c259c640 1 --2- 172.21.15.114:0/2947137661 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f17a406c9b0 0x7f17a406ee70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f17b400a870 tx=0x7f17b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:37.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.534+0000 7f17baffd640 1 -- 172.21.15.114:0/2947137661 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f17bc07d580 con 0x7f17c4155fd0 2024-04-28T13:08:37.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:37.709+0000 7f17c8ff7640 1 -- 172.21.15.114:0/2947137661 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f17c4072720 con 0x7f17c4155fd0 2024-04-28T13:08:38.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.408+0000 7f17baffd640 1 -- 172.21.15.114:0/2947137661 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) ==== 169+0+0 (secure 0 0 0) 0x7f17bc07ce80 con 0x7f17c4155fd0 2024-04-28T13:08:38.409 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' removed 2024-04-28T13:08:38.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.412+0000 7f17c8ff7640 1 -- 172.21.15.114:0/2947137661 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f17a406c9b0 msgr2=0x7f17a406ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:38.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.412+0000 7f17c8ff7640 1 --2- 172.21.15.114:0/2947137661 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f17a406c9b0 0x7f17a406ee70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f17b400a870 tx=0x7f17b4008040 comp rx=0 tx=0).stop 2024-04-28T13:08:38.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.412+0000 7f17c8ff7640 1 -- 172.21.15.114:0/2947137661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17c4155fd0 msgr2=0x7f17c40b0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:38.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.412+0000 7f17c8ff7640 1 --2- 172.21.15.114:0/2947137661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17c4155fd0 0x7f17c40b0b40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f17bc02ce90 tx=0x7f17bc004a40 comp rx=0 tx=0).stop 2024-04-28T13:08:38.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.412+0000 7f17c8ff7640 1 -- 172.21.15.114:0/2947137661 shutdown_connections 2024-04-28T13:08:38.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.412+0000 7f17c8ff7640 1 --2- 172.21.15.114:0/2947137661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17c4155fd0 0x7f17c40b0b40 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:38.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.412+0000 7f17c8ff7640 1 --2- 172.21.15.114:0/2947137661 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f17a406c9b0 0x7f17a406ee70 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:38.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.412+0000 7f17c8ff7640 1 --2- 172.21.15.114:0/2947137661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17c40d0530 0x7f17c40cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:38.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.412+0000 7f17c8ff7640 1 --2- 172.21.15.114:0/2947137661 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17c406e860 0x7f17c4150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:38.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.412+0000 7f17c8ff7640 1 -- 172.21.15.114:0/2947137661 >> 172.21.15.114:0/2947137661 conn(0x7f17c406c530 msgr2=0x7f17c4159d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:38.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.412+0000 7f17c8ff7640 1 -- 172.21.15.114:0/2947137661 shutdown_connections 2024-04-28T13:08:38.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.412+0000 7f17c8ff7640 1 -- 172.21.15.114:0/2947137661 wait complete. 2024-04-28T13:08:38.427 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-28T13:08:38.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.530+0000 7f4890978640 1 Processor -- start 2024-04-28T13:08:38.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.530+0000 7f4890978640 1 -- start start 2024-04-28T13:08:38.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.531+0000 7f4890978640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f488c148dc0 0x7f488c0d0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:38.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.531+0000 7f4890978640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f488c0d1270 0x7f488c0c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:38.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.531+0000 7f4890978640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f488c0c8610 0x7f488c0cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:38.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.531+0000 7f4890978640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f488c0c8e70 con 0x7f488c148dc0 2024-04-28T13:08:38.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.531+0000 7f4890978640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f488c0c9150 con 0x7f488c0d1270 2024-04-28T13:08:38.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.531+0000 7f4890978640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f488c0c9430 con 0x7f488c0c8610 2024-04-28T13:08:38.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.531+0000 7f488a59c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f488c148dc0 0x7f488c0d0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:38.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.531+0000 7f488a59c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f488c148dc0 0x7f488c0d0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43252/0 (socket says 172.21.15.114:43252) 2024-04-28T13:08:38.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.531+0000 7f488a59c640 1 -- 172.21.15.114:0/3261455198 learned_addr learned my addr 172.21.15.114:0/3261455198 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:38.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.531+0000 7f488a59c640 1 -- 172.21.15.114:0/3261455198 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f488c0c8610 msgr2=0x7f488c0cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:38.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.531+0000 7f488a59c640 1 --2- 172.21.15.114:0/3261455198 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f488c0c8610 0x7f488c0cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:38.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.532+0000 7f488a59c640 1 -- 172.21.15.114:0/3261455198 >> v2:172.21.15.134:3300/0 conn(0x7f488c0d1270 msgr2=0x7f488c0c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:38.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.532+0000 7f488a59c640 1 --2- 172.21.15.114:0/3261455198 >> v2:172.21.15.134:3300/0 conn(0x7f488c0d1270 0x7f488c0c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:38.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.532+0000 7f488a59c640 1 -- 172.21.15.114:0/3261455198 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f488c0c9710 con 0x7f488c148dc0 2024-04-28T13:08:38.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.532+0000 7f488a59c640 1 --2- 172.21.15.114:0/3261455198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f488c148dc0 0x7f488c0d0d30 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f488c074020 tx=0x7f487c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad8d1e2f616a177 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:38.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.532+0000 7f488959a640 1 -- 172.21.15.114:0/3261455198 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c036070 con 0x7f488c148dc0 2024-04-28T13:08:38.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.532+0000 7f488959a640 1 -- 172.21.15.114:0/3261455198 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f487c031600 con 0x7f488c148dc0 2024-04-28T13:08:38.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.532+0000 7f488959a640 1 -- 172.21.15.114:0/3261455198 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c0319d0 con 0x7f488c148dc0 2024-04-28T13:08:38.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.533+0000 7f4890978640 1 -- 172.21.15.114:0/3261455198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f488c148dc0 msgr2=0x7f488c0d0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:38.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.533+0000 7f4890978640 1 --2- 172.21.15.114:0/3261455198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f488c148dc0 0x7f488c0d0d30 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f488c074020 tx=0x7f487c02a6a0 comp rx=0 tx=0).stop 2024-04-28T13:08:38.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.533+0000 7f4890978640 1 -- 172.21.15.114:0/3261455198 shutdown_connections 2024-04-28T13:08:38.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.533+0000 7f4890978640 1 --2- 172.21.15.114:0/3261455198 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f488c0c8610 0x7f488c0cfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:38.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.533+0000 7f4890978640 1 --2- 172.21.15.114:0/3261455198 >> v2:172.21.15.134:3300/0 conn(0x7f488c0d1270 0x7f488c0c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:38.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.533+0000 7f4890978640 1 --2- 172.21.15.114:0/3261455198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f488c148dc0 0x7f488c0d0d30 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:38.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.533+0000 7f4890978640 1 -- 172.21.15.114:0/3261455198 >> 172.21.15.114:0/3261455198 conn(0x7f488c0706f0 msgr2=0x7f488c070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:38.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.533+0000 7f4890978640 1 -- 172.21.15.114:0/3261455198 shutdown_connections 2024-04-28T13:08:38.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.533+0000 7f4890978640 1 -- 172.21.15.114:0/3261455198 wait complete. 2024-04-28T13:08:38.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.534+0000 7f4890978640 1 Processor -- start 2024-04-28T13:08:38.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.534+0000 7f4890978640 1 -- start start 2024-04-28T13:08:38.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.535+0000 7f4890978640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f488c0c8610 0x7f488c13fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:38.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.535+0000 7f4890978640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f488c0d1270 0x7f488c0ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:38.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.535+0000 7f4890978640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f488c148dc0 0x7f488c1f52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:38.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.535+0000 7f4890978640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f488c0c8c00 con 0x7f488c148dc0 2024-04-28T13:08:38.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.535+0000 7f4890978640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f488c0c8a80 con 0x7f488c0c8610 2024-04-28T13:08:38.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.535+0000 7f4890978640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f488c0d00b0 con 0x7f488c0d1270 2024-04-28T13:08:38.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.535+0000 7f488ad9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f488c148dc0 0x7f488c1f52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:38.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.535+0000 7f488ad9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f488c148dc0 0x7f488c1f52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43266/0 (socket says 172.21.15.114:43266) 2024-04-28T13:08:38.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.535+0000 7f488ad9d640 1 -- 172.21.15.114:0/329429721 learned_addr learned my addr 172.21.15.114:0/329429721 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:38.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.535+0000 7f488a59c640 1 --2- 172.21.15.114:0/329429721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f488c0c8610 0x7f488c13fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:38.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.535+0000 7f4889d9b640 1 --2- 172.21.15.114:0/329429721 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f488c0d1270 0x7f488c0ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:38.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.535+0000 7f488ad9d640 1 -- 172.21.15.114:0/329429721 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f488c0d1270 msgr2=0x7f488c0ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:38.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.535+0000 7f488ad9d640 1 --2- 172.21.15.114:0/329429721 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f488c0d1270 0x7f488c0ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:38.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.535+0000 7f488ad9d640 1 -- 172.21.15.114:0/329429721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f488c0c8610 msgr2=0x7f488c13fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:38.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.535+0000 7f488ad9d640 1 --2- 172.21.15.114:0/329429721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f488c0c8610 0x7f488c13fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:38.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.535+0000 7f488ad9d640 1 -- 172.21.15.114:0/329429721 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f488c160b80 con 0x7f488c148dc0 2024-04-28T13:08:38.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.536+0000 7f488ad9d640 1 --2- 172.21.15.114:0/329429721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f488c148dc0 0x7f488c1f52b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f488400b450 tx=0x7f488400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:38.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.536+0000 7f487affd640 1 -- 172.21.15.114:0/329429721 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4884015020 con 0x7f488c148dc0 2024-04-28T13:08:38.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.536+0000 7f487affd640 1 -- 172.21.15.114:0/329429721 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4884011890 con 0x7f488c148dc0 2024-04-28T13:08:38.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.536+0000 7f487affd640 1 -- 172.21.15.114:0/329429721 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4884011c60 con 0x7f488c148dc0 2024-04-28T13:08:38.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.536+0000 7f4890978640 1 -- 172.21.15.114:0/329429721 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f488c160e60 con 0x7f488c148dc0 2024-04-28T13:08:38.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.536+0000 7f4890978640 1 -- 172.21.15.114:0/329429721 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f488c161420 con 0x7f488c148dc0 2024-04-28T13:08:38.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.537+0000 7f4890978640 1 -- 172.21.15.114:0/329429721 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f488c06a3d0 con 0x7f488c148dc0 2024-04-28T13:08:38.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.537+0000 7f487affd640 1 -- 172.21.15.114:0/329429721 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f4884018020 con 0x7f488c148dc0 2024-04-28T13:08:38.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.538+0000 7f487affd640 1 --2- 172.21.15.114:0/329429721 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f486c06c980 0x7f486c06ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:38.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.538+0000 7f487affd640 1 -- 172.21.15.114:0/329429721 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f488408b9a0 con 0x7f488c148dc0 2024-04-28T13:08:38.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.538+0000 7f488a59c640 1 --2- 172.21.15.114:0/329429721 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f486c06c980 0x7f486c06ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:38.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.538+0000 7f488a59c640 1 --2- 172.21.15.114:0/329429721 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f486c06c980 0x7f486c06ee40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f487c033000 tx=0x7f487c009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:38.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.542+0000 7f487affd640 1 -- 172.21.15.114:0/329429721 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f488401f020 con 0x7f488c148dc0 2024-04-28T13:08:38.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.717+0000 7f4890978640 1 -- 172.21.15.114:0/329429721 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f488c075940 con 0x7f488c148dc0 2024-04-28T13:08:38.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.720+0000 7f487affd640 1 -- 172.21.15.114:0/329429721 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f488400d040 con 0x7f488c148dc0 2024-04-28T13:08:38.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.722+0000 7f4890978640 1 -- 172.21.15.114:0/329429721 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f486c06c980 msgr2=0x7f486c06ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:38.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.722+0000 7f4890978640 1 --2- 172.21.15.114:0/329429721 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f486c06c980 0x7f486c06ee40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f487c033000 tx=0x7f487c009000 comp rx=0 tx=0).stop 2024-04-28T13:08:38.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.722+0000 7f4890978640 1 -- 172.21.15.114:0/329429721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f488c148dc0 msgr2=0x7f488c1f52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:38.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.722+0000 7f4890978640 1 --2- 172.21.15.114:0/329429721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f488c148dc0 0x7f488c1f52b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f488400b450 tx=0x7f488400b910 comp rx=0 tx=0).stop 2024-04-28T13:08:38.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.722+0000 7f4890978640 1 -- 172.21.15.114:0/329429721 shutdown_connections 2024-04-28T13:08:38.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.722+0000 7f4890978640 1 --2- 172.21.15.114:0/329429721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f488c148dc0 0x7f488c1f52b0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:38.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.722+0000 7f4890978640 1 --2- 172.21.15.114:0/329429721 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f488c0d1270 0x7f488c0ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:38.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.722+0000 7f4890978640 1 --2- 172.21.15.114:0/329429721 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f486c06c980 0x7f486c06ee40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:38.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.722+0000 7f4890978640 1 --2- 172.21.15.114:0/329429721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f488c0c8610 0x7f488c13fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:38.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.722+0000 7f4890978640 1 -- 172.21.15.114:0/329429721 >> 172.21.15.114:0/329429721 conn(0x7f488c0706f0 msgr2=0x7f488c0b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:38.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.722+0000 7f4890978640 1 -- 172.21.15.114:0/329429721 shutdown_connections 2024-04-28T13:08:38.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.722+0000 7f4890978640 1 -- 172.21.15.114:0/329429721 wait complete. 2024-04-28T13:08:38.734 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots.test_subvolume_group_snapshot_unsupported_status' 2024-04-28T13:08:38.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.829+0000 7f2d86ec8640 1 Processor -- start 2024-04-28T13:08:38.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.829+0000 7f2d86ec8640 1 -- start start 2024-04-28T13:08:38.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.830+0000 7f2d86ec8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d80153330 0x7f2d8015d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:38.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.830+0000 7f2d86ec8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2d800723d0 0x7f2d80073bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:38.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.830+0000 7f2d86ec8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d80153710 con 0x7f2d800740f0 2024-04-28T13:08:38.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.830+0000 7f2d86ec8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f2d80074560 con 0x7f2d800723d0 2024-04-28T13:08:38.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.830+0000 7f2d86ec8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2d800b4a60 con 0x7f2d80153330 2024-04-28T13:08:38.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.830+0000 7f2d84c64640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d80153330 0x7f2d8015d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:38.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.830+0000 7f2d7ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2d800723d0 0x7f2d80073bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:38.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.830+0000 7f2d7ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2d800723d0 0x7f2d80073bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:43558/0 (socket says 172.21.15.114:43558) 2024-04-28T13:08:38.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.830+0000 7f2d84c64640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d80153330 0x7f2d8015d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:46050/0 (socket says 172.21.15.114:46050) 2024-04-28T13:08:38.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.830+0000 7f2d85465640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f2d800740f0 0x7f2d8015fe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:45438/0 (socket says 172.21.15.114:45438) 2024-04-28T13:08:38.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.830+0000 7f2d7ffff640 1 -- 172.21.15.114:0/2330657513 learned_addr learned my addr 172.21.15.114:0/2330657513 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:38.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.831+0000 7f2d7ffff640 1 -- 172.21.15.114:0/2330657513 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d80153330 msgr2=0x7f2d8015d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:38.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.831+0000 7f2d7ffff640 1 --2- 172.21.15.114:0/2330657513 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d80153330 0x7f2d8015d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:38.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.831+0000 7f2d7ffff640 1 -- 172.21.15.114:0/2330657513 >> v1:172.21.15.134:6789/0 conn(0x7f2d800740f0 legacy=0x7f2d8015fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:38.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.831+0000 7f2d7ffff640 1 -- 172.21.15.114:0/2330657513 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d80072990 con 0x7f2d800723d0 2024-04-28T13:08:38.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.831+0000 7f2d7ffff640 1 --2- 172.21.15.114:0/2330657513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d800723d0 0x7f2d80073bb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2d74009870 tx=0x7f2d7402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71a035fbd3f14ba4 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:38.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.832+0000 7f2d7f7fe640 1 -- 172.21.15.114:0/2330657513 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d74037070 con 0x7f2d800723d0 2024-04-28T13:08:38.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.832+0000 7f2d7f7fe640 1 -- 172.21.15.114:0/2330657513 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d74032440 con 0x7f2d800723d0 2024-04-28T13:08:38.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.832+0000 7f2d7f7fe640 1 -- 172.21.15.114:0/2330657513 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d74032810 con 0x7f2d800723d0 2024-04-28T13:08:38.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.832+0000 7f2d86ec8640 1 -- 172.21.15.114:0/2330657513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d800723d0 msgr2=0x7f2d80073bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:38.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.832+0000 7f2d86ec8640 1 --2- 172.21.15.114:0/2330657513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d800723d0 0x7f2d80073bb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2d74009870 tx=0x7f2d7402a270 comp rx=0 tx=0).stop 2024-04-28T13:08:38.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.832+0000 7f2d86ec8640 1 -- 172.21.15.114:0/2330657513 shutdown_connections 2024-04-28T13:08:38.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.832+0000 7f2d86ec8640 1 --2- 172.21.15.114:0/2330657513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d800723d0 0x7f2d80073bb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:38.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.832+0000 7f2d86ec8640 1 --2- 172.21.15.114:0/2330657513 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d80153330 0x7f2d8015d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:38.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.832+0000 7f2d86ec8640 1 -- 172.21.15.114:0/2330657513 >> 172.21.15.114:0/2330657513 conn(0x7f2d8006c980 msgr2=0x7f2d800b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:38.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.832+0000 7f2d86ec8640 1 -- 172.21.15.114:0/2330657513 shutdown_connections 2024-04-28T13:08:38.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.832+0000 7f2d86ec8640 1 -- 172.21.15.114:0/2330657513 wait complete. 2024-04-28T13:08:38.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.833+0000 7f2d86ec8640 1 Processor -- start 2024-04-28T13:08:38.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.833+0000 7f2d86ec8640 1 -- start start 2024-04-28T13:08:38.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.834+0000 7f2d86ec8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d800723d0 0x7f2d80147750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:38.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.834+0000 7f2d86ec8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d800740f0 0x7f2d8015e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:38.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.834+0000 7f2d86ec8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d80153330 0x7f2d8015e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:38.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.834+0000 7f2d86ec8640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2d80073230 con 0x7f2d800740f0 2024-04-28T13:08:38.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.834+0000 7f2d86ec8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2d80072f50 con 0x7f2d80153330 2024-04-28T13:08:38.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.834+0000 7f2d86ec8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2d80073510 con 0x7f2d800723d0 2024-04-28T13:08:38.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.834+0000 7f2d7ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d800740f0 0x7f2d8015e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:38.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.834+0000 7f2d7ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d800740f0 0x7f2d8015e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43270/0 (socket says 172.21.15.114:43270) 2024-04-28T13:08:38.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.834+0000 7f2d7ffff640 1 -- 172.21.15.114:0/3656219789 learned_addr learned my addr 172.21.15.114:0/3656219789 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:38.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.834+0000 7f2d84c64640 1 --2- 172.21.15.114:0/3656219789 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d800723d0 0x7f2d80147750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:38.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.834+0000 7f2d85465640 1 --2- 172.21.15.114:0/3656219789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d80153330 0x7f2d8015e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:38.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.835+0000 7f2d7ffff640 1 -- 172.21.15.114:0/3656219789 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d800723d0 msgr2=0x7f2d80147750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:38.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.835+0000 7f2d7ffff640 1 --2- 172.21.15.114:0/3656219789 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d800723d0 0x7f2d80147750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:38.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.835+0000 7f2d7ffff640 1 -- 172.21.15.114:0/3656219789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d80153330 msgr2=0x7f2d8015e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:38.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.835+0000 7f2d7ffff640 1 --2- 172.21.15.114:0/3656219789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d80153330 0x7f2d8015e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:38.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.835+0000 7f2d7ffff640 1 -- 172.21.15.114:0/3656219789 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d80147c90 con 0x7f2d800740f0 2024-04-28T13:08:38.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.835+0000 7f2d7ffff640 1 --2- 172.21.15.114:0/3656219789 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d800740f0 0x7f2d8015e1c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2d7402a2b0 tx=0x7f2d740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:38.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.835+0000 7f2d7d7fa640 1 -- 172.21.15.114:0/3656219789 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d74037040 con 0x7f2d800740f0 2024-04-28T13:08:38.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.835+0000 7f2d7d7fa640 1 -- 172.21.15.114:0/3656219789 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d74042070 con 0x7f2d800740f0 2024-04-28T13:08:38.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.835+0000 7f2d7d7fa640 1 -- 172.21.15.114:0/3656219789 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d74030880 con 0x7f2d800740f0 2024-04-28T13:08:38.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.835+0000 7f2d86ec8640 1 -- 172.21.15.114:0/3656219789 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d80157ab0 con 0x7f2d800740f0 2024-04-28T13:08:38.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.835+0000 7f2d86ec8640 1 -- 172.21.15.114:0/3656219789 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d80158070 con 0x7f2d800740f0 2024-04-28T13:08:38.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.836+0000 7f2d86ec8640 1 -- 172.21.15.114:0/3656219789 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d8006a3d0 con 0x7f2d800740f0 2024-04-28T13:08:38.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.837+0000 7f2d7d7fa640 1 -- 172.21.15.114:0/3656219789 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f2d74030a20 con 0x7f2d800740f0 2024-04-28T13:08:38.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.837+0000 7f2d7d7fa640 1 --2- 172.21.15.114:0/3656219789 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2d6c06c980 0x7f2d6c06ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:38.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.837+0000 7f2d7d7fa640 1 -- 172.21.15.114:0/3656219789 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f2d740abfd0 con 0x7f2d800740f0 2024-04-28T13:08:38.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.837+0000 7f2d84c64640 1 --2- 172.21.15.114:0/3656219789 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2d6c06c980 0x7f2d6c06ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:38.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.838+0000 7f2d84c64640 1 --2- 172.21.15.114:0/3656219789 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2d6c06c980 0x7f2d6c06ee40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2d7000bde0 tx=0x7f2d7000b3a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:38.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:38.841+0000 7f2d7d7fa640 1 -- 172.21.15.114:0/3656219789 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2d7407a0c0 con 0x7f2d800740f0 2024-04-28T13:08:39.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.089+0000 7f2d86ec8640 1 -- 172.21.15.114:0/3656219789 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots.test_subvolume_group_snapshot_unsupported_status"]} v 0) -- 0x7f2d8015fbc0 con 0x7f2d800740f0 2024-04-28T13:08:39.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.410+0000 7f2d7d7fa640 1 -- 172.21.15.114:0/3656219789 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots.test_subvolume_group_snapshot_unsupported_status"]}]=0 v93) ==== 181+0+0 (secure 0 0 0) 0x7f2d7407e3c0 con 0x7f2d800740f0 2024-04-28T13:08:39.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.412+0000 7f2d86ec8640 1 -- 172.21.15.114:0/3656219789 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2d6c06c980 msgr2=0x7f2d6c06ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:39.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.412+0000 7f2d86ec8640 1 --2- 172.21.15.114:0/3656219789 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2d6c06c980 0x7f2d6c06ee40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2d7000bde0 tx=0x7f2d7000b3a0 comp rx=0 tx=0).stop 2024-04-28T13:08:39.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.412+0000 7f2d86ec8640 1 -- 172.21.15.114:0/3656219789 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d800740f0 msgr2=0x7f2d8015e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:39.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.412+0000 7f2d86ec8640 1 --2- 172.21.15.114:0/3656219789 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d800740f0 0x7f2d8015e1c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2d7402a2b0 tx=0x7f2d740046c0 comp rx=0 tx=0).stop 2024-04-28T13:08:39.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.412+0000 7f2d86ec8640 1 -- 172.21.15.114:0/3656219789 shutdown_connections 2024-04-28T13:08:39.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.412+0000 7f2d86ec8640 1 --2- 172.21.15.114:0/3656219789 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2d6c06c980 0x7f2d6c06ee40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:39.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.412+0000 7f2d86ec8640 1 --2- 172.21.15.114:0/3656219789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d80153330 0x7f2d8015e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:39.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.412+0000 7f2d86ec8640 1 --2- 172.21.15.114:0/3656219789 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d800740f0 0x7f2d8015e1c0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:39.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.412+0000 7f2d86ec8640 1 --2- 172.21.15.114:0/3656219789 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d800723d0 0x7f2d80147750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:39.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.412+0000 7f2d86ec8640 1 -- 172.21.15.114:0/3656219789 >> 172.21.15.114:0/3656219789 conn(0x7f2d8006c980 msgr2=0x7f2d8015fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:39.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.412+0000 7f2d86ec8640 1 -- 172.21.15.114:0/3656219789 shutdown_connections 2024-04-28T13:08:39.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.412+0000 7f2d86ec8640 1 -- 172.21.15.114:0/3656219789 wait complete. 2024-04-28T13:08:39.424 INFO:tasks.cephfs_test_runner:test_subvolume_group_snapshot_unsupported_status (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) ... ok 2024-04-28T13:08:39.424 INFO:tasks.cephfs_test_runner:Starting test: test_clean_stale_subvolume_snapshot_metadata (tasks.cephfs.test_volumes.TestSubvolumeSnapshots) Validate cleaning of stale subvolume snapshot metadata. 2024-04-28T13:08:39.425 INFO:tasks.cephfs_test_runner:test_clean_stale_subvolume_snapshot_metadata (tasks.cephfs.test_volumes.TestSubvolumeSnapshots) 2024-04-28T13:08:39.425 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:08:39.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.528+0000 7fb07b90a640 1 Processor -- start 2024-04-28T13:08:39.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.528+0000 7fb07b90a640 1 -- start start 2024-04-28T13:08:39.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.529+0000 7fb07b90a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb0740b58a0 0x7fb074071490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:39.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.529+0000 7fb07b90a640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb074073ce0 con 0x7fb0740b53f0 2024-04-28T13:08:39.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.529+0000 7fb07b90a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb074073fc0 con 0x7fb0741487f0 2024-04-28T13:08:39.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.529+0000 7fb07b90a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb074074580 con 0x7fb0740b58a0 2024-04-28T13:08:39.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.529+0000 7fb078ea5640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb0740b53f0 0x7fb074070d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:54412/0 (socket says 172.21.15.114:54412) 2024-04-28T13:08:39.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.529+0000 7fb078ea5640 1 -- 172.21.15.114:0/3642148936 learned_addr learned my addr 172.21.15.114:0/3642148936 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:39.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.529+0000 7fb06bfff640 1 -- 172.21.15.114:0/3642148936 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3482036247 0 0) 0x7fb074073ce0 con 0x7fb0740b53f0 2024-04-28T13:08:39.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.529+0000 7fb079ea7640 1 --2- 172.21.15.114:0/3642148936 >> v2:172.21.15.134:3300/0 conn(0x7fb0740b58a0 0x7fb074071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:39.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.529+0000 7fb06bfff640 1 -- 172.21.15.114:0/3642148936 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb060003520 con 0x7fb0740b53f0 2024-04-28T13:08:39.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.529+0000 7fb06bfff640 1 -- 172.21.15.114:0/3642148936 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2898700944 0 0) 0x7fb060003520 con 0x7fb0740b53f0 2024-04-28T13:08:39.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.530+0000 7fb06bfff640 1 -- 172.21.15.114:0/3642148936 >> v2:172.21.15.134:3300/0 conn(0x7fb0740b58a0 msgr2=0x7fb074071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:39.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.530+0000 7fb06bfff640 1 --2- 172.21.15.114:0/3642148936 >> v2:172.21.15.134:3300/0 conn(0x7fb0740b58a0 0x7fb074071490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:39.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.530+0000 7fb06bfff640 1 -- 172.21.15.114:0/3642148936 >> v1:172.21.15.134:6789/0 conn(0x7fb0741487f0 legacy=0x7fb074073290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:39.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.530+0000 7fb06bfff640 1 -- 172.21.15.114:0/3642148936 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0740742a0 con 0x7fb0740b53f0 2024-04-28T13:08:39.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.530+0000 7fb06bfff640 1 -- 172.21.15.114:0/3642148936 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7fb064001670 con 0x7fb0740b53f0 2024-04-28T13:08:39.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.530+0000 7fb06bfff640 1 -- 172.21.15.114:0/3642148936 >> v1:172.21.15.114:6789/0 conn(0x7fb0740b53f0 legacy=0x7fb074070d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:39.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.530+0000 7fb06bfff640 1 --2- 172.21.15.114:0/3642148936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0600039b0 0x7fb060003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:39.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.530+0000 7fb06bfff640 1 --2- 172.21.15.114:0/3642148936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb060004800 0x7fb060004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:39.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.530+0000 7fb06bfff640 1 --2- 172.21.15.114:0/3642148936 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb0600051c0 0x7fb06000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:39.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.530+0000 7fb06bfff640 1 -- 172.21.15.114:0/3642148936 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb074074580 con 0x7fb060004800 2024-04-28T13:08:39.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.530+0000 7fb06bfff640 1 -- 172.21.15.114:0/3642148936 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb06000c160 con 0x7fb0600039b0 2024-04-28T13:08:39.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.530+0000 7fb06bfff640 1 -- 172.21.15.114:0/3642148936 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb06000c360 con 0x7fb0600051c0 2024-04-28T13:08:39.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.530+0000 7fb078ea5640 1 --2- 172.21.15.114:0/3642148936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb060004800 0x7fb060004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:39.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.530+0000 7fb0796a6640 1 --2- 172.21.15.114:0/3642148936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0600039b0 0x7fb060003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:39.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.530+0000 7fb079ea7640 1 --2- 172.21.15.114:0/3642148936 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb0600051c0 0x7fb06000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:39.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.530+0000 7fb078ea5640 1 -- 172.21.15.114:0/3642148936 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb0600051c0 msgr2=0x7fb06000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:39.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.530+0000 7fb078ea5640 1 --2- 172.21.15.114:0/3642148936 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb0600051c0 0x7fb06000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:39.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.530+0000 7fb078ea5640 1 -- 172.21.15.114:0/3642148936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0600039b0 msgr2=0x7fb060003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:39.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.530+0000 7fb078ea5640 1 --2- 172.21.15.114:0/3642148936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0600039b0 0x7fb060003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:39.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.530+0000 7fb078ea5640 1 -- 172.21.15.114:0/3642148936 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb060003520 con 0x7fb060004800 2024-04-28T13:08:39.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.530+0000 7fb079ea7640 1 -- 172.21.15.114:0/3642148936 reap_dead start 2024-04-28T13:08:39.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.530+0000 7fb0796a6640 1 --2- 172.21.15.114:0/3642148936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0600039b0 0x7fb060003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:39.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.531+0000 7fb078ea5640 1 --2- 172.21.15.114:0/3642148936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb060004800 0x7fb060004c80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb06400c240 tx=0x7fb060005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f82bc1a420f028 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:39.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.531+0000 7fb06bfff640 1 -- 172.21.15.114:0/3642148936 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb064007d10 con 0x7fb060004800 2024-04-28T13:08:39.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.531+0000 7fb06bfff640 1 -- 172.21.15.114:0/3642148936 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb064005ad0 con 0x7fb060004800 2024-04-28T13:08:39.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.531+0000 7fb06bfff640 1 -- 172.21.15.114:0/3642148936 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb064007070 con 0x7fb060004800 2024-04-28T13:08:39.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.531+0000 7fb07b90a640 1 -- 172.21.15.114:0/3642148936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb060004800 msgr2=0x7fb060004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:39.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.531+0000 7fb07b90a640 1 --2- 172.21.15.114:0/3642148936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb060004800 0x7fb060004c80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb06400c240 tx=0x7fb060005830 comp rx=0 tx=0).stop 2024-04-28T13:08:39.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.531+0000 7fb07b90a640 1 -- 172.21.15.114:0/3642148936 shutdown_connections 2024-04-28T13:08:39.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.531+0000 7fb07b90a640 1 --2- 172.21.15.114:0/3642148936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb060004800 0x7fb060004c80 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:39.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.531+0000 7fb07b90a640 1 -- 172.21.15.114:0/3642148936 >> 172.21.15.114:0/3642148936 conn(0x7fb0740b3d50 msgr2=0x7fb0740b4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:39.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.531+0000 7fb07b90a640 1 -- 172.21.15.114:0/3642148936 shutdown_connections 2024-04-28T13:08:39.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.532+0000 7fb07b90a640 1 -- 172.21.15.114:0/3642148936 wait complete. 2024-04-28T13:08:39.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.533+0000 7fb07b90a640 1 Processor -- start 2024-04-28T13:08:39.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.533+0000 7fb07b90a640 1 -- start start 2024-04-28T13:08:39.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.533+0000 7fb07b90a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb060004800 0x7fb07413f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:39.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.533+0000 7fb07b90a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb074161590 0x7fb0741f52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:39.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.533+0000 7fb07b90a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb074159f10 0x7fb07415a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:39.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.533+0000 7fb07b90a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb0740ae850 con 0x7fb074161590 2024-04-28T13:08:39.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.533+0000 7fb07b90a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb0740b5c80 con 0x7fb060004800 2024-04-28T13:08:39.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.533+0000 7fb07b90a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb0740ae9d0 con 0x7fb074159f10 2024-04-28T13:08:39.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.533+0000 7fb078ea5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb074161590 0x7fb0741f52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:39.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.533+0000 7fb078ea5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb074161590 0x7fb0741f52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43280/0 (socket says 172.21.15.114:43280) 2024-04-28T13:08:39.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.533+0000 7fb078ea5640 1 -- 172.21.15.114:0/4250600709 learned_addr learned my addr 172.21.15.114:0/4250600709 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:39.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.534+0000 7fb079ea7640 1 --2- 172.21.15.114:0/4250600709 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb074159f10 0x7fb07415a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:39.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.534+0000 7fb0796a6640 1 --2- 172.21.15.114:0/4250600709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb060004800 0x7fb07413f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:39.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.534+0000 7fb078ea5640 1 -- 172.21.15.114:0/4250600709 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb074159f10 msgr2=0x7fb07415a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:39.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.534+0000 7fb078ea5640 1 --2- 172.21.15.114:0/4250600709 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb074159f10 0x7fb07415a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:39.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.534+0000 7fb078ea5640 1 -- 172.21.15.114:0/4250600709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb060004800 msgr2=0x7fb07413f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:39.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.534+0000 7fb078ea5640 1 --2- 172.21.15.114:0/4250600709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb060004800 0x7fb07413f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:39.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.534+0000 7fb078ea5640 1 -- 172.21.15.114:0/4250600709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb074161c20 con 0x7fb074161590 2024-04-28T13:08:39.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.534+0000 7fb078ea5640 1 --2- 172.21.15.114:0/4250600709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb074161590 0x7fb0741f52f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb06400c240 tx=0x7fb074073eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:39.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.534+0000 7fb069ffb640 1 -- 172.21.15.114:0/4250600709 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb064001470 con 0x7fb074161590 2024-04-28T13:08:39.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.534+0000 7fb069ffb640 1 -- 172.21.15.114:0/4250600709 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb064040070 con 0x7fb074161590 2024-04-28T13:08:39.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.534+0000 7fb07b90a640 1 -- 172.21.15.114:0/4250600709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb074161f00 con 0x7fb074161590 2024-04-28T13:08:39.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.534+0000 7fb069ffb640 1 -- 172.21.15.114:0/4250600709 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0640047e0 con 0x7fb074161590 2024-04-28T13:08:39.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.534+0000 7fb07b90a640 1 -- 172.21.15.114:0/4250600709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0741624c0 con 0x7fb074161590 2024-04-28T13:08:39.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.535+0000 7fb07b90a640 1 -- 172.21.15.114:0/4250600709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb07406a3d0 con 0x7fb074161590 2024-04-28T13:08:39.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.536+0000 7fb069ffb640 1 -- 172.21.15.114:0/4250600709 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7fb06403a070 con 0x7fb074161590 2024-04-28T13:08:39.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.536+0000 7fb069ffb640 1 --2- 172.21.15.114:0/4250600709 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb05806c980 0x7fb05806ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:39.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.536+0000 7fb0796a6640 1 --2- 172.21.15.114:0/4250600709 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb05806c980 0x7fb05806ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:39.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.536+0000 7fb069ffb640 1 -- 172.21.15.114:0/4250600709 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fb0640aab30 con 0x7fb074161590 2024-04-28T13:08:39.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.537+0000 7fb0796a6640 1 --2- 172.21.15.114:0/4250600709 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb05806c980 0x7fb05806ee40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb070000c00 tx=0x7fb070009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:39.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.541+0000 7fb069ffb640 1 -- 172.21.15.114:0/4250600709 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb064078cb0 con 0x7fb074161590 2024-04-28T13:08:39.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.715+0000 7fb07b90a640 1 -- 172.21.15.114:0/4250600709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb0740b4840 con 0x7fb074161590 2024-04-28T13:08:39.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.716+0000 7fb069ffb640 1 -- 172.21.15.114:0/4250600709 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+13070 (secure 0 0 0) 0x7fb06407cfb0 con 0x7fb074161590 2024-04-28T13:08:39.716 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:39.716 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":37,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:08:38.403323+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6834/1155749661":"2024-04-29T13:08:35.395662+0000","172.21.15.134:6832/1155749661":"2024-04-29T13:08:35.395662+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:08:39.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.718+0000 7fb07b90a640 1 -- 172.21.15.114:0/4250600709 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb05806c980 msgr2=0x7fb05806ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:39.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.718+0000 7fb07b90a640 1 --2- 172.21.15.114:0/4250600709 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb05806c980 0x7fb05806ee40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb070000c00 tx=0x7fb070009040 comp rx=0 tx=0).stop 2024-04-28T13:08:39.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.718+0000 7fb07b90a640 1 -- 172.21.15.114:0/4250600709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb074161590 msgr2=0x7fb0741f52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:39.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.718+0000 7fb07b90a640 1 --2- 172.21.15.114:0/4250600709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb074161590 0x7fb0741f52f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb06400c240 tx=0x7fb074073eb0 comp rx=0 tx=0).stop 2024-04-28T13:08:39.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.718+0000 7fb07b90a640 1 -- 172.21.15.114:0/4250600709 shutdown_connections 2024-04-28T13:08:39.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.718+0000 7fb07b90a640 1 --2- 172.21.15.114:0/4250600709 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb074159f10 0x7fb07415a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:39.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.718+0000 7fb07b90a640 1 --2- 172.21.15.114:0/4250600709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb074161590 0x7fb0741f52f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:39.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.718+0000 7fb07b90a640 1 --2- 172.21.15.114:0/4250600709 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb05806c980 0x7fb05806ee40 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:39.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.718+0000 7fb07b90a640 1 --2- 172.21.15.114:0/4250600709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb060004800 0x7fb07413f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:39.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.718+0000 7fb07b90a640 1 -- 172.21.15.114:0/4250600709 >> 172.21.15.114:0/4250600709 conn(0x7fb0740b3d50 msgr2=0x7fb0740d0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:39.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.718+0000 7fb07b90a640 1 -- 172.21.15.114:0/4250600709 shutdown_connections 2024-04-28T13:08:39.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.718+0000 7fb07b90a640 1 -- 172.21.15.114:0/4250600709 wait complete. 2024-04-28T13:08:39.730 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-28T13:07:14.721860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-28T13:08:39.730 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-28T13:08:39.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.829+0000 7fcea45f0640 1 Processor -- start 2024-04-28T13:08:39.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.829+0000 7fcea45f0640 1 -- start start 2024-04-28T13:08:39.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.830+0000 7fcea45f0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fce9c072e30 0x7fce9c0732b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:39.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.830+0000 7fcea45f0640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fce9c15c370 0x7fce9c15c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:39.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.830+0000 7fcea45f0640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce9c0d02b0 con 0x7fce9c0b4850 2024-04-28T13:08:39.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.830+0000 7fcea45f0640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fce9c0cedc0 con 0x7fce9c072e30 2024-04-28T13:08:39.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.830+0000 7fcea45f0640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fce9c073cc0 con 0x7fce9c15c370 2024-04-28T13:08:39.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.830+0000 7fcea1b8b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fce9c072e30 0x7fce9c0732b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:39.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.830+0000 7fcea238c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fce9c0b4850 0x7fce9c0b4c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:54416/0 (socket says 172.21.15.114:54416) 2024-04-28T13:08:39.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.830+0000 7fcea238c640 1 -- 172.21.15.114:0/2240955595 learned_addr learned my addr 172.21.15.114:0/2240955595 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:39.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.830+0000 7fcea2b8d640 1 --2- 172.21.15.114:0/2240955595 >> v2:172.21.15.134:3300/0 conn(0x7fce9c15c370 0x7fce9c15c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:39.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.830+0000 7fcea1b8b640 1 -- 172.21.15.114:0/2240955595 >> v2:172.21.15.134:3300/0 conn(0x7fce9c15c370 msgr2=0x7fce9c15c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:39.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.830+0000 7fcea1b8b640 1 --2- 172.21.15.114:0/2240955595 >> v2:172.21.15.134:3300/0 conn(0x7fce9c15c370 0x7fce9c15c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:39.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.830+0000 7fcea1b8b640 1 -- 172.21.15.114:0/2240955595 >> v1:172.21.15.114:6789/0 conn(0x7fce9c0b4850 legacy=0x7fce9c0b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:39.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.830+0000 7fcea1b8b640 1 -- 172.21.15.114:0/2240955595 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce9c073fa0 con 0x7fce9c072e30 2024-04-28T13:08:39.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.830+0000 7fcea138a640 1 -- 172.21.15.114:0/2240955595 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1287582809 0 0) 0x7fce9c0d02b0 con 0x7fce9c0b4850 2024-04-28T13:08:39.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.831+0000 7fcea1b8b640 1 --2- 172.21.15.114:0/2240955595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce9c072e30 0x7fce9c0732b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fce9c0b3c70 tx=0x7fce8c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e71d906a6f75fd7d server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:39.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.831+0000 7fcea138a640 1 -- 172.21.15.114:0/2240955595 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c037070 con 0x7fce9c072e30 2024-04-28T13:08:39.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.831+0000 7fcea138a640 1 -- 172.21.15.114:0/2240955595 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce8c032440 con 0x7fce9c072e30 2024-04-28T13:08:39.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.831+0000 7fcea138a640 1 -- 172.21.15.114:0/2240955595 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c02ae60 con 0x7fce9c072e30 2024-04-28T13:08:39.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.831+0000 7fcea45f0640 1 -- 172.21.15.114:0/2240955595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce9c072e30 msgr2=0x7fce9c0732b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:39.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.831+0000 7fcea45f0640 1 --2- 172.21.15.114:0/2240955595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce9c072e30 0x7fce9c0732b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fce9c0b3c70 tx=0x7fce8c02a110 comp rx=0 tx=0).stop 2024-04-28T13:08:39.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.831+0000 7fcea45f0640 1 -- 172.21.15.114:0/2240955595 shutdown_connections 2024-04-28T13:08:39.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.831+0000 7fcea45f0640 1 --2- 172.21.15.114:0/2240955595 >> v2:172.21.15.134:3300/0 conn(0x7fce9c15c370 0x7fce9c15c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:39.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.831+0000 7fcea45f0640 1 --2- 172.21.15.114:0/2240955595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce9c072e30 0x7fce9c0732b0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:39.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.831+0000 7fcea45f0640 1 -- 172.21.15.114:0/2240955595 >> 172.21.15.114:0/2240955595 conn(0x7fce9c06c980 msgr2=0x7fce9c0b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:39.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.831+0000 7fcea45f0640 1 -- 172.21.15.114:0/2240955595 shutdown_connections 2024-04-28T13:08:39.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.831+0000 7fcea45f0640 1 -- 172.21.15.114:0/2240955595 wait complete. 2024-04-28T13:08:39.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.833+0000 7fcea45f0640 1 Processor -- start 2024-04-28T13:08:39.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.833+0000 7fcea45f0640 1 -- start start 2024-04-28T13:08:39.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.833+0000 7fcea45f0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce9c072e30 0x7fce9c14d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:39.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.833+0000 7fcea45f0640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce9c0b4850 0x7fce9c1f2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:39.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.833+0000 7fcea45f0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce9c15c370 0x7fce9c0ad650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:39.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.833+0000 7fcea45f0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c06e3e0 con 0x7fce9c072e30 2024-04-28T13:08:39.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.833+0000 7fcea45f0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c074560 con 0x7fce9c15c370 2024-04-28T13:08:39.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.833+0000 7fcea45f0640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fce9c15cce0 con 0x7fce9c0b4850 2024-04-28T13:08:39.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.833+0000 7fcea238c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce9c072e30 0x7fce9c14d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:39.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.833+0000 7fcea238c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce9c072e30 0x7fce9c14d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43306/0 (socket says 172.21.15.114:43306) 2024-04-28T13:08:39.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.833+0000 7fcea238c640 1 -- 172.21.15.114:0/2829252867 learned_addr learned my addr 172.21.15.114:0/2829252867 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:39.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.834+0000 7fcea2b8d640 1 --2- 172.21.15.114:0/2829252867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce9c15c370 0x7fce9c0ad650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:39.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.834+0000 7fcea1b8b640 1 --2- 172.21.15.114:0/2829252867 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce9c0b4850 0x7fce9c1f2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:39.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.834+0000 7fcea238c640 1 -- 172.21.15.114:0/2829252867 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce9c0b4850 msgr2=0x7fce9c1f2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:39.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.834+0000 7fcea238c640 1 --2- 172.21.15.114:0/2829252867 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce9c0b4850 0x7fce9c1f2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:39.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.834+0000 7fcea238c640 1 -- 172.21.15.114:0/2829252867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce9c15c370 msgr2=0x7fce9c0ad650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:39.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.834+0000 7fcea238c640 1 --2- 172.21.15.114:0/2829252867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce9c15c370 0x7fce9c0ad650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:39.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.834+0000 7fcea238c640 1 -- 172.21.15.114:0/2829252867 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce9c14dec0 con 0x7fce9c072e30 2024-04-28T13:08:39.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.834+0000 7fcea2b8d640 1 --2- 172.21.15.114:0/2829252867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce9c15c370 0x7fce9c0ad650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:39.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.834+0000 7fcea238c640 1 --2- 172.21.15.114:0/2829252867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce9c072e30 0x7fce9c14d980 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fce9400c4d0 tx=0x7fce9400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:39.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.834+0000 7fce92ffd640 1 -- 172.21.15.114:0/2829252867 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce94018070 con 0x7fce9c072e30 2024-04-28T13:08:39.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.834+0000 7fce92ffd640 1 -- 172.21.15.114:0/2829252867 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce94007500 con 0x7fce9c072e30 2024-04-28T13:08:39.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.834+0000 7fce92ffd640 1 -- 172.21.15.114:0/2829252867 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce94004a20 con 0x7fce9c072e30 2024-04-28T13:08:39.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.834+0000 7fcea45f0640 1 -- 172.21.15.114:0/2829252867 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce9c156290 con 0x7fce9c072e30 2024-04-28T13:08:39.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.834+0000 7fcea45f0640 1 -- 172.21.15.114:0/2829252867 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce9c0ab300 con 0x7fce9c072e30 2024-04-28T13:08:39.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.835+0000 7fcea45f0640 1 -- 172.21.15.114:0/2829252867 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce9c06a3d0 con 0x7fce9c072e30 2024-04-28T13:08:39.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.835+0000 7fce92ffd640 1 -- 172.21.15.114:0/2829252867 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7fce9401b070 con 0x7fce9c072e30 2024-04-28T13:08:39.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.836+0000 7fce92ffd640 1 --2- 172.21.15.114:0/2829252867 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fce8006c980 0x7fce8006ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:39.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.836+0000 7fce92ffd640 1 -- 172.21.15.114:0/2829252867 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fce9408ac30 con 0x7fce9c072e30 2024-04-28T13:08:39.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.836+0000 7fcea1b8b640 1 --2- 172.21.15.114:0/2829252867 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fce8006c980 0x7fce8006ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:39.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.836+0000 7fcea1b8b640 1 --2- 172.21.15.114:0/2829252867 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fce8006c980 0x7fce8006ee40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fce8c034000 tx=0x7fce8c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:39.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:39.840+0000 7fce92ffd640 1 -- 172.21.15.114:0/2829252867 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fce9c14dec0 con 0x7fce9c072e30 2024-04-28T13:08:40.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.014+0000 7fcea45f0640 1 -- 172.21.15.114:0/2829252867 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fce9c0cf3f0 con 0x7fce9c072e30 2024-04-28T13:08:40.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.014+0000 7fce92ffd640 1 -- 172.21.15.114:0/2829252867 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) ==== 93+0+10 (secure 0 0 0) 0x7fce940592e0 con 0x7fce9c072e30 2024-04-28T13:08:40.015 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-28T13:08:40.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.016+0000 7fcea45f0640 1 -- 172.21.15.114:0/2829252867 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fce8006c980 msgr2=0x7fce8006ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:40.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.016+0000 7fcea45f0640 1 --2- 172.21.15.114:0/2829252867 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fce8006c980 0x7fce8006ee40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fce8c034000 tx=0x7fce8c02e000 comp rx=0 tx=0).stop 2024-04-28T13:08:40.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.016+0000 7fcea45f0640 1 -- 172.21.15.114:0/2829252867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce9c072e30 msgr2=0x7fce9c14d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:40.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.016+0000 7fcea45f0640 1 --2- 172.21.15.114:0/2829252867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce9c072e30 0x7fce9c14d980 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fce9400c4d0 tx=0x7fce9400c990 comp rx=0 tx=0).stop 2024-04-28T13:08:40.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.016+0000 7fcea45f0640 1 -- 172.21.15.114:0/2829252867 shutdown_connections 2024-04-28T13:08:40.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.016+0000 7fcea45f0640 1 --2- 172.21.15.114:0/2829252867 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fce8006c980 0x7fce8006ee40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:40.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.016+0000 7fcea45f0640 1 --2- 172.21.15.114:0/2829252867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce9c15c370 0x7fce9c0ad650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:40.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.016+0000 7fcea45f0640 1 --2- 172.21.15.114:0/2829252867 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce9c0b4850 0x7fce9c1f2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:40.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.016+0000 7fcea45f0640 1 --2- 172.21.15.114:0/2829252867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce9c072e30 0x7fce9c14d980 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:40.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.016+0000 7fcea45f0640 1 -- 172.21.15.114:0/2829252867 >> 172.21.15.114:0/2829252867 conn(0x7fce9c06c980 msgr2=0x7fce9c072320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:40.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.016+0000 7fcea45f0640 1 -- 172.21.15.114:0/2829252867 shutdown_connections 2024-04-28T13:08:40.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.016+0000 7fcea45f0640 1 -- 172.21.15.114:0/2829252867 wait complete. 2024-04-28T13:08:40.028 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_clean_stale_subvolume_snapshot_metadata' 2024-04-28T13:08:40.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.124+0000 7fe4633ac640 1 Processor -- start 2024-04-28T13:08:40.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.124+0000 7fe4633ac640 1 -- start start 2024-04-28T13:08:40.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.125+0000 7fe4633ac640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe45c06d360 0x7fe45c06e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:40.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.125+0000 7fe4633ac640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe45c06d740 0x7fe45c15f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:40.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.125+0000 7fe4633ac640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe45c070950 con 0x7fe45c162de0 2024-04-28T13:08:40.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.125+0000 7fe4633ac640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fe45c0af6b0 con 0x7fe45c06d360 2024-04-28T13:08:40.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.125+0000 7fe4633ac640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fe45c06eed0 con 0x7fe45c06d740 2024-04-28T13:08:40.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.125+0000 7fe461148640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe45c06d360 0x7fe45c06e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:40.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.125+0000 7fe461949640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe45c162de0 0x7fe45c163270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:54418/0 (socket says 172.21.15.114:54418) 2024-04-28T13:08:40.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.125+0000 7fe461949640 1 -- 172.21.15.114:0/1635316990 learned_addr learned my addr 172.21.15.114:0/1635316990 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:40.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.125+0000 7fe460947640 1 --2- 172.21.15.114:0/1635316990 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe45c06d740 0x7fe45c15f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:40.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.125+0000 7fe461148640 1 -- 172.21.15.114:0/1635316990 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe45c06d740 msgr2=0x7fe45c15f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:40.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.125+0000 7fe461148640 1 --2- 172.21.15.114:0/1635316990 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe45c06d740 0x7fe45c15f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:40.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.125+0000 7fe461148640 1 -- 172.21.15.114:0/1635316990 >> v1:172.21.15.114:6789/0 conn(0x7fe45c162de0 legacy=0x7fe45c163270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:40.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.125+0000 7fe453fff640 1 -- 172.21.15.114:0/1635316990 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3005189964 0 0) 0x7fe45c070950 con 0x7fe45c162de0 2024-04-28T13:08:40.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.125+0000 7fe461148640 1 -- 172.21.15.114:0/1635316990 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe45c06fc80 con 0x7fe45c06d360 2024-04-28T13:08:40.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.125+0000 7fe460947640 1 --2- 172.21.15.114:0/1635316990 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe45c06d740 0x7fe45c15f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:40.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.126+0000 7fe461148640 1 --2- 172.21.15.114:0/1635316990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45c06d360 0x7fe45c06e990 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe4580097a0 tx=0x7fe45802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9b405c76d3c57c server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:40.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.126+0000 7fe453fff640 1 -- 172.21.15.114:0/1635316990 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe458037070 con 0x7fe45c06d360 2024-04-28T13:08:40.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.126+0000 7fe453fff640 1 -- 172.21.15.114:0/1635316990 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe458032440 con 0x7fe45c06d360 2024-04-28T13:08:40.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.126+0000 7fe453fff640 1 -- 172.21.15.114:0/1635316990 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe458032810 con 0x7fe45c06d360 2024-04-28T13:08:40.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.127+0000 7fe4633ac640 1 -- 172.21.15.114:0/1635316990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45c06d360 msgr2=0x7fe45c06e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:40.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.127+0000 7fe4633ac640 1 --2- 172.21.15.114:0/1635316990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45c06d360 0x7fe45c06e990 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe4580097a0 tx=0x7fe45802a180 comp rx=0 tx=0).stop 2024-04-28T13:08:40.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.127+0000 7fe4633ac640 1 -- 172.21.15.114:0/1635316990 shutdown_connections 2024-04-28T13:08:40.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.127+0000 7fe4633ac640 1 --2- 172.21.15.114:0/1635316990 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe45c06d740 0x7fe45c15f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:40.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.127+0000 7fe4633ac640 1 --2- 172.21.15.114:0/1635316990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45c06d360 0x7fe45c06e990 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:40.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.127+0000 7fe4633ac640 1 -- 172.21.15.114:0/1635316990 >> 172.21.15.114:0/1635316990 conn(0x7fe45c072a60 msgr2=0x7fe45c072e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:40.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.127+0000 7fe4633ac640 1 -- 172.21.15.114:0/1635316990 shutdown_connections 2024-04-28T13:08:40.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.127+0000 7fe4633ac640 1 -- 172.21.15.114:0/1635316990 wait complete. 2024-04-28T13:08:40.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.128+0000 7fe4633ac640 1 Processor -- start 2024-04-28T13:08:40.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.128+0000 7fe4633ac640 1 -- start start 2024-04-28T13:08:40.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.128+0000 7fe4633ac640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe45c06d360 0x7fe45c150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:40.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.129+0000 7fe4633ac640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45c06d740 0x7fe45c14e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:40.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.129+0000 7fe4633ac640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe45c162de0 0x7fe45c14ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:40.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.129+0000 7fe4633ac640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe45c06f6c0 con 0x7fe45c06d740 2024-04-28T13:08:40.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.129+0000 7fe4633ac640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe45c06f3e0 con 0x7fe45c162de0 2024-04-28T13:08:40.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.129+0000 7fe4633ac640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fe45c06f9a0 con 0x7fe45c06d360 2024-04-28T13:08:40.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.129+0000 7fe460947640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45c06d740 0x7fe45c14e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:40.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.129+0000 7fe460947640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45c06d740 0x7fe45c14e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43332/0 (socket says 172.21.15.114:43332) 2024-04-28T13:08:40.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.129+0000 7fe460947640 1 -- 172.21.15.114:0/1281495065 learned_addr learned my addr 172.21.15.114:0/1281495065 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:40.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.129+0000 7fe460947640 1 -- 172.21.15.114:0/1281495065 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe45c06d360 msgr2=0x7fe45c150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:40.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.129+0000 7fe460947640 1 --2- 172.21.15.114:0/1281495065 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe45c06d360 0x7fe45c150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:40.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.129+0000 7fe460947640 1 -- 172.21.15.114:0/1281495065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe45c162de0 msgr2=0x7fe45c14ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:40.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.129+0000 7fe461949640 1 --2- 172.21.15.114:0/1281495065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe45c162de0 0x7fe45c14ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:40.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.129+0000 7fe460947640 1 --2- 172.21.15.114:0/1281495065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe45c162de0 0x7fe45c14ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:40.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.129+0000 7fe460947640 1 -- 172.21.15.114:0/1281495065 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe45c14e740 con 0x7fe45c06d740 2024-04-28T13:08:40.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.129+0000 7fe461949640 1 --2- 172.21.15.114:0/1281495065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe45c162de0 0x7fe45c14ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:40.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.129+0000 7fe460947640 1 --2- 172.21.15.114:0/1281495065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45c06d740 0x7fe45c14e200 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe44c00c820 tx=0x7fe44c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:40.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.129+0000 7fe451ffb640 1 -- 172.21.15.114:0/1281495065 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44c015070 con 0x7fe45c06d740 2024-04-28T13:08:40.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.129+0000 7fe451ffb640 1 -- 172.21.15.114:0/1281495065 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe44c007a30 con 0x7fe45c06d740 2024-04-28T13:08:40.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.129+0000 7fe451ffb640 1 -- 172.21.15.114:0/1281495065 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44c007e00 con 0x7fe45c06d740 2024-04-28T13:08:40.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.129+0000 7fe4633ac640 1 -- 172.21.15.114:0/1281495065 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe45c160270 con 0x7fe45c06d740 2024-04-28T13:08:40.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.129+0000 7fe4633ac640 1 -- 172.21.15.114:0/1281495065 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe45c1607f0 con 0x7fe45c06d740 2024-04-28T13:08:40.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.130+0000 7fe4633ac640 1 -- 172.21.15.114:0/1281495065 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe45c06a3d0 con 0x7fe45c06d740 2024-04-28T13:08:40.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.131+0000 7fe451ffb640 1 -- 172.21.15.114:0/1281495065 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7fe44c018070 con 0x7fe45c06d740 2024-04-28T13:08:40.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.131+0000 7fe451ffb640 1 --2- 172.21.15.114:0/1281495065 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fe44006c980 0x7fe44006ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:40.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.131+0000 7fe451ffb640 1 -- 172.21.15.114:0/1281495065 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fe44c08b960 con 0x7fe45c06d740 2024-04-28T13:08:40.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.131+0000 7fe461148640 1 --2- 172.21.15.114:0/1281495065 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fe44006c980 0x7fe44006ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:40.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.132+0000 7fe461148640 1 --2- 172.21.15.114:0/1281495065 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fe44006c980 0x7fe44006ee40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe458034000 tx=0x7fe45802c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:40.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.136+0000 7fe451ffb640 1 -- 172.21.15.114:0/1281495065 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe45c14e740 con 0x7fe45c06d740 2024-04-28T13:08:40.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.375+0000 7fe4633ac640 1 -- 172.21.15.114:0/1281495065 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_clean_stale_subvolume_snapshot_metadata"]} v 0) -- 0x7fe45c15ffc0 con 0x7fe45c06d740 2024-04-28T13:08:40.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.411+0000 7fe451ffb640 1 -- 172.21.15.114:0/1281495065 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_clean_stale_subvolume_snapshot_metadata"]}]=0 v94) ==== 175+0+0 (secure 0 0 0) 0x7fe45c15ffc0 con 0x7fe45c06d740 2024-04-28T13:08:40.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.413+0000 7fe4633ac640 1 -- 172.21.15.114:0/1281495065 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fe44006c980 msgr2=0x7fe44006ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:40.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.413+0000 7fe4633ac640 1 --2- 172.21.15.114:0/1281495065 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fe44006c980 0x7fe44006ee40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe458034000 tx=0x7fe45802c000 comp rx=0 tx=0).stop 2024-04-28T13:08:40.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.413+0000 7fe4633ac640 1 -- 172.21.15.114:0/1281495065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45c06d740 msgr2=0x7fe45c14e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:40.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.413+0000 7fe4633ac640 1 --2- 172.21.15.114:0/1281495065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45c06d740 0x7fe45c14e200 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe44c00c820 tx=0x7fe44c00cc20 comp rx=0 tx=0).stop 2024-04-28T13:08:40.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.413+0000 7fe4633ac640 1 -- 172.21.15.114:0/1281495065 shutdown_connections 2024-04-28T13:08:40.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.413+0000 7fe4633ac640 1 --2- 172.21.15.114:0/1281495065 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fe44006c980 0x7fe44006ee40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:40.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.413+0000 7fe4633ac640 1 --2- 172.21.15.114:0/1281495065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe45c162de0 0x7fe45c14ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:40.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.413+0000 7fe4633ac640 1 --2- 172.21.15.114:0/1281495065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45c06d740 0x7fe45c14e200 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:40.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.413+0000 7fe4633ac640 1 --2- 172.21.15.114:0/1281495065 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe45c06d360 0x7fe45c150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:40.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.413+0000 7fe4633ac640 1 -- 172.21.15.114:0/1281495065 >> 172.21.15.114:0/1281495065 conn(0x7fe45c072a60 msgr2=0x7fe45c15cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:40.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.413+0000 7fe4633ac640 1 -- 172.21.15.114:0/1281495065 shutdown_connections 2024-04-28T13:08:40.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.413+0000 7fe4633ac640 1 -- 172.21.15.114:0/1281495065 wait complete. 2024-04-28T13:08:40.424 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-28T13:08:40.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.522+0000 7ffac0246640 1 Processor -- start 2024-04-28T13:08:40.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.523+0000 7ffac0246640 1 -- start start 2024-04-28T13:08:40.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.523+0000 7ffac0246640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ffab80b59a0 0x7ffab8162f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:40.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.523+0000 7ffac0246640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffab8163600 con 0x7ffab806c350 2024-04-28T13:08:40.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.523+0000 7ffac0246640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffab81638e0 con 0x7ffab80ce9a0 2024-04-28T13:08:40.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.523+0000 7ffac0246640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ffab8163ea0 con 0x7ffab80b59a0 2024-04-28T13:08:40.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.524+0000 7ffabdfe2640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ffab806c350 0x7ffab806c730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52246/0 (socket says 172.21.15.114:52246) 2024-04-28T13:08:40.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.524+0000 7ffabdfe2640 1 -- 172.21.15.114:0/3520103782 learned_addr learned my addr 172.21.15.114:0/3520103782 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:40.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.524+0000 7ffabe7e3640 1 --2- 172.21.15.114:0/3520103782 >> v2:172.21.15.134:3300/0 conn(0x7ffab80b59a0 0x7ffab8162f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:40.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.524+0000 7ffabcfe0640 1 -- 172.21.15.114:0/3520103782 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3518972730 0 0) 0x7ffab8163600 con 0x7ffab806c350 2024-04-28T13:08:40.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.524+0000 7ffabcfe0640 1 -- 172.21.15.114:0/3520103782 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffaa4003520 con 0x7ffab806c350 2024-04-28T13:08:40.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.524+0000 7ffabcfe0640 1 -- 172.21.15.114:0/3520103782 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 463914766 0 0) 0x7ffaa4003520 con 0x7ffab806c350 2024-04-28T13:08:40.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.524+0000 7ffabcfe0640 1 -- 172.21.15.114:0/3520103782 >> v2:172.21.15.134:3300/0 conn(0x7ffab80b59a0 msgr2=0x7ffab8162f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:40.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.524+0000 7ffabcfe0640 1 --2- 172.21.15.114:0/3520103782 >> v2:172.21.15.134:3300/0 conn(0x7ffab80b59a0 0x7ffab8162f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:40.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.524+0000 7ffabcfe0640 1 -- 172.21.15.114:0/3520103782 >> v1:172.21.15.134:6789/0 conn(0x7ffab80ce9a0 legacy=0x7ffab8070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:40.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.524+0000 7ffabcfe0640 1 -- 172.21.15.114:0/3520103782 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab8163bc0 con 0x7ffab806c350 2024-04-28T13:08:40.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.524+0000 7ffabcfe0640 1 -- 172.21.15.114:0/3520103782 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7ffaa8001670 con 0x7ffab806c350 2024-04-28T13:08:40.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.524+0000 7ffabcfe0640 1 -- 172.21.15.114:0/3520103782 >> v1:172.21.15.114:6789/0 conn(0x7ffab806c350 legacy=0x7ffab806c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:40.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.524+0000 7ffabcfe0640 1 --2- 172.21.15.114:0/3520103782 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffaa40039b0 0x7ffaa4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:40.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.524+0000 7ffabcfe0640 1 --2- 172.21.15.114:0/3520103782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffaa4004800 0x7ffaa4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:40.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.524+0000 7ffabcfe0640 1 --2- 172.21.15.114:0/3520103782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffaa40051c0 0x7ffaa400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:40.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.524+0000 7ffabcfe0640 1 -- 172.21.15.114:0/3520103782 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa400c130 con 0x7ffaa40051c0 2024-04-28T13:08:40.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.524+0000 7ffabcfe0640 1 -- 172.21.15.114:0/3520103782 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa400c2e0 con 0x7ffaa4004800 2024-04-28T13:08:40.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.524+0000 7ffabcfe0640 1 -- 172.21.15.114:0/3520103782 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ffaa400c4e0 con 0x7ffaa40039b0 2024-04-28T13:08:40.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.524+0000 7ffabe7e3640 1 --2- 172.21.15.114:0/3520103782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffaa40051c0 0x7ffaa400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:40.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.524+0000 7ffabdfe2640 1 --2- 172.21.15.114:0/3520103782 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffaa40039b0 0x7ffaa4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:40.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.524+0000 7ffabd7e1640 1 --2- 172.21.15.114:0/3520103782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffaa4004800 0x7ffaa4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:40.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.525+0000 7ffabe7e3640 1 -- 172.21.15.114:0/3520103782 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffaa40039b0 msgr2=0x7ffaa4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:40.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.525+0000 7ffabe7e3640 1 --2- 172.21.15.114:0/3520103782 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffaa40039b0 0x7ffaa4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:40.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.525+0000 7ffabe7e3640 1 -- 172.21.15.114:0/3520103782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffaa4004800 msgr2=0x7ffaa4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:40.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.525+0000 7ffabe7e3640 1 --2- 172.21.15.114:0/3520103782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffaa4004800 0x7ffaa4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:40.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.525+0000 7ffabe7e3640 1 -- 172.21.15.114:0/3520103782 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa4003520 con 0x7ffaa40051c0 2024-04-28T13:08:40.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.525+0000 7ffabe7e3640 1 -- 172.21.15.114:0/3520103782 reap_dead start 2024-04-28T13:08:40.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.525+0000 7ffabe7e3640 1 --2- 172.21.15.114:0/3520103782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffaa40051c0 0x7ffaa400b9c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ffab0009fc0 tx=0x7ffaa4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea50e8fe22a115e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:40.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.525+0000 7ffabcfe0640 1 -- 172.21.15.114:0/3520103782 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab0035020 con 0x7ffaa40051c0 2024-04-28T13:08:40.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.525+0000 7ffabcfe0640 1 -- 172.21.15.114:0/3520103782 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffab0003bd0 con 0x7ffaa40051c0 2024-04-28T13:08:40.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.525+0000 7ffabcfe0640 1 -- 172.21.15.114:0/3520103782 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab0009c10 con 0x7ffaa40051c0 2024-04-28T13:08:40.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.526+0000 7ffac0246640 1 -- 172.21.15.114:0/3520103782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffaa40051c0 msgr2=0x7ffaa400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:40.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.526+0000 7ffac0246640 1 --2- 172.21.15.114:0/3520103782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffaa40051c0 0x7ffaa400b9c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ffab0009fc0 tx=0x7ffaa4005830 comp rx=0 tx=0).stop 2024-04-28T13:08:40.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.526+0000 7ffac0246640 1 -- 172.21.15.114:0/3520103782 shutdown_connections 2024-04-28T13:08:40.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.526+0000 7ffac0246640 1 --2- 172.21.15.114:0/3520103782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffaa40051c0 0x7ffaa400b9c0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:40.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.526+0000 7ffac0246640 1 -- 172.21.15.114:0/3520103782 >> 172.21.15.114:0/3520103782 conn(0x7ffab806f4f0 msgr2=0x7ffab806f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:40.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.526+0000 7ffac0246640 1 -- 172.21.15.114:0/3520103782 shutdown_connections 2024-04-28T13:08:40.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.526+0000 7ffac0246640 1 -- 172.21.15.114:0/3520103782 wait complete. 2024-04-28T13:08:40.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.527+0000 7ffac0246640 1 Processor -- start 2024-04-28T13:08:40.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.527+0000 7ffac0246640 1 -- start start 2024-04-28T13:08:40.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.528+0000 7ffac0246640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffaa40051c0 0x7ffab815e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:40.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.528+0000 7ffac0246640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffab8161410 0x7ffab80b0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:40.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.528+0000 7ffac0246640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffab8161890 0x7ffab80b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:40.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.528+0000 7ffac0246640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ffab8163080 con 0x7ffab8161410 2024-04-28T13:08:40.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.528+0000 7ffac0246640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffab8162f00 con 0x7ffaa40051c0 2024-04-28T13:08:40.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.528+0000 7ffac0246640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ffab8163200 con 0x7ffab8161890 2024-04-28T13:08:40.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.528+0000 7ffabd7e1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffab8161410 0x7ffab80b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:40.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.528+0000 7ffabd7e1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffab8161410 0x7ffab80b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44372/0 (socket says 172.21.15.114:44372) 2024-04-28T13:08:40.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.528+0000 7ffabd7e1640 1 -- 172.21.15.114:0/2247140769 learned_addr learned my addr 172.21.15.114:0/2247140769 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:40.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.528+0000 7ffabdfe2640 1 --2- 172.21.15.114:0/2247140769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffaa40051c0 0x7ffab815e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:40.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.528+0000 7ffabe7e3640 1 --2- 172.21.15.114:0/2247140769 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffab8161890 0x7ffab80b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:40.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.528+0000 7ffabd7e1640 1 -- 172.21.15.114:0/2247140769 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffab8161890 msgr2=0x7ffab80b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:40.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.528+0000 7ffabd7e1640 1 --2- 172.21.15.114:0/2247140769 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffab8161890 0x7ffab80b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:40.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.528+0000 7ffabd7e1640 1 -- 172.21.15.114:0/2247140769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffaa40051c0 msgr2=0x7ffab815e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:40.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.528+0000 7ffabd7e1640 1 --2- 172.21.15.114:0/2247140769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffaa40051c0 0x7ffab815e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:40.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.528+0000 7ffabd7e1640 1 -- 172.21.15.114:0/2247140769 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab80b1e00 con 0x7ffab8161410 2024-04-28T13:08:40.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.528+0000 7ffabdfe2640 1 --2- 172.21.15.114:0/2247140769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffaa40051c0 0x7ffab815e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:40.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.528+0000 7ffabd7e1640 1 --2- 172.21.15.114:0/2247140769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffab8161410 0x7ffab80b0530 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ffab400f5f0 tx=0x7ffab400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:40.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.529+0000 7ffaae7fc640 1 -- 172.21.15.114:0/2247140769 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab40052e0 con 0x7ffab8161410 2024-04-28T13:08:40.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.529+0000 7ffaae7fc640 1 -- 172.21.15.114:0/2247140769 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffab4018070 con 0x7ffab8161410 2024-04-28T13:08:40.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.529+0000 7ffac0246640 1 -- 172.21.15.114:0/2247140769 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffab80b20e0 con 0x7ffab8161410 2024-04-28T13:08:40.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.529+0000 7ffaae7fc640 1 -- 172.21.15.114:0/2247140769 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab4003810 con 0x7ffab8161410 2024-04-28T13:08:40.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.529+0000 7ffac0246640 1 -- 172.21.15.114:0/2247140769 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffab80b26a0 con 0x7ffab8161410 2024-04-28T13:08:40.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.530+0000 7ffac0246640 1 -- 172.21.15.114:0/2247140769 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffab8069d60 con 0x7ffab8161410 2024-04-28T13:08:40.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.530+0000 7ffaae7fc640 1 -- 172.21.15.114:0/2247140769 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7ffab40039b0 con 0x7ffab8161410 2024-04-28T13:08:40.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.531+0000 7ffaae7fc640 1 --2- 172.21.15.114:0/2247140769 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ffa9c06c980 0x7ffa9c06ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:40.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.531+0000 7ffabdfe2640 1 --2- 172.21.15.114:0/2247140769 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ffa9c06c980 0x7ffa9c06ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:40.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.531+0000 7ffaae7fc640 1 -- 172.21.15.114:0/2247140769 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7ffab408b5e0 con 0x7ffab8161410 2024-04-28T13:08:40.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.531+0000 7ffabdfe2640 1 --2- 172.21.15.114:0/2247140769 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ffa9c06c980 0x7ffa9c06ee40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8001eb0 tx=0x7ffaa8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:40.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.535+0000 7ffaae7fc640 1 -- 172.21.15.114:0/2247140769 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ffab8069d60 con 0x7ffab8161410 2024-04-28T13:08:40.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.709+0000 7ffac0246640 1 -- 172.21.15.114:0/2247140769 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7ffab806a3d0 con 0x7ffab8161410 2024-04-28T13:08:40.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.712+0000 7ffaae7fc640 1 -- 172.21.15.114:0/2247140769 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7ffab4059db0 con 0x7ffab8161410 2024-04-28T13:08:40.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.715+0000 7ffac0246640 1 -- 172.21.15.114:0/2247140769 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ffa9c06c980 msgr2=0x7ffa9c06ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:40.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.715+0000 7ffac0246640 1 --2- 172.21.15.114:0/2247140769 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ffa9c06c980 0x7ffa9c06ee40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8001eb0 tx=0x7ffaa8009040 comp rx=0 tx=0).stop 2024-04-28T13:08:40.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.715+0000 7ffac0246640 1 -- 172.21.15.114:0/2247140769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffab8161410 msgr2=0x7ffab80b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:40.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.715+0000 7ffac0246640 1 --2- 172.21.15.114:0/2247140769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffab8161410 0x7ffab80b0530 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ffab400f5f0 tx=0x7ffab400fab0 comp rx=0 tx=0).stop 2024-04-28T13:08:40.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.715+0000 7ffac0246640 1 -- 172.21.15.114:0/2247140769 shutdown_connections 2024-04-28T13:08:40.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.715+0000 7ffac0246640 1 --2- 172.21.15.114:0/2247140769 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffab8161890 0x7ffab80b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:40.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.715+0000 7ffac0246640 1 --2- 172.21.15.114:0/2247140769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffab8161410 0x7ffab80b0530 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:40.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.715+0000 7ffac0246640 1 --2- 172.21.15.114:0/2247140769 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ffa9c06c980 0x7ffa9c06ee40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:40.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.715+0000 7ffac0246640 1 --2- 172.21.15.114:0/2247140769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffaa40051c0 0x7ffab815e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:40.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.715+0000 7ffac0246640 1 -- 172.21.15.114:0/2247140769 >> 172.21.15.114:0/2247140769 conn(0x7ffab806f4f0 msgr2=0x7ffab80d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:40.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.715+0000 7ffac0246640 1 -- 172.21.15.114:0/2247140769 shutdown_connections 2024-04-28T13:08:40.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:40.715+0000 7ffac0246640 1 -- 172.21.15.114:0/2247140769 wait complete. 2024-04-28T13:08:40.726 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-28T13:08:40.727 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-28T13:08:40.769 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-28T13:08:40.815 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-28T13:08:40.816 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:08:40.816 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-28T13:08:40.831 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19608 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-28T13:08:40.831 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:08:40.832 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-28T13:08:40.849 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056112,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13795 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248848k,nr_inodes=812212,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-28T13:08:40.849 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:08:40.849 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-28T13:08:40.886 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19608 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-28T13:08:40.887 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:08:40.887 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-28T13:08:40.906 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056112,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13795 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248848k,nr_inodes=812212,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-28T13:08:40.906 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-28T13:08:40.906 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-28T13:08:41.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.021+0000 7fa0eac20640 1 Processor -- start 2024-04-28T13:08:41.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.021+0000 7fa0eac20640 1 -- start start 2024-04-28T13:08:41.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.022+0000 7fa0eac20640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa0e415f430 0x7fa0e40715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:41.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.022+0000 7fa0eac20640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa0e40b5970 0x7fa0e40740e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:41.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.022+0000 7fa0eac20640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0e40746f0 con 0x7fa0e4073c50 2024-04-28T13:08:41.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.022+0000 7fa0eac20640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fa0e415f810 con 0x7fa0e415f430 2024-04-28T13:08:41.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.022+0000 7fa0eac20640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fa0e4070810 con 0x7fa0e40b5970 2024-04-28T13:08:41.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.022+0000 7fa0e89bc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa0e415f430 0x7fa0e40715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:41.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.022+0000 7fa0e89bc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa0e415f430 0x7fa0e40715d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44386/0 (socket says 172.21.15.114:44386) 2024-04-28T13:08:41.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.022+0000 7fa0e89bc640 1 -- 172.21.15.114:0/1927287923 learned_addr learned my addr 172.21.15.114:0/1927287923 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:41.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.022+0000 7fa0e89bc640 1 -- 172.21.15.114:0/1927287923 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa0e40b5970 msgr2=0x7fa0e40740e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:41.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.022+0000 7fa0e89bc640 1 --2- 172.21.15.114:0/1927287923 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa0e40b5970 0x7fa0e40740e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:41.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.022+0000 7fa0e89bc640 1 -- 172.21.15.114:0/1927287923 >> v1:172.21.15.134:6789/0 conn(0x7fa0e4073c50 legacy=0x7fa0e40b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:41.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.022+0000 7fa0e89bc640 1 -- 172.21.15.114:0/1927287923 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e4070af0 con 0x7fa0e415f430 2024-04-28T13:08:41.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.023+0000 7fa0e89bc640 1 --2- 172.21.15.114:0/1927287923 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0e415f430 0x7fa0e40715d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8009870 tx=0x7fa0d802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa4f224bb9a6edf server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:41.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.023+0000 7fa0e37fe640 1 -- 172.21.15.114:0/1927287923 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d8037070 con 0x7fa0e415f430 2024-04-28T13:08:41.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.023+0000 7fa0e37fe640 1 -- 172.21.15.114:0/1927287923 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0d8032440 con 0x7fa0e415f430 2024-04-28T13:08:41.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.023+0000 7fa0e37fe640 1 -- 172.21.15.114:0/1927287923 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d8032810 con 0x7fa0e415f430 2024-04-28T13:08:41.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.023+0000 7fa0eac20640 1 -- 172.21.15.114:0/1927287923 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0e415f430 msgr2=0x7fa0e40715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:41.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.023+0000 7fa0eac20640 1 --2- 172.21.15.114:0/1927287923 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0e415f430 0x7fa0e40715d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8009870 tx=0x7fa0d802a230 comp rx=0 tx=0).stop 2024-04-28T13:08:41.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.023+0000 7fa0eac20640 1 -- 172.21.15.114:0/1927287923 shutdown_connections 2024-04-28T13:08:41.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.023+0000 7fa0eac20640 1 --2- 172.21.15.114:0/1927287923 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa0e40b5970 0x7fa0e40740e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:41.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.023+0000 7fa0eac20640 1 --2- 172.21.15.114:0/1927287923 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0e415f430 0x7fa0e40715d0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:41.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.023+0000 7fa0eac20640 1 -- 172.21.15.114:0/1927287923 >> 172.21.15.114:0/1927287923 conn(0x7fa0e40b3c50 msgr2=0x7fa0e40b4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:41.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.024+0000 7fa0eac20640 1 -- 172.21.15.114:0/1927287923 shutdown_connections 2024-04-28T13:08:41.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.024+0000 7fa0eac20640 1 -- 172.21.15.114:0/1927287923 wait complete. 2024-04-28T13:08:41.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.025+0000 7fa0eac20640 1 Processor -- start 2024-04-28T13:08:41.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.025+0000 7fa0eac20640 1 -- start start 2024-04-28T13:08:41.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.025+0000 7fa0eac20640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0e4073c50 0x7fa0e41e7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:41.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.025+0000 7fa0eac20640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa0e40b5970 0x7fa0e4148980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:41.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.025+0000 7fa0eac20640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0e415f430 0x7fa0e406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:41.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.025+0000 7fa0eac20640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e4071b10 con 0x7fa0e415f430 2024-04-28T13:08:41.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.025+0000 7fa0eac20640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e40710b0 con 0x7fa0e4073c50 2024-04-28T13:08:41.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.025+0000 7fa0eac20640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fa0e40b15a0 con 0x7fa0e40b5970 2024-04-28T13:08:41.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.026+0000 7fa0e91bd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0e415f430 0x7fa0e406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:41.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.026+0000 7fa0e91bd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0e415f430 0x7fa0e406f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44390/0 (socket says 172.21.15.114:44390) 2024-04-28T13:08:41.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.026+0000 7fa0e91bd640 1 -- 172.21.15.114:0/3097824373 learned_addr learned my addr 172.21.15.114:0/3097824373 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:41.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.026+0000 7fa0e89bc640 1 --2- 172.21.15.114:0/3097824373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0e4073c50 0x7fa0e41e7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:41.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.026+0000 7fa0e3fff640 1 --2- 172.21.15.114:0/3097824373 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa0e40b5970 0x7fa0e4148980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:41.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.026+0000 7fa0e91bd640 1 -- 172.21.15.114:0/3097824373 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa0e40b5970 msgr2=0x7fa0e4148980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:41.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.026+0000 7fa0e91bd640 1 --2- 172.21.15.114:0/3097824373 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa0e40b5970 0x7fa0e4148980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:41.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.026+0000 7fa0e91bd640 1 -- 172.21.15.114:0/3097824373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0e4073c50 msgr2=0x7fa0e41e7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:41.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.026+0000 7fa0e91bd640 1 --2- 172.21.15.114:0/3097824373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0e4073c50 0x7fa0e41e7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:41.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.026+0000 7fa0e91bd640 1 -- 172.21.15.114:0/3097824373 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e41e8060 con 0x7fa0e415f430 2024-04-28T13:08:41.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.026+0000 7fa0e91bd640 1 --2- 172.21.15.114:0/3097824373 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0e415f430 0x7fa0e406f120 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc00b9e0 tx=0x7fa0dc00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:41.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.026+0000 7fa0e17fa640 1 -- 172.21.15.114:0/3097824373 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc019070 con 0x7fa0e415f430 2024-04-28T13:08:41.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.026+0000 7fa0e17fa640 1 -- 172.21.15.114:0/3097824373 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0dc00cb20 con 0x7fa0e415f430 2024-04-28T13:08:41.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.026+0000 7fa0eac20640 1 -- 172.21.15.114:0/3097824373 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0e41e8330 con 0x7fa0e415f430 2024-04-28T13:08:41.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.026+0000 7fa0e17fa640 1 -- 172.21.15.114:0/3097824373 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc014440 con 0x7fa0e415f430 2024-04-28T13:08:41.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.026+0000 7fa0eac20640 1 -- 172.21.15.114:0/3097824373 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0e41e88f0 con 0x7fa0e415f430 2024-04-28T13:08:41.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.027+0000 7fa0eac20640 1 -- 172.21.15.114:0/3097824373 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0e406a3d0 con 0x7fa0e415f430 2024-04-28T13:08:41.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.028+0000 7fa0e17fa640 1 -- 172.21.15.114:0/3097824373 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7fa0dc01c070 con 0x7fa0e415f430 2024-04-28T13:08:41.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.028+0000 7fa0e17fa640 1 --2- 172.21.15.114:0/3097824373 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa0c806c980 0x7fa0c806ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:41.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.028+0000 7fa0e17fa640 1 -- 172.21.15.114:0/3097824373 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fa0dc08b500 con 0x7fa0e415f430 2024-04-28T13:08:41.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.028+0000 7fa0e89bc640 1 --2- 172.21.15.114:0/3097824373 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa0c806c980 0x7fa0c806ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:41.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.029+0000 7fa0e89bc640 1 --2- 172.21.15.114:0/3097824373 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa0c806c980 0x7fa0c806ee40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8034000 tx=0x7fa0d802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:41.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.033+0000 7fa0e17fa640 1 -- 172.21.15.114:0/3097824373 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa0dc059cd0 con 0x7fa0e415f430 2024-04-28T13:08:41.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.243+0000 7fa0eac20640 1 -- 172.21.15.114:0/3097824373 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0e415cb60 con 0x7fa0e415f430 2024-04-28T13:08:41.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.244+0000 7fa0e17fa640 1 -- 172.21.15.114:0/3097824373 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+3877 (secure 0 0 0) 0x7fa0dc0595d0 con 0x7fa0e415f430 2024-04-28T13:08:41.244 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:41.245 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":16,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3832267996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":3832267996},{"type":"v1","addr":"172.21.15.134:6835","nonce":3832267996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5130,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2035724706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2035724706},{"type":"v1","addr":"172.21.15.114:6836","nonce":2035724706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":5133,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3180452801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3180452801},{"type":"v1","addr":"172.21.15.114:6837","nonce":3180452801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5161,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/445947113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":445947113},{"type":"v1","addr":"172.21.15.134:6834","nonce":445947113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[]} 2024-04-28T13:08:41.245 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 16 2024-04-28T13:08:41.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.245+0000 7fa0eac20640 1 -- 172.21.15.114:0/3097824373 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa0c806c980 msgr2=0x7fa0c806ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:41.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.245+0000 7fa0eac20640 1 --2- 172.21.15.114:0/3097824373 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa0c806c980 0x7fa0c806ee40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8034000 tx=0x7fa0d802e000 comp rx=0 tx=0).stop 2024-04-28T13:08:41.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.245+0000 7fa0eac20640 1 -- 172.21.15.114:0/3097824373 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0e415f430 msgr2=0x7fa0e406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:41.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.245+0000 7fa0eac20640 1 --2- 172.21.15.114:0/3097824373 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0e415f430 0x7fa0e406f120 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc00b9e0 tx=0x7fa0dc00bea0 comp rx=0 tx=0).stop 2024-04-28T13:08:41.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.246+0000 7fa0eac20640 1 -- 172.21.15.114:0/3097824373 shutdown_connections 2024-04-28T13:08:41.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.246+0000 7fa0eac20640 1 --2- 172.21.15.114:0/3097824373 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0e415f430 0x7fa0e406f120 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:41.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.246+0000 7fa0eac20640 1 --2- 172.21.15.114:0/3097824373 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa0e40b5970 0x7fa0e4148980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:41.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.246+0000 7fa0eac20640 1 --2- 172.21.15.114:0/3097824373 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa0c806c980 0x7fa0c806ee40 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:41.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.246+0000 7fa0eac20640 1 --2- 172.21.15.114:0/3097824373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0e4073c50 0x7fa0e41e7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:41.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.246+0000 7fa0eac20640 1 -- 172.21.15.114:0/3097824373 >> 172.21.15.114:0/3097824373 conn(0x7fa0e40b3c50 msgr2=0x7fa0e40b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:41.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.246+0000 7fa0eac20640 1 -- 172.21.15.114:0/3097824373 shutdown_connections 2024-04-28T13:08:41.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.246+0000 7fa0eac20640 1 -- 172.21.15.114:0/3097824373 wait complete. 2024-04-28T13:08:41.258 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-28T13:08:41.258 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-28T13:08:41.258 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-28T13:08:41.258 INFO:teuthology.orchestra.run:waiting for 300 2024-04-28T13:08:41.258 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-28T13:08:41.258 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-28T13:08:41.258 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-28T13:08:41.259 INFO:teuthology.orchestra.run:waiting for 300 2024-04-28T13:08:41.259 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-28T13:08:41.259 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-28T13:08:41.259 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-28T13:08:41.259 INFO:teuthology.orchestra.run:waiting for 300 2024-04-28T13:08:41.259 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-28T13:08:41.259 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-28T13:08:41.259 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-28T13:08:41.260 INFO:teuthology.orchestra.run:waiting for 300 2024-04-28T13:08:41.268 INFO:tasks.ceph.mds.a:Stopped 2024-04-28T13:08:41.268 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-28T13:08:41.269 INFO:tasks.ceph.mds.c:Stopped 2024-04-28T13:08:41.269 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-28T13:08:41.271 INFO:tasks.ceph.mds.b:Stopped 2024-04-28T13:08:41.271 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-28T13:08:41.272 INFO:tasks.ceph.mds.d:Stopped 2024-04-28T13:08:41.272 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-28T13:08:41.311 INFO:tasks.ceph.mds.a:Started 2024-04-28T13:08:41.311 DEBUG:teuthology.parallel:result is None 2024-04-28T13:08:41.311 INFO:tasks.ceph.mds.c:Started 2024-04-28T13:08:41.312 DEBUG:teuthology.parallel:result is None 2024-04-28T13:08:41.314 INFO:tasks.ceph.mds.b:Started 2024-04-28T13:08:41.314 DEBUG:teuthology.parallel:result is None 2024-04-28T13:08:41.315 INFO:tasks.ceph.mds.d:Started 2024-04-28T13:08:41.315 DEBUG:teuthology.parallel:result is None 2024-04-28T13:08:41.315 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-28T13:08:41.383 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-04-28T13:08:41.383 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-04-28T13:08:41.393 INFO:tasks.ceph.mds.d.smithi134.stdout:starting mds.d at 2024-04-28T13:08:41.393 INFO:tasks.ceph.mds.b.smithi134.stdout:starting mds.b at 2024-04-28T13:08:41.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.415+0000 7fde12d12640 1 Processor -- start 2024-04-28T13:08:41.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.415+0000 7fde12d12640 1 -- start start 2024-04-28T13:08:41.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.416+0000 7fde12d12640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fde0c0d0d80 0x7fde0c0d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:41.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.416+0000 7fde12d12640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde0c0ceb60 con 0x7fde0c0cf920 2024-04-28T13:08:41.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.416+0000 7fde12d12640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde0c0cee40 con 0x7fde0c14d160 2024-04-28T13:08:41.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.416+0000 7fde12d12640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fde0c0cf120 con 0x7fde0c0d0d80 2024-04-28T13:08:41.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.416+0000 7fde0bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fde0c0d0d80 0x7fde0c0d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:41.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.416+0000 7fde0bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fde0c0d0d80 0x7fde0c0d11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44420/0 (socket says 172.21.15.114:44420) 2024-04-28T13:08:41.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.416+0000 7fde0bfff640 1 -- 172.21.15.114:0/2541897603 learned_addr learned my addr 172.21.15.114:0/2541897603 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:41.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.416+0000 7fde10aae640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fde0c14d160 0x7fde0c0b3e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:38254/0 (socket says 172.21.15.114:38254) 2024-04-28T13:08:41.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.416+0000 7fde112af640 1 --1- 172.21.15.114:0/2541897603 >> v1:172.21.15.114:6789/0 conn(0x7fde0c0cf920 0x7fde0c072100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52266/0 (socket says 172.21.15.114:52266) 2024-04-28T13:08:41.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.416+0000 7fde0bfff640 1 -- 172.21.15.114:0/2541897603 >> v1:172.21.15.134:6789/0 conn(0x7fde0c14d160 legacy=0x7fde0c0b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:41.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.416+0000 7fde0bfff640 1 -- 172.21.15.114:0/2541897603 >> v1:172.21.15.114:6789/0 conn(0x7fde0c0cf920 legacy=0x7fde0c072100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:41.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.416+0000 7fde0bfff640 1 -- 172.21.15.114:0/2541897603 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde0c0b4570 con 0x7fde0c0d0d80 2024-04-28T13:08:41.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.417+0000 7fde0bfff640 1 --2- 172.21.15.114:0/2541897603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde0c0d0d80 0x7fde0c0d11e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fddf8009870 tx=0x7fddf802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c16789f5e53e90 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:41.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.418+0000 7fde0b7fe640 1 -- 172.21.15.114:0/2541897603 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf8037070 con 0x7fde0c0d0d80 2024-04-28T13:08:41.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.418+0000 7fde0b7fe640 1 -- 172.21.15.114:0/2541897603 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddf8032440 con 0x7fde0c0d0d80 2024-04-28T13:08:41.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.418+0000 7fde0b7fe640 1 -- 172.21.15.114:0/2541897603 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf8032810 con 0x7fde0c0d0d80 2024-04-28T13:08:41.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.419+0000 7fde12d12640 1 -- 172.21.15.114:0/2541897603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde0c0d0d80 msgr2=0x7fde0c0d11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:41.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.419+0000 7fde12d12640 1 --2- 172.21.15.114:0/2541897603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde0c0d0d80 0x7fde0c0d11e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fddf8009870 tx=0x7fddf802a270 comp rx=0 tx=0).stop 2024-04-28T13:08:41.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.419+0000 7fde12d12640 1 -- 172.21.15.114:0/2541897603 shutdown_connections 2024-04-28T13:08:41.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.419+0000 7fde12d12640 1 --2- 172.21.15.114:0/2541897603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde0c0d0d80 0x7fde0c0d11e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:41.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.419+0000 7fde12d12640 1 -- 172.21.15.114:0/2541897603 >> 172.21.15.114:0/2541897603 conn(0x7fde0c0cd8b0 msgr2=0x7fde0c0cdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:41.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.419+0000 7fde12d12640 1 -- 172.21.15.114:0/2541897603 shutdown_connections 2024-04-28T13:08:41.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.419+0000 7fde12d12640 1 -- 172.21.15.114:0/2541897603 wait complete. 2024-04-28T13:08:41.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.420+0000 7fde12d12640 1 Processor -- start 2024-04-28T13:08:41.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.420+0000 7fde12d12640 1 -- start start 2024-04-28T13:08:41.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.421+0000 7fde12d12640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde0c0cf920 0x7fde0c163080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:41.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.421+0000 7fde12d12640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde0c0d0d80 0x7fde0c1fa710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:41.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.421+0000 7fde12d12640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde0c14d160 0x7fde0c0c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:41.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.421+0000 7fde12d12640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fde0c072990 con 0x7fde0c0d0d80 2024-04-28T13:08:41.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.421+0000 7fde12d12640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fde0c072810 con 0x7fde0c0cf920 2024-04-28T13:08:41.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.421+0000 7fde12d12640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fde0c0cfdd0 con 0x7fde0c14d160 2024-04-28T13:08:41.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.421+0000 7fde0bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde0c0d0d80 0x7fde0c1fa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:41.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.421+0000 7fde0bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde0c0d0d80 0x7fde0c1fa710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44434/0 (socket says 172.21.15.114:44434) 2024-04-28T13:08:41.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.421+0000 7fde0bfff640 1 -- 172.21.15.114:0/4225212363 learned_addr learned my addr 172.21.15.114:0/4225212363 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:41.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.421+0000 7fde10aae640 1 --2- 172.21.15.114:0/4225212363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde0c0cf920 0x7fde0c163080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:41.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.421+0000 7fde112af640 1 --2- 172.21.15.114:0/4225212363 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde0c14d160 0x7fde0c0c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:41.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.422+0000 7fde0bfff640 1 -- 172.21.15.114:0/4225212363 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde0c14d160 msgr2=0x7fde0c0c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:41.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.422+0000 7fde0bfff640 1 --2- 172.21.15.114:0/4225212363 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde0c14d160 0x7fde0c0c62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:41.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.422+0000 7fde0bfff640 1 -- 172.21.15.114:0/4225212363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde0c0cf920 msgr2=0x7fde0c163080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:41.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.422+0000 7fde0bfff640 1 --2- 172.21.15.114:0/4225212363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde0c0cf920 0x7fde0c163080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:41.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.422+0000 7fde0bfff640 1 -- 172.21.15.114:0/4225212363 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde0c1fac50 con 0x7fde0c0d0d80 2024-04-28T13:08:41.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.422+0000 7fde0bfff640 1 --2- 172.21.15.114:0/4225212363 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde0c0d0d80 0x7fde0c1fa710 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fddf8000c00 tx=0x7fddf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:41.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.422+0000 7fde097fa640 1 -- 172.21.15.114:0/4225212363 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf8037040 con 0x7fde0c0d0d80 2024-04-28T13:08:41.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.422+0000 7fde097fa640 1 -- 172.21.15.114:0/4225212363 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddf8042070 con 0x7fde0c0d0d80 2024-04-28T13:08:41.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.422+0000 7fde097fa640 1 -- 172.21.15.114:0/4225212363 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf8030bd0 con 0x7fde0c0d0d80 2024-04-28T13:08:41.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.422+0000 7fde12d12640 1 -- 172.21.15.114:0/4225212363 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde0c0c7c60 con 0x7fde0c0d0d80 2024-04-28T13:08:41.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.422+0000 7fde12d12640 1 -- 172.21.15.114:0/4225212363 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde0c0c8220 con 0x7fde0c0d0d80 2024-04-28T13:08:41.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.423+0000 7fde12d12640 1 -- 172.21.15.114:0/4225212363 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde0c06a3d0 con 0x7fde0c0d0d80 2024-04-28T13:08:41.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.423+0000 7fde097fa640 1 -- 172.21.15.114:0/4225212363 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7fddf8047460 con 0x7fde0c0d0d80 2024-04-28T13:08:41.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.424+0000 7fde097fa640 1 --2- 172.21.15.114:0/4225212363 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fddf006c980 0x7fddf006ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:41.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.424+0000 7fde097fa640 1 -- 172.21.15.114:0/4225212363 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7fddf80ac3c0 con 0x7fde0c0d0d80 2024-04-28T13:08:41.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.424+0000 7fde10aae640 1 --2- 172.21.15.114:0/4225212363 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fddf006c980 0x7fddf006ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:41.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.424+0000 7fde10aae640 1 --2- 172.21.15.114:0/4225212363 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fddf006c980 0x7fddf006ee40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fde00000f60 tx=0x7fde00000ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:41.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.430+0000 7fde097fa640 1 -- 172.21.15.114:0/4225212363 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fde0c1fac50 con 0x7fde0c0d0d80 2024-04-28T13:08:41.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:41.616+0000 7fde12d12640 1 -- 172.21.15.114:0/4225212363 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fde0c0c6080 con 0x7fde0c0d0d80 2024-04-28T13:08:42.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.434+0000 7fde097fa640 1 -- 172.21.15.114:0/4225212363 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v42) ==== 97+0+0 (secure 0 0 0) 0x7fddf807a4b0 con 0x7fde0c0d0d80 2024-04-28T13:08:42.435 INFO:teuthology.orchestra.run.smithi114.stderr: removed all blocklist entries 2024-04-28T13:08:42.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.436+0000 7fde12d12640 1 -- 172.21.15.114:0/4225212363 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fddf006c980 msgr2=0x7fddf006ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:42.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.436+0000 7fde12d12640 1 --2- 172.21.15.114:0/4225212363 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fddf006c980 0x7fddf006ee40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fde00000f60 tx=0x7fde00000ed0 comp rx=0 tx=0).stop 2024-04-28T13:08:42.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.436+0000 7fde12d12640 1 -- 172.21.15.114:0/4225212363 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde0c0d0d80 msgr2=0x7fde0c1fa710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:42.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.436+0000 7fde12d12640 1 --2- 172.21.15.114:0/4225212363 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde0c0d0d80 0x7fde0c1fa710 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fddf8000c00 tx=0x7fddf80046c0 comp rx=0 tx=0).stop 2024-04-28T13:08:42.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.437+0000 7fde12d12640 1 -- 172.21.15.114:0/4225212363 shutdown_connections 2024-04-28T13:08:42.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.437+0000 7fde12d12640 1 --2- 172.21.15.114:0/4225212363 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde0c14d160 0x7fde0c0c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:42.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.437+0000 7fde12d12640 1 --2- 172.21.15.114:0/4225212363 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde0c0d0d80 0x7fde0c1fa710 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:42.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.437+0000 7fde12d12640 1 --2- 172.21.15.114:0/4225212363 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fddf006c980 0x7fddf006ee40 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:42.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.437+0000 7fde12d12640 1 --2- 172.21.15.114:0/4225212363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde0c0cf920 0x7fde0c163080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:42.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.437+0000 7fde12d12640 1 -- 172.21.15.114:0/4225212363 >> 172.21.15.114:0/4225212363 conn(0x7fde0c0cd8b0 msgr2=0x7fde0c0b5410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:42.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.437+0000 7fde12d12640 1 -- 172.21.15.114:0/4225212363 shutdown_connections 2024-04-28T13:08:42.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.437+0000 7fde12d12640 1 -- 172.21.15.114:0/4225212363 wait complete. 2024-04-28T13:08:42.451 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-28T13:08:42.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.552+0000 7f5a65b5f640 1 Processor -- start 2024-04-28T13:08:42.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.552+0000 7f5a65b5f640 1 -- start start 2024-04-28T13:08:42.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.553+0000 7f5a65b5f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5a60146c00 0x7f5a6015eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:42.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.553+0000 7f5a65b5f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5a600cdf60 0x7f5a6015e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:42.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.553+0000 7f5a65b5f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a60146fe0 con 0x7f5a600ced60 2024-04-28T13:08:42.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.553+0000 7f5a65b5f640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f5a600cff80 con 0x7f5a60146c00 2024-04-28T13:08:42.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.553+0000 7f5a65b5f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f5a60073440 con 0x7f5a600cdf60 2024-04-28T13:08:42.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.553+0000 7f5a5f7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5a60146c00 0x7f5a6015eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:42.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.553+0000 7f5a5f7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5a60146c00 0x7f5a6015eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44440/0 (socket says 172.21.15.114:44440) 2024-04-28T13:08:42.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.553+0000 7f5a5f7fe640 1 -- 172.21.15.114:0/2627592674 learned_addr learned my addr 172.21.15.114:0/2627592674 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:42.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.553+0000 7f5a5f7fe640 1 -- 172.21.15.114:0/2627592674 >> v2:172.21.15.134:3300/0 conn(0x7f5a600cdf60 msgr2=0x7f5a6015e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:42.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.554+0000 7f5a5f7fe640 1 --2- 172.21.15.114:0/2627592674 >> v2:172.21.15.134:3300/0 conn(0x7f5a600cdf60 0x7f5a6015e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:42.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.554+0000 7f5a5f7fe640 1 -- 172.21.15.114:0/2627592674 >> v1:172.21.15.134:6789/0 conn(0x7f5a600ced60 legacy=0x7f5a600cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:42.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.554+0000 7f5a5f7fe640 1 -- 172.21.15.114:0/2627592674 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a600cf400 con 0x7f5a60146c00 2024-04-28T13:08:42.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.554+0000 7f5a5f7fe640 1 --2- 172.21.15.114:0/2627592674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a60146c00 0x7f5a6015eab0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5a600ce3f0 tx=0x7f5a5002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76731ab1a3f04d8d server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:42.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.554+0000 7f5a5e7fc640 1 -- 172.21.15.114:0/2627592674 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50037070 con 0x7f5a60146c00 2024-04-28T13:08:42.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.554+0000 7f5a5e7fc640 1 -- 172.21.15.114:0/2627592674 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a50032440 con 0x7f5a60146c00 2024-04-28T13:08:42.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.554+0000 7f5a5e7fc640 1 -- 172.21.15.114:0/2627592674 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50032810 con 0x7f5a60146c00 2024-04-28T13:08:42.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.555+0000 7f5a65b5f640 1 -- 172.21.15.114:0/2627592674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a60146c00 msgr2=0x7f5a6015eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:42.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.555+0000 7f5a65b5f640 1 --2- 172.21.15.114:0/2627592674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a60146c00 0x7f5a6015eab0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5a600ce3f0 tx=0x7f5a5002a230 comp rx=0 tx=0).stop 2024-04-28T13:08:42.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.555+0000 7f5a65b5f640 1 -- 172.21.15.114:0/2627592674 shutdown_connections 2024-04-28T13:08:42.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.555+0000 7f5a65b5f640 1 --2- 172.21.15.114:0/2627592674 >> v2:172.21.15.134:3300/0 conn(0x7f5a600cdf60 0x7f5a6015e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:42.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.555+0000 7f5a65b5f640 1 --2- 172.21.15.114:0/2627592674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a60146c00 0x7f5a6015eab0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:42.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.555+0000 7f5a65b5f640 1 -- 172.21.15.114:0/2627592674 >> 172.21.15.114:0/2627592674 conn(0x7f5a6006c980 msgr2=0x7f5a600b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:42.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.555+0000 7f5a65b5f640 1 -- 172.21.15.114:0/2627592674 shutdown_connections 2024-04-28T13:08:42.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.555+0000 7f5a65b5f640 1 -- 172.21.15.114:0/2627592674 wait complete. 2024-04-28T13:08:42.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.556+0000 7f5a65b5f640 1 Processor -- start 2024-04-28T13:08:42.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.556+0000 7f5a65b5f640 1 -- start start 2024-04-28T13:08:42.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.557+0000 7f5a65b5f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a600cdf60 0x7f5a60157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:42.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.557+0000 7f5a65b5f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a600ced60 0x7f5a6013c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:42.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.557+0000 7f5a65b5f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a60146c00 0x7f5a6013ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:42.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.557+0000 7f5a65b5f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5a600cfca0 con 0x7f5a600cdf60 2024-04-28T13:08:42.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.557+0000 7f5a65b5f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5a600cf9c0 con 0x7f5a60146c00 2024-04-28T13:08:42.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.557+0000 7f5a65b5f640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f5a60073920 con 0x7f5a600ced60 2024-04-28T13:08:42.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.557+0000 7f5a5f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a600cdf60 0x7f5a60157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:42.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.557+0000 7f5a5f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a600cdf60 0x7f5a60157f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44452/0 (socket says 172.21.15.114:44452) 2024-04-28T13:08:42.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.557+0000 7f5a5f7fe640 1 -- 172.21.15.114:0/1076849179 learned_addr learned my addr 172.21.15.114:0/1076849179 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:42.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.557+0000 7f5a5ffff640 1 --2- 172.21.15.114:0/1076849179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a60146c00 0x7f5a6013ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:42.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.557+0000 7f5a5effd640 1 --2- 172.21.15.114:0/1076849179 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a600ced60 0x7f5a6013c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:42.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.557+0000 7f5a5f7fe640 1 -- 172.21.15.114:0/1076849179 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a600ced60 msgr2=0x7f5a6013c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:42.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.557+0000 7f5a5f7fe640 1 --2- 172.21.15.114:0/1076849179 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a600ced60 0x7f5a6013c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:42.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.557+0000 7f5a5f7fe640 1 -- 172.21.15.114:0/1076849179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a60146c00 msgr2=0x7f5a6013ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:42.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.557+0000 7f5a5f7fe640 1 --2- 172.21.15.114:0/1076849179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a60146c00 0x7f5a6013ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:42.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.557+0000 7f5a5f7fe640 1 -- 172.21.15.114:0/1076849179 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a6015bdb0 con 0x7f5a600cdf60 2024-04-28T13:08:42.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.557+0000 7f5a5effd640 1 --2- 172.21.15.114:0/1076849179 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a600ced60 0x7f5a6013c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:42.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.558+0000 7f5a5f7fe640 1 --2- 172.21.15.114:0/1076849179 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a600cdf60 0x7f5a60157f60 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5a50000c00 tx=0x7f5a500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:42.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.558+0000 7f5a47fff640 1 -- 172.21.15.114:0/1076849179 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50041070 con 0x7f5a600cdf60 2024-04-28T13:08:42.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.558+0000 7f5a47fff640 1 -- 172.21.15.114:0/1076849179 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a5003c870 con 0x7f5a600cdf60 2024-04-28T13:08:42.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.558+0000 7f5a65b5f640 1 -- 172.21.15.114:0/1076849179 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a6015c090 con 0x7f5a600cdf60 2024-04-28T13:08:42.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.558+0000 7f5a47fff640 1 -- 172.21.15.114:0/1076849179 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50037040 con 0x7f5a600cdf60 2024-04-28T13:08:42.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.558+0000 7f5a65b5f640 1 -- 172.21.15.114:0/1076849179 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a6015c650 con 0x7f5a600cdf60 2024-04-28T13:08:42.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.559+0000 7f5a65b5f640 1 -- 172.21.15.114:0/1076849179 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a6006a3d0 con 0x7f5a600cdf60 2024-04-28T13:08:42.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.559+0000 7f5a47fff640 1 -- 172.21.15.114:0/1076849179 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f5a50044070 con 0x7f5a600cdf60 2024-04-28T13:08:42.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.560+0000 7f5a47fff640 1 --2- 172.21.15.114:0/1076849179 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5a4c06c980 0x7f5a4c06ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:42.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.560+0000 7f5a47fff640 1 -- 172.21.15.114:0/1076849179 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4857+0+0 (secure 0 0 0) 0x7f5a500ac360 con 0x7f5a600cdf60 2024-04-28T13:08:42.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.560+0000 7f5a5effd640 1 --2- 172.21.15.114:0/1076849179 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5a4c06c980 0x7f5a4c06ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:42.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.560+0000 7f5a5effd640 1 --2- 172.21.15.114:0/1076849179 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5a4c06c980 0x7f5a4c06ee40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5a54007fd0 tx=0x7f5a54009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:42.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.564+0000 7f5a47fff640 1 -- 172.21.15.114:0/1076849179 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5a60146fe0 con 0x7f5a600cdf60 2024-04-28T13:08:42.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.807+0000 7f5a65b5f640 1 -- 172.21.15.114:0/1076849179 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f5a600b63b0 con 0x7f5a600cdf60 2024-04-28T13:08:42.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.808+0000 7f5a47fff640 1 -- 172.21.15.114:0/1076849179 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) ==== 80+0+5304 (secure 0 0 0) 0x7f5a5007ab80 con 0x7f5a600cdf60 2024-04-28T13:08:42.808 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:42.809 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-04-28T13:08:42.809 INFO:teuthology.orchestra.run.smithi114.stdout: "auth_dump": [ 2024-04-28T13:08:42.809 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:42.809 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.a", 2024-04-28T13:08:42.809 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDOSS5meB+bEBAArawFLsKWVvZZpyhjaeozhg==", 2024-04-28T13:08:42.809 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:42.809 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-04-28T13:08:42.809 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-04-28T13:08:42.809 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-04-28T13:08:42.809 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-28T13:08:42.809 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:42.809 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:42.809 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:42.809 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.b", 2024-04-28T13:08:42.810 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDOSS5mb4njGxAAx3fJpA7jCiyGvEXLNcpSaQ==", 2024-04-28T13:08:42.810 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:42.810 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-04-28T13:08:42.810 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-04-28T13:08:42.810 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-04-28T13:08:42.810 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-28T13:08:42.810 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:42.810 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:42.810 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:42.810 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.c", 2024-04-28T13:08:42.810 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDOSS5muFVyFxAADP42j0wWV/Qb4wajs6Vm7w==", 2024-04-28T13:08:42.810 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:42.810 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-04-28T13:08:42.811 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-04-28T13:08:42.811 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-04-28T13:08:42.811 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-28T13:08:42.811 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:42.811 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:42.811 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:42.811 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.d", 2024-04-28T13:08:42.811 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDOSS5mN0qbIhAA9S6kThv7lpqtwmFDcki8Lg==", 2024-04-28T13:08:42.811 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:42.811 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-04-28T13:08:42.811 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-04-28T13:08:42.811 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-04-28T13:08:42.811 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-28T13:08:42.811 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:42.811 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:42.811 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:42.812 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.0", 2024-04-28T13:08:42.812 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDSSS5memG6ABAADdmTdP17zXCzkrIjMXoFWA==", 2024-04-28T13:08:42.812 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:42.812 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-04-28T13:08:42.812 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-04-28T13:08:42.812 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-28T13:08:42.812 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:42.812 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:42.812 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:42.812 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.1", 2024-04-28T13:08:42.812 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDUSS5mk4xZOxAAqn4QV8CSUcVM1eA5mpIEzQ==", 2024-04-28T13:08:42.812 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:42.812 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-04-28T13:08:42.812 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-04-28T13:08:42.813 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-28T13:08:42.813 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:42.813 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:42.813 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:42.813 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.2", 2024-04-28T13:08:42.813 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDXSS5mvz9LORAAkJgWHQWyCG5kJlOyhd6j1Q==", 2024-04-28T13:08:42.813 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:42.813 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-04-28T13:08:42.813 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-04-28T13:08:42.813 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-28T13:08:42.813 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:42.813 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:42.813 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:42.813 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.3", 2024-04-28T13:08:42.813 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDaSS5mPr44NxAAj+Isl9uyJTcqe/8FiMqHQg==", 2024-04-28T13:08:42.814 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:42.814 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-04-28T13:08:42.814 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-04-28T13:08:42.814 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-28T13:08:42.814 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:42.814 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:42.814 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:42.814 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.4", 2024-04-28T13:08:42.814 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDgSS5m2hWeOBAAIC4TiBY229V/ZZpx6LT2hg==", 2024-04-28T13:08:42.814 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:42.814 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-04-28T13:08:42.814 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-04-28T13:08:42.815 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-28T13:08:42.815 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:42.815 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:42.815 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:42.815 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.5", 2024-04-28T13:08:42.815 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDjSS5mkNcSNxAAint1u9W5rXiim5A0VSNttw==", 2024-04-28T13:08:42.815 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:42.815 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-04-28T13:08:42.815 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-04-28T13:08:42.815 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-28T13:08:42.815 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:42.815 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:42.815 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:42.816 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.6", 2024-04-28T13:08:42.816 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDmSS5mc/zZNBAAE3US5p+6A4Rh2d+5agGruw==", 2024-04-28T13:08:42.816 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:42.816 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-04-28T13:08:42.816 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-04-28T13:08:42.816 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-28T13:08:42.816 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:42.816 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:42.816 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:42.816 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.7", 2024-04-28T13:08:42.816 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDpSS5m6BiJMhAArOmge/xKpTqoM3UyHjv1+Q==", 2024-04-28T13:08:42.816 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:42.816 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-04-28T13:08:42.816 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-04-28T13:08:42.816 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-28T13:08:42.817 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:42.817 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:42.817 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:42.817 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.0", 2024-04-28T13:08:42.817 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDOSS5mzotvJhAAlis8wXdOL4WCzxzUL8L3qw==", 2024-04-28T13:08:42.817 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:42.817 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-04-28T13:08:42.817 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow r", 2024-04-28T13:08:42.817 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-28T13:08:42.817 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:42.817 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:42.817 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:42.817 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.1", 2024-04-28T13:08:42.817 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDOSS5m1XLQLhAAKfchd9USFncmg1umNNZYlQ==", 2024-04-28T13:08:42.817 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:42.818 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-04-28T13:08:42.818 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-04-28T13:08:42.818 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-04-28T13:08:42.818 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-04-28T13:08:42.818 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:42.818 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:42.818 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:42.818 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.2", 2024-04-28T13:08:42.818 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDOSS5meMfOKxAA+cOkQCX3HK4IBlDG2+chig==", 2024-04-28T13:08:42.818 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:42.818 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-04-28T13:08:42.818 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-04-28T13:08:42.818 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-04-28T13:08:42.819 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-04-28T13:08:42.819 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:42.819 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:42.819 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:42.819 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.3", 2024-04-28T13:08:42.819 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDOSS5mmLkyNBAAzOEmmOcyB9EP6I4TkYKNWA==", 2024-04-28T13:08:42.819 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:42.819 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-04-28T13:08:42.819 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-04-28T13:08:42.819 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-04-28T13:08:42.819 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-04-28T13:08:42.819 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:42.819 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:42.819 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:42.819 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.admin", 2024-04-28T13:08:42.820 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDNSS5mtoIQKBAA/3lGRHIKtKq5wMYqUkgvgw==", 2024-04-28T13:08:42.820 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:42.820 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-04-28T13:08:42.820 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-04-28T13:08:42.820 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-04-28T13:08:42.820 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-28T13:08:42.820 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:42.820 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:42.820 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:42.820 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.x", 2024-04-28T13:08:42.820 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDOSS5m+YaTDRAAXHg0ngbju2RVDFYmXabVSg==", 2024-04-28T13:08:42.820 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:42.820 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-04-28T13:08:42.820 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-04-28T13:08:42.821 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-28T13:08:42.821 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:42.821 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-28T13:08:42.821 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:42.821 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.y", 2024-04-28T13:08:42.821 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDOSS5mWiliChAAq5hGUK1snRJRChZ09HDyhA==", 2024-04-28T13:08:42.821 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-28T13:08:42.821 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-04-28T13:08:42.821 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-04-28T13:08:42.821 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-28T13:08:42.821 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:42.821 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:42.821 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-04-28T13:08:42.821 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-04-28T13:08:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.809+0000 7f5a65b5f640 1 -- 172.21.15.114:0/1076849179 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5a4c06c980 msgr2=0x7f5a4c06ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.809+0000 7f5a65b5f640 1 --2- 172.21.15.114:0/1076849179 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5a4c06c980 0x7f5a4c06ee40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5a54007fd0 tx=0x7f5a54009040 comp rx=0 tx=0).stop 2024-04-28T13:08:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.809+0000 7f5a65b5f640 1 -- 172.21.15.114:0/1076849179 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a600cdf60 msgr2=0x7f5a60157f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.809+0000 7f5a65b5f640 1 --2- 172.21.15.114:0/1076849179 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a600cdf60 0x7f5a60157f60 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5a50000c00 tx=0x7f5a500046c0 comp rx=0 tx=0).stop 2024-04-28T13:08:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.809+0000 7f5a65b5f640 1 -- 172.21.15.114:0/1076849179 shutdown_connections 2024-04-28T13:08:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.809+0000 7f5a65b5f640 1 --2- 172.21.15.114:0/1076849179 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5a4c06c980 0x7f5a4c06ee40 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.809+0000 7f5a65b5f640 1 --2- 172.21.15.114:0/1076849179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a60146c00 0x7f5a6013ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.809+0000 7f5a65b5f640 1 --2- 172.21.15.114:0/1076849179 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a600ced60 0x7f5a6013c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.809+0000 7f5a65b5f640 1 --2- 172.21.15.114:0/1076849179 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a600cdf60 0x7f5a60157f60 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.809+0000 7f5a65b5f640 1 -- 172.21.15.114:0/1076849179 >> 172.21.15.114:0/1076849179 conn(0x7f5a6006c980 msgr2=0x7f5a60073cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.810+0000 7f5a65b5f640 1 -- 172.21.15.114:0/1076849179 shutdown_connections 2024-04-28T13:08:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.810+0000 7f5a65b5f640 1 -- 172.21.15.114:0/1076849179 wait complete. 2024-04-28T13:08:42.824 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:08:42.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.920+0000 7fe7a207b640 1 Processor -- start 2024-04-28T13:08:42.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.920+0000 7fe7a207b640 1 -- start start 2024-04-28T13:08:42.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.921+0000 7fe7a207b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe79c146c00 0x7fe79c15eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:42.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.921+0000 7fe7a207b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe79c0ced60 0x7fe79c15e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:42.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.921+0000 7fe7a207b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe79c146fe0 con 0x7fe79c0cd890 2024-04-28T13:08:42.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.921+0000 7fe7a207b640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fe79c073440 con 0x7fe79c146c00 2024-04-28T13:08:42.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.921+0000 7fe7a207b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fe79c15e8d0 con 0x7fe79c0ced60 2024-04-28T13:08:42.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.921+0000 7fe79b7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe79c146c00 0x7fe79c15eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:42.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.921+0000 7fe79b7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe79c146c00 0x7fe79c15eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44456/0 (socket says 172.21.15.114:44456) 2024-04-28T13:08:42.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.921+0000 7fe79b7fe640 1 -- 172.21.15.114:0/3953194511 learned_addr learned my addr 172.21.15.114:0/3953194511 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:42.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.921+0000 7fe79affd640 1 --2- 172.21.15.114:0/3953194511 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe79c0ced60 0x7fe79c15e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:42.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.921+0000 7fe79b7fe640 1 -- 172.21.15.114:0/3953194511 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe79c0ced60 msgr2=0x7fe79c15e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:42.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.921+0000 7fe79b7fe640 1 --2- 172.21.15.114:0/3953194511 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe79c0ced60 0x7fe79c15e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:42.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.921+0000 7fe79b7fe640 1 -- 172.21.15.114:0/3953194511 >> v1:172.21.15.134:6789/0 conn(0x7fe79c0cd890 legacy=0x7fe79c073920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:42.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.921+0000 7fe79b7fe640 1 -- 172.21.15.114:0/3953194511 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe79c0cf390 con 0x7fe79c146c00 2024-04-28T13:08:42.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.921+0000 7fe79affd640 1 --2- 172.21.15.114:0/3953194511 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe79c0ced60 0x7fe79c15e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:42.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.922+0000 7fe79b7fe640 1 --2- 172.21.15.114:0/3953194511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe79c146c00 0x7fe79c15eb10 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe79c0cebf0 tx=0x7fe78c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136af5b2d8a5f450 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:42.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.922+0000 7fe79a7fc640 1 -- 172.21.15.114:0/3953194511 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c037070 con 0x7fe79c146c00 2024-04-28T13:08:42.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.922+0000 7fe79a7fc640 1 -- 172.21.15.114:0/3953194511 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe78c032440 con 0x7fe79c146c00 2024-04-28T13:08:42.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.922+0000 7fe79a7fc640 1 -- 172.21.15.114:0/3953194511 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c032810 con 0x7fe79c146c00 2024-04-28T13:08:42.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.923+0000 7fe7a207b640 1 -- 172.21.15.114:0/3953194511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe79c146c00 msgr2=0x7fe79c15eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:42.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.923+0000 7fe7a207b640 1 --2- 172.21.15.114:0/3953194511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe79c146c00 0x7fe79c15eb10 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe79c0cebf0 tx=0x7fe78c02a1e0 comp rx=0 tx=0).stop 2024-04-28T13:08:42.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.923+0000 7fe7a207b640 1 -- 172.21.15.114:0/3953194511 shutdown_connections 2024-04-28T13:08:42.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.923+0000 7fe7a207b640 1 --2- 172.21.15.114:0/3953194511 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe79c0ced60 0x7fe79c15e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:42.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.923+0000 7fe7a207b640 1 --2- 172.21.15.114:0/3953194511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe79c146c00 0x7fe79c15eb10 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:42.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.923+0000 7fe7a207b640 1 -- 172.21.15.114:0/3953194511 >> 172.21.15.114:0/3953194511 conn(0x7fe79c06c980 msgr2=0x7fe79c0b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:42.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.923+0000 7fe7a207b640 1 -- 172.21.15.114:0/3953194511 shutdown_connections 2024-04-28T13:08:42.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.923+0000 7fe7a207b640 1 -- 172.21.15.114:0/3953194511 wait complete. 2024-04-28T13:08:42.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.924+0000 7fe7a207b640 1 Processor -- start 2024-04-28T13:08:42.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.924+0000 7fe7a207b640 1 -- start start 2024-04-28T13:08:42.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.925+0000 7fe7a207b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe79c0cd890 0x7fe79c13a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:42.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.925+0000 7fe7a207b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe79c0ced60 0x7fe79c138900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:42.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.925+0000 7fe7a207b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe79c146c00 0x7fe79c06faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:42.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.925+0000 7fe7a207b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c0cfc30 con 0x7fe79c146c00 2024-04-28T13:08:42.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.925+0000 7fe7a207b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c0cf950 con 0x7fe79c0cd890 2024-04-28T13:08:42.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.925+0000 7fe7a207b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fe79c0cdd00 con 0x7fe79c0ced60 2024-04-28T13:08:42.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.925+0000 7fe79bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe79c146c00 0x7fe79c06faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:42.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.925+0000 7fe79bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe79c146c00 0x7fe79c06faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44466/0 (socket says 172.21.15.114:44466) 2024-04-28T13:08:42.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.925+0000 7fe79bfff640 1 -- 172.21.15.114:0/4252274239 learned_addr learned my addr 172.21.15.114:0/4252274239 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:42.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.925+0000 7fe79affd640 1 --2- 172.21.15.114:0/4252274239 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe79c0ced60 0x7fe79c138900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:42.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.925+0000 7fe79b7fe640 1 --2- 172.21.15.114:0/4252274239 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe79c0cd890 0x7fe79c13a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:42.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.925+0000 7fe79bfff640 1 -- 172.21.15.114:0/4252274239 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe79c0ced60 msgr2=0x7fe79c138900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:42.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.925+0000 7fe79bfff640 1 --2- 172.21.15.114:0/4252274239 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe79c0ced60 0x7fe79c138900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:42.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.925+0000 7fe79bfff640 1 -- 172.21.15.114:0/4252274239 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe79c0cd890 msgr2=0x7fe79c13a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:42.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.925+0000 7fe79bfff640 1 --2- 172.21.15.114:0/4252274239 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe79c0cd890 0x7fe79c13a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:42.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.925+0000 7fe79bfff640 1 -- 172.21.15.114:0/4252274239 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe79c138e40 con 0x7fe79c146c00 2024-04-28T13:08:42.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.925+0000 7fe79b7fe640 1 --2- 172.21.15.114:0/4252274239 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe79c0cd890 0x7fe79c13a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:42.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.925+0000 7fe79bfff640 1 --2- 172.21.15.114:0/4252274239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe79c146c00 0x7fe79c06faa0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe79400c780 tx=0x7fe79400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:42.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.925+0000 7fe783fff640 1 -- 172.21.15.114:0/4252274239 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe794004b60 con 0x7fe79c146c00 2024-04-28T13:08:42.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.925+0000 7fe783fff640 1 -- 172.21.15.114:0/4252274239 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe794004d00 con 0x7fe79c146c00 2024-04-28T13:08:42.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.925+0000 7fe783fff640 1 -- 172.21.15.114:0/4252274239 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79400aa90 con 0x7fe79c146c00 2024-04-28T13:08:42.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.926+0000 7fe7a207b640 1 -- 172.21.15.114:0/4252274239 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe79c06ea00 con 0x7fe79c146c00 2024-04-28T13:08:42.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.926+0000 7fe7a207b640 1 -- 172.21.15.114:0/4252274239 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe79c06efc0 con 0x7fe79c146c00 2024-04-28T13:08:42.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.926+0000 7fe7a207b640 1 -- 172.21.15.114:0/4252274239 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe79c06a3d0 con 0x7fe79c146c00 2024-04-28T13:08:42.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.927+0000 7fe783fff640 1 -- 172.21.15.114:0/4252274239 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7fe79400ac30 con 0x7fe79c146c00 2024-04-28T13:08:42.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.927+0000 7fe783fff640 1 --2- 172.21.15.114:0/4252274239 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fe78806c980 0x7fe78806ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:42.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.928+0000 7fe79b7fe640 1 --2- 172.21.15.114:0/4252274239 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fe78806c980 0x7fe78806ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:42.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.928+0000 7fe783fff640 1 -- 172.21.15.114:0/4252274239 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4857+0+0 (secure 0 0 0) 0x7fe79408bb20 con 0x7fe79c146c00 2024-04-28T13:08:42.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.928+0000 7fe79b7fe640 1 --2- 172.21.15.114:0/4252274239 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fe78806c980 0x7fe78806ee40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe78c034000 tx=0x7fe78c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:42.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:42.932+0000 7fe783fff640 1 -- 172.21.15.114:0/4252274239 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe794020070 con 0x7fe79c146c00 2024-04-28T13:08:43.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.108+0000 7fe7a207b640 1 -- 172.21.15.114:0/4252274239 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe79c15fcf0 con 0x7fe79c146c00 2024-04-28T13:08:43.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.109+0000 7fe783fff640 1 -- 172.21.15.114:0/4252274239 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) ==== 74+0+12939 (secure 0 0 0) 0x7fe79c138e40 con 0x7fe79c146c00 2024-04-28T13:08:43.110 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:43.110 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":42,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:08:42.433900+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:08:43.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.111+0000 7fe7a207b640 1 -- 172.21.15.114:0/4252274239 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fe78806c980 msgr2=0x7fe78806ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:43.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.111+0000 7fe7a207b640 1 --2- 172.21.15.114:0/4252274239 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fe78806c980 0x7fe78806ee40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe78c034000 tx=0x7fe78c02e000 comp rx=0 tx=0).stop 2024-04-28T13:08:43.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.111+0000 7fe7a207b640 1 -- 172.21.15.114:0/4252274239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe79c146c00 msgr2=0x7fe79c06faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:43.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.111+0000 7fe7a207b640 1 --2- 172.21.15.114:0/4252274239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe79c146c00 0x7fe79c06faa0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe79400c780 tx=0x7fe79400cc40 comp rx=0 tx=0).stop 2024-04-28T13:08:43.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.111+0000 7fe7a207b640 1 -- 172.21.15.114:0/4252274239 shutdown_connections 2024-04-28T13:08:43.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.111+0000 7fe7a207b640 1 --2- 172.21.15.114:0/4252274239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe79c146c00 0x7fe79c06faa0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:43.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.111+0000 7fe7a207b640 1 --2- 172.21.15.114:0/4252274239 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe79c0ced60 0x7fe79c138900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:43.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.111+0000 7fe7a207b640 1 --2- 172.21.15.114:0/4252274239 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fe78806c980 0x7fe78806ee40 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:43.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.111+0000 7fe7a207b640 1 --2- 172.21.15.114:0/4252274239 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe79c0cd890 0x7fe79c13a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:43.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.111+0000 7fe7a207b640 1 -- 172.21.15.114:0/4252274239 >> 172.21.15.114:0/4252274239 conn(0x7fe79c06c980 msgr2=0x7fe79c1604f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:43.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.111+0000 7fe7a207b640 1 -- 172.21.15.114:0/4252274239 shutdown_connections 2024-04-28T13:08:43.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.111+0000 7fe7a207b640 1 -- 172.21.15.114:0/4252274239 wait complete. 2024-04-28T13:08:43.122 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-28T13:07:14.721860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-28T13:08:43.123 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-28T13:08:43.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.220+0000 7f9cb8c62640 1 Processor -- start 2024-04-28T13:08:43.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.220+0000 7f9cb8c62640 1 -- start start 2024-04-28T13:08:43.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.221+0000 7f9cb8c62640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9cb4140000 0x7f9cb40d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:43.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.221+0000 7f9cb8c62640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9cb40d3a30 0x7f9cb415d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:43.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.221+0000 7f9cb8c62640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cb41429d0 con 0x7f9cb415dd20 2024-04-28T13:08:43.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.221+0000 7f9cb8c62640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f9cb40d3e90 con 0x7f9cb40d3a30 2024-04-28T13:08:43.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.221+0000 7f9cb8c62640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f9cb4142cb0 con 0x7f9cb4140000 2024-04-28T13:08:43.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.222+0000 7f9cb2d9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9cb415dd20 0x7f9cb4070650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52272/0 (socket says 172.21.15.114:52272) 2024-04-28T13:08:43.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.222+0000 7f9cb2d9d640 1 -- 172.21.15.114:0/1827741170 learned_addr learned my addr 172.21.15.114:0/1827741170 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:43.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.222+0000 7f9cb259c640 1 --2- 172.21.15.114:0/1827741170 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9cb4140000 0x7f9cb40d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:43.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.222+0000 7f9cb1d9b640 1 --2- 172.21.15.114:0/1827741170 >> v2:172.21.15.134:3300/0 conn(0x7f9cb40d3a30 0x7f9cb415d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:43.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.222+0000 7f9cb159a640 1 -- 172.21.15.114:0/1827741170 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 354463425 0 0) 0x7f9cb41429d0 con 0x7f9cb415dd20 2024-04-28T13:08:43.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.222+0000 7f9cb159a640 1 -- 172.21.15.114:0/1827741170 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c9c003520 con 0x7f9cb415dd20 2024-04-28T13:08:43.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.222+0000 7f9cb159a640 1 -- 172.21.15.114:0/1827741170 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3269027942 0 0) 0x7f9c9c003520 con 0x7f9cb415dd20 2024-04-28T13:08:43.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.222+0000 7f9cb159a640 1 -- 172.21.15.114:0/1827741170 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9cb4140000 msgr2=0x7f9cb40d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:43.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.222+0000 7f9cb159a640 1 --2- 172.21.15.114:0/1827741170 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9cb4140000 0x7f9cb40d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:43.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.222+0000 7f9cb159a640 1 -- 172.21.15.114:0/1827741170 >> v2:172.21.15.134:3300/0 conn(0x7f9cb40d3a30 msgr2=0x7f9cb415d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:43.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.222+0000 7f9cb159a640 1 --2- 172.21.15.114:0/1827741170 >> v2:172.21.15.134:3300/0 conn(0x7f9cb40d3a30 0x7f9cb415d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:43.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.222+0000 7f9cb159a640 1 -- 172.21.15.114:0/1827741170 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb4142f90 con 0x7f9cb415dd20 2024-04-28T13:08:43.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.222+0000 7f9cb159a640 1 -- 172.21.15.114:0/1827741170 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f9cac0019f0 con 0x7f9cb415dd20 2024-04-28T13:08:43.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.222+0000 7f9cb159a640 1 -- 172.21.15.114:0/1827741170 >> v1:172.21.15.114:6789/0 conn(0x7f9cb415dd20 legacy=0x7f9cb4070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:43.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.222+0000 7f9cb159a640 1 --2- 172.21.15.114:0/1827741170 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9cb4140000 0x7f9c9c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:43.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.222+0000 7f9cb159a640 1 --2- 172.21.15.114:0/1827741170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c9c003f30 0x7f9c9c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:43.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.222+0000 7f9cb159a640 1 --2- 172.21.15.114:0/1827741170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c9c004d40 0x7f9c9c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:43.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.222+0000 7f9cb159a640 1 -- 172.21.15.114:0/1827741170 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb40d3e90 con 0x7f9c9c004d40 2024-04-28T13:08:43.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.222+0000 7f9cb159a640 1 -- 172.21.15.114:0/1827741170 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb4142cb0 con 0x7f9c9c003f30 2024-04-28T13:08:43.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.222+0000 7f9cb159a640 1 -- 172.21.15.114:0/1827741170 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f9c9c00b9c0 con 0x7f9cb4140000 2024-04-28T13:08:43.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.222+0000 7f9cb2d9d640 1 --2- 172.21.15.114:0/1827741170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c9c004d40 0x7f9c9c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:43.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.222+0000 7f9cb259c640 1 --2- 172.21.15.114:0/1827741170 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9cb4140000 0x7f9c9c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:43.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.222+0000 7f9cb1d9b640 1 --2- 172.21.15.114:0/1827741170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c9c003f30 0x7f9c9c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:43.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.223+0000 7f9cb2d9d640 1 -- 172.21.15.114:0/1827741170 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9cb4140000 msgr2=0x7f9c9c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:43.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.223+0000 7f9cb2d9d640 1 --2- 172.21.15.114:0/1827741170 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9cb4140000 0x7f9c9c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:43.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.223+0000 7f9cb2d9d640 1 -- 172.21.15.114:0/1827741170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c9c003f30 msgr2=0x7f9c9c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:43.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.223+0000 7f9cb2d9d640 1 --2- 172.21.15.114:0/1827741170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c9c003f30 0x7f9c9c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:43.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.223+0000 7f9cb2d9d640 1 -- 172.21.15.114:0/1827741170 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c9c003520 con 0x7f9c9c004d40 2024-04-28T13:08:43.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.223+0000 7f9cb2d9d640 1 --2- 172.21.15.114:0/1827741170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c9c004d40 0x7f9c9c0051c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9cac00a880 tx=0x7f9c9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3ebf579c0fd2a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:43.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.223+0000 7f9cb159a640 1 -- 172.21.15.114:0/1827741170 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cac00a4a0 con 0x7f9c9c004d40 2024-04-28T13:08:43.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.223+0000 7f9cb159a640 1 -- 172.21.15.114:0/1827741170 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cac02f070 con 0x7f9c9c004d40 2024-04-28T13:08:43.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.223+0000 7f9cb159a640 1 -- 172.21.15.114:0/1827741170 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cac02bce0 con 0x7f9c9c004d40 2024-04-28T13:08:43.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.224+0000 7f9cb8c62640 1 -- 172.21.15.114:0/1827741170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c9c004d40 msgr2=0x7f9c9c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:43.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.224+0000 7f9cb8c62640 1 --2- 172.21.15.114:0/1827741170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c9c004d40 0x7f9c9c0051c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9cac00a880 tx=0x7f9c9c005830 comp rx=0 tx=0).stop 2024-04-28T13:08:43.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.224+0000 7f9cb2d9d640 1 -- 172.21.15.114:0/1827741170 reap_dead start 2024-04-28T13:08:43.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.224+0000 7f9cb8c62640 1 -- 172.21.15.114:0/1827741170 shutdown_connections 2024-04-28T13:08:43.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.224+0000 7f9cb8c62640 1 -- 172.21.15.114:0/1827741170 >> 172.21.15.114:0/1827741170 conn(0x7f9cb4063160 msgr2=0x7f9cb4063570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:43.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.224+0000 7f9cb8c62640 1 -- 172.21.15.114:0/1827741170 shutdown_connections 2024-04-28T13:08:43.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.224+0000 7f9cb8c62640 1 -- 172.21.15.114:0/1827741170 wait complete. 2024-04-28T13:08:43.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.225+0000 7f9cb8c62640 1 Processor -- start 2024-04-28T13:08:43.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.225+0000 7f9cb8c62640 1 -- start start 2024-04-28T13:08:43.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.226+0000 7f9cb8c62640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9c9c004d40 0x7f9cb4156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:43.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.226+0000 7f9cb8c62640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cb40b7be0 0x7f9cb41f0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:43.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.226+0000 7f9cb8c62640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cb41f0e40 0x7f9cb41419f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:43.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.226+0000 7f9cb8c62640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb415e190 con 0x7f9cb41f0e40 2024-04-28T13:08:43.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.226+0000 7f9cb8c62640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb41403e0 con 0x7f9cb40b7be0 2024-04-28T13:08:43.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.226+0000 7f9cb8c62640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f9cb415e310 con 0x7f9c9c004d40 2024-04-28T13:08:43.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.226+0000 7f9cb2d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cb41f0e40 0x7f9cb41419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:43.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.226+0000 7f9cb2d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cb41f0e40 0x7f9cb41419f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44478/0 (socket says 172.21.15.114:44478) 2024-04-28T13:08:43.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.226+0000 7f9cb2d9d640 1 -- 172.21.15.114:0/3822201935 learned_addr learned my addr 172.21.15.114:0/3822201935 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:43.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.226+0000 7f9cb259c640 1 --2- 172.21.15.114:0/3822201935 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9c9c004d40 0x7f9cb4156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:43.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.226+0000 7f9cb1d9b640 1 --2- 172.21.15.114:0/3822201935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cb40b7be0 0x7f9cb41f0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:43.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.227+0000 7f9cb2d9d640 1 -- 172.21.15.114:0/3822201935 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9c9c004d40 msgr2=0x7f9cb4156e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:43.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.227+0000 7f9cb2d9d640 1 --2- 172.21.15.114:0/3822201935 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9c9c004d40 0x7f9cb4156e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:43.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.227+0000 7f9cb2d9d640 1 -- 172.21.15.114:0/3822201935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cb40b7be0 msgr2=0x7f9cb41f0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:43.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.227+0000 7f9cb2d9d640 1 --2- 172.21.15.114:0/3822201935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cb40b7be0 0x7f9cb41f0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:43.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.227+0000 7f9cb2d9d640 1 -- 172.21.15.114:0/3822201935 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb41f1880 con 0x7f9cb41f0e40 2024-04-28T13:08:43.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.227+0000 7f9cb2d9d640 1 --2- 172.21.15.114:0/3822201935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cb41f0e40 0x7f9cb41419f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f9cac02b530 tx=0x7f9cb4142ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:43.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.227+0000 7f9ca2ffd640 1 -- 172.21.15.114:0/3822201935 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cac00a4a0 con 0x7f9cb41f0e40 2024-04-28T13:08:43.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.227+0000 7f9ca2ffd640 1 -- 172.21.15.114:0/3822201935 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cac004b60 con 0x7f9cb41f0e40 2024-04-28T13:08:43.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.227+0000 7f9cb8c62640 1 -- 172.21.15.114:0/3822201935 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cb41f12c0 con 0x7f9cb41f0e40 2024-04-28T13:08:43.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.227+0000 7f9ca2ffd640 1 -- 172.21.15.114:0/3822201935 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cac001ff0 con 0x7f9cb41f0e40 2024-04-28T13:08:43.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.227+0000 7f9cb8c62640 1 -- 172.21.15.114:0/3822201935 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cb4154710 con 0x7f9cb41f0e40 2024-04-28T13:08:43.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.228+0000 7f9cb8c62640 1 -- 172.21.15.114:0/3822201935 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cb406a3d0 con 0x7f9cb41f0e40 2024-04-28T13:08:43.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.228+0000 7f9ca2ffd640 1 -- 172.21.15.114:0/3822201935 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f9cac034470 con 0x7f9cb41f0e40 2024-04-28T13:08:43.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.229+0000 7f9ca2ffd640 1 --2- 172.21.15.114:0/3822201935 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9c9406c980 0x7f9c9406ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:43.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.229+0000 7f9ca2ffd640 1 -- 172.21.15.114:0/3822201935 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4857+0+0 (secure 0 0 0) 0x7f9cac0ab9f0 con 0x7f9cb41f0e40 2024-04-28T13:08:43.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.229+0000 7f9cb259c640 1 --2- 172.21.15.114:0/3822201935 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9c9406c980 0x7f9c9406ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:43.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.229+0000 7f9cb259c640 1 --2- 172.21.15.114:0/3822201935 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9c9406c980 0x7f9c9406ee40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9cb415cae0 tx=0x7f9ca8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:43.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.233+0000 7f9ca2ffd640 1 -- 172.21.15.114:0/3822201935 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9cac07a240 con 0x7f9cb41f0e40 2024-04-28T13:08:43.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.408+0000 7f9cb8c62640 1 -- 172.21.15.114:0/3822201935 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9cb41618f0 con 0x7f9cb41f0e40 2024-04-28T13:08:43.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.409+0000 7f9ca2ffd640 1 -- 172.21.15.114:0/3822201935 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) ==== 93+0+10 (secure 0 0 0) 0x7f9cac0abe20 con 0x7f9cb41f0e40 2024-04-28T13:08:43.410 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-28T13:08:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.410+0000 7f9cb8c62640 1 -- 172.21.15.114:0/3822201935 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9c9406c980 msgr2=0x7f9c9406ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.410+0000 7f9cb8c62640 1 --2- 172.21.15.114:0/3822201935 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9c9406c980 0x7f9c9406ee40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9cb415cae0 tx=0x7f9ca8009190 comp rx=0 tx=0).stop 2024-04-28T13:08:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.410+0000 7f9cb8c62640 1 -- 172.21.15.114:0/3822201935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cb41f0e40 msgr2=0x7f9cb41419f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.410+0000 7f9cb8c62640 1 --2- 172.21.15.114:0/3822201935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cb41f0e40 0x7f9cb41419f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f9cac02b530 tx=0x7f9cb4142ba0 comp rx=0 tx=0).stop 2024-04-28T13:08:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.411+0000 7f9cb8c62640 1 -- 172.21.15.114:0/3822201935 shutdown_connections 2024-04-28T13:08:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.411+0000 7f9cb8c62640 1 --2- 172.21.15.114:0/3822201935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cb41f0e40 0x7f9cb41419f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.411+0000 7f9cb8c62640 1 --2- 172.21.15.114:0/3822201935 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9c9406c980 0x7f9c9406ee40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.411+0000 7f9cb8c62640 1 --2- 172.21.15.114:0/3822201935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cb40b7be0 0x7f9cb41f0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.411+0000 7f9cb8c62640 1 --2- 172.21.15.114:0/3822201935 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9c9c004d40 0x7f9cb4156e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:43.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.411+0000 7f9cb8c62640 1 -- 172.21.15.114:0/3822201935 >> 172.21.15.114:0/3822201935 conn(0x7f9cb4063160 msgr2=0x7f9cb40b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:43.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.411+0000 7f9cb8c62640 1 -- 172.21.15.114:0/3822201935 shutdown_connections 2024-04-28T13:08:43.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.411+0000 7f9cb8c62640 1 -- 172.21.15.114:0/3822201935 wait complete. 2024-04-28T13:08:43.422 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-28T13:08:43.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.519+0000 7f6cb6ecc640 1 Processor -- start 2024-04-28T13:08:43.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.519+0000 7f6cb6ecc640 1 -- start start 2024-04-28T13:08:43.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.520+0000 7f6cb6ecc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6cb006e990 0x7f6cb015f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:43.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.520+0000 7f6cb6ecc640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6cb00afb20 0x7f6cb00affb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:43.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.520+0000 7f6cb6ecc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cb0070950 con 0x7f6cb006d360 2024-04-28T13:08:43.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.520+0000 7f6cb6ecc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f6cb00af6b0 con 0x7f6cb006e990 2024-04-28T13:08:43.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.520+0000 7f6cb6ecc640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f6cb006f100 con 0x7f6cb00afb20 2024-04-28T13:08:43.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.520+0000 7f6caffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6cb006e990 0x7f6cb015f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:43.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.520+0000 7f6caffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6cb006e990 0x7f6cb015f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44482/0 (socket says 172.21.15.114:44482) 2024-04-28T13:08:43.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.520+0000 7f6caffff640 1 -- 172.21.15.114:0/59238208 learned_addr learned my addr 172.21.15.114:0/59238208 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:43.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.520+0000 7f6cb5469640 1 --2- 172.21.15.114:0/59238208 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6cb00afb20 0x7f6cb00affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:43.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.520+0000 7f6caffff640 1 -- 172.21.15.114:0/59238208 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6cb00afb20 msgr2=0x7f6cb00affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:43.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.520+0000 7f6caffff640 1 --2- 172.21.15.114:0/59238208 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6cb00afb20 0x7f6cb00affb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:43.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.520+0000 7f6caffff640 1 -- 172.21.15.114:0/59238208 >> v1:172.21.15.114:6789/0 conn(0x7f6cb006d360 legacy=0x7f6cb006d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:43.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.520+0000 7f6caffff640 1 -- 172.21.15.114:0/59238208 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cb006fc80 con 0x7f6cb006e990 2024-04-28T13:08:43.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.520+0000 7f6cb5469640 1 --2- 172.21.15.114:0/59238208 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6cb00afb20 0x7f6cb00affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:43.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.521+0000 7f6caffff640 1 --2- 172.21.15.114:0/59238208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cb006e990 0x7f6cb015f4a0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009870 tx=0x7f6c9c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695b21df96aedd6b server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:43.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.521+0000 7f6caf7fe640 1 -- 172.21.15.114:0/59238208 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c037070 con 0x7f6cb006e990 2024-04-28T13:08:43.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.521+0000 7f6caf7fe640 1 -- 172.21.15.114:0/59238208 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c9c032440 con 0x7f6cb006e990 2024-04-28T13:08:43.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.521+0000 7f6caf7fe640 1 -- 172.21.15.114:0/59238208 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c032810 con 0x7f6cb006e990 2024-04-28T13:08:43.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.521+0000 7f6cb6ecc640 1 -- 172.21.15.114:0/59238208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cb006e990 msgr2=0x7f6cb015f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:43.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.521+0000 7f6cb6ecc640 1 --2- 172.21.15.114:0/59238208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cb006e990 0x7f6cb015f4a0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009870 tx=0x7f6c9c02a270 comp rx=0 tx=0).stop 2024-04-28T13:08:43.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.522+0000 7f6cb6ecc640 1 -- 172.21.15.114:0/59238208 shutdown_connections 2024-04-28T13:08:43.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.522+0000 7f6cb6ecc640 1 --2- 172.21.15.114:0/59238208 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6cb00afb20 0x7f6cb00affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:43.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.522+0000 7f6cb6ecc640 1 --2- 172.21.15.114:0/59238208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cb006e990 0x7f6cb015f4a0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:43.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.522+0000 7f6cb6ecc640 1 -- 172.21.15.114:0/59238208 >> 172.21.15.114:0/59238208 conn(0x7f6cb0072a60 msgr2=0x7f6cb0072e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:43.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.522+0000 7f6cb6ecc640 1 -- 172.21.15.114:0/59238208 shutdown_connections 2024-04-28T13:08:43.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.522+0000 7f6cb6ecc640 1 -- 172.21.15.114:0/59238208 wait complete. 2024-04-28T13:08:43.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.523+0000 7f6cb6ecc640 1 Processor -- start 2024-04-28T13:08:43.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.523+0000 7f6cb6ecc640 1 -- start start 2024-04-28T13:08:43.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.524+0000 7f6cb6ecc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cb006d360 0x7f6cb014df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:43.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.524+0000 7f6cb6ecc640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6cb006e990 0x7f6cb0155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:43.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.524+0000 7f6cb6ecc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cb00afb20 0x7f6cb01e9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:43.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.524+0000 7f6cb6ecc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb006f9a0 con 0x7f6cb006d360 2024-04-28T13:08:43.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.524+0000 7f6cb6ecc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb006f6c0 con 0x7f6cb00afb20 2024-04-28T13:08:43.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.524+0000 7f6cb6ecc640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f6cb006ee10 con 0x7f6cb006e990 2024-04-28T13:08:43.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.524+0000 7f6cb4c68640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cb006d360 0x7f6cb014df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:43.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.524+0000 7f6cb4c68640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cb006d360 0x7f6cb014df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44494/0 (socket says 172.21.15.114:44494) 2024-04-28T13:08:43.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.524+0000 7f6cb4c68640 1 -- 172.21.15.114:0/3192215282 learned_addr learned my addr 172.21.15.114:0/3192215282 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:43.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.524+0000 7f6caffff640 1 --2- 172.21.15.114:0/3192215282 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6cb006e990 0x7f6cb0155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:43.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.524+0000 7f6cb5469640 1 --2- 172.21.15.114:0/3192215282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cb00afb20 0x7f6cb01e9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:43.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.524+0000 7f6cb4c68640 1 -- 172.21.15.114:0/3192215282 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6cb006e990 msgr2=0x7f6cb0155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:43.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.524+0000 7f6cb4c68640 1 --2- 172.21.15.114:0/3192215282 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6cb006e990 0x7f6cb0155740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:43.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.524+0000 7f6cb4c68640 1 -- 172.21.15.114:0/3192215282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cb00afb20 msgr2=0x7f6cb01e9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:43.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.524+0000 7f6cb4c68640 1 --2- 172.21.15.114:0/3192215282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cb00afb20 0x7f6cb01e9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:43.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.524+0000 7f6cb4c68640 1 -- 172.21.15.114:0/3192215282 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cb00cf3e0 con 0x7f6cb006d360 2024-04-28T13:08:43.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.524+0000 7f6caffff640 1 --2- 172.21.15.114:0/3192215282 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6cb006e990 0x7f6cb0155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:43.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.524+0000 7f6cb5469640 1 --2- 172.21.15.114:0/3192215282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cb00afb20 0x7f6cb01e9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:43.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.524+0000 7f6cb4c68640 1 --2- 172.21.15.114:0/3192215282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cb006d360 0x7f6cb014df60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6ca400c430 tx=0x7f6ca400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:43.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.524+0000 7f6cad7fa640 1 -- 172.21.15.114:0/3192215282 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca40052d0 con 0x7f6cb006d360 2024-04-28T13:08:43.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.524+0000 7f6cad7fa640 1 -- 172.21.15.114:0/3192215282 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ca4005490 con 0x7f6cb006d360 2024-04-28T13:08:43.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.524+0000 7f6cb6ecc640 1 -- 172.21.15.114:0/3192215282 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cb00d0840 con 0x7f6cb006d360 2024-04-28T13:08:43.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.524+0000 7f6cad7fa640 1 -- 172.21.15.114:0/3192215282 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4007260 con 0x7f6cb006d360 2024-04-28T13:08:43.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.524+0000 7f6cb6ecc640 1 -- 172.21.15.114:0/3192215282 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cb00d0ae0 con 0x7f6cb006d360 2024-04-28T13:08:43.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.525+0000 7f6cb6ecc640 1 -- 172.21.15.114:0/3192215282 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cb0151e30 con 0x7f6cb006d360 2024-04-28T13:08:43.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.526+0000 7f6cad7fa640 1 -- 172.21.15.114:0/3192215282 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f6ca4007400 con 0x7f6cb006d360 2024-04-28T13:08:43.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.526+0000 7f6cad7fa640 1 --2- 172.21.15.114:0/3192215282 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6c9406c980 0x7f6c9406ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:43.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.526+0000 7f6caffff640 1 --2- 172.21.15.114:0/3192215282 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6c9406c980 0x7f6c9406ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:43.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.526+0000 7f6cad7fa640 1 -- 172.21.15.114:0/3192215282 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4857+0+0 (secure 0 0 0) 0x7f6ca408ad90 con 0x7f6cb006d360 2024-04-28T13:08:43.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.527+0000 7f6caffff640 1 --2- 172.21.15.114:0/3192215282 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6c9406c980 0x7f6c9406ee40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c034000 tx=0x7f6c9c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:43.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.531+0000 7f6cad7fa640 1 -- 172.21.15.114:0/3192215282 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6cb0151e30 con 0x7f6cb006d360 2024-04-28T13:08:43.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.706+0000 7f6cb6ecc640 1 -- 172.21.15.114:0/3192215282 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f6cb006a3d0 con 0x7f6cb006d360 2024-04-28T13:08:43.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.706+0000 7f6cad7fa640 1 -- 172.21.15.114:0/3192215282 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v42) ==== 84+0+65 (secure 0 0 0) 0x7f6cb00cf3e0 con 0x7f6cb006d360 2024-04-28T13:08:43.707 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:43.707 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-04-28T13:08:43.707 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:43.707 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2024-04-28T13:08:43.708 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2024-04-28T13:08:43.708 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:43.708 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-04-28T13:08:43.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.708+0000 7f6cb6ecc640 1 -- 172.21.15.114:0/3192215282 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6c9406c980 msgr2=0x7f6c9406ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:43.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.708+0000 7f6cb6ecc640 1 --2- 172.21.15.114:0/3192215282 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6c9406c980 0x7f6c9406ee40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c034000 tx=0x7f6c9c02e000 comp rx=0 tx=0).stop 2024-04-28T13:08:43.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.708+0000 7f6cb6ecc640 1 -- 172.21.15.114:0/3192215282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cb006d360 msgr2=0x7f6cb014df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:43.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.708+0000 7f6cb6ecc640 1 --2- 172.21.15.114:0/3192215282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cb006d360 0x7f6cb014df60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6ca400c430 tx=0x7f6ca400c8f0 comp rx=0 tx=0).stop 2024-04-28T13:08:43.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.708+0000 7f6cb6ecc640 1 -- 172.21.15.114:0/3192215282 shutdown_connections 2024-04-28T13:08:43.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.708+0000 7f6cb6ecc640 1 --2- 172.21.15.114:0/3192215282 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6c9406c980 0x7f6c9406ee40 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:43.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.708+0000 7f6cb6ecc640 1 --2- 172.21.15.114:0/3192215282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cb00afb20 0x7f6cb01e9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:43.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.708+0000 7f6cb6ecc640 1 --2- 172.21.15.114:0/3192215282 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6cb006e990 0x7f6cb0155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:43.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.708+0000 7f6cb6ecc640 1 --2- 172.21.15.114:0/3192215282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cb006d360 0x7f6cb014df60 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:43.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.708+0000 7f6cb6ecc640 1 -- 172.21.15.114:0/3192215282 >> 172.21.15.114:0/3192215282 conn(0x7f6cb0072a60 msgr2=0x7f6cb015d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:43.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.709+0000 7f6cb6ecc640 1 -- 172.21.15.114:0/3192215282 shutdown_connections 2024-04-28T13:08:43.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.709+0000 7f6cb6ecc640 1 -- 172.21.15.114:0/3192215282 wait complete. 2024-04-28T13:08:43.720 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-28T13:08:43.720 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-28T13:08:43.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.820+0000 7f6b98c45640 1 Processor -- start 2024-04-28T13:08:43.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.820+0000 7f6b98c45640 1 -- start start 2024-04-28T13:08:43.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.821+0000 7f6b98c45640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b9415f660 0x7f6b940739a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:43.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.821+0000 7f6b98c45640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b9406f800 con 0x7f6b940b0970 2024-04-28T13:08:43.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.821+0000 7f6b98c45640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b940cc870 con 0x7f6b940d1d30 2024-04-28T13:08:43.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.821+0000 7f6b98c45640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f6b940d21c0 con 0x7f6b9415f660 2024-04-28T13:08:43.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.821+0000 7f6b92d9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6b940b0970 0x7f6b9406ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52290/0 (socket says 172.21.15.114:52290) 2024-04-28T13:08:43.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.821+0000 7f6b92d9d640 1 -- 172.21.15.114:0/904362910 learned_addr learned my addr 172.21.15.114:0/904362910 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:43.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.821+0000 7f6b9259c640 1 --2- 172.21.15.114:0/904362910 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b9415f660 0x7f6b940739a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:43.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.822+0000 7f6b9159a640 1 -- 172.21.15.114:0/904362910 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1340308016 0 0) 0x7f6b9406f800 con 0x7f6b940b0970 2024-04-28T13:08:43.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.822+0000 7f6b9159a640 1 -- 172.21.15.114:0/904362910 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b7c003520 con 0x7f6b940b0970 2024-04-28T13:08:43.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.822+0000 7f6b9259c640 1 -- 172.21.15.114:0/904362910 >> v1:172.21.15.134:6789/0 conn(0x7f6b940d1d30 legacy=0x7f6b9406e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:43.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.822+0000 7f6b9159a640 1 -- 172.21.15.114:0/904362910 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2066306553 0 0) 0x7f6b940cc870 con 0x7f6b940d1d30 2024-04-28T13:08:43.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.822+0000 7f6b9259c640 1 -- 172.21.15.114:0/904362910 >> v1:172.21.15.114:6789/0 conn(0x7f6b940b0970 legacy=0x7f6b9406ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:43.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.822+0000 7f6b9259c640 1 -- 172.21.15.114:0/904362910 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9406faa0 con 0x7f6b9415f660 2024-04-28T13:08:43.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.823+0000 7f6b9259c640 1 --2- 172.21.15.114:0/904362910 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b9415f660 0x7f6b940739a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009dc0 tx=0x7f6b8402a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65b4f35f7ed9e8ad server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:43.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.823+0000 7f6b9159a640 1 -- 172.21.15.114:0/904362910 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b84007740 con 0x7f6b9415f660 2024-04-28T13:08:43.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.823+0000 7f6b9159a640 1 -- 172.21.15.114:0/904362910 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b840078e0 con 0x7f6b9415f660 2024-04-28T13:08:43.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.823+0000 7f6b9159a640 1 -- 172.21.15.114:0/904362910 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b84007c90 con 0x7f6b9415f660 2024-04-28T13:08:43.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.823+0000 7f6b98c45640 1 -- 172.21.15.114:0/904362910 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b9415f660 msgr2=0x7f6b940739a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:43.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.823+0000 7f6b98c45640 1 --2- 172.21.15.114:0/904362910 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b9415f660 0x7f6b940739a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009dc0 tx=0x7f6b8402a6d0 comp rx=0 tx=0).stop 2024-04-28T13:08:43.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.823+0000 7f6b98c45640 1 -- 172.21.15.114:0/904362910 shutdown_connections 2024-04-28T13:08:43.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.823+0000 7f6b98c45640 1 --2- 172.21.15.114:0/904362910 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b9415f660 0x7f6b940739a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:43.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.823+0000 7f6b98c45640 1 -- 172.21.15.114:0/904362910 >> 172.21.15.114:0/904362910 conn(0x7f6b940d1210 msgr2=0x7f6b940d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:43.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.823+0000 7f6b98c45640 1 -- 172.21.15.114:0/904362910 shutdown_connections 2024-04-28T13:08:43.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.823+0000 7f6b98c45640 1 -- 172.21.15.114:0/904362910 wait complete. 2024-04-28T13:08:43.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.825+0000 7f6b98c45640 1 Processor -- start 2024-04-28T13:08:43.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.825+0000 7f6b98c45640 1 -- start start 2024-04-28T13:08:43.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.825+0000 7f6b98c45640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b940b0970 0x7f6b940ca930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:43.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.825+0000 7f6b98c45640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b9415f660 0x7f6b940af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:43.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.825+0000 7f6b98c45640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b94156db0 0x7f6b94157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:43.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.825+0000 7f6b98c45640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6b94070580 con 0x7f6b94156db0 2024-04-28T13:08:43.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.825+0000 7f6b98c45640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6b940700f0 con 0x7f6b940b0970 2024-04-28T13:08:43.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.825+0000 7f6b98c45640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f6b9406f470 con 0x7f6b9415f660 2024-04-28T13:08:43.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.826+0000 7f6b92d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b94156db0 0x7f6b94157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:43.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.826+0000 7f6b92d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b94156db0 0x7f6b94157240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44508/0 (socket says 172.21.15.114:44508) 2024-04-28T13:08:43.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.826+0000 7f6b92d9d640 1 -- 172.21.15.114:0/3559900842 learned_addr learned my addr 172.21.15.114:0/3559900842 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:43.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.826+0000 7f6b91d9b640 1 --2- 172.21.15.114:0/3559900842 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b9415f660 0x7f6b940af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:43.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.826+0000 7f6b9259c640 1 --2- 172.21.15.114:0/3559900842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b940b0970 0x7f6b940ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:43.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.826+0000 7f6b92d9d640 1 -- 172.21.15.114:0/3559900842 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b9415f660 msgr2=0x7f6b940af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:43.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.826+0000 7f6b92d9d640 1 --2- 172.21.15.114:0/3559900842 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b9415f660 0x7f6b940af3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:43.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.826+0000 7f6b92d9d640 1 -- 172.21.15.114:0/3559900842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b940b0970 msgr2=0x7f6b940ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:43.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.826+0000 7f6b92d9d640 1 --2- 172.21.15.114:0/3559900842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b940b0970 0x7f6b940ca930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:43.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.826+0000 7f6b92d9d640 1 -- 172.21.15.114:0/3559900842 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9415db60 con 0x7f6b94156db0 2024-04-28T13:08:43.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.826+0000 7f6b92d9d640 1 --2- 172.21.15.114:0/3559900842 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b94156db0 0x7f6b94157240 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c00c430 tx=0x7f6b8c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:43.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.826+0000 7f6b82ffd640 1 -- 172.21.15.114:0/3559900842 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c017070 con 0x7f6b94156db0 2024-04-28T13:08:43.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.826+0000 7f6b82ffd640 1 -- 172.21.15.114:0/3559900842 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b8c005ce0 con 0x7f6b94156db0 2024-04-28T13:08:43.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.826+0000 7f6b98c45640 1 -- 172.21.15.114:0/3559900842 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b94157780 con 0x7f6b94156db0 2024-04-28T13:08:43.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.826+0000 7f6b82ffd640 1 -- 172.21.15.114:0/3559900842 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c0072f0 con 0x7f6b94156db0 2024-04-28T13:08:43.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.826+0000 7f6b98c45640 1 -- 172.21.15.114:0/3559900842 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b940b0300 con 0x7f6b94156db0 2024-04-28T13:08:43.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.827+0000 7f6b98c45640 1 -- 172.21.15.114:0/3559900842 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b940d1030 con 0x7f6b94156db0 2024-04-28T13:08:43.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.828+0000 7f6b82ffd640 1 -- 172.21.15.114:0/3559900842 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f6b8c01a070 con 0x7f6b94156db0 2024-04-28T13:08:43.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.828+0000 7f6b82ffd640 1 --2- 172.21.15.114:0/3559900842 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6b7406c980 0x7f6b7406ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:43.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.828+0000 7f6b82ffd640 1 -- 172.21.15.114:0/3559900842 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4857+0+0 (secure 0 0 0) 0x7f6b8c08abc0 con 0x7f6b94156db0 2024-04-28T13:08:43.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.828+0000 7f6b9259c640 1 --2- 172.21.15.114:0/3559900842 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6b7406c980 0x7f6b7406ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:43.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.829+0000 7f6b9259c640 1 --2- 172.21.15.114:0/3559900842 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6b7406c980 0x7f6b7406ee40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6b84034000 tx=0x7f6b8402f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:43.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:43.832+0000 7f6b82ffd640 1 -- 172.21.15.114:0/3559900842 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6b940d1030 con 0x7f6b94156db0 2024-04-28T13:08:44.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.008+0000 7f6b98c45640 1 -- 172.21.15.114:0/3559900842 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f6b940d15f0 con 0x7f6b94156db0 2024-04-28T13:08:44.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.440+0000 7f6b82ffd640 1 -- 172.21.15.114:0/3559900842 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v43) ==== 138+0+0 (secure 0 0 0) 0x7f6b940d15f0 con 0x7f6b94156db0 2024-04-28T13:08:44.441 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2024-04-28T13:08:44.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.442+0000 7f6b98c45640 1 -- 172.21.15.114:0/3559900842 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6b7406c980 msgr2=0x7f6b7406ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:44.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.442+0000 7f6b98c45640 1 --2- 172.21.15.114:0/3559900842 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6b7406c980 0x7f6b7406ee40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6b84034000 tx=0x7f6b8402f000 comp rx=0 tx=0).stop 2024-04-28T13:08:44.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.442+0000 7f6b98c45640 1 -- 172.21.15.114:0/3559900842 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b94156db0 msgr2=0x7f6b94157240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:44.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.442+0000 7f6b98c45640 1 --2- 172.21.15.114:0/3559900842 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b94156db0 0x7f6b94157240 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c00c430 tx=0x7f6b8c00c8f0 comp rx=0 tx=0).stop 2024-04-28T13:08:44.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.442+0000 7f6b98c45640 1 -- 172.21.15.114:0/3559900842 shutdown_connections 2024-04-28T13:08:44.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.442+0000 7f6b98c45640 1 --2- 172.21.15.114:0/3559900842 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b94156db0 0x7f6b94157240 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:44.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.442+0000 7f6b98c45640 1 --2- 172.21.15.114:0/3559900842 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b9415f660 0x7f6b940af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:44.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.442+0000 7f6b98c45640 1 --2- 172.21.15.114:0/3559900842 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6b7406c980 0x7f6b7406ee40 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:44.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.442+0000 7f6b98c45640 1 --2- 172.21.15.114:0/3559900842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b940b0970 0x7f6b940ca930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:44.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.442+0000 7f6b98c45640 1 -- 172.21.15.114:0/3559900842 >> 172.21.15.114:0/3559900842 conn(0x7f6b940d1210 msgr2=0x7f6b940739a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:44.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.442+0000 7f6b98c45640 1 -- 172.21.15.114:0/3559900842 shutdown_connections 2024-04-28T13:08:44.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.442+0000 7f6b98c45640 1 -- 172.21.15.114:0/3559900842 wait complete. 2024-04-28T13:08:44.458 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-28T13:08:44.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.563+0000 7f7ce4d0a640 1 Processor -- start 2024-04-28T13:08:44.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.563+0000 7f7ce4d0a640 1 -- start start 2024-04-28T13:08:44.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.564+0000 7f7ce4d0a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7ce015f3d0 0x7f7ce00b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:44.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.564+0000 7f7ce4d0a640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ce00b6050 con 0x7f7ce0162fb0 2024-04-28T13:08:44.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.564+0000 7f7ce4d0a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ce00d0630 con 0x7f7ce006d510 2024-04-28T13:08:44.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.564+0000 7f7ce4d0a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f7ce00b6940 con 0x7f7ce015f3d0 2024-04-28T13:08:44.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.564+0000 7f7cddd9b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f7ce0162fb0 0x7f7ce00cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52304/0 (socket says 172.21.15.114:52304) 2024-04-28T13:08:44.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.564+0000 7f7cddd9b640 1 -- 172.21.15.114:0/1806733071 learned_addr learned my addr 172.21.15.114:0/1806733071 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:44.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.564+0000 7f7cdd59a640 1 -- 172.21.15.114:0/1806733071 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1857827832 0 0) 0x7f7ce00b6050 con 0x7f7ce0162fb0 2024-04-28T13:08:44.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.564+0000 7f7cdd59a640 1 -- 172.21.15.114:0/1806733071 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cc8003520 con 0x7f7ce0162fb0 2024-04-28T13:08:44.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.564+0000 7f7cde59c640 1 --2- 172.21.15.114:0/1806733071 >> v2:172.21.15.134:3300/0 conn(0x7f7ce015f3d0 0x7f7ce00b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:44.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.564+0000 7f7cdd59a640 1 -- 172.21.15.114:0/1806733071 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 951952906 0 0) 0x7f7cc8003520 con 0x7f7ce0162fb0 2024-04-28T13:08:44.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.564+0000 7f7cdd59a640 1 -- 172.21.15.114:0/1806733071 >> v2:172.21.15.134:3300/0 conn(0x7f7ce015f3d0 msgr2=0x7f7ce00b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:44.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.564+0000 7f7cdd59a640 1 --2- 172.21.15.114:0/1806733071 >> v2:172.21.15.134:3300/0 conn(0x7f7ce015f3d0 0x7f7ce00b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:44.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.564+0000 7f7cdd59a640 1 -- 172.21.15.114:0/1806733071 >> v1:172.21.15.134:6789/0 conn(0x7f7ce006d510 legacy=0x7f7ce00cf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:44.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.564+0000 7f7cdd59a640 1 -- 172.21.15.114:0/1806733071 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ce00b62f0 con 0x7f7ce0162fb0 2024-04-28T13:08:44.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.564+0000 7f7cdd59a640 1 -- 172.21.15.114:0/1806733071 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f7cd4001670 con 0x7f7ce0162fb0 2024-04-28T13:08:44.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.564+0000 7f7cdd59a640 1 -- 172.21.15.114:0/1806733071 >> v1:172.21.15.114:6789/0 conn(0x7f7ce0162fb0 legacy=0x7f7ce00cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:44.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.564+0000 7f7cdd59a640 1 --2- 172.21.15.114:0/1806733071 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7cc80039b0 0x7f7cc8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:44.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.564+0000 7f7cdd59a640 1 --2- 172.21.15.114:0/1806733071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cc8004800 0x7f7cc8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:44.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.564+0000 7f7cdd59a640 1 --2- 172.21.15.114:0/1806733071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cc80051c0 0x7f7cc800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:44.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.564+0000 7f7cdd59a640 1 -- 172.21.15.114:0/1806733071 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc800c130 con 0x7f7cc80051c0 2024-04-28T13:08:44.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.564+0000 7f7cdd59a640 1 -- 172.21.15.114:0/1806733071 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc800c2e0 con 0x7f7cc8004800 2024-04-28T13:08:44.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.564+0000 7f7cdd59a640 1 -- 172.21.15.114:0/1806733071 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f7cc800c4e0 con 0x7f7cc80039b0 2024-04-28T13:08:44.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.564+0000 7f7cded9d640 1 --2- 172.21.15.114:0/1806733071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cc80051c0 0x7f7cc800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:44.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.565+0000 7f7cddd9b640 1 --2- 172.21.15.114:0/1806733071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cc8004800 0x7f7cc8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:44.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.565+0000 7f7cde59c640 1 --2- 172.21.15.114:0/1806733071 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7cc80039b0 0x7f7cc8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:44.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.565+0000 7f7cded9d640 1 -- 172.21.15.114:0/1806733071 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7cc80039b0 msgr2=0x7f7cc8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:44.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.565+0000 7f7cded9d640 1 --2- 172.21.15.114:0/1806733071 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7cc80039b0 0x7f7cc8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:44.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.565+0000 7f7cded9d640 1 -- 172.21.15.114:0/1806733071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cc8004800 msgr2=0x7f7cc8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:44.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.565+0000 7f7cded9d640 1 --2- 172.21.15.114:0/1806733071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cc8004800 0x7f7cc8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:44.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.565+0000 7f7cded9d640 1 -- 172.21.15.114:0/1806733071 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc8003520 con 0x7f7cc80051c0 2024-04-28T13:08:44.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.565+0000 7f7cded9d640 1 -- 172.21.15.114:0/1806733071 reap_dead start 2024-04-28T13:08:44.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.565+0000 7f7cded9d640 1 --2- 172.21.15.114:0/1806733071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cc80051c0 0x7f7cc800b9c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8001e20 tx=0x7f7cc8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebdca1109435c457 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:44.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.566+0000 7f7cdd59a640 1 -- 172.21.15.114:0/1806733071 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8001a70 con 0x7f7cc80051c0 2024-04-28T13:08:44.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.566+0000 7f7cdd59a640 1 -- 172.21.15.114:0/1806733071 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cd802ae40 con 0x7f7cc80051c0 2024-04-28T13:08:44.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.566+0000 7f7cdd59a640 1 -- 172.21.15.114:0/1806733071 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8003bb0 con 0x7f7cc80051c0 2024-04-28T13:08:44.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.566+0000 7f7ce4d0a640 1 -- 172.21.15.114:0/1806733071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cc80051c0 msgr2=0x7f7cc800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:44.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.566+0000 7f7ce4d0a640 1 --2- 172.21.15.114:0/1806733071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cc80051c0 0x7f7cc800b9c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8001e20 tx=0x7f7cc8005830 comp rx=0 tx=0).stop 2024-04-28T13:08:44.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.566+0000 7f7ce4d0a640 1 -- 172.21.15.114:0/1806733071 shutdown_connections 2024-04-28T13:08:44.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.566+0000 7f7ce4d0a640 1 --2- 172.21.15.114:0/1806733071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cc80051c0 0x7f7cc800b9c0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:44.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.566+0000 7f7ce4d0a640 1 -- 172.21.15.114:0/1806733071 >> 172.21.15.114:0/1806733071 conn(0x7f7ce00d16b0 msgr2=0x7f7ce00d1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:44.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.566+0000 7f7ce4d0a640 1 -- 172.21.15.114:0/1806733071 shutdown_connections 2024-04-28T13:08:44.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.566+0000 7f7ce4d0a640 1 -- 172.21.15.114:0/1806733071 wait complete. 2024-04-28T13:08:44.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.567+0000 7f7ce4d0a640 1 Processor -- start 2024-04-28T13:08:44.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.568+0000 7f7ce4d0a640 1 -- start start 2024-04-28T13:08:44.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.568+0000 7f7ce4d0a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cc80051c0 0x7f7ce0154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:44.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.568+0000 7f7ce4d0a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ce00704e0 0x7f7ce00afb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:44.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.568+0000 7f7ce4d0a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ce0152e50 0x7f7ce01532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:44.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.568+0000 7f7ce4d0a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce015f930 con 0x7f7cc80051c0 2024-04-28T13:08:44.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.568+0000 7f7ce4d0a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce015f7b0 con 0x7f7ce0152e50 2024-04-28T13:08:44.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.568+0000 7f7ce4d0a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f7ce0163ca0 con 0x7f7ce00704e0 2024-04-28T13:08:44.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.568+0000 7f7cde59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cc80051c0 0x7f7ce0154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:44.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.568+0000 7f7cde59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cc80051c0 0x7f7ce0154010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44530/0 (socket says 172.21.15.114:44530) 2024-04-28T13:08:44.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.568+0000 7f7cde59c640 1 -- 172.21.15.114:0/1406392060 learned_addr learned my addr 172.21.15.114:0/1406392060 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:44.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.568+0000 7f7cddd9b640 1 --2- 172.21.15.114:0/1406392060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ce00704e0 0x7f7ce00afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:44.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.568+0000 7f7cded9d640 1 --2- 172.21.15.114:0/1406392060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ce0152e50 0x7f7ce01532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:44.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.569+0000 7f7cde59c640 1 -- 172.21.15.114:0/1406392060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ce00704e0 msgr2=0x7f7ce00afb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:44.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.569+0000 7f7cde59c640 1 --2- 172.21.15.114:0/1406392060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ce00704e0 0x7f7ce00afb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:44.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.569+0000 7f7cde59c640 1 -- 172.21.15.114:0/1406392060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ce0152e50 msgr2=0x7f7ce01532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:44.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.569+0000 7f7cde59c640 1 --2- 172.21.15.114:0/1406392060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ce0152e50 0x7f7ce01532d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:44.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.569+0000 7f7cde59c640 1 -- 172.21.15.114:0/1406392060 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ce0153810 con 0x7f7cc80051c0 2024-04-28T13:08:44.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.569+0000 7f7cde59c640 1 --2- 172.21.15.114:0/1406392060 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cc80051c0 0x7f7ce0154010 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0011910 tx=0x7f7cd0011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:44.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.569+0000 7f7cceffd640 1 -- 172.21.15.114:0/1406392060 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd000faf0 con 0x7f7cc80051c0 2024-04-28T13:08:44.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.569+0000 7f7cceffd640 1 -- 172.21.15.114:0/1406392060 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cd000fc90 con 0x7f7cc80051c0 2024-04-28T13:08:44.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.569+0000 7f7ce4d0a640 1 -- 172.21.15.114:0/1406392060 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ce0154940 con 0x7f7cc80051c0 2024-04-28T13:08:44.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.569+0000 7f7cceffd640 1 -- 172.21.15.114:0/1406392060 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd0014440 con 0x7f7cc80051c0 2024-04-28T13:08:44.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.569+0000 7f7ce4d0a640 1 -- 172.21.15.114:0/1406392060 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ce0154f00 con 0x7f7cc80051c0 2024-04-28T13:08:44.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.570+0000 7f7ce4d0a640 1 -- 172.21.15.114:0/1406392060 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ce006a3d0 con 0x7f7cc80051c0 2024-04-28T13:08:44.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.571+0000 7f7cceffd640 1 -- 172.21.15.114:0/1406392060 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f7cd0012040 con 0x7f7cc80051c0 2024-04-28T13:08:44.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.571+0000 7f7cceffd640 1 --2- 172.21.15.114:0/1406392060 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7cc006c980 0x7f7cc006ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:44.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.571+0000 7f7cceffd640 1 -- 172.21.15.114:0/1406392060 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5227+0+0 (secure 0 0 0) 0x7f7cd008bfb0 con 0x7f7cc80051c0 2024-04-28T13:08:44.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.571+0000 7f7cddd9b640 1 --2- 172.21.15.114:0/1406392060 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7cc006c980 0x7f7cc006ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:44.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.571+0000 7f7cddd9b640 1 --2- 172.21.15.114:0/1406392060 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7cc006c980 0x7f7cc006ee40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0157110 tx=0x7f7cd4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:44.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.575+0000 7f7cceffd640 1 -- 172.21.15.114:0/1406392060 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7cd0019030 con 0x7f7cc80051c0 2024-04-28T13:08:44.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:44.750+0000 7f7ce4d0a640 1 -- 172.21.15.114:0/1406392060 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f7ce00d2310 con 0x7f7cc80051c0 2024-04-28T13:08:45.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.442+0000 7f7cceffd640 1 -- 172.21.15.114:0/1406392060 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v44) ==== 170+0+0 (secure 0 0 0) 0x7f7cd005a5d0 con 0x7f7cc80051c0 2024-04-28T13:08:45.443 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2024-04-28T13:08:45.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.444+0000 7f7ce4d0a640 1 -- 172.21.15.114:0/1406392060 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7cc006c980 msgr2=0x7f7cc006ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:45.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.444+0000 7f7ce4d0a640 1 --2- 172.21.15.114:0/1406392060 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7cc006c980 0x7f7cc006ee40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0157110 tx=0x7f7cd4009040 comp rx=0 tx=0).stop 2024-04-28T13:08:45.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.444+0000 7f7ce4d0a640 1 -- 172.21.15.114:0/1406392060 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cc80051c0 msgr2=0x7f7ce0154010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:45.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.444+0000 7f7ce4d0a640 1 --2- 172.21.15.114:0/1406392060 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cc80051c0 0x7f7ce0154010 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0011910 tx=0x7f7cd0011dd0 comp rx=0 tx=0).stop 2024-04-28T13:08:45.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.445+0000 7f7ce4d0a640 1 -- 172.21.15.114:0/1406392060 shutdown_connections 2024-04-28T13:08:45.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.445+0000 7f7ce4d0a640 1 --2- 172.21.15.114:0/1406392060 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f7cc006c980 0x7f7cc006ee40 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:45.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.445+0000 7f7ce4d0a640 1 --2- 172.21.15.114:0/1406392060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ce0152e50 0x7f7ce01532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:45.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.445+0000 7f7ce4d0a640 1 --2- 172.21.15.114:0/1406392060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ce00704e0 0x7f7ce00afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:45.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.445+0000 7f7ce4d0a640 1 --2- 172.21.15.114:0/1406392060 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cc80051c0 0x7f7ce0154010 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:45.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.445+0000 7f7ce4d0a640 1 -- 172.21.15.114:0/1406392060 >> 172.21.15.114:0/1406392060 conn(0x7f7ce00d16b0 msgr2=0x7f7ce015d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:45.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.445+0000 7f7ce4d0a640 1 -- 172.21.15.114:0/1406392060 shutdown_connections 2024-04-28T13:08:45.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.445+0000 7f7ce4d0a640 1 -- 172.21.15.114:0/1406392060 wait complete. 2024-04-28T13:08:45.467 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-28T13:08:45.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.569+0000 7f15945a4640 1 Processor -- start 2024-04-28T13:08:45.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.569+0000 7f15945a4640 1 -- start start 2024-04-28T13:08:45.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.570+0000 7f15945a4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f158c15f3d0 0x7f158c0b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:45.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.570+0000 7f15945a4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f158c162fb0 0x7f158c1633f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:45.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.570+0000 7f15945a4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f158c0b6050 con 0x7f158c0cf280 2024-04-28T13:08:45.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.570+0000 7f15945a4640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f158c0b6940 con 0x7f158c15f3d0 2024-04-28T13:08:45.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.570+0000 7f15945a4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f158c0b4c40 con 0x7f158c162fb0 2024-04-28T13:08:45.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.570+0000 7f1592340640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f158c15f3d0 0x7f158c0b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:45.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.570+0000 7f1592340640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f158c15f3d0 0x7f158c0b4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44534/0 (socket says 172.21.15.114:44534) 2024-04-28T13:08:45.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.570+0000 7f1592340640 1 -- 172.21.15.114:0/2200004656 learned_addr learned my addr 172.21.15.114:0/2200004656 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:45.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.570+0000 7f1591b3f640 1 --2- 172.21.15.114:0/2200004656 >> v2:172.21.15.134:3300/0 conn(0x7f158c162fb0 0x7f158c1633f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:45.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.570+0000 7f1592340640 1 -- 172.21.15.114:0/2200004656 >> v2:172.21.15.134:3300/0 conn(0x7f158c162fb0 msgr2=0x7f158c1633f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:45.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.570+0000 7f1592340640 1 --2- 172.21.15.114:0/2200004656 >> v2:172.21.15.134:3300/0 conn(0x7f158c162fb0 0x7f158c1633f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:45.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.570+0000 7f1592340640 1 -- 172.21.15.114:0/2200004656 >> v1:172.21.15.114:6789/0 conn(0x7f158c0cf280 legacy=0x7f158c0cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:45.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.570+0000 7f1592340640 1 -- 172.21.15.114:0/2200004656 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f158c0d0630 con 0x7f158c15f3d0 2024-04-28T13:08:45.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.571+0000 7f1592340640 1 --2- 172.21.15.114:0/2200004656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f158c15f3d0 0x7f158c0b4700 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f158c0b6220 tx=0x7f158402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d50705562bc5f7dc server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:45.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.571+0000 7f159133e640 1 -- 172.21.15.114:0/2200004656 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1584036070 con 0x7f158c15f3d0 2024-04-28T13:08:45.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.571+0000 7f159133e640 1 -- 172.21.15.114:0/2200004656 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1584031600 con 0x7f158c15f3d0 2024-04-28T13:08:45.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.571+0000 7f159133e640 1 -- 172.21.15.114:0/2200004656 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15840319d0 con 0x7f158c15f3d0 2024-04-28T13:08:45.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.572+0000 7f15945a4640 1 -- 172.21.15.114:0/2200004656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f158c15f3d0 msgr2=0x7f158c0b4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:45.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.572+0000 7f15945a4640 1 --2- 172.21.15.114:0/2200004656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f158c15f3d0 0x7f158c0b4700 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f158c0b6220 tx=0x7f158402a730 comp rx=0 tx=0).stop 2024-04-28T13:08:45.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.572+0000 7f15945a4640 1 -- 172.21.15.114:0/2200004656 shutdown_connections 2024-04-28T13:08:45.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.572+0000 7f15945a4640 1 --2- 172.21.15.114:0/2200004656 >> v2:172.21.15.134:3300/0 conn(0x7f158c162fb0 0x7f158c1633f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:45.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.572+0000 7f15945a4640 1 --2- 172.21.15.114:0/2200004656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f158c15f3d0 0x7f158c0b4700 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:45.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.572+0000 7f15945a4640 1 -- 172.21.15.114:0/2200004656 >> 172.21.15.114:0/2200004656 conn(0x7f158c0d16b0 msgr2=0x7f158c0d1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:45.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.572+0000 7f15945a4640 1 -- 172.21.15.114:0/2200004656 shutdown_connections 2024-04-28T13:08:45.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.572+0000 7f15945a4640 1 -- 172.21.15.114:0/2200004656 wait complete. 2024-04-28T13:08:45.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.573+0000 7f15945a4640 1 Processor -- start 2024-04-28T13:08:45.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.573+0000 7f15945a4640 1 -- start start 2024-04-28T13:08:45.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.574+0000 7f15945a4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f158c0cf280 0x7f158c0d0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:45.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.574+0000 7f15945a4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f158c15f3d0 0x7f158c14fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:45.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.574+0000 7f15945a4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f158c162fb0 0x7f158c150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:45.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.574+0000 7f15945a4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f158c0b65d0 con 0x7f158c15f3d0 2024-04-28T13:08:45.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.574+0000 7f15945a4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f158c163930 con 0x7f158c162fb0 2024-04-28T13:08:45.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.574+0000 7f15945a4640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f158c15f7b0 con 0x7f158c0cf280 2024-04-28T13:08:45.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.574+0000 7f1591b3f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f158c15f3d0 0x7f158c14fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:45.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.574+0000 7f1591b3f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f158c15f3d0 0x7f158c14fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44540/0 (socket says 172.21.15.114:44540) 2024-04-28T13:08:45.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.574+0000 7f1591b3f640 1 -- 172.21.15.114:0/893874176 learned_addr learned my addr 172.21.15.114:0/893874176 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:45.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.574+0000 7f1592340640 1 --2- 172.21.15.114:0/893874176 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f158c0cf280 0x7f158c0d0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:45.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.574+0000 7f1592b41640 1 --2- 172.21.15.114:0/893874176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f158c162fb0 0x7f158c150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:45.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.574+0000 7f1591b3f640 1 -- 172.21.15.114:0/893874176 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f158c0cf280 msgr2=0x7f158c0d0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:45.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.574+0000 7f1591b3f640 1 --2- 172.21.15.114:0/893874176 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f158c0cf280 0x7f158c0d0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:45.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.574+0000 7f1591b3f640 1 -- 172.21.15.114:0/893874176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f158c162fb0 msgr2=0x7f158c150140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:45.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.574+0000 7f1591b3f640 1 --2- 172.21.15.114:0/893874176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f158c162fb0 0x7f158c150140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:45.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.574+0000 7f1591b3f640 1 -- 172.21.15.114:0/893874176 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f158c15fbe0 con 0x7f158c15f3d0 2024-04-28T13:08:45.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.574+0000 7f1591b3f640 1 --2- 172.21.15.114:0/893874176 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f158c15f3d0 0x7f158c14fc00 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f157c00e8a0 tx=0x7f157c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:45.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.574+0000 7f1582ffd640 1 -- 172.21.15.114:0/893874176 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157c017070 con 0x7f158c15f3d0 2024-04-28T13:08:45.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.574+0000 7f1582ffd640 1 -- 172.21.15.114:0/893874176 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f157c00c940 con 0x7f158c15f3d0 2024-04-28T13:08:45.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.575+0000 7f15945a4640 1 -- 172.21.15.114:0/893874176 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f158c15fe80 con 0x7f158c15f3d0 2024-04-28T13:08:45.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.575+0000 7f1582ffd640 1 -- 172.21.15.114:0/893874176 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157c00cd30 con 0x7f158c15f3d0 2024-04-28T13:08:45.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.575+0000 7f15945a4640 1 -- 172.21.15.114:0/893874176 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f158c160440 con 0x7f158c15f3d0 2024-04-28T13:08:45.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.575+0000 7f15945a4640 1 -- 172.21.15.114:0/893874176 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f158c06a3d0 con 0x7f158c15f3d0 2024-04-28T13:08:45.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.576+0000 7f1582ffd640 1 -- 172.21.15.114:0/893874176 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f157c01a070 con 0x7f158c15f3d0 2024-04-28T13:08:45.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.576+0000 7f1582ffd640 1 --2- 172.21.15.114:0/893874176 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f157006c980 0x7f157006ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:45.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.576+0000 7f1582ffd640 1 -- 172.21.15.114:0/893874176 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5609+0+0 (secure 0 0 0) 0x7f157c08b8b0 con 0x7f158c15f3d0 2024-04-28T13:08:45.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.576+0000 7f1592340640 1 --2- 172.21.15.114:0/893874176 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f157006c980 0x7f157006ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:45.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.577+0000 7f1592340640 1 --2- 172.21.15.114:0/893874176 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f157006c980 0x7f157006ee40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1584033000 tx=0x7f1584009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:45.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.581+0000 7f1582ffd640 1 -- 172.21.15.114:0/893874176 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f157c059790 con 0x7f158c15f3d0 2024-04-28T13:08:45.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:45.792+0000 7f15945a4640 1 -- 172.21.15.114:0/893874176 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f158c0d2310 con 0x7f158c15f3d0 2024-04-28T13:08:46.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.467+0000 7f1582ffd640 1 -- 172.21.15.114:0/893874176 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v18) ==== 172+0+0 (secure 0 0 0) 0x7f157c05da90 con 0x7f158c15f3d0 2024-04-28T13:08:46.468 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 6 and data pool 7 2024-04-28T13:08:46.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.470+0000 7f15945a4640 1 -- 172.21.15.114:0/893874176 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f157006c980 msgr2=0x7f157006ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:46.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.470+0000 7f15945a4640 1 --2- 172.21.15.114:0/893874176 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f157006c980 0x7f157006ee40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1584033000 tx=0x7f1584009000 comp rx=0 tx=0).stop 2024-04-28T13:08:46.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.470+0000 7f15945a4640 1 -- 172.21.15.114:0/893874176 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f158c15f3d0 msgr2=0x7f158c14fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:46.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.470+0000 7f15945a4640 1 --2- 172.21.15.114:0/893874176 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f158c15f3d0 0x7f158c14fc00 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f157c00e8a0 tx=0x7f157c00ed60 comp rx=0 tx=0).stop 2024-04-28T13:08:46.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.470+0000 7f15945a4640 1 -- 172.21.15.114:0/893874176 shutdown_connections 2024-04-28T13:08:46.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.470+0000 7f15945a4640 1 --2- 172.21.15.114:0/893874176 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f157006c980 0x7f157006ee40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:46.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.470+0000 7f15945a4640 1 --2- 172.21.15.114:0/893874176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f158c162fb0 0x7f158c150140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:46.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.470+0000 7f15945a4640 1 --2- 172.21.15.114:0/893874176 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f158c15f3d0 0x7f158c14fc00 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:46.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.470+0000 7f15945a4640 1 --2- 172.21.15.114:0/893874176 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f158c0cf280 0x7f158c0d0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:46.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.470+0000 7f15945a4640 1 -- 172.21.15.114:0/893874176 >> 172.21.15.114:0/893874176 conn(0x7f158c0d16b0 msgr2=0x7f158c06d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:46.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.471+0000 7f15945a4640 1 -- 172.21.15.114:0/893874176 shutdown_connections 2024-04-28T13:08:46.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.471+0000 7f15945a4640 1 -- 172.21.15.114:0/893874176 wait complete. 2024-04-28T13:08:46.495 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:08:46.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.592+0000 7f86eb504640 1 Processor -- start 2024-04-28T13:08:46.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.592+0000 7f86eb504640 1 -- start start 2024-04-28T13:08:46.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.593+0000 7f86eb504640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f86e415f410 0x7f86e40baaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:46.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.593+0000 7f86eb504640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f86e40b4380 0x7f86e40b8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:46.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.593+0000 7f86eb504640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86e40cff60 0x7f86e40d03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:46.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.593+0000 7f86eb504640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f86e40d3f10 con 0x7f86e415f410 2024-04-28T13:08:46.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.593+0000 7f86eb504640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f86e40b8840 con 0x7f86e40b4380 2024-04-28T13:08:46.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.593+0000 7f86eb504640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f86e40d3650 con 0x7f86e40cff60 2024-04-28T13:08:46.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.593+0000 7f86e92a0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f86e415f410 0x7f86e40baaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:46.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.593+0000 7f86e92a0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f86e415f410 0x7f86e40baaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44552/0 (socket says 172.21.15.114:44552) 2024-04-28T13:08:46.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.593+0000 7f86e92a0640 1 -- 172.21.15.114:0/3478460774 learned_addr learned my addr 172.21.15.114:0/3478460774 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:46.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.593+0000 7f86e8a9f640 1 --2- 172.21.15.114:0/3478460774 >> v2:172.21.15.134:3300/0 conn(0x7f86e40b4380 0x7f86e40b8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:46.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.593+0000 7f86e9aa1640 1 --2- 172.21.15.114:0/3478460774 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86e40cff60 0x7f86e40d03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:46.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.593+0000 7f86e92a0640 1 -- 172.21.15.114:0/3478460774 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86e40cff60 msgr2=0x7f86e40d03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:46.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.593+0000 7f86e92a0640 1 --2- 172.21.15.114:0/3478460774 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86e40cff60 0x7f86e40d03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:46.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.593+0000 7f86e92a0640 1 -- 172.21.15.114:0/3478460774 >> v2:172.21.15.134:3300/0 conn(0x7f86e40b4380 msgr2=0x7f86e40b8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:46.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.593+0000 7f86e92a0640 1 --2- 172.21.15.114:0/3478460774 >> v2:172.21.15.134:3300/0 conn(0x7f86e40b4380 0x7f86e40b8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:46.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.593+0000 7f86e92a0640 1 -- 172.21.15.114:0/3478460774 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e415f7f0 con 0x7f86e415f410 2024-04-28T13:08:46.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.594+0000 7f86e92a0640 1 --2- 172.21.15.114:0/3478460774 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86e415f410 0x7f86e40baaf0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f86e4162e50 tx=0x7f86e002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab4ef2f2eb48a68 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:46.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.594+0000 7f86dbfff640 1 -- 172.21.15.114:0/3478460774 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e0036070 con 0x7f86e415f410 2024-04-28T13:08:46.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.594+0000 7f86dbfff640 1 -- 172.21.15.114:0/3478460774 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86e0031600 con 0x7f86e415f410 2024-04-28T13:08:46.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.594+0000 7f86dbfff640 1 -- 172.21.15.114:0/3478460774 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e00319d0 con 0x7f86e415f410 2024-04-28T13:08:46.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.595+0000 7f86eb504640 1 -- 172.21.15.114:0/3478460774 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86e415f410 msgr2=0x7f86e40baaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:46.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.595+0000 7f86eb504640 1 --2- 172.21.15.114:0/3478460774 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86e415f410 0x7f86e40baaf0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f86e4162e50 tx=0x7f86e002a730 comp rx=0 tx=0).stop 2024-04-28T13:08:46.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.595+0000 7f86eb504640 1 -- 172.21.15.114:0/3478460774 shutdown_connections 2024-04-28T13:08:46.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.595+0000 7f86eb504640 1 --2- 172.21.15.114:0/3478460774 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86e40cff60 0x7f86e40d03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:46.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.595+0000 7f86eb504640 1 --2- 172.21.15.114:0/3478460774 >> v2:172.21.15.134:3300/0 conn(0x7f86e40b4380 0x7f86e40b8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:46.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.595+0000 7f86eb504640 1 --2- 172.21.15.114:0/3478460774 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86e415f410 0x7f86e40baaf0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:46.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.595+0000 7f86eb504640 1 -- 172.21.15.114:0/3478460774 >> 172.21.15.114:0/3478460774 conn(0x7f86e40633a0 msgr2=0x7f86e40d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:46.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.595+0000 7f86eb504640 1 -- 172.21.15.114:0/3478460774 shutdown_connections 2024-04-28T13:08:46.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.595+0000 7f86eb504640 1 -- 172.21.15.114:0/3478460774 wait complete. 2024-04-28T13:08:46.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.596+0000 7f86eb504640 1 Processor -- start 2024-04-28T13:08:46.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.596+0000 7f86eb504640 1 -- start start 2024-04-28T13:08:46.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.597+0000 7f86eb504640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86e40b4380 0x7f86e415e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:46.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.597+0000 7f86eb504640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86e40cff60 0x7f86e40cd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:46.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.597+0000 7f86eb504640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86e415f410 0x7f86e414ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:46.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.597+0000 7f86eb504640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f86e40d38c0 con 0x7f86e40cff60 2024-04-28T13:08:46.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.597+0000 7f86eb504640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f86e40d2570 con 0x7f86e415f410 2024-04-28T13:08:46.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.597+0000 7f86eb504640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f86e40d3ba0 con 0x7f86e40b4380 2024-04-28T13:08:46.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.597+0000 7f86e8a9f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86e40cff60 0x7f86e40cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:46.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.597+0000 7f86e8a9f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86e40cff60 0x7f86e40cd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44554/0 (socket says 172.21.15.114:44554) 2024-04-28T13:08:46.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.597+0000 7f86e8a9f640 1 -- 172.21.15.114:0/1222768850 learned_addr learned my addr 172.21.15.114:0/1222768850 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:46.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.597+0000 7f86e9aa1640 1 --2- 172.21.15.114:0/1222768850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86e415f410 0x7f86e414ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:46.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.597+0000 7f86e92a0640 1 --2- 172.21.15.114:0/1222768850 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86e40b4380 0x7f86e415e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:46.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.597+0000 7f86e8a9f640 1 -- 172.21.15.114:0/1222768850 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86e40b4380 msgr2=0x7f86e415e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:46.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.597+0000 7f86e8a9f640 1 --2- 172.21.15.114:0/1222768850 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86e40b4380 0x7f86e415e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:46.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.597+0000 7f86e8a9f640 1 -- 172.21.15.114:0/1222768850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86e415f410 msgr2=0x7f86e414ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:46.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.597+0000 7f86e8a9f640 1 --2- 172.21.15.114:0/1222768850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86e415f410 0x7f86e414ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:46.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.597+0000 7f86e8a9f640 1 -- 172.21.15.114:0/1222768850 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e40cdaa0 con 0x7f86e40cff60 2024-04-28T13:08:46.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.597+0000 7f86e9aa1640 1 --2- 172.21.15.114:0/1222768850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86e415f410 0x7f86e414ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:46.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.597+0000 7f86e8a9f640 1 --2- 172.21.15.114:0/1222768850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86e40cff60 0x7f86e40cd560 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f86d400d800 tx=0x7f86d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:46.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.597+0000 7f86d9ffb640 1 -- 172.21.15.114:0/1222768850 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d4018020 con 0x7f86e40cff60 2024-04-28T13:08:46.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.597+0000 7f86d9ffb640 1 -- 172.21.15.114:0/1222768850 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86d4009640 con 0x7f86e40cff60 2024-04-28T13:08:46.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.597+0000 7f86eb504640 1 -- 172.21.15.114:0/1222768850 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86e414efb0 con 0x7f86e40cff60 2024-04-28T13:08:46.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.597+0000 7f86d9ffb640 1 -- 172.21.15.114:0/1222768850 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d4009a10 con 0x7f86e40cff60 2024-04-28T13:08:46.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.598+0000 7f86eb504640 1 -- 172.21.15.114:0/1222768850 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86e40ce030 con 0x7f86e40cff60 2024-04-28T13:08:46.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.598+0000 7f86eb504640 1 -- 172.21.15.114:0/1222768850 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86e406a3d0 con 0x7f86e40cff60 2024-04-28T13:08:46.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.599+0000 7f86d9ffb640 1 -- 172.21.15.114:0/1222768850 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f86d401b020 con 0x7f86e40cff60 2024-04-28T13:08:46.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.599+0000 7f86d9ffb640 1 --2- 172.21.15.114:0/1222768850 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f86c806c980 0x7f86c806ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:46.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.600+0000 7f86e92a0640 1 --2- 172.21.15.114:0/1222768850 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f86c806c980 0x7f86c806ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:46.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.600+0000 7f86d9ffb640 1 -- 172.21.15.114:0/1222768850 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f86d408bd10 con 0x7f86e40cff60 2024-04-28T13:08:46.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.600+0000 7f86e92a0640 1 --2- 172.21.15.114:0/1222768850 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f86c806c980 0x7f86c806ee40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f86e0033000 tx=0x7f86e0009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:46.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.604+0000 7f86d9ffb640 1 -- 172.21.15.114:0/1222768850 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f86d4022030 con 0x7f86e40cff60 2024-04-28T13:08:46.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.781+0000 7f86eb504640 1 -- 172.21.15.114:0/1222768850 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f86e40bb210 con 0x7f86e40cff60 2024-04-28T13:08:46.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.782+0000 7f86d9ffb640 1 -- 172.21.15.114:0/1222768850 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16674 (secure 0 0 0) 0x7f86d405a1e0 con 0x7f86e40cff60 2024-04-28T13:08:46.783 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:46.783 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":45,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:08:45.794444+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-28T13:08:44.012998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-28T13:08:44.754935+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:08:46.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.784+0000 7f86eb504640 1 -- 172.21.15.114:0/1222768850 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f86c806c980 msgr2=0x7f86c806ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:46.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.784+0000 7f86eb504640 1 --2- 172.21.15.114:0/1222768850 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f86c806c980 0x7f86c806ee40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f86e0033000 tx=0x7f86e0009000 comp rx=0 tx=0).stop 2024-04-28T13:08:46.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.784+0000 7f86eb504640 1 -- 172.21.15.114:0/1222768850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86e40cff60 msgr2=0x7f86e40cd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:46.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.784+0000 7f86eb504640 1 --2- 172.21.15.114:0/1222768850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86e40cff60 0x7f86e40cd560 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f86d400d800 tx=0x7f86d400dcc0 comp rx=0 tx=0).stop 2024-04-28T13:08:46.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.784+0000 7f86eb504640 1 -- 172.21.15.114:0/1222768850 shutdown_connections 2024-04-28T13:08:46.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.784+0000 7f86eb504640 1 --2- 172.21.15.114:0/1222768850 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f86c806c980 0x7f86c806ee40 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:46.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.784+0000 7f86eb504640 1 --2- 172.21.15.114:0/1222768850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86e415f410 0x7f86e414ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:46.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.784+0000 7f86eb504640 1 --2- 172.21.15.114:0/1222768850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86e40cff60 0x7f86e40cd560 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:46.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.784+0000 7f86eb504640 1 --2- 172.21.15.114:0/1222768850 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86e40b4380 0x7f86e415e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:46.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.784+0000 7f86eb504640 1 -- 172.21.15.114:0/1222768850 >> 172.21.15.114:0/1222768850 conn(0x7f86e40633a0 msgr2=0x7f86e4161a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:46.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.784+0000 7f86eb504640 1 -- 172.21.15.114:0/1222768850 shutdown_connections 2024-04-28T13:08:46.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.784+0000 7f86eb504640 1 -- 172.21.15.114:0/1222768850 wait complete. 2024-04-28T13:08:46.796 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:08:46.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.891+0000 7fc2fc2c4640 1 Processor -- start 2024-04-28T13:08:46.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.891+0000 7fc2fc2c4640 1 -- start start 2024-04-28T13:08:46.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.892+0000 7fc2fc2c4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc2f40b73d0 0x7fc2f40d27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:46.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.892+0000 7fc2fc2c4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc2f4070710 0x7fc2f4070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:46.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.892+0000 7fc2fc2c4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2f4072830 con 0x7fc2f4071b90 2024-04-28T13:08:46.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.892+0000 7fc2fc2c4640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fc2f4072b10 con 0x7fc2f40b73d0 2024-04-28T13:08:46.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.892+0000 7fc2fc2c4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc2f40d1d10 con 0x7fc2f4070710 2024-04-28T13:08:46.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.893+0000 7fc2fa060640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc2f40b73d0 0x7fc2f40d27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:46.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.893+0000 7fc2fa060640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc2f40b73d0 0x7fc2f40d27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44568/0 (socket says 172.21.15.114:44568) 2024-04-28T13:08:46.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.893+0000 7fc2fa060640 1 -- 172.21.15.114:0/3572119612 learned_addr learned my addr 172.21.15.114:0/3572119612 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:46.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.893+0000 7fc2f985f640 1 --2- 172.21.15.114:0/3572119612 >> v2:172.21.15.134:3300/0 conn(0x7fc2f4070710 0x7fc2f4070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:46.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.893+0000 7fc2fa060640 1 -- 172.21.15.114:0/3572119612 >> v2:172.21.15.134:3300/0 conn(0x7fc2f4070710 msgr2=0x7fc2f4070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:46.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.893+0000 7fc2fa060640 1 --2- 172.21.15.114:0/3572119612 >> v2:172.21.15.134:3300/0 conn(0x7fc2f4070710 0x7fc2f4070ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:46.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.893+0000 7fc2fa060640 1 -- 172.21.15.114:0/3572119612 >> v1:172.21.15.114:6789/0 conn(0x7fc2f4071b90 legacy=0x7fc2f4071fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:46.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.893+0000 7fc2fa060640 1 -- 172.21.15.114:0/3572119612 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f40d1ff0 con 0x7fc2f40b73d0 2024-04-28T13:08:46.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.893+0000 7fc2f985f640 1 --2- 172.21.15.114:0/3572119612 >> v2:172.21.15.134:3300/0 conn(0x7fc2f4070710 0x7fc2f4070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:46.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.893+0000 7fc2fa060640 1 --2- 172.21.15.114:0/3572119612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f40b73d0 0x7fc2f40d27f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4063dc0 tx=0x7fc2f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea9dbc1508dadfdd server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:46.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.894+0000 7fc2f905e640 1 -- 172.21.15.114:0/3572119612 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0037070 con 0x7fc2f40b73d0 2024-04-28T13:08:46.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.894+0000 7fc2f905e640 1 -- 172.21.15.114:0/3572119612 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f0032440 con 0x7fc2f40b73d0 2024-04-28T13:08:46.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.894+0000 7fc2f905e640 1 -- 172.21.15.114:0/3572119612 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0032810 con 0x7fc2f40b73d0 2024-04-28T13:08:46.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.894+0000 7fc2fc2c4640 1 -- 172.21.15.114:0/3572119612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f40b73d0 msgr2=0x7fc2f40d27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:46.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.894+0000 7fc2fc2c4640 1 --2- 172.21.15.114:0/3572119612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f40b73d0 0x7fc2f40d27f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4063dc0 tx=0x7fc2f002a270 comp rx=0 tx=0).stop 2024-04-28T13:08:46.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.894+0000 7fc2fc2c4640 1 -- 172.21.15.114:0/3572119612 shutdown_connections 2024-04-28T13:08:46.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.894+0000 7fc2fc2c4640 1 --2- 172.21.15.114:0/3572119612 >> v2:172.21.15.134:3300/0 conn(0x7fc2f4070710 0x7fc2f4070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:46.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.894+0000 7fc2fc2c4640 1 --2- 172.21.15.114:0/3572119612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f40b73d0 0x7fc2f40d27f0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:46.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.894+0000 7fc2fc2c4640 1 -- 172.21.15.114:0/3572119612 >> 172.21.15.114:0/3572119612 conn(0x7fc2f40b4c60 msgr2=0x7fc2f40b5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:46.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.894+0000 7fc2fc2c4640 1 -- 172.21.15.114:0/3572119612 shutdown_connections 2024-04-28T13:08:46.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.894+0000 7fc2fc2c4640 1 -- 172.21.15.114:0/3572119612 wait complete. 2024-04-28T13:08:46.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.895+0000 7fc2fc2c4640 1 Processor -- start 2024-04-28T13:08:46.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.895+0000 7fc2fc2c4640 1 -- start start 2024-04-28T13:08:46.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.896+0000 7fc2fc2c4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2f4070710 0x7fc2f41439b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:46.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.896+0000 7fc2fc2c4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2f4071b90 0x7fc2f4152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:46.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.896+0000 7fc2fc2c4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f40b73d0 0x7fc2f415c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:46.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.896+0000 7fc2fc2c4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f40d2eb0 con 0x7fc2f40b73d0 2024-04-28T13:08:46.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.896+0000 7fc2fc2c4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f40d2d30 con 0x7fc2f4070710 2024-04-28T13:08:46.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.896+0000 7fc2fc2c4640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc2f40b77b0 con 0x7fc2f4071b90 2024-04-28T13:08:46.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.896+0000 7fc2fa861640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f40b73d0 0x7fc2f415c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:46.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.896+0000 7fc2fa861640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f40b73d0 0x7fc2f415c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44580/0 (socket says 172.21.15.114:44580) 2024-04-28T13:08:46.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.896+0000 7fc2fa861640 1 -- 172.21.15.114:0/70434328 learned_addr learned my addr 172.21.15.114:0/70434328 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:46.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.896+0000 7fc2fa060640 1 --2- 172.21.15.114:0/70434328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2f4070710 0x7fc2f41439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:46.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.896+0000 7fc2f985f640 1 --2- 172.21.15.114:0/70434328 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2f4071b90 0x7fc2f4152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:46.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.896+0000 7fc2fa861640 1 -- 172.21.15.114:0/70434328 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2f4071b90 msgr2=0x7fc2f4152ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:46.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.896+0000 7fc2fa861640 1 --2- 172.21.15.114:0/70434328 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2f4071b90 0x7fc2f4152ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:46.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.896+0000 7fc2fa861640 1 -- 172.21.15.114:0/70434328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2f4070710 msgr2=0x7fc2f41439b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:46.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.896+0000 7fc2fa861640 1 --2- 172.21.15.114:0/70434328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2f4070710 0x7fc2f41439b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:46.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.896+0000 7fc2fa861640 1 -- 172.21.15.114:0/70434328 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f4150df0 con 0x7fc2f40b73d0 2024-04-28T13:08:46.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.896+0000 7fc2f985f640 1 --2- 172.21.15.114:0/70434328 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2f4071b90 0x7fc2f4152ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:46.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.897+0000 7fc2fa861640 1 --2- 172.21.15.114:0/70434328 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f40b73d0 0x7fc2f415c270 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec00c7a0 tx=0x7fc2ec00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:46.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.897+0000 7fc2eaffd640 1 -- 172.21.15.114:0/70434328 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec003b70 con 0x7fc2f40b73d0 2024-04-28T13:08:46.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.897+0000 7fc2eaffd640 1 -- 172.21.15.114:0/70434328 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2ec003d30 con 0x7fc2f40b73d0 2024-04-28T13:08:46.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.897+0000 7fc2fc2c4640 1 -- 172.21.15.114:0/70434328 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2f414fc70 con 0x7fc2f40b73d0 2024-04-28T13:08:46.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.897+0000 7fc2eaffd640 1 -- 172.21.15.114:0/70434328 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec00aa90 con 0x7fc2f40b73d0 2024-04-28T13:08:46.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.897+0000 7fc2fc2c4640 1 -- 172.21.15.114:0/70434328 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2f4151390 con 0x7fc2f40b73d0 2024-04-28T13:08:46.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.898+0000 7fc2fc2c4640 1 -- 172.21.15.114:0/70434328 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2f406a3d0 con 0x7fc2f40b73d0 2024-04-28T13:08:46.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.898+0000 7fc2eaffd640 1 -- 172.21.15.114:0/70434328 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7fc2ec00ac30 con 0x7fc2f40b73d0 2024-04-28T13:08:46.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.899+0000 7fc2eaffd640 1 --2- 172.21.15.114:0/70434328 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc2d806c980 0x7fc2d806ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:46.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.899+0000 7fc2fa060640 1 --2- 172.21.15.114:0/70434328 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc2d806c980 0x7fc2d806ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:46.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.899+0000 7fc2eaffd640 1 -- 172.21.15.114:0/70434328 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fc2ec08b9c0 con 0x7fc2f40b73d0 2024-04-28T13:08:46.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.899+0000 7fc2fa060640 1 --2- 172.21.15.114:0/70434328 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc2d806c980 0x7fc2d806ee40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0034000 tx=0x7fc2f002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:46.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:46.903+0000 7fc2eaffd640 1 -- 172.21.15.114:0/70434328 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc2ec059e90 con 0x7fc2f40b73d0 2024-04-28T13:08:47.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.076+0000 7fc2fc2c4640 1 -- 172.21.15.114:0/70434328 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc2f4071460 con 0x7fc2f40b73d0 2024-04-28T13:08:47.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.077+0000 7fc2eaffd640 1 -- 172.21.15.114:0/70434328 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16674 (secure 0 0 0) 0x7fc2ec059790 con 0x7fc2f40b73d0 2024-04-28T13:08:47.078 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:47.078 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":45,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:08:45.794444+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-28T13:08:44.012998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-28T13:08:44.754935+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:08:47.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.079+0000 7fc2fc2c4640 1 -- 172.21.15.114:0/70434328 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc2d806c980 msgr2=0x7fc2d806ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:47.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.079+0000 7fc2fc2c4640 1 --2- 172.21.15.114:0/70434328 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc2d806c980 0x7fc2d806ee40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0034000 tx=0x7fc2f002e000 comp rx=0 tx=0).stop 2024-04-28T13:08:47.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.079+0000 7fc2fc2c4640 1 -- 172.21.15.114:0/70434328 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f40b73d0 msgr2=0x7fc2f415c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:47.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.079+0000 7fc2fc2c4640 1 --2- 172.21.15.114:0/70434328 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f40b73d0 0x7fc2f415c270 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec00c7a0 tx=0x7fc2ec00cc60 comp rx=0 tx=0).stop 2024-04-28T13:08:47.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.079+0000 7fc2fc2c4640 1 -- 172.21.15.114:0/70434328 shutdown_connections 2024-04-28T13:08:47.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.079+0000 7fc2fc2c4640 1 --2- 172.21.15.114:0/70434328 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f40b73d0 0x7fc2f415c270 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:47.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.079+0000 7fc2fc2c4640 1 --2- 172.21.15.114:0/70434328 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2f4071b90 0x7fc2f4152ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:47.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.079+0000 7fc2fc2c4640 1 --2- 172.21.15.114:0/70434328 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fc2d806c980 0x7fc2d806ee40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:47.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.079+0000 7fc2fc2c4640 1 --2- 172.21.15.114:0/70434328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2f4070710 0x7fc2f41439b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:47.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.079+0000 7fc2fc2c4640 1 -- 172.21.15.114:0/70434328 >> 172.21.15.114:0/70434328 conn(0x7fc2f40b4c60 msgr2=0x7fc2f40b4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:47.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.079+0000 7fc2fc2c4640 1 -- 172.21.15.114:0/70434328 shutdown_connections 2024-04-28T13:08:47.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.079+0000 7fc2fc2c4640 1 -- 172.21.15.114:0/70434328 wait complete. 2024-04-28T13:08:47.091 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-28T13:08:47.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.190+0000 7f285f9f7640 1 Processor -- start 2024-04-28T13:08:47.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.190+0000 7f285f9f7640 1 -- start start 2024-04-28T13:08:47.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.191+0000 7f285f9f7640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28580b4850 0x7f28580b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:47.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.191+0000 7f285f9f7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f28580732b0 0x7f28580cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:47.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.191+0000 7f285f9f7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28580cedc0 con 0x7f2858072e30 2024-04-28T13:08:47.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.191+0000 7f285f9f7640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f28580b5170 con 0x7f28580732b0 2024-04-28T13:08:47.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.191+0000 7f285f9f7640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2858073720 con 0x7f28580b4850 2024-04-28T13:08:47.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.191+0000 7f285cf92640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2858072e30 0x7f28580cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52328/0 (socket says 172.21.15.114:52328) 2024-04-28T13:08:47.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.191+0000 7f285cf92640 1 -- 172.21.15.114:0/1013311114 learned_addr learned my addr 172.21.15.114:0/1013311114 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:47.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.191+0000 7f285df94640 1 --2- 172.21.15.114:0/1013311114 >> v2:172.21.15.134:3300/0 conn(0x7f28580732b0 0x7f28580cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:47.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.191+0000 7f284ffff640 1 -- 172.21.15.114:0/1013311114 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1705688486 0 0) 0x7f28580cedc0 con 0x7f2858072e30 2024-04-28T13:08:47.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.191+0000 7f285d793640 1 --2- 172.21.15.114:0/1013311114 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28580b4850 0x7f28580b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:47.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.191+0000 7f284ffff640 1 -- 172.21.15.114:0/1013311114 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2844003520 con 0x7f2858072e30 2024-04-28T13:08:47.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.191+0000 7f284ffff640 1 -- 172.21.15.114:0/1013311114 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2917092184 0 0) 0x7f2844003520 con 0x7f2858072e30 2024-04-28T13:08:47.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.191+0000 7f284ffff640 1 -- 172.21.15.114:0/1013311114 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28580b4850 msgr2=0x7f28580b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:47.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.191+0000 7f284ffff640 1 --2- 172.21.15.114:0/1013311114 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28580b4850 0x7f28580b4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:47.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.191+0000 7f284ffff640 1 -- 172.21.15.114:0/1013311114 >> v2:172.21.15.134:3300/0 conn(0x7f28580732b0 msgr2=0x7f28580cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:47.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.191+0000 7f284ffff640 1 --2- 172.21.15.114:0/1013311114 >> v2:172.21.15.134:3300/0 conn(0x7f28580732b0 0x7f28580cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:47.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.191+0000 7f284ffff640 1 -- 172.21.15.114:0/1013311114 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2858073cc0 con 0x7f2858072e30 2024-04-28T13:08:47.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.191+0000 7f284ffff640 1 -- 172.21.15.114:0/1013311114 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f2848001670 con 0x7f2858072e30 2024-04-28T13:08:47.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.191+0000 7f284ffff640 1 -- 172.21.15.114:0/1013311114 >> v1:172.21.15.114:6789/0 conn(0x7f2858072e30 legacy=0x7f28580cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:47.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.191+0000 7f284ffff640 1 --2- 172.21.15.114:0/1013311114 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28580b4850 0x7f28440039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:47.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.191+0000 7f284ffff640 1 --2- 172.21.15.114:0/1013311114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2844003f30 0x7f2844004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:47.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.191+0000 7f284ffff640 1 --2- 172.21.15.114:0/1013311114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2844004d40 0x7f28440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:47.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.191+0000 7f284ffff640 1 -- 172.21.15.114:0/1013311114 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f28580b5170 con 0x7f2844003f30 2024-04-28T13:08:47.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.191+0000 7f284ffff640 1 -- 172.21.15.114:0/1013311114 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2858073720 con 0x7f2844004d40 2024-04-28T13:08:47.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.191+0000 7f284ffff640 1 -- 172.21.15.114:0/1013311114 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f284400ba10 con 0x7f28580b4850 2024-04-28T13:08:47.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.191+0000 7f285df94640 1 --2- 172.21.15.114:0/1013311114 >> v2:172.21.15.134:3300/0 conn(0x7f28580732b0 0x7f28580cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:08:47.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.192+0000 7f285cf92640 1 --2- 172.21.15.114:0/1013311114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2844003f30 0x7f2844004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:47.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.192+0000 7f285d793640 1 --2- 172.21.15.114:0/1013311114 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28580b4850 0x7f28440039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:47.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.192+0000 7f285df94640 1 --2- 172.21.15.114:0/1013311114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2844004d40 0x7f28440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:47.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.192+0000 7f285cf92640 1 -- 172.21.15.114:0/1013311114 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28580b4850 msgr2=0x7f28440039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:47.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.192+0000 7f285cf92640 1 --2- 172.21.15.114:0/1013311114 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28580b4850 0x7f28440039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:47.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.192+0000 7f285cf92640 1 -- 172.21.15.114:0/1013311114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2844004d40 msgr2=0x7f28440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:47.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.192+0000 7f285cf92640 1 --2- 172.21.15.114:0/1013311114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2844004d40 0x7f28440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:47.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.192+0000 7f285cf92640 1 -- 172.21.15.114:0/1013311114 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2844003520 con 0x7f2844003f30 2024-04-28T13:08:47.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.192+0000 7f285df94640 1 --2- 172.21.15.114:0/1013311114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2844004d40 0x7f28440051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:47.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.192+0000 7f285cf92640 1 --2- 172.21.15.114:0/1013311114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2844003f30 0x7f2844004800 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f284800c240 tx=0x7f2844005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa320c7dcede908b server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:47.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.193+0000 7f284ffff640 1 -- 172.21.15.114:0/1013311114 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2848007d50 con 0x7f2844003f30 2024-04-28T13:08:47.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.193+0000 7f284ffff640 1 -- 172.21.15.114:0/1013311114 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f284802e070 con 0x7f2844003f30 2024-04-28T13:08:47.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.193+0000 7f284ffff640 1 -- 172.21.15.114:0/1013311114 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2848005d30 con 0x7f2844003f30 2024-04-28T13:08:47.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.193+0000 7f285f9f7640 1 -- 172.21.15.114:0/1013311114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2844003f30 msgr2=0x7f2844004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:47.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.193+0000 7f285f9f7640 1 --2- 172.21.15.114:0/1013311114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2844003f30 0x7f2844004800 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f284800c240 tx=0x7f2844005830 comp rx=0 tx=0).stop 2024-04-28T13:08:47.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.193+0000 7f285df94640 1 -- 172.21.15.114:0/1013311114 reap_dead start 2024-04-28T13:08:47.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.193+0000 7f285f9f7640 1 -- 172.21.15.114:0/1013311114 shutdown_connections 2024-04-28T13:08:47.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.193+0000 7f285f9f7640 1 -- 172.21.15.114:0/1013311114 >> 172.21.15.114:0/1013311114 conn(0x7f285806c980 msgr2=0x7f28580b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:47.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.193+0000 7f285f9f7640 1 -- 172.21.15.114:0/1013311114 shutdown_connections 2024-04-28T13:08:47.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.193+0000 7f285f9f7640 1 -- 172.21.15.114:0/1013311114 wait complete. 2024-04-28T13:08:47.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.194+0000 7f285f9f7640 1 Processor -- start 2024-04-28T13:08:47.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.194+0000 7f285f9f7640 1 -- start start 2024-04-28T13:08:47.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.195+0000 7f285f9f7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2844003f30 0x7f28581f4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:47.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.195+0000 7f285f9f7640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f285806f1f0 0x7f285806f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:47.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.195+0000 7f285f9f7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28581e5440 0x7f28581e58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:47.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.195+0000 7f285f9f7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2858074560 con 0x7f2844003f30 2024-04-28T13:08:47.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.195+0000 7f285f9f7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2858074280 con 0x7f28581e5440 2024-04-28T13:08:47.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.195+0000 7f285f9f7640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f285806e3e0 con 0x7f285806f1f0 2024-04-28T13:08:47.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.195+0000 7f285d793640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2844003f30 0x7f28581f4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:47.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.195+0000 7f285d793640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2844003f30 0x7f28581f4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44600/0 (socket says 172.21.15.114:44600) 2024-04-28T13:08:47.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.195+0000 7f285d793640 1 -- 172.21.15.114:0/4198134812 learned_addr learned my addr 172.21.15.114:0/4198134812 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:47.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.195+0000 7f285cf92640 1 --2- 172.21.15.114:0/4198134812 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f285806f1f0 0x7f285806f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:47.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.195+0000 7f285df94640 1 --2- 172.21.15.114:0/4198134812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28581e5440 0x7f28581e58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:47.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.195+0000 7f285d793640 1 -- 172.21.15.114:0/4198134812 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f285806f1f0 msgr2=0x7f285806f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:47.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.195+0000 7f285d793640 1 --2- 172.21.15.114:0/4198134812 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f285806f1f0 0x7f285806f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:47.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.195+0000 7f285d793640 1 -- 172.21.15.114:0/4198134812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28581e5440 msgr2=0x7f28581e58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:47.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.195+0000 7f285d793640 1 --2- 172.21.15.114:0/4198134812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28581e5440 0x7f28581e58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:47.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.195+0000 7f285d793640 1 -- 172.21.15.114:0/4198134812 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28581f8830 con 0x7f2844003f30 2024-04-28T13:08:47.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.195+0000 7f285cf92640 1 --2- 172.21.15.114:0/4198134812 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f285806f1f0 0x7f285806f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:47.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.196+0000 7f285d793640 1 --2- 172.21.15.114:0/4198134812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2844003f30 0x7f28581f4a90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f2854011a00 tx=0x7f2854011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:47.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.196+0000 7f284dffb640 1 -- 172.21.15.114:0/4198134812 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285400faf0 con 0x7f2844003f30 2024-04-28T13:08:47.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.196+0000 7f284dffb640 1 -- 172.21.15.114:0/4198134812 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f285400fc90 con 0x7f2844003f30 2024-04-28T13:08:47.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.196+0000 7f285f9f7640 1 -- 172.21.15.114:0/4198134812 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28581f8b10 con 0x7f2844003f30 2024-04-28T13:08:47.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.196+0000 7f284dffb640 1 -- 172.21.15.114:0/4198134812 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2854014440 con 0x7f2844003f30 2024-04-28T13:08:47.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.196+0000 7f285f9f7640 1 -- 172.21.15.114:0/4198134812 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28581f90d0 con 0x7f2844003f30 2024-04-28T13:08:47.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.197+0000 7f285f9f7640 1 -- 172.21.15.114:0/4198134812 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f285806a3d0 con 0x7f2844003f30 2024-04-28T13:08:47.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.197+0000 7f284dffb640 1 -- 172.21.15.114:0/4198134812 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f2854012040 con 0x7f2844003f30 2024-04-28T13:08:47.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.198+0000 7f284dffb640 1 --2- 172.21.15.114:0/4198134812 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f283c06c980 0x7f283c06ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:47.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.198+0000 7f284dffb640 1 -- 172.21.15.114:0/4198134812 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f285408c010 con 0x7f2844003f30 2024-04-28T13:08:47.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.198+0000 7f285cf92640 1 --2- 172.21.15.114:0/4198134812 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f283c06c980 0x7f283c06ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:47.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.198+0000 7f285cf92640 1 --2- 172.21.15.114:0/4198134812 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f283c06c980 0x7f283c06ee40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2848033000 tx=0x7f284802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:47.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.202+0000 7f284dffb640 1 -- 172.21.15.114:0/4198134812 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2854019030 con 0x7f2844003f30 2024-04-28T13:08:47.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.413+0000 7f285f9f7640 1 -- 172.21.15.114:0/4198134812 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f28581e5e00 con 0x7f2844003f30 2024-04-28T13:08:47.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.476+0000 7f284dffb640 1 -- 172.21.15.114:0/4198134812 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v19) ==== 118+0+0 (secure 0 0 0) 0x7f285405a4e0 con 0x7f2844003f30 2024-04-28T13:08:47.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.479+0000 7f285f9f7640 1 -- 172.21.15.114:0/4198134812 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f283c06c980 msgr2=0x7f283c06ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:47.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.479+0000 7f285f9f7640 1 --2- 172.21.15.114:0/4198134812 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f283c06c980 0x7f283c06ee40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2848033000 tx=0x7f284802e000 comp rx=0 tx=0).stop 2024-04-28T13:08:47.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.479+0000 7f285f9f7640 1 -- 172.21.15.114:0/4198134812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2844003f30 msgr2=0x7f28581f4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:47.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.479+0000 7f285f9f7640 1 --2- 172.21.15.114:0/4198134812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2844003f30 0x7f28581f4a90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f2854011a00 tx=0x7f2854011ec0 comp rx=0 tx=0).stop 2024-04-28T13:08:47.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.479+0000 7f285f9f7640 1 -- 172.21.15.114:0/4198134812 shutdown_connections 2024-04-28T13:08:47.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.479+0000 7f285f9f7640 1 --2- 172.21.15.114:0/4198134812 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f283c06c980 0x7f283c06ee40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:47.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.479+0000 7f285f9f7640 1 --2- 172.21.15.114:0/4198134812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28581e5440 0x7f28581e58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:47.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.479+0000 7f285f9f7640 1 --2- 172.21.15.114:0/4198134812 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f285806f1f0 0x7f285806f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:47.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.479+0000 7f285f9f7640 1 --2- 172.21.15.114:0/4198134812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2844003f30 0x7f28581f4a90 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:47.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.479+0000 7f285f9f7640 1 -- 172.21.15.114:0/4198134812 >> 172.21.15.114:0/4198134812 conn(0x7f285806c980 msgr2=0x7f28580b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:47.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.479+0000 7f285f9f7640 1 -- 172.21.15.114:0/4198134812 shutdown_connections 2024-04-28T13:08:47.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.479+0000 7f285f9f7640 1 -- 172.21.15.114:0/4198134812 wait complete. 2024-04-28T13:08:47.492 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-28T13:08:47.492 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-28T13:08:47.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.590+0000 7f9fa5023640 1 Processor -- start 2024-04-28T13:08:47.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.590+0000 7f9fa5023640 1 -- start start 2024-04-28T13:08:47.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.590+0000 7f9fa5023640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9fa00ce9a0 0x7f9fa00b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:47.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.590+0000 7f9fa5023640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fa0162f00 0x7f9fa0070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:47.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.590+0000 7f9fa5023640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fa0163390 con 0x7f9fa006c350 2024-04-28T13:08:47.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.590+0000 7f9fa5023640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f9fa0163ea0 con 0x7f9fa00ce9a0 2024-04-28T13:08:47.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.590+0000 7f9fa5023640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f9fa0163600 con 0x7f9fa0162f00 2024-04-28T13:08:47.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.591+0000 7f9f97fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9fa00ce9a0 0x7f9fa00b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:47.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.591+0000 7f9f97fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9fa00ce9a0 0x7f9fa00b59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44602/0 (socket says 172.21.15.114:44602) 2024-04-28T13:08:47.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.591+0000 7f9f97fff640 1 -- 172.21.15.114:0/3625867192 learned_addr learned my addr 172.21.15.114:0/3625867192 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:47.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.591+0000 7f9f9f59e640 1 --2- 172.21.15.114:0/3625867192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fa0162f00 0x7f9fa0070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:47.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.591+0000 7f9f97fff640 1 -- 172.21.15.114:0/3625867192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fa0162f00 msgr2=0x7f9fa0070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:47.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.591+0000 7f9f97fff640 1 --2- 172.21.15.114:0/3625867192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fa0162f00 0x7f9fa0070e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:47.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.591+0000 7f9f97fff640 1 -- 172.21.15.114:0/3625867192 >> v1:172.21.15.134:6789/0 conn(0x7f9fa006c350 legacy=0x7f9fa006c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:47.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.591+0000 7f9f97fff640 1 -- 172.21.15.114:0/3625867192 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa01638e0 con 0x7f9fa00ce9a0 2024-04-28T13:08:47.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.592+0000 7f9f97fff640 1 --2- 172.21.15.114:0/3625867192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fa00ce9a0 0x7f9fa00b59a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f9f88009870 tx=0x7f9f8802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a487f827235624e server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:47.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.592+0000 7f9f9e59c640 1 -- 172.21.15.114:0/3625867192 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f88037070 con 0x7f9fa00ce9a0 2024-04-28T13:08:47.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.592+0000 7f9f9e59c640 1 -- 172.21.15.114:0/3625867192 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f88032440 con 0x7f9fa00ce9a0 2024-04-28T13:08:47.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.592+0000 7f9f9e59c640 1 -- 172.21.15.114:0/3625867192 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f88032810 con 0x7f9fa00ce9a0 2024-04-28T13:08:47.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.592+0000 7f9fa5023640 1 -- 172.21.15.114:0/3625867192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fa00ce9a0 msgr2=0x7f9fa00b59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:47.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.592+0000 7f9fa5023640 1 --2- 172.21.15.114:0/3625867192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fa00ce9a0 0x7f9fa00b59a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f9f88009870 tx=0x7f9f8802a1c0 comp rx=0 tx=0).stop 2024-04-28T13:08:47.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.592+0000 7f9fa5023640 1 -- 172.21.15.114:0/3625867192 shutdown_connections 2024-04-28T13:08:47.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.592+0000 7f9fa5023640 1 --2- 172.21.15.114:0/3625867192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fa0162f00 0x7f9fa0070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:47.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.592+0000 7f9fa5023640 1 --2- 172.21.15.114:0/3625867192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fa00ce9a0 0x7f9fa00b59a0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:47.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.592+0000 7f9fa5023640 1 -- 172.21.15.114:0/3625867192 >> 172.21.15.114:0/3625867192 conn(0x7f9fa006f4f0 msgr2=0x7f9fa006f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:47.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.592+0000 7f9fa5023640 1 -- 172.21.15.114:0/3625867192 shutdown_connections 2024-04-28T13:08:47.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.592+0000 7f9fa5023640 1 -- 172.21.15.114:0/3625867192 wait complete. 2024-04-28T13:08:47.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.594+0000 7f9fa5023640 1 Processor -- start 2024-04-28T13:08:47.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.594+0000 7f9fa5023640 1 -- start start 2024-04-28T13:08:47.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.594+0000 7f9fa5023640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fa006c350 0x7f9fa015efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:47.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.594+0000 7f9fa5023640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fa00ce9a0 0x7f9fa00b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:47.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.594+0000 7f9fa5023640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fa0162f00 0x7f9fa015f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:47.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.594+0000 7f9fa5023640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa0148f40 con 0x7f9fa0162f00 2024-04-28T13:08:47.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.594+0000 7f9fa5023640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa0148dc0 con 0x7f9fa006c350 2024-04-28T13:08:47.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.594+0000 7f9fa5023640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f9fa0071370 con 0x7f9fa00ce9a0 2024-04-28T13:08:47.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.595+0000 7f9f9f59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fa0162f00 0x7f9fa015f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:47.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.595+0000 7f9f9f59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fa0162f00 0x7f9fa015f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44608/0 (socket says 172.21.15.114:44608) 2024-04-28T13:08:47.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.595+0000 7f9f9f59e640 1 -- 172.21.15.114:0/1723823415 learned_addr learned my addr 172.21.15.114:0/1723823415 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:47.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.595+0000 7f9f97fff640 1 --2- 172.21.15.114:0/1723823415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fa00ce9a0 0x7f9fa00b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:47.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.595+0000 7f9f9ed9d640 1 --2- 172.21.15.114:0/1723823415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fa006c350 0x7f9fa015efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:47.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.595+0000 7f9f9f59e640 1 -- 172.21.15.114:0/1723823415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fa00ce9a0 msgr2=0x7f9fa00b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:47.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.595+0000 7f9f9f59e640 1 --2- 172.21.15.114:0/1723823415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fa00ce9a0 0x7f9fa00b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:47.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.595+0000 7f9f9f59e640 1 -- 172.21.15.114:0/1723823415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fa006c350 msgr2=0x7f9fa015efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:47.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.595+0000 7f9f9f59e640 1 --2- 172.21.15.114:0/1723823415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fa006c350 0x7f9fa015efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:47.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.595+0000 7f9f9f59e640 1 -- 172.21.15.114:0/1723823415 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa00b3320 con 0x7f9fa0162f00 2024-04-28T13:08:47.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.595+0000 7f9f9f59e640 1 --2- 172.21.15.114:0/1723823415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fa0162f00 0x7f9fa015f890 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9f98009d30 tx=0x7f9f9800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:47.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.595+0000 7f9f977fe640 1 -- 172.21.15.114:0/1723823415 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f98018020 con 0x7f9fa0162f00 2024-04-28T13:08:47.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.595+0000 7f9f977fe640 1 -- 172.21.15.114:0/1723823415 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f98014480 con 0x7f9fa0162f00 2024-04-28T13:08:47.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.595+0000 7f9fa5023640 1 -- 172.21.15.114:0/1723823415 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa00b3600 con 0x7f9fa0162f00 2024-04-28T13:08:47.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.595+0000 7f9f977fe640 1 -- 172.21.15.114:0/1723823415 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f98014870 con 0x7f9fa0162f00 2024-04-28T13:08:47.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.595+0000 7f9fa5023640 1 -- 172.21.15.114:0/1723823415 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa00b3bc0 con 0x7f9fa0162f00 2024-04-28T13:08:47.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.596+0000 7f9fa5023640 1 -- 172.21.15.114:0/1723823415 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fa006a3d0 con 0x7f9fa0162f00 2024-04-28T13:08:47.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.597+0000 7f9f977fe640 1 -- 172.21.15.114:0/1723823415 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f9f98005d10 con 0x7f9fa0162f00 2024-04-28T13:08:47.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.597+0000 7f9f977fe640 1 --2- 172.21.15.114:0/1723823415 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9f8006c980 0x7f9f8006ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:47.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.597+0000 7f9f977fe640 1 -- 172.21.15.114:0/1723823415 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f9f9808c520 con 0x7f9fa0162f00 2024-04-28T13:08:47.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.597+0000 7f9f9ed9d640 1 --2- 172.21.15.114:0/1723823415 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9f8006c980 0x7f9f8006ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:47.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.598+0000 7f9f9ed9d640 1 --2- 172.21.15.114:0/1723823415 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9f8006c980 0x7f9f8006ee40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9f90001780 tx=0x7f9f90009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:47.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.602+0000 7f9f977fe640 1 -- 172.21.15.114:0/1723823415 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9f98022070 con 0x7f9fa0162f00 2024-04-28T13:08:47.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:47.814+0000 7f9fa5023640 1 -- 172.21.15.114:0/1723823415 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f9fa0073810 con 0x7f9fa0162f00 2024-04-28T13:08:48.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.486+0000 7f9f977fe640 1 -- 172.21.15.114:0/1723823415 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v20) ==== 122+0+0 (secure 0 0 0) 0x7f9f98010040 con 0x7f9fa0162f00 2024-04-28T13:08:48.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.488+0000 7f9fa5023640 1 -- 172.21.15.114:0/1723823415 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9f8006c980 msgr2=0x7f9f8006ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:48.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.488+0000 7f9fa5023640 1 --2- 172.21.15.114:0/1723823415 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9f8006c980 0x7f9f8006ee40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9f90001780 tx=0x7f9f90009040 comp rx=0 tx=0).stop 2024-04-28T13:08:48.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.488+0000 7f9fa5023640 1 -- 172.21.15.114:0/1723823415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fa0162f00 msgr2=0x7f9fa015f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:48.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.488+0000 7f9fa5023640 1 --2- 172.21.15.114:0/1723823415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fa0162f00 0x7f9fa015f890 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9f98009d30 tx=0x7f9f9800c490 comp rx=0 tx=0).stop 2024-04-28T13:08:48.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.489+0000 7f9fa5023640 1 -- 172.21.15.114:0/1723823415 shutdown_connections 2024-04-28T13:08:48.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.489+0000 7f9fa5023640 1 --2- 172.21.15.114:0/1723823415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fa0162f00 0x7f9fa015f890 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:48.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.489+0000 7f9fa5023640 1 --2- 172.21.15.114:0/1723823415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fa00ce9a0 0x7f9fa00b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:48.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.489+0000 7f9fa5023640 1 --2- 172.21.15.114:0/1723823415 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f9f8006c980 0x7f9f8006ee40 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:48.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.489+0000 7f9fa5023640 1 --2- 172.21.15.114:0/1723823415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fa006c350 0x7f9fa015efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:48.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.489+0000 7f9fa5023640 1 -- 172.21.15.114:0/1723823415 >> 172.21.15.114:0/1723823415 conn(0x7f9fa006f4f0 msgr2=0x7f9fa0147130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:48.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.489+0000 7f9fa5023640 1 -- 172.21.15.114:0/1723823415 shutdown_connections 2024-04-28T13:08:48.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.489+0000 7f9fa5023640 1 -- 172.21.15.114:0/1723823415 wait complete. 2024-04-28T13:08:48.501 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-28T13:08:48.501 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-28T13:08:48.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.598+0000 7f8402f2c640 1 Processor -- start 2024-04-28T13:08:48.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.598+0000 7f8402f2c640 1 -- start start 2024-04-28T13:08:48.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.599+0000 7f8402f2c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83fc0cda00 0x7f83fc0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:48.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.599+0000 7f8402f2c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f83fc1601d0 0x7f83fc155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:48.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.599+0000 7f8402f2c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83fc0d2be0 con 0x7f83fc0d07b0 2024-04-28T13:08:48.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.599+0000 7f8402f2c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f83fc160980 con 0x7f83fc1601d0 2024-04-28T13:08:48.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.599+0000 7f8402f2c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f83fc1606a0 con 0x7f83fc0cda00 2024-04-28T13:08:48.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.599+0000 7f83fbfff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f83fc0d07b0 0x7f83fc15fac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52336/0 (socket says 172.21.15.114:52336) 2024-04-28T13:08:48.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.599+0000 7f83fbfff640 1 -- 172.21.15.114:0/2039135867 learned_addr learned my addr 172.21.15.114:0/2039135867 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:48.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.599+0000 7f8400cc8640 1 --2- 172.21.15.114:0/2039135867 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83fc0cda00 0x7f83fc0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:48.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.599+0000 7f84014c9640 1 --2- 172.21.15.114:0/2039135867 >> v2:172.21.15.134:3300/0 conn(0x7f83fc1601d0 0x7f83fc155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:48.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.600+0000 7f83fb7fe640 1 -- 172.21.15.114:0/2039135867 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2339582164 0 0) 0x7f83fc0d2be0 con 0x7f83fc0d07b0 2024-04-28T13:08:48.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.600+0000 7f83fb7fe640 1 -- 172.21.15.114:0/2039135867 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83e4003520 con 0x7f83fc0d07b0 2024-04-28T13:08:48.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.600+0000 7f83fb7fe640 1 -- 172.21.15.114:0/2039135867 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 565117386 0 0) 0x7f83e4003520 con 0x7f83fc0d07b0 2024-04-28T13:08:48.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.600+0000 7f83fb7fe640 1 -- 172.21.15.114:0/2039135867 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83fc0cda00 msgr2=0x7f83fc0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:48.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.600+0000 7f83fb7fe640 1 --2- 172.21.15.114:0/2039135867 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83fc0cda00 0x7f83fc0d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:48.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.600+0000 7f83fb7fe640 1 -- 172.21.15.114:0/2039135867 >> v2:172.21.15.134:3300/0 conn(0x7f83fc1601d0 msgr2=0x7f83fc155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:48.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.600+0000 7f83fb7fe640 1 --2- 172.21.15.114:0/2039135867 >> v2:172.21.15.134:3300/0 conn(0x7f83fc1601d0 0x7f83fc155fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:48.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.600+0000 7f83fb7fe640 1 -- 172.21.15.114:0/2039135867 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83fc0cf7b0 con 0x7f83fc0d07b0 2024-04-28T13:08:48.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.600+0000 7f83fb7fe640 1 -- 172.21.15.114:0/2039135867 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f83f0001670 con 0x7f83fc0d07b0 2024-04-28T13:08:48.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.600+0000 7f8400cc8640 1 --2- 172.21.15.114:0/2039135867 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83fc0cda00 0x7f83fc0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:08:48.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.600+0000 7f83fb7fe640 1 -- 172.21.15.114:0/2039135867 >> v1:172.21.15.114:6789/0 conn(0x7f83fc0d07b0 legacy=0x7f83fc15fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:48.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.600+0000 7f83fb7fe640 1 --2- 172.21.15.114:0/2039135867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83e40039b0 0x7f83e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:48.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.600+0000 7f83fb7fe640 1 --2- 172.21.15.114:0/2039135867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83e4004800 0x7f83e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:48.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.600+0000 7f83fb7fe640 1 --2- 172.21.15.114:0/2039135867 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83fc0cda00 0x7f83e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:48.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.600+0000 7f83fb7fe640 1 -- 172.21.15.114:0/2039135867 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f83fc160980 con 0x7f83e40039b0 2024-04-28T13:08:48.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.600+0000 7f83fb7fe640 1 -- 172.21.15.114:0/2039135867 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f83fc1606a0 con 0x7f83e4004800 2024-04-28T13:08:48.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.600+0000 7f83fb7fe640 1 -- 172.21.15.114:0/2039135867 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f83e400b9c0 con 0x7f83fc0cda00 2024-04-28T13:08:48.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.600+0000 7f84014c9640 1 --2- 172.21.15.114:0/2039135867 >> v2:172.21.15.134:3300/0 conn(0x7f83fc1601d0 0x7f83fc155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:08:48.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.600+0000 7f8400cc8640 1 --2- 172.21.15.114:0/2039135867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83e40039b0 0x7f83e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:48.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.600+0000 7f83fbfff640 1 --2- 172.21.15.114:0/2039135867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83e4004800 0x7f83e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:48.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.600+0000 7f84014c9640 1 --2- 172.21.15.114:0/2039135867 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83fc0cda00 0x7f83e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:48.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.600+0000 7f8400cc8640 1 -- 172.21.15.114:0/2039135867 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83fc0cda00 msgr2=0x7f83e40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:48.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.600+0000 7f8400cc8640 1 --2- 172.21.15.114:0/2039135867 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83fc0cda00 0x7f83e40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:48.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.600+0000 7f8400cc8640 1 -- 172.21.15.114:0/2039135867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83e4004800 msgr2=0x7f83e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:48.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.600+0000 7f8400cc8640 1 --2- 172.21.15.114:0/2039135867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83e4004800 0x7f83e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:48.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.600+0000 7f8400cc8640 1 -- 172.21.15.114:0/2039135867 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e4003520 con 0x7f83e40039b0 2024-04-28T13:08:48.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.600+0000 7f83fbfff640 1 --2- 172.21.15.114:0/2039135867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83e4004800 0x7f83e4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:48.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.601+0000 7f8400cc8640 1 --2- 172.21.15.114:0/2039135867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83e40039b0 0x7f83e4003dd0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f83ec009c90 tx=0x7f83e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a59b23224215e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:48.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.601+0000 7f83fb7fe640 1 -- 172.21.15.114:0/2039135867 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ec036070 con 0x7f83e40039b0 2024-04-28T13:08:48.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.601+0000 7f83fb7fe640 1 -- 172.21.15.114:0/2039135867 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83ec031400 con 0x7f83e40039b0 2024-04-28T13:08:48.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.601+0000 7f83fb7fe640 1 -- 172.21.15.114:0/2039135867 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ec009860 con 0x7f83e40039b0 2024-04-28T13:08:48.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.601+0000 7f8402f2c640 1 -- 172.21.15.114:0/2039135867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83e40039b0 msgr2=0x7f83e4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:48.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.601+0000 7f8402f2c640 1 --2- 172.21.15.114:0/2039135867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83e40039b0 0x7f83e4003dd0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f83ec009c90 tx=0x7f83e4005830 comp rx=0 tx=0).stop 2024-04-28T13:08:48.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.601+0000 7f84014c9640 1 -- 172.21.15.114:0/2039135867 reap_dead start 2024-04-28T13:08:48.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.602+0000 7f8402f2c640 1 -- 172.21.15.114:0/2039135867 shutdown_connections 2024-04-28T13:08:48.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.602+0000 7f8402f2c640 1 -- 172.21.15.114:0/2039135867 >> 172.21.15.114:0/2039135867 conn(0x7f83fc0706f0 msgr2=0x7f83fc070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:48.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.602+0000 7f8402f2c640 1 -- 172.21.15.114:0/2039135867 shutdown_connections 2024-04-28T13:08:48.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.602+0000 7f8402f2c640 1 -- 172.21.15.114:0/2039135867 wait complete. 2024-04-28T13:08:48.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.603+0000 7f8402f2c640 1 Processor -- start 2024-04-28T13:08:48.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.603+0000 7f8402f2c640 1 -- start start 2024-04-28T13:08:48.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.604+0000 7f8402f2c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83e40039b0 0x7f83fc0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:48.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.604+0000 7f8402f2c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83fc1f9230 0x7f83fc0c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:48.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.604+0000 7f8402f2c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83fc0c9890 0x7f83fc146200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:48.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.604+0000 7f8402f2c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f83fc0cdde0 con 0x7f83fc0c9890 2024-04-28T13:08:48.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.604+0000 7f8402f2c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f83fc0cfd70 con 0x7f83fc1f9230 2024-04-28T13:08:48.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.604+0000 7f8402f2c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f83fc0cdf60 con 0x7f83e40039b0 2024-04-28T13:08:48.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.604+0000 7f84014c9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83fc0c9890 0x7f83fc146200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:48.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.604+0000 7f84014c9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83fc0c9890 0x7f83fc146200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44618/0 (socket says 172.21.15.114:44618) 2024-04-28T13:08:48.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.604+0000 7f84014c9640 1 -- 172.21.15.114:0/3113644261 learned_addr learned my addr 172.21.15.114:0/3113644261 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:48.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.604+0000 7f83fbfff640 1 --2- 172.21.15.114:0/3113644261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83fc1f9230 0x7f83fc0c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:48.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.604+0000 7f8400cc8640 1 --2- 172.21.15.114:0/3113644261 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83e40039b0 0x7f83fc0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:48.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.604+0000 7f84014c9640 1 -- 172.21.15.114:0/3113644261 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83e40039b0 msgr2=0x7f83fc0ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:48.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.604+0000 7f84014c9640 1 --2- 172.21.15.114:0/3113644261 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83e40039b0 0x7f83fc0ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:48.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.604+0000 7f84014c9640 1 -- 172.21.15.114:0/3113644261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83fc1f9230 msgr2=0x7f83fc0c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:48.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.604+0000 7f84014c9640 1 --2- 172.21.15.114:0/3113644261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83fc1f9230 0x7f83fc0c9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:48.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.604+0000 7f84014c9640 1 -- 172.21.15.114:0/3113644261 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83fc146ea0 con 0x7f83fc0c9890 2024-04-28T13:08:48.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.604+0000 7f83fbfff640 1 --2- 172.21.15.114:0/3113644261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83fc1f9230 0x7f83fc0c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:48.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.604+0000 7f84014c9640 1 --2- 172.21.15.114:0/3113644261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83fc0c9890 0x7f83fc146200 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0743e0 tx=0x7f83f4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:48.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.604+0000 7f83f97fa640 1 -- 172.21.15.114:0/3113644261 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f4011e00 con 0x7f83fc0c9890 2024-04-28T13:08:48.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.604+0000 7f83f97fa640 1 -- 172.21.15.114:0/3113644261 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83f401b070 con 0x7f83fc0c9890 2024-04-28T13:08:48.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.604+0000 7f8402f2c640 1 -- 172.21.15.114:0/3113644261 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83fc1f8750 con 0x7f83fc0c9890 2024-04-28T13:08:48.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.604+0000 7f83f97fa640 1 -- 172.21.15.114:0/3113644261 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f4003990 con 0x7f83fc0c9890 2024-04-28T13:08:48.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.604+0000 7f8402f2c640 1 -- 172.21.15.114:0/3113644261 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83fc1f8d10 con 0x7f83fc0c9890 2024-04-28T13:08:48.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.605+0000 7f8402f2c640 1 -- 172.21.15.114:0/3113644261 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83fc06a3d0 con 0x7f83fc0c9890 2024-04-28T13:08:48.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.606+0000 7f83f97fa640 1 -- 172.21.15.114:0/3113644261 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f83f4005d10 con 0x7f83fc0c9890 2024-04-28T13:08:48.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.606+0000 7f83f97fa640 1 --2- 172.21.15.114:0/3113644261 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f83e806c9b0 0x7f83e806ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:48.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.606+0000 7f83f97fa640 1 -- 172.21.15.114:0/3113644261 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f83f408c2c0 con 0x7f83fc0c9890 2024-04-28T13:08:48.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.606+0000 7f8400cc8640 1 --2- 172.21.15.114:0/3113644261 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f83e806c9b0 0x7f83e806ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:48.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.607+0000 7f8400cc8640 1 --2- 172.21.15.114:0/3113644261 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f83e806c9b0 0x7f83e806ee70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f83ec033000 tx=0x7f83ec008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:48.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.610+0000 7f83f97fa640 1 -- 172.21.15.114:0/3113644261 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f83f4025020 con 0x7f83fc0c9890 2024-04-28T13:08:48.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.823+0000 7f8402f2c640 1 -- 172.21.15.114:0/3113644261 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83fc1f8ee0 con 0x7f83fc0c9890 2024-04-28T13:08:48.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.823+0000 7f83f97fa640 1 -- 172.21.15.114:0/3113644261 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5190 (secure 0 0 0) 0x7f83f405a680 con 0x7f83fc0c9890 2024-04-28T13:08:48.824 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:48.824 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4946,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/3532702893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3532702893},{"type":"v1","addr":"172.21.15.114:6836","nonce":3532702893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":4955,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/819388915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":819388915},{"type":"v1","addr":"172.21.15.134:6834","nonce":819388915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5215,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2410765352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2410765352},{"type":"v1","addr":"172.21.15.114:6837","nonce":2410765352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-28T13:08:45.794409+0000","modified":"2024-04-28T13:08:47.816406+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5601":{"gid":5601,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/3334515618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":3334515618},{"type":"v1","addr":"172.21.15.134:6835","nonce":3334515618}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5601,"qdb_cluster":[5601]},"id":3}]} 2024-04-28T13:08:48.824 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 20 2024-04-28T13:08:48.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.825+0000 7f8402f2c640 1 -- 172.21.15.114:0/3113644261 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f83e806c9b0 msgr2=0x7f83e806ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:48.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.825+0000 7f8402f2c640 1 --2- 172.21.15.114:0/3113644261 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f83e806c9b0 0x7f83e806ee70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f83ec033000 tx=0x7f83ec008030 comp rx=0 tx=0).stop 2024-04-28T13:08:48.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.825+0000 7f8402f2c640 1 -- 172.21.15.114:0/3113644261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83fc0c9890 msgr2=0x7f83fc146200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:48.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.825+0000 7f8402f2c640 1 --2- 172.21.15.114:0/3113644261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83fc0c9890 0x7f83fc146200 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0743e0 tx=0x7f83f4009f90 comp rx=0 tx=0).stop 2024-04-28T13:08:48.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.825+0000 7f8402f2c640 1 -- 172.21.15.114:0/3113644261 shutdown_connections 2024-04-28T13:08:48.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.825+0000 7f8402f2c640 1 --2- 172.21.15.114:0/3113644261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83fc0c9890 0x7f83fc146200 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:48.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.825+0000 7f8402f2c640 1 --2- 172.21.15.114:0/3113644261 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f83e806c9b0 0x7f83e806ee70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:48.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.825+0000 7f8402f2c640 1 --2- 172.21.15.114:0/3113644261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83fc1f9230 0x7f83fc0c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:48.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.825+0000 7f8402f2c640 1 --2- 172.21.15.114:0/3113644261 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83e40039b0 0x7f83fc0ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:48.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.825+0000 7f8402f2c640 1 -- 172.21.15.114:0/3113644261 >> 172.21.15.114:0/3113644261 conn(0x7f83fc0706f0 msgr2=0x7f83fc0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:48.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.825+0000 7f8402f2c640 1 -- 172.21.15.114:0/3113644261 shutdown_connections 2024-04-28T13:08:48.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.825+0000 7f8402f2c640 1 -- 172.21.15.114:0/3113644261 wait complete. 2024-04-28T13:08:48.837 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-28T13:08:48.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.932+0000 7f72d3647640 1 Processor -- start 2024-04-28T13:08:48.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.933+0000 7f72d3647640 1 -- start start 2024-04-28T13:08:48.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.933+0000 7f72d3647640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f72cc15f410 0x7f72cc0baaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:48.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.933+0000 7f72d3647640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72cc0b4380 0x7f72cc0b8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:48.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.933+0000 7f72d3647640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f72cc0cff60 0x7f72cc0d03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:48.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.933+0000 7f72d3647640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f72cc0d3f10 con 0x7f72cc0cff60 2024-04-28T13:08:48.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.933+0000 7f72d3647640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f72cc0b8840 con 0x7f72cc15f410 2024-04-28T13:08:48.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.933+0000 7f72d3647640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f72cc0d3650 con 0x7f72cc0b4380 2024-04-28T13:08:48.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.934+0000 7f72d1be4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f72cc0cff60 0x7f72cc0d03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:48.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.934+0000 7f72d1be4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f72cc0cff60 0x7f72cc0d03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44634/0 (socket says 172.21.15.114:44634) 2024-04-28T13:08:48.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.934+0000 7f72d1be4640 1 -- 172.21.15.114:0/3872072354 learned_addr learned my addr 172.21.15.114:0/3872072354 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:48.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.934+0000 7f72d0be2640 1 --2- 172.21.15.114:0/3872072354 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72cc0b4380 0x7f72cc0b8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:48.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.934+0000 7f72d13e3640 1 --2- 172.21.15.114:0/3872072354 >> v2:172.21.15.134:3300/0 conn(0x7f72cc15f410 0x7f72cc0baaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:48.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.934+0000 7f72d1be4640 1 -- 172.21.15.114:0/3872072354 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72cc0b4380 msgr2=0x7f72cc0b8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:48.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.934+0000 7f72d1be4640 1 --2- 172.21.15.114:0/3872072354 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72cc0b4380 0x7f72cc0b8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:48.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.934+0000 7f72d1be4640 1 -- 172.21.15.114:0/3872072354 >> v2:172.21.15.134:3300/0 conn(0x7f72cc15f410 msgr2=0x7f72cc0baaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:48.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.934+0000 7f72d1be4640 1 --2- 172.21.15.114:0/3872072354 >> v2:172.21.15.134:3300/0 conn(0x7f72cc15f410 0x7f72cc0baaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:48.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.934+0000 7f72d1be4640 1 -- 172.21.15.114:0/3872072354 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72cc15f7f0 con 0x7f72cc0cff60 2024-04-28T13:08:48.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.934+0000 7f72d13e3640 1 --2- 172.21.15.114:0/3872072354 >> v2:172.21.15.134:3300/0 conn(0x7f72cc15f410 0x7f72cc0baaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:48.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.935+0000 7f72d1be4640 1 --2- 172.21.15.114:0/3872072354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72cc0cff60 0x7f72cc0d03f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0d3580 tx=0x7f72c402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a90e87434df507 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:48.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.935+0000 7f72c3fff640 1 -- 172.21.15.114:0/3872072354 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c4036070 con 0x7f72cc0cff60 2024-04-28T13:08:48.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.935+0000 7f72c3fff640 1 -- 172.21.15.114:0/3872072354 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72c4031600 con 0x7f72cc0cff60 2024-04-28T13:08:48.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.935+0000 7f72c3fff640 1 -- 172.21.15.114:0/3872072354 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c40319d0 con 0x7f72cc0cff60 2024-04-28T13:08:48.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.935+0000 7f72d3647640 1 -- 172.21.15.114:0/3872072354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72cc0cff60 msgr2=0x7f72cc0d03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:48.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.935+0000 7f72d3647640 1 --2- 172.21.15.114:0/3872072354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72cc0cff60 0x7f72cc0d03f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0d3580 tx=0x7f72c402a730 comp rx=0 tx=0).stop 2024-04-28T13:08:48.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.935+0000 7f72d3647640 1 -- 172.21.15.114:0/3872072354 shutdown_connections 2024-04-28T13:08:48.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.935+0000 7f72d3647640 1 --2- 172.21.15.114:0/3872072354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72cc0cff60 0x7f72cc0d03f0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:48.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.935+0000 7f72d3647640 1 --2- 172.21.15.114:0/3872072354 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72cc0b4380 0x7f72cc0b8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:48.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.935+0000 7f72d3647640 1 --2- 172.21.15.114:0/3872072354 >> v2:172.21.15.134:3300/0 conn(0x7f72cc15f410 0x7f72cc0baaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:48.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.935+0000 7f72d3647640 1 -- 172.21.15.114:0/3872072354 >> 172.21.15.114:0/3872072354 conn(0x7f72cc0633a0 msgr2=0x7f72cc0d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:48.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.935+0000 7f72d3647640 1 -- 172.21.15.114:0/3872072354 shutdown_connections 2024-04-28T13:08:48.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.935+0000 7f72d3647640 1 -- 172.21.15.114:0/3872072354 wait complete. 2024-04-28T13:08:48.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.937+0000 7f72d3647640 1 Processor -- start 2024-04-28T13:08:48.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.937+0000 7f72d3647640 1 -- start start 2024-04-28T13:08:48.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.937+0000 7f72d3647640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72cc0b4380 0x7f72cc0ac630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:48.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.937+0000 7f72d3647640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72cc0cff60 0x7f72cc161600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:48.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.937+0000 7f72d3647640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72cc15f410 0x7f72cc153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:48.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.937+0000 7f72d3647640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f72cc0d38c0 con 0x7f72cc0cff60 2024-04-28T13:08:48.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.937+0000 7f72d3647640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f72cc0d2570 con 0x7f72cc15f410 2024-04-28T13:08:48.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.937+0000 7f72d3647640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f72cc0d3ba0 con 0x7f72cc0b4380 2024-04-28T13:08:48.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.937+0000 7f72d0be2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72cc0cff60 0x7f72cc161600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:48.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.937+0000 7f72d0be2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72cc0cff60 0x7f72cc161600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44636/0 (socket says 172.21.15.114:44636) 2024-04-28T13:08:48.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.937+0000 7f72d0be2640 1 -- 172.21.15.114:0/1158324533 learned_addr learned my addr 172.21.15.114:0/1158324533 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:48.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.938+0000 7f72d1be4640 1 --2- 172.21.15.114:0/1158324533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72cc15f410 0x7f72cc153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:48.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.938+0000 7f72d13e3640 1 --2- 172.21.15.114:0/1158324533 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72cc0b4380 0x7f72cc0ac630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:48.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.938+0000 7f72d0be2640 1 -- 172.21.15.114:0/1158324533 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72cc0b4380 msgr2=0x7f72cc0ac630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:48.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.938+0000 7f72d0be2640 1 --2- 172.21.15.114:0/1158324533 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72cc0b4380 0x7f72cc0ac630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:48.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.938+0000 7f72d0be2640 1 -- 172.21.15.114:0/1158324533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72cc15f410 msgr2=0x7f72cc153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:48.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.938+0000 7f72d0be2640 1 --2- 172.21.15.114:0/1158324533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72cc15f410 0x7f72cc153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:48.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.938+0000 7f72d0be2640 1 -- 172.21.15.114:0/1158324533 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72cc153cc0 con 0x7f72cc0cff60 2024-04-28T13:08:48.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.938+0000 7f72d13e3640 1 --2- 172.21.15.114:0/1158324533 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72cc0b4380 0x7f72cc0ac630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:48.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.938+0000 7f72d0be2640 1 --2- 172.21.15.114:0/1158324533 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72cc0cff60 0x7f72cc161600 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f72bc00e870 tx=0x7f72bc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:48.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.938+0000 7f72c1ffb640 1 -- 172.21.15.114:0/1158324533 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72bc017070 con 0x7f72cc0cff60 2024-04-28T13:08:48.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.938+0000 7f72c1ffb640 1 -- 172.21.15.114:0/1158324533 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72bc00ee60 con 0x7f72cc0cff60 2024-04-28T13:08:48.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.938+0000 7f72d3647640 1 -- 172.21.15.114:0/1158324533 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72cc0acd30 con 0x7f72cc0cff60 2024-04-28T13:08:48.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.938+0000 7f72c1ffb640 1 -- 172.21.15.114:0/1158324533 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72bc00cb80 con 0x7f72cc0cff60 2024-04-28T13:08:48.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.938+0000 7f72d3647640 1 -- 172.21.15.114:0/1158324533 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72cc0ad2f0 con 0x7f72cc0cff60 2024-04-28T13:08:48.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.939+0000 7f72d3647640 1 -- 172.21.15.114:0/1158324533 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72cc161b40 con 0x7f72cc0cff60 2024-04-28T13:08:48.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.940+0000 7f72c1ffb640 1 -- 172.21.15.114:0/1158324533 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f72bc01a070 con 0x7f72cc0cff60 2024-04-28T13:08:48.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.940+0000 7f72c1ffb640 1 --2- 172.21.15.114:0/1158324533 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f72b006c980 0x7f72b006ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:48.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.940+0000 7f72c1ffb640 1 -- 172.21.15.114:0/1158324533 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f72bc08bc60 con 0x7f72cc0cff60 2024-04-28T13:08:48.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.940+0000 7f72d13e3640 1 --2- 172.21.15.114:0/1158324533 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f72b006c980 0x7f72b006ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:48.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.941+0000 7f72d13e3640 1 --2- 172.21.15.114:0/1158324533 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f72b006c980 0x7f72b006ee40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f72c8006fd0 tx=0x7f72c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:48.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:48.945+0000 7f72c1ffb640 1 -- 172.21.15.114:0/1158324533 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f72bc059ae0 con 0x7f72cc0cff60 2024-04-28T13:08:49.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.118+0000 7f72d3647640 1 -- 172.21.15.114:0/1158324533 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72cc0d2020 con 0x7f72cc0cff60 2024-04-28T13:08:49.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.119+0000 7f72c1ffb640 1 -- 172.21.15.114:0/1158324533 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16661 (secure 0 0 0) 0x7f72bc05dde0 con 0x7f72cc0cff60 2024-04-28T13:08:49.120 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:49.120 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":46,"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","created":"2024-04-28T13:07:00.624951+0000","modified":"2024-04-28T13:08:47.476454+0000","last_up_change":"2024-04-28T13:07:12.767100+0000","last_in_change":"2024-04-28T13:07:03.729802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-28T13:07:14.721860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-28T13:08:44.012998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-28T13:08:44.754935+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ca919e-5c7b-4e90-997a-0e3cc1c774c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6805","nonce":1115116056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6809","nonce":1115116056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6815","nonce":1115116056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1115116056},{"type":"v1","addr":"172.21.15.114:6813","nonce":1115116056}]},"public_addr":"172.21.15.114:6805/1115116056","cluster_addr":"172.21.15.114:6809/1115116056","heartbeat_back_addr":"172.21.15.114:6815/1115116056","heartbeat_front_addr":"172.21.15.114:6813/1115116056","state":["exists","up"]},{"osd":1,"uuid":"5192cc15-7cf4-43b2-a57b-77207a8c4201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6817","nonce":2936162808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6819","nonce":2936162808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6823","nonce":2936162808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2936162808},{"type":"v1","addr":"172.21.15.114:6821","nonce":2936162808}]},"public_addr":"172.21.15.114:6817/2936162808","cluster_addr":"172.21.15.114:6819/2936162808","heartbeat_back_addr":"172.21.15.114:6823/2936162808","heartbeat_front_addr":"172.21.15.114:6821/2936162808","state":["exists","up"]},{"osd":2,"uuid":"a73196a7-2ecb-42c6-9b37-ff7927fcf8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1255181515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6827","nonce":1255181515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6831","nonce":1255181515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1255181515},{"type":"v1","addr":"172.21.15.114:6829","nonce":1255181515}]},"public_addr":"172.21.15.114:6825/1255181515","cluster_addr":"172.21.15.114:6827/1255181515","heartbeat_back_addr":"172.21.15.114:6831/1255181515","heartbeat_front_addr":"172.21.15.114:6829/1255181515","state":["exists","up"]},{"osd":3,"uuid":"40509c3a-36c0-4349-a224-c535be2c2a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6801","nonce":2142391188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6804","nonce":2142391188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6811","nonce":2142391188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2142391188},{"type":"v1","addr":"172.21.15.114:6808","nonce":2142391188}]},"public_addr":"172.21.15.114:6801/2142391188","cluster_addr":"172.21.15.114:6804/2142391188","heartbeat_back_addr":"172.21.15.114:6811/2142391188","heartbeat_front_addr":"172.21.15.114:6808/2142391188","state":["exists","up"]},{"osd":4,"uuid":"234d6f2f-d39a-41f2-a50b-012ad966201a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6801","nonce":3315097167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6805","nonce":3315097167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6813","nonce":3315097167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":3315097167},{"type":"v1","addr":"172.21.15.134:6809","nonce":3315097167}]},"public_addr":"172.21.15.134:6801/3315097167","cluster_addr":"172.21.15.134:6805/3315097167","heartbeat_back_addr":"172.21.15.134:6813/3315097167","heartbeat_front_addr":"172.21.15.134:6809/3315097167","state":["exists","up"]},{"osd":5,"uuid":"baa42689-53c8-457b-b5ef-205595a5e47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6825","nonce":2503413832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6827","nonce":2503413832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6831","nonce":2503413832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2503413832},{"type":"v1","addr":"172.21.15.134:6829","nonce":2503413832}]},"public_addr":"172.21.15.134:6825/2503413832","cluster_addr":"172.21.15.134:6827/2503413832","heartbeat_back_addr":"172.21.15.134:6831/2503413832","heartbeat_front_addr":"172.21.15.134:6829/2503413832","state":["exists","up"]},{"osd":6,"uuid":"d15e8a86-6e84-491b-baca-10147cf3cfa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6817","nonce":1909762070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6819","nonce":1909762070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6823","nonce":1909762070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1909762070},{"type":"v1","addr":"172.21.15.134:6821","nonce":1909762070}]},"public_addr":"172.21.15.134:6817/1909762070","cluster_addr":"172.21.15.134:6819/1909762070","heartbeat_back_addr":"172.21.15.134:6823/1909762070","heartbeat_front_addr":"172.21.15.134:6821/1909762070","state":["exists","up"]},{"osd":7,"uuid":"9e421188-4268-4e18-919b-b8fc7aa2d532","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6804","nonce":881087352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6808","nonce":881087352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6815","nonce":881087352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":881087352},{"type":"v1","addr":"172.21.15.134:6812","nonce":881087352}]},"public_addr":"172.21.15.134:6804/881087352","cluster_addr":"172.21.15.134:6808/881087352","heartbeat_back_addr":"172.21.15.134:6815/881087352","heartbeat_front_addr":"172.21.15.134:6812/881087352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.797054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.881197+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.944463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.883426+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.870007+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.847549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.924843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-28T13:07:08.873598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-28T13:08:49.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.121+0000 7f72d3647640 1 -- 172.21.15.114:0/1158324533 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f72b006c980 msgr2=0x7f72b006ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:49.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.121+0000 7f72d3647640 1 --2- 172.21.15.114:0/1158324533 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f72b006c980 0x7f72b006ee40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f72c8006fd0 tx=0x7f72c8008040 comp rx=0 tx=0).stop 2024-04-28T13:08:49.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.121+0000 7f72d3647640 1 -- 172.21.15.114:0/1158324533 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72cc0cff60 msgr2=0x7f72cc161600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:49.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.121+0000 7f72d3647640 1 --2- 172.21.15.114:0/1158324533 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72cc0cff60 0x7f72cc161600 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f72bc00e870 tx=0x7f72bc00ed30 comp rx=0 tx=0).stop 2024-04-28T13:08:49.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.121+0000 7f72d3647640 1 -- 172.21.15.114:0/1158324533 shutdown_connections 2024-04-28T13:08:49.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.121+0000 7f72d3647640 1 --2- 172.21.15.114:0/1158324533 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f72b006c980 0x7f72b006ee40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.121+0000 7f72d3647640 1 --2- 172.21.15.114:0/1158324533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72cc15f410 0x7f72cc153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.121+0000 7f72d3647640 1 --2- 172.21.15.114:0/1158324533 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72cc0cff60 0x7f72cc161600 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.121+0000 7f72d3647640 1 --2- 172.21.15.114:0/1158324533 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72cc0b4380 0x7f72cc0ac630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.121+0000 7f72d3647640 1 -- 172.21.15.114:0/1158324533 >> 172.21.15.114:0/1158324533 conn(0x7f72cc0633a0 msgr2=0x7f72cc0b89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:49.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.121+0000 7f72d3647640 1 -- 172.21.15.114:0/1158324533 shutdown_connections 2024-04-28T13:08:49.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.121+0000 7f72d3647640 1 -- 172.21.15.114:0/1158324533 wait complete. 2024-04-28T13:08:49.133 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-28T13:08:49.133 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-28T13:08:49.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.228+0000 7fbea3724640 1 Processor -- start 2024-04-28T13:08:49.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.228+0000 7fbea3724640 1 -- start start 2024-04-28T13:08:49.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.229+0000 7fbea3724640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe9c06d360 0x7fbe9c06e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:49.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.229+0000 7fbea3724640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbe9c06d740 0x7fbe9c15f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:49.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.229+0000 7fbea3724640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe9c070950 con 0x7fbe9c162de0 2024-04-28T13:08:49.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.229+0000 7fbea3724640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fbe9c0af6b0 con 0x7fbe9c06d740 2024-04-28T13:08:49.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.229+0000 7fbea3724640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fbe9c06eed0 con 0x7fbe9c06d360 2024-04-28T13:08:49.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.229+0000 7fbea0cbf640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbe9c06d740 0x7fbe9c15f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:49.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.229+0000 7fbea0cbf640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbe9c06d740 0x7fbe9c15f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44640/0 (socket says 172.21.15.114:44640) 2024-04-28T13:08:49.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.229+0000 7fbea0cbf640 1 -- 172.21.15.114:0/366451773 learned_addr learned my addr 172.21.15.114:0/366451773 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:49.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.229+0000 7fbea14c0640 1 --2- 172.21.15.114:0/366451773 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe9c06d360 0x7fbe9c06e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:49.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.229+0000 7fbea0cbf640 1 -- 172.21.15.114:0/366451773 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe9c06d360 msgr2=0x7fbe9c06e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:49.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.229+0000 7fbea0cbf640 1 --2- 172.21.15.114:0/366451773 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe9c06d360 0x7fbe9c06e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.230+0000 7fbea0cbf640 1 -- 172.21.15.114:0/366451773 >> v1:172.21.15.134:6789/0 conn(0x7fbe9c162de0 legacy=0x7fbe9c163270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:49.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.230+0000 7fbea0cbf640 1 -- 172.21.15.114:0/366451773 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9c06fc80 con 0x7fbe9c06d740 2024-04-28T13:08:49.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.230+0000 7fbea14c0640 1 --2- 172.21.15.114:0/366451773 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe9c06d360 0x7fbe9c06e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:49.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.230+0000 7fbea0cbf640 1 --2- 172.21.15.114:0/366451773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe9c06d740 0x7fbe9c15f4a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009870 tx=0x7fbe8c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e062a6e557f2fe4 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:49.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.230+0000 7fbe93fff640 1 -- 172.21.15.114:0/366451773 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c037070 con 0x7fbe9c06d740 2024-04-28T13:08:49.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.230+0000 7fbe93fff640 1 -- 172.21.15.114:0/366451773 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe8c032440 con 0x7fbe9c06d740 2024-04-28T13:08:49.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.230+0000 7fbe93fff640 1 -- 172.21.15.114:0/366451773 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c032810 con 0x7fbe9c06d740 2024-04-28T13:08:49.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.231+0000 7fbea3724640 1 -- 172.21.15.114:0/366451773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe9c06d740 msgr2=0x7fbe9c15f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:49.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.231+0000 7fbea3724640 1 --2- 172.21.15.114:0/366451773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe9c06d740 0x7fbe9c15f4a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009870 tx=0x7fbe8c02a210 comp rx=0 tx=0).stop 2024-04-28T13:08:49.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.231+0000 7fbea3724640 1 -- 172.21.15.114:0/366451773 shutdown_connections 2024-04-28T13:08:49.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.231+0000 7fbea3724640 1 --2- 172.21.15.114:0/366451773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe9c06d740 0x7fbe9c15f4a0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.231+0000 7fbea3724640 1 --2- 172.21.15.114:0/366451773 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe9c06d360 0x7fbe9c06e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.231+0000 7fbea3724640 1 -- 172.21.15.114:0/366451773 >> 172.21.15.114:0/366451773 conn(0x7fbe9c072a60 msgr2=0x7fbe9c072e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:49.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.231+0000 7fbea3724640 1 -- 172.21.15.114:0/366451773 shutdown_connections 2024-04-28T13:08:49.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.231+0000 7fbea3724640 1 -- 172.21.15.114:0/366451773 wait complete. 2024-04-28T13:08:49.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.232+0000 7fbea3724640 1 Processor -- start 2024-04-28T13:08:49.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.232+0000 7fbea3724640 1 -- start start 2024-04-28T13:08:49.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.233+0000 7fbea3724640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe9c06d360 0x7fbe9c1f91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:49.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.233+0000 7fbea3724640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe9c06d740 0x7fbe9c14a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:49.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.233+0000 7fbea3724640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe9c162de0 0x7fbe9c1618b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:49.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.233+0000 7fbea3724640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c06f6c0 con 0x7fbe9c162de0 2024-04-28T13:08:49.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.233+0000 7fbea3724640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c06f3e0 con 0x7fbe9c06d360 2024-04-28T13:08:49.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.233+0000 7fbea3724640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fbe9c06f9a0 con 0x7fbe9c06d740 2024-04-28T13:08:49.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.233+0000 7fbea1cc1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe9c162de0 0x7fbe9c1618b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:49.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.233+0000 7fbea1cc1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe9c162de0 0x7fbe9c1618b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44650/0 (socket says 172.21.15.114:44650) 2024-04-28T13:08:49.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.233+0000 7fbea1cc1640 1 -- 172.21.15.114:0/1015704469 learned_addr learned my addr 172.21.15.114:0/1015704469 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:49.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.233+0000 7fbea1cc1640 1 -- 172.21.15.114:0/1015704469 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe9c06d740 msgr2=0x7fbe9c14a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:49.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.233+0000 7fbea1cc1640 1 --2- 172.21.15.114:0/1015704469 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe9c06d740 0x7fbe9c14a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.233+0000 7fbea1cc1640 1 -- 172.21.15.114:0/1015704469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe9c06d360 msgr2=0x7fbe9c1f91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:49.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.233+0000 7fbea1cc1640 1 --2- 172.21.15.114:0/1015704469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe9c06d360 0x7fbe9c1f91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.233+0000 7fbea1cc1640 1 -- 172.21.15.114:0/1015704469 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9c1e9c50 con 0x7fbe9c162de0 2024-04-28T13:08:49.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.233+0000 7fbea1cc1640 1 --2- 172.21.15.114:0/1015704469 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe9c162de0 0x7fbe9c1618b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fbe9400b440 tx=0x7fbe9400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:49.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.233+0000 7fbe91ffb640 1 -- 172.21.15.114:0/1015704469 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe94015020 con 0x7fbe9c162de0 2024-04-28T13:08:49.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.233+0000 7fbe91ffb640 1 -- 172.21.15.114:0/1015704469 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe94011830 con 0x7fbe9c162de0 2024-04-28T13:08:49.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.233+0000 7fbea3724640 1 -- 172.21.15.114:0/1015704469 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe9c1e9970 con 0x7fbe9c162de0 2024-04-28T13:08:49.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.233+0000 7fbe91ffb640 1 -- 172.21.15.114:0/1015704469 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe94011c20 con 0x7fbe9c162de0 2024-04-28T13:08:49.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.234+0000 7fbea3724640 1 -- 172.21.15.114:0/1015704469 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe9c1e90c0 con 0x7fbe9c162de0 2024-04-28T13:08:49.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.235+0000 7fbea3724640 1 -- 172.21.15.114:0/1015704469 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe9c0b45d0 con 0x7fbe9c162de0 2024-04-28T13:08:49.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.235+0000 7fbe91ffb640 1 -- 172.21.15.114:0/1015704469 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7fbe94018020 con 0x7fbe9c162de0 2024-04-28T13:08:49.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.235+0000 7fbe91ffb640 1 --2- 172.21.15.114:0/1015704469 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbe8006c980 0x7fbe8006ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:49.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.235+0000 7fbe91ffb640 1 -- 172.21.15.114:0/1015704469 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fbe9408b790 con 0x7fbe9c162de0 2024-04-28T13:08:49.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.235+0000 7fbea14c0640 1 --2- 172.21.15.114:0/1015704469 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbe8006c980 0x7fbe8006ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:49.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.236+0000 7fbea14c0640 1 --2- 172.21.15.114:0/1015704469 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbe8006c980 0x7fbe8006ee40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbe98008ea0 tx=0x7fbe980083d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:49.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.240+0000 7fbe91ffb640 1 -- 172.21.15.114:0/1015704469 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbe9401f030 con 0x7fbe9c162de0 2024-04-28T13:08:49.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.410+0000 7fbea3724640 1 -- 172.21.15.114:0/1015704469 --> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbe9c06a3d0 con 0x7fbe8006c980 2024-04-28T13:08:49.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.416+0000 7fbe91ffb640 1 -- 172.21.15.114:0/1015704469 <== mgr.4104 v2:172.21.15.114:6832/2240257326 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237177 (secure 0 0 0) 0x7fbe9c06a3d0 con 0x7fbe8006c980 2024-04-28T13:08:49.419 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:49.420 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-04-28T13:08:49.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.418+0000 7fbea3724640 1 -- 172.21.15.114:0/1015704469 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbe8006c980 msgr2=0x7fbe8006ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:49.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.418+0000 7fbea3724640 1 --2- 172.21.15.114:0/1015704469 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbe8006c980 0x7fbe8006ee40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbe98008ea0 tx=0x7fbe980083d0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.419+0000 7fbea3724640 1 -- 172.21.15.114:0/1015704469 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe9c162de0 msgr2=0x7fbe9c1618b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:49.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.419+0000 7fbea3724640 1 --2- 172.21.15.114:0/1015704469 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe9c162de0 0x7fbe9c1618b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fbe9400b440 tx=0x7fbe9400b900 comp rx=0 tx=0).stop 2024-04-28T13:08:49.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.419+0000 7fbea3724640 1 -- 172.21.15.114:0/1015704469 shutdown_connections 2024-04-28T13:08:49.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.419+0000 7fbea3724640 1 --2- 172.21.15.114:0/1015704469 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe9c162de0 0x7fbe9c1618b0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.419+0000 7fbea3724640 1 --2- 172.21.15.114:0/1015704469 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe9c06d740 0x7fbe9c14a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.419+0000 7fbea3724640 1 --2- 172.21.15.114:0/1015704469 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fbe8006c980 0x7fbe8006ee40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.419+0000 7fbea3724640 1 --2- 172.21.15.114:0/1015704469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe9c06d360 0x7fbe9c1f91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.419+0000 7fbea3724640 1 -- 172.21.15.114:0/1015704469 >> 172.21.15.114:0/1015704469 conn(0x7fbe9c072a60 msgr2=0x7fbe9c072e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:49.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.419+0000 7fbea3724640 1 -- 172.21.15.114:0/1015704469 shutdown_connections 2024-04-28T13:08:49.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.419+0000 7fbea3724640 1 -- 172.21.15.114:0/1015704469 wait complete. 2024-04-28T13:08:49.430 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2024-04-28T13:08:48.721412+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221068,"kb_used_data":4868,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753652,"statfs":{"total":773094113280,"available":772867739648,"internally_reserved":0,"allocated":4984832,"data_stored":2681323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.279280"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":204,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-28T13:08:41.439340+0000","last_change":"2024-04-28T13:07:16.698740+0000","last_active":"2024-04-28T13:08:41.439340+0000","last_peered":"2024-04-28T13:08:41.439340+0000","last_clean":"2024-04-28T13:08:41.439340+0000","last_became_active":"2024-04-28T13:07:16.696364+0000","last_became_peered":"2024-04-28T13:07:16.696364+0000","last_unstale":"2024-04-28T13:08:41.439340+0000","last_undegraded":"2024-04-28T13:08:41.439340+0000","last_fullsized":"2024-04-28T13:08:41.439340+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:14.770499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:14.770499+0000","last_clean_scrub_stamp":"2024-04-28T13:07:14.770499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:39:38.986133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1073152,"data_stored":779876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":189508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27508,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":491520,"data_stored":194635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27508,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":491520,"data_stored":194635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27496,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":479232,"data_stored":189508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":174079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":194635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1036288,"data_stored":764447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-28T13:08:49.435 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-28T13:08:49.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.567+0000 7f5ab46cc640 1 Processor -- start 2024-04-28T13:08:49.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.567+0000 7f5ab46cc640 1 -- start start 2024-04-28T13:08:49.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.568+0000 7f5ab46cc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5aac15f5a0 0x7f5aac0baef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:49.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.568+0000 7f5ab46cc640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5aac0b8e50 0x7f5aac0cff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:49.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.568+0000 7f5ab46cc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5aac0d04c0 0x7f5aac0b6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:49.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.568+0000 7f5ab46cc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f5aac0d0930 con 0x7f5aac0d04c0 2024-04-28T13:08:49.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.568+0000 7f5ab46cc640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f5aac0ba720 con 0x7f5aac15f5a0 2024-04-28T13:08:49.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.568+0000 7f5ab46cc640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f5aac0b9680 con 0x7f5aac0b8e50 2024-04-28T13:08:49.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.568+0000 7f5ab2c69640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5aac0d04c0 0x7f5aac0b6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:49.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.568+0000 7f5ab2c69640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5aac0d04c0 0x7f5aac0b6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44664/0 (socket says 172.21.15.114:44664) 2024-04-28T13:08:49.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.568+0000 7f5ab2c69640 1 -- 172.21.15.114:0/1082768933 learned_addr learned my addr 172.21.15.114:0/1082768933 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:49.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.568+0000 7f5ab1c67640 1 --2- 172.21.15.114:0/1082768933 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5aac0b8e50 0x7f5aac0cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:49.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.568+0000 7f5ab2468640 1 --2- 172.21.15.114:0/1082768933 >> v2:172.21.15.134:3300/0 conn(0x7f5aac15f5a0 0x7f5aac0baef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:49.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.568+0000 7f5ab2c69640 1 -- 172.21.15.114:0/1082768933 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5aac0b8e50 msgr2=0x7f5aac0cff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:49.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.568+0000 7f5ab2c69640 1 --2- 172.21.15.114:0/1082768933 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5aac0b8e50 0x7f5aac0cff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.568+0000 7f5ab2c69640 1 -- 172.21.15.114:0/1082768933 >> v2:172.21.15.134:3300/0 conn(0x7f5aac15f5a0 msgr2=0x7f5aac0baef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:49.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.568+0000 7f5ab2c69640 1 --2- 172.21.15.114:0/1082768933 >> v2:172.21.15.134:3300/0 conn(0x7f5aac15f5a0 0x7f5aac0baef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.568+0000 7f5ab2c69640 1 -- 172.21.15.114:0/1082768933 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aac0b9960 con 0x7f5aac0d04c0 2024-04-28T13:08:49.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.568+0000 7f5ab2468640 1 --2- 172.21.15.114:0/1082768933 >> v2:172.21.15.134:3300/0 conn(0x7f5aac15f5a0 0x7f5aac0baef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:49.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.569+0000 7f5ab2c69640 1 --2- 172.21.15.114:0/1082768933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aac0d04c0 0x7f5aac0b6d30 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5aac0d2e10 tx=0x7f5aa402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b692149786c642c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:49.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.569+0000 7f5ab1466640 1 -- 172.21.15.114:0/1082768933 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa4036070 con 0x7f5aac0d04c0 2024-04-28T13:08:49.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.569+0000 7f5ab1466640 1 -- 172.21.15.114:0/1082768933 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5aa4031600 con 0x7f5aac0d04c0 2024-04-28T13:08:49.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.569+0000 7f5ab1466640 1 -- 172.21.15.114:0/1082768933 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa40319d0 con 0x7f5aac0d04c0 2024-04-28T13:08:49.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.570+0000 7f5ab46cc640 1 -- 172.21.15.114:0/1082768933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aac0d04c0 msgr2=0x7f5aac0b6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:49.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.570+0000 7f5ab46cc640 1 --2- 172.21.15.114:0/1082768933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aac0d04c0 0x7f5aac0b6d30 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5aac0d2e10 tx=0x7f5aa402a610 comp rx=0 tx=0).stop 2024-04-28T13:08:49.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.570+0000 7f5ab46cc640 1 -- 172.21.15.114:0/1082768933 shutdown_connections 2024-04-28T13:08:49.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.570+0000 7f5ab46cc640 1 --2- 172.21.15.114:0/1082768933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aac0d04c0 0x7f5aac0b6d30 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.570+0000 7f5ab46cc640 1 --2- 172.21.15.114:0/1082768933 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5aac0b8e50 0x7f5aac0cff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.570+0000 7f5ab46cc640 1 --2- 172.21.15.114:0/1082768933 >> v2:172.21.15.134:3300/0 conn(0x7f5aac15f5a0 0x7f5aac0baef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.570+0000 7f5ab46cc640 1 -- 172.21.15.114:0/1082768933 >> 172.21.15.114:0/1082768933 conn(0x7f5aac063160 msgr2=0x7f5aac063570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:49.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.570+0000 7f5ab46cc640 1 -- 172.21.15.114:0/1082768933 shutdown_connections 2024-04-28T13:08:49.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.570+0000 7f5ab46cc640 1 -- 172.21.15.114:0/1082768933 wait complete. 2024-04-28T13:08:49.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.571+0000 7f5ab46cc640 1 Processor -- start 2024-04-28T13:08:49.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.571+0000 7f5ab46cc640 1 -- start start 2024-04-28T13:08:49.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.572+0000 7f5ab46cc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aac0b8e50 0x7f5aac159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:49.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.572+0000 7f5ab46cc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5aac0d04c0 0x7f5aac0cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:49.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.572+0000 7f5ab46cc640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5aac15f5a0 0x7f5aac1562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:49.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.572+0000 7f5ab46cc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5aac0ba200 con 0x7f5aac0b8e50 2024-04-28T13:08:49.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.572+0000 7f5ab46cc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5aac0b9f20 con 0x7f5aac0d04c0 2024-04-28T13:08:49.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.572+0000 7f5ab46cc640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f5aac0b9270 con 0x7f5aac15f5a0 2024-04-28T13:08:49.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.572+0000 7f5ab2468640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aac0b8e50 0x7f5aac159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:49.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.572+0000 7f5ab2468640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aac0b8e50 0x7f5aac159e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44666/0 (socket says 172.21.15.114:44666) 2024-04-28T13:08:49.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.572+0000 7f5ab2468640 1 -- 172.21.15.114:0/4088299567 learned_addr learned my addr 172.21.15.114:0/4088299567 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:49.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.572+0000 7f5ab2468640 1 -- 172.21.15.114:0/4088299567 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5aac15f5a0 msgr2=0x7f5aac1562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:49.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.572+0000 7f5ab2468640 1 --2- 172.21.15.114:0/4088299567 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5aac15f5a0 0x7f5aac1562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.572+0000 7f5ab2468640 1 -- 172.21.15.114:0/4088299567 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5aac0d04c0 msgr2=0x7f5aac0cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:49.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.572+0000 7f5ab2468640 1 --2- 172.21.15.114:0/4088299567 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5aac0d04c0 0x7f5aac0cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.572+0000 7f5ab2468640 1 -- 172.21.15.114:0/4088299567 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aac0b5d20 con 0x7f5aac0b8e50 2024-04-28T13:08:49.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.572+0000 7f5ab2468640 1 --2- 172.21.15.114:0/4088299567 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aac0b8e50 0x7f5aac159e60 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5aa800c7f0 tx=0x7f5aa800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:49.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.572+0000 7f5aa2ffd640 1 -- 172.21.15.114:0/4088299567 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8015070 con 0x7f5aac0b8e50 2024-04-28T13:08:49.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.572+0000 7f5aa2ffd640 1 -- 172.21.15.114:0/4088299567 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5aa8007820 con 0x7f5aac0b8e50 2024-04-28T13:08:49.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.572+0000 7f5ab46cc640 1 -- 172.21.15.114:0/4088299567 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5aac0b4f60 con 0x7f5aac0b8e50 2024-04-28T13:08:49.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.572+0000 7f5aa2ffd640 1 -- 172.21.15.114:0/4088299567 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8007bd0 con 0x7f5aac0b8e50 2024-04-28T13:08:49.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.572+0000 7f5ab46cc640 1 -- 172.21.15.114:0/4088299567 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5aac0b5520 con 0x7f5aac0b8e50 2024-04-28T13:08:49.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.573+0000 7f5ab46cc640 1 -- 172.21.15.114:0/4088299567 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5aac06a3d0 con 0x7f5aac0b8e50 2024-04-28T13:08:49.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.574+0000 7f5aa2ffd640 1 -- 172.21.15.114:0/4088299567 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f5aa8018070 con 0x7f5aac0b8e50 2024-04-28T13:08:49.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.574+0000 7f5aa2ffd640 1 --2- 172.21.15.114:0/4088299567 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5a9006c980 0x7f5a9006ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:49.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.574+0000 7f5aa2ffd640 1 -- 172.21.15.114:0/4088299567 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f5aa808bd70 con 0x7f5aac0b8e50 2024-04-28T13:08:49.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.574+0000 7f5ab1c67640 1 --2- 172.21.15.114:0/4088299567 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5a9006c980 0x7f5a9006ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:49.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.574+0000 7f5ab1c67640 1 --2- 172.21.15.114:0/4088299567 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5a9006c980 0x7f5a9006ee40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5aac0d2730 tx=0x7f5a9c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:49.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.578+0000 7f5aa2ffd640 1 -- 172.21.15.114:0/4088299567 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5aa805a130 con 0x7f5aac0b8e50 2024-04-28T13:08:49.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.750+0000 7f5ab46cc640 1 -- 172.21.15.114:0/4088299567 --> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5aac0d4f20 con 0x7f5a9006c980 2024-04-28T13:08:49.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.756+0000 7f5aa2ffd640 1 -- 172.21.15.114:0/4088299567 <== mgr.4104 v2:172.21.15.114:6832/2240257326 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237177 (secure 0 0 0) 0x7f5aac0d4f20 con 0x7f5a9006c980 2024-04-28T13:08:49.759 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:49.760 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-04-28T13:08:49.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.758+0000 7f5ab46cc640 1 -- 172.21.15.114:0/4088299567 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5a9006c980 msgr2=0x7f5a9006ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:49.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.758+0000 7f5ab46cc640 1 --2- 172.21.15.114:0/4088299567 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5a9006c980 0x7f5a9006ee40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5aac0d2730 tx=0x7f5a9c008040 comp rx=0 tx=0).stop 2024-04-28T13:08:49.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.758+0000 7f5ab46cc640 1 -- 172.21.15.114:0/4088299567 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aac0b8e50 msgr2=0x7f5aac159e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:49.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.758+0000 7f5ab46cc640 1 --2- 172.21.15.114:0/4088299567 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aac0b8e50 0x7f5aac159e60 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5aa800c7f0 tx=0x7f5aa800ccb0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.759+0000 7f5ab46cc640 1 -- 172.21.15.114:0/4088299567 shutdown_connections 2024-04-28T13:08:49.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.759+0000 7f5ab46cc640 1 --2- 172.21.15.114:0/4088299567 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5aac15f5a0 0x7f5aac1562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.759+0000 7f5ab46cc640 1 --2- 172.21.15.114:0/4088299567 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5a9006c980 0x7f5a9006ee40 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.759+0000 7f5ab46cc640 1 --2- 172.21.15.114:0/4088299567 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5aac0d04c0 0x7f5aac0cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.759+0000 7f5ab46cc640 1 --2- 172.21.15.114:0/4088299567 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aac0b8e50 0x7f5aac159e60 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.759+0000 7f5ab46cc640 1 -- 172.21.15.114:0/4088299567 >> 172.21.15.114:0/4088299567 conn(0x7f5aac063160 msgr2=0x7f5aac0d5720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:49.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.759+0000 7f5ab46cc640 1 -- 172.21.15.114:0/4088299567 shutdown_connections 2024-04-28T13:08:49.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.759+0000 7f5ab46cc640 1 -- 172.21.15.114:0/4088299567 wait complete. 2024-04-28T13:08:49.770 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2024-04-28T13:08:48.721412+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221068,"kb_used_data":4868,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753652,"statfs":{"total":773094113280,"available":772867739648,"internally_reserved":0,"allocated":4984832,"data_stored":2681323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.279280"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":204,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-28T13:08:41.439340+0000","last_change":"2024-04-28T13:07:16.698740+0000","last_active":"2024-04-28T13:08:41.439340+0000","last_peered":"2024-04-28T13:08:41.439340+0000","last_clean":"2024-04-28T13:08:41.439340+0000","last_became_active":"2024-04-28T13:07:16.696364+0000","last_became_peered":"2024-04-28T13:07:16.696364+0000","last_unstale":"2024-04-28T13:08:41.439340+0000","last_undegraded":"2024-04-28T13:08:41.439340+0000","last_fullsized":"2024-04-28T13:08:41.439340+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:14.770499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:14.770499+0000","last_clean_scrub_stamp":"2024-04-28T13:07:14.770499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:39:38.986133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1073152,"data_stored":779876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":189508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27508,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":491520,"data_stored":194635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27508,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":491520,"data_stored":194635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27496,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":479232,"data_stored":189508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":174079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":194635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1036288,"data_stored":764447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-28T13:08:49.774 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-28T13:08:49.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.909+0000 7fb0240c4640 1 Processor -- start 2024-04-28T13:08:49.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.910+0000 7fb0240c4640 1 -- start start 2024-04-28T13:08:49.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.910+0000 7fb0240c4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb01c15f430 0x7fb01c0715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:49.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.910+0000 7fb0240c4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb01c073c50 0x7fb01c0740b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:49.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.910+0000 7fb0240c4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb01c0746f0 con 0x7fb01c0b5260 2024-04-28T13:08:49.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.910+0000 7fb0240c4640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fb01c15f810 con 0x7fb01c15f430 2024-04-28T13:08:49.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.910+0000 7fb0240c4640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb01c070810 con 0x7fb01c073c50 2024-04-28T13:08:49.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.910+0000 7fb021e60640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb01c15f430 0x7fb01c0715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:49.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.911+0000 7fb021e60640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb01c15f430 0x7fb01c0715d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44670/0 (socket says 172.21.15.114:44670) 2024-04-28T13:08:49.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.911+0000 7fb021e60640 1 -- 172.21.15.114:0/3195083716 learned_addr learned my addr 172.21.15.114:0/3195083716 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:49.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.911+0000 7fb02165f640 1 --2- 172.21.15.114:0/3195083716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb01c073c50 0x7fb01c0740b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:49.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.911+0000 7fb021e60640 1 -- 172.21.15.114:0/3195083716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb01c073c50 msgr2=0x7fb01c0740b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:49.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.911+0000 7fb021e60640 1 --2- 172.21.15.114:0/3195083716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb01c073c50 0x7fb01c0740b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.911+0000 7fb021e60640 1 -- 172.21.15.114:0/3195083716 >> v1:172.21.15.134:6789/0 conn(0x7fb01c0b5260 legacy=0x7fb01c0ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:49.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.911+0000 7fb021e60640 1 -- 172.21.15.114:0/3195083716 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb01c070af0 con 0x7fb01c15f430 2024-04-28T13:08:49.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.911+0000 7fb02165f640 1 --2- 172.21.15.114:0/3195083716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb01c073c50 0x7fb01c0740b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:49.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.911+0000 7fb021e60640 1 --2- 172.21.15.114:0/3195083716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb01c15f430 0x7fb01c0715d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb01c06edb0 tx=0x7fb00c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3bf5dc5e25032cd server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:49.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.912+0000 7fb020e5e640 1 -- 172.21.15.114:0/3195083716 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00c037070 con 0x7fb01c15f430 2024-04-28T13:08:49.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.912+0000 7fb020e5e640 1 -- 172.21.15.114:0/3195083716 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb00c032440 con 0x7fb01c15f430 2024-04-28T13:08:49.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.912+0000 7fb020e5e640 1 -- 172.21.15.114:0/3195083716 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00c032810 con 0x7fb01c15f430 2024-04-28T13:08:49.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.912+0000 7fb0240c4640 1 -- 172.21.15.114:0/3195083716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb01c15f430 msgr2=0x7fb01c0715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:49.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.912+0000 7fb0240c4640 1 --2- 172.21.15.114:0/3195083716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb01c15f430 0x7fb01c0715d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb01c06edb0 tx=0x7fb00c02a1e0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.912+0000 7fb0240c4640 1 -- 172.21.15.114:0/3195083716 shutdown_connections 2024-04-28T13:08:49.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.912+0000 7fb0240c4640 1 --2- 172.21.15.114:0/3195083716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb01c073c50 0x7fb01c0740b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.912+0000 7fb0240c4640 1 --2- 172.21.15.114:0/3195083716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb01c15f430 0x7fb01c0715d0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.912+0000 7fb0240c4640 1 -- 172.21.15.114:0/3195083716 >> 172.21.15.114:0/3195083716 conn(0x7fb01c0b3c50 msgr2=0x7fb01c0b4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:49.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.912+0000 7fb0240c4640 1 -- 172.21.15.114:0/3195083716 shutdown_connections 2024-04-28T13:08:49.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.912+0000 7fb0240c4640 1 -- 172.21.15.114:0/3195083716 wait complete. 2024-04-28T13:08:49.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.913+0000 7fb0240c4640 1 Processor -- start 2024-04-28T13:08:49.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.913+0000 7fb0240c4640 1 -- start start 2024-04-28T13:08:49.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.914+0000 7fb0240c4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb01c073c50 0x7fb01c1446f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:49.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.914+0000 7fb0240c4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb01c0b5260 0x7fb01c0b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.914+0000 7fb0240c4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb01c15f430 0x7fb01c0b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.914+0000 7fb0240c4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb01c071b10 con 0x7fb01c15f430 2024-04-28T13:08:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.914+0000 7fb0240c4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb01c0710b0 con 0x7fb01c0b5260 2024-04-28T13:08:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.914+0000 7fb0240c4640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb01c0b15a0 con 0x7fb01c073c50 2024-04-28T13:08:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.914+0000 7fb022661640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb01c15f430 0x7fb01c0b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.914+0000 7fb022661640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb01c15f430 0x7fb01c0b32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44684/0 (socket says 172.21.15.114:44684) 2024-04-28T13:08:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.914+0000 7fb022661640 1 -- 172.21.15.114:0/2913331083 learned_addr learned my addr 172.21.15.114:0/2913331083 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.914+0000 7fb02165f640 1 --2- 172.21.15.114:0/2913331083 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb01c0b5260 0x7fb01c0b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.914+0000 7fb021e60640 1 --2- 172.21.15.114:0/2913331083 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb01c073c50 0x7fb01c1446f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.915+0000 7fb022661640 1 -- 172.21.15.114:0/2913331083 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb01c073c50 msgr2=0x7fb01c1446f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.915+0000 7fb022661640 1 --2- 172.21.15.114:0/2913331083 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb01c073c50 0x7fb01c1446f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.915+0000 7fb022661640 1 -- 172.21.15.114:0/2913331083 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb01c0b5260 msgr2=0x7fb01c0b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.915+0000 7fb022661640 1 --2- 172.21.15.114:0/2913331083 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb01c0b5260 0x7fb01c0b2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:49.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.915+0000 7fb022661640 1 -- 172.21.15.114:0/2913331083 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb01c1472d0 con 0x7fb01c15f430 2024-04-28T13:08:49.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.915+0000 7fb022661640 1 --2- 172.21.15.114:0/2913331083 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb01c15f430 0x7fb01c0b32f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb01400c7b0 tx=0x7fb01400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:49.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.915+0000 7fb0127fc640 1 -- 172.21.15.114:0/2913331083 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb014004b60 con 0x7fb01c15f430 2024-04-28T13:08:49.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.915+0000 7fb0127fc640 1 -- 172.21.15.114:0/2913331083 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb014004d00 con 0x7fb01c15f430 2024-04-28T13:08:49.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.915+0000 7fb0240c4640 1 -- 172.21.15.114:0/2913331083 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb01c1475b0 con 0x7fb01c15f430 2024-04-28T13:08:49.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.915+0000 7fb0127fc640 1 -- 172.21.15.114:0/2913331083 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01400aa90 con 0x7fb01c15f430 2024-04-28T13:08:49.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.915+0000 7fb0240c4640 1 -- 172.21.15.114:0/2913331083 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb01c147b70 con 0x7fb01c15f430 2024-04-28T13:08:49.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.916+0000 7fb0240c4640 1 -- 172.21.15.114:0/2913331083 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb01c06a3d0 con 0x7fb01c15f430 2024-04-28T13:08:49.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.916+0000 7fb0127fc640 1 -- 172.21.15.114:0/2913331083 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7fb01400ac30 con 0x7fb01c15f430 2024-04-28T13:08:49.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.917+0000 7fb0127fc640 1 --2- 172.21.15.114:0/2913331083 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb00006c980 0x7fb00006ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:49.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.917+0000 7fb021e60640 1 --2- 172.21.15.114:0/2913331083 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb00006c980 0x7fb00006ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:49.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.917+0000 7fb0127fc640 1 -- 172.21.15.114:0/2913331083 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fb01408beb0 con 0x7fb01c15f430 2024-04-28T13:08:49.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.917+0000 7fb021e60640 1 --2- 172.21.15.114:0/2913331083 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb00006c980 0x7fb00006ee40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb00c034000 tx=0x7fb00c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:49.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:49.921+0000 7fb0127fc640 1 -- 172.21.15.114:0/2913331083 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb014020070 con 0x7fb01c15f430 2024-04-28T13:08:49.973 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:08:49.975 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:08:50.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.098+0000 7fb0240c4640 1 -- 172.21.15.114:0/2913331083 --> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb01c0b58e0 con 0x7fb00006c980 2024-04-28T13:08:50.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.103+0000 7fb0127fc640 1 -- 172.21.15.114:0/2913331083 <== mgr.4104 v2:172.21.15.114:6832/2240257326 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237177 (secure 0 0 0) 0x7fb00c07be90 con 0x7fb00006c980 2024-04-28T13:08:50.106 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:50.107 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-04-28T13:08:50.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.106+0000 7fb0240c4640 1 -- 172.21.15.114:0/2913331083 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb00006c980 msgr2=0x7fb00006ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:50.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.106+0000 7fb0240c4640 1 --2- 172.21.15.114:0/2913331083 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb00006c980 0x7fb00006ee40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb00c034000 tx=0x7fb00c02e000 comp rx=0 tx=0).stop 2024-04-28T13:08:50.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.106+0000 7fb0240c4640 1 -- 172.21.15.114:0/2913331083 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb01c15f430 msgr2=0x7fb01c0b32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:50.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.106+0000 7fb0240c4640 1 --2- 172.21.15.114:0/2913331083 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb01c15f430 0x7fb01c0b32f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb01400c7b0 tx=0x7fb01400cc70 comp rx=0 tx=0).stop 2024-04-28T13:08:50.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.106+0000 7fb0240c4640 1 -- 172.21.15.114:0/2913331083 shutdown_connections 2024-04-28T13:08:50.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.106+0000 7fb0240c4640 1 --2- 172.21.15.114:0/2913331083 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb01c15f430 0x7fb01c0b32f0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:50.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.106+0000 7fb0240c4640 1 --2- 172.21.15.114:0/2913331083 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb00006c980 0x7fb00006ee40 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:50.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.106+0000 7fb0240c4640 1 --2- 172.21.15.114:0/2913331083 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb01c0b5260 0x7fb01c0b2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:50.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.106+0000 7fb0240c4640 1 --2- 172.21.15.114:0/2913331083 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb01c073c50 0x7fb01c1446f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:50.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.106+0000 7fb0240c4640 1 -- 172.21.15.114:0/2913331083 >> 172.21.15.114:0/2913331083 conn(0x7fb01c0b3c50 msgr2=0x7fb01c0b2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:50.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.106+0000 7fb0240c4640 1 -- 172.21.15.114:0/2913331083 shutdown_connections 2024-04-28T13:08:50.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.106+0000 7fb0240c4640 1 -- 172.21.15.114:0/2913331083 wait complete. 2024-04-28T13:08:50.117 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2024-04-28T13:08:48.721412+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221068,"kb_used_data":4868,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753652,"statfs":{"total":773094113280,"available":772867739648,"internally_reserved":0,"allocated":4984832,"data_stored":2681323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.279280"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:45.441219+0000","last_change":"2024-04-28T13:08:45.441219+0000","last_active":"2024-04-28T13:08:45.441219+0000","last_peered":"2024-04-28T13:08:45.441219+0000","last_clean":"2024-04-28T13:08:45.441219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:45.441219+0000","last_undegraded":"2024-04-28T13:08:45.441219+0000","last_fullsized":"2024-04-28T13:08:45.441219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-28T13:08:44.439523+0000","last_change":"2024-04-28T13:08:44.439523+0000","last_active":"2024-04-28T13:08:44.439523+0000","last_peered":"2024-04-28T13:08:44.439523+0000","last_clean":"2024-04-28T13:08:44.439523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-28T13:08:44.439523+0000","last_undegraded":"2024-04-28T13:08:44.439523+0000","last_fullsized":"2024-04-28T13:08:44.439523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":204,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-28T13:08:41.439340+0000","last_change":"2024-04-28T13:07:16.698740+0000","last_active":"2024-04-28T13:08:41.439340+0000","last_peered":"2024-04-28T13:08:41.439340+0000","last_clean":"2024-04-28T13:08:41.439340+0000","last_became_active":"2024-04-28T13:07:16.696364+0000","last_became_peered":"2024-04-28T13:07:16.696364+0000","last_unstale":"2024-04-28T13:08:41.439340+0000","last_undegraded":"2024-04-28T13:08:41.439340+0000","last_fullsized":"2024-04-28T13:08:41.439340+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:14.770499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:14.770499+0000","last_clean_scrub_stamp":"2024-04-28T13:07:14.770499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:39:38.986133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1073152,"data_stored":779876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":189508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27508,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":491520,"data_stored":194635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27508,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":491520,"data_stored":194635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27496,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":479232,"data_stored":189508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":174079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":194635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1036288,"data_stored":764447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-28T13:08:50.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2024-04-28T13:08:50.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3e is not active+clean 2024-04-28T13:08:50.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2024-04-28T13:08:50.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3c is not active+clean 2024-04-28T13:08:50.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2024-04-28T13:08:50.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3a is not active+clean 2024-04-28T13:08:50.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2024-04-28T13:08:50.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.38 is not active+clean 2024-04-28T13:08:50.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.37 is not active+clean 2024-04-28T13:08:50.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2024-04-28T13:08:50.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.35 is not active+clean 2024-04-28T13:08:50.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.34 is not active+clean 2024-04-28T13:08:50.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.33 is not active+clean 2024-04-28T13:08:50.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2024-04-28T13:08:50.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.31 is not active+clean 2024-04-28T13:08:50.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2024-04-28T13:08:50.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2024-04-28T13:08:50.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2024-04-28T13:08:50.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2024-04-28T13:08:50.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2c is not active+clean 2024-04-28T13:08:50.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2b is not active+clean 2024-04-28T13:08:50.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2a is not active+clean 2024-04-28T13:08:50.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2024-04-28T13:08:50.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2024-04-28T13:08:50.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2024-04-28T13:08:50.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.26 is not active+clean 2024-04-28T13:08:50.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2024-04-28T13:08:50.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2024-04-28T13:08:50.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2024-04-28T13:08:50.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2024-04-28T13:08:50.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.21 is not active+clean 2024-04-28T13:08:50.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.20 is not active+clean 2024-04-28T13:08:50.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2024-04-28T13:08:50.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2024-04-28T13:08:50.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2024-04-28T13:08:50.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2024-04-28T13:08:50.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2024-04-28T13:08:50.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2024-04-28T13:08:50.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2024-04-28T13:08:50.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2024-04-28T13:08:50.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2024-04-28T13:08:50.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2024-04-28T13:08:50.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2024-04-28T13:08:50.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2024-04-28T13:08:50.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2024-04-28T13:08:50.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2024-04-28T13:08:50.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2024-04-28T13:08:50.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2024-04-28T13:08:50.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2024-04-28T13:08:50.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2024-04-28T13:08:50.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2024-04-28T13:08:50.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2024-04-28T13:08:50.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2024-04-28T13:08:50.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2024-04-28T13:08:50.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2024-04-28T13:08:50.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2024-04-28T13:08:50.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2024-04-28T13:08:50.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2024-04-28T13:08:50.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2024-04-28T13:08:50.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2024-04-28T13:08:50.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2024-04-28T13:08:50.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2024-04-28T13:08:50.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2024-04-28T13:08:50.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2024-04-28T13:08:50.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2024-04-28T13:08:50.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2024-04-28T13:08:50.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2024-04-28T13:08:50.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2024-04-28T13:08:50.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2024-04-28T13:08:50.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2024-04-28T13:08:50.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2024-04-28T13:08:50.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2024-04-28T13:08:50.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2024-04-28T13:08:50.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2024-04-28T13:08:50.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2024-04-28T13:08:50.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2024-04-28T13:08:50.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2024-04-28T13:08:50.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2024-04-28T13:08:50.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2024-04-28T13:08:50.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2024-04-28T13:08:50.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2024-04-28T13:08:50.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2024-04-28T13:08:50.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2024-04-28T13:08:50.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2024-04-28T13:08:50.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2024-04-28T13:08:50.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2024-04-28T13:08:50.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2024-04-28T13:08:50.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2024-04-28T13:08:50.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2024-04-28T13:08:50.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2024-04-28T13:08:50.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2024-04-28T13:08:50.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2024-04-28T13:08:50.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2024-04-28T13:08:50.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2024-04-28T13:08:50.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2024-04-28T13:08:50.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:45.441219+0000', 'last_change': '2024-04-28T13:08:45.441219+0000', 'last_active': '2024-04-28T13:08:45.441219+0000', 'last_peered': '2024-04-28T13:08:45.441219+0000', 'last_clean': '2024-04-28T13:08:45.441219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:45.441219+0000', 'last_undegraded': '2024-04-28T13:08:45.441219+0000', 'last_fullsized': '2024-04-28T13:08:45.441219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:45.441219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2024-04-28T13:08:50.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-28T13:08:44.439523+0000', 'last_change': '2024-04-28T13:08:44.439523+0000', 'last_active': '2024-04-28T13:08:44.439523+0000', 'last_peered': '2024-04-28T13:08:44.439523+0000', 'last_clean': '2024-04-28T13:08:44.439523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-28T13:08:44.439523+0000', 'last_undegraded': '2024-04-28T13:08:44.439523+0000', 'last_fullsized': '2024-04-28T13:08:44.439523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'last_clean_scrub_stamp': '2024-04-28T13:08:44.439523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-28T13:08:50.140 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-28T13:08:50.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.252+0000 7f39fa3e7640 1 Processor -- start 2024-04-28T13:08:50.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.252+0000 7f39fa3e7640 1 -- start start 2024-04-28T13:08:50.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.252+0000 7f39fa3e7640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39f406ca60 0x7f39f40d08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:50.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.252+0000 7f39fa3e7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f39f41465b0 0x7f39f4073400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:50.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.252+0000 7f39fa3e7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39f40d0fb0 con 0x7f39f41461a0 2024-04-28T13:08:50.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.252+0000 7f39fa3e7640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f39f40d1bc0 con 0x7f39f41465b0 2024-04-28T13:08:50.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.252+0000 7f39fa3e7640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f39f40d1290 con 0x7f39f406ca60 2024-04-28T13:08:50.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.253+0000 7f39f8984640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f39f41465b0 0x7f39f4073400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:50.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.253+0000 7f39f8984640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f39f41465b0 0x7f39f4073400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44700/0 (socket says 172.21.15.114:44700) 2024-04-28T13:08:50.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.253+0000 7f39f8984640 1 -- 172.21.15.114:0/1346031538 learned_addr learned my addr 172.21.15.114:0/1346031538 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:50.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.253+0000 7f39f8984640 1 -- 172.21.15.114:0/1346031538 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39f406ca60 msgr2=0x7f39f40d08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:50.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.253+0000 7f39f8984640 1 --2- 172.21.15.114:0/1346031538 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39f406ca60 0x7f39f40d08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:50.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.253+0000 7f39f8984640 1 -- 172.21.15.114:0/1346031538 >> v1:172.21.15.134:6789/0 conn(0x7f39f41461a0 legacy=0x7f39f406c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:50.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.253+0000 7f39f8984640 1 -- 172.21.15.114:0/1346031538 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f40d1570 con 0x7f39f41465b0 2024-04-28T13:08:50.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.254+0000 7f39f8984640 1 --2- 172.21.15.114:0/1346031538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39f41465b0 0x7f39f4073400 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f39ec009e50 tx=0x7f39ec02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f47d3940c0829cb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:50.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.254+0000 7f39f2ffd640 1 -- 172.21.15.114:0/1346031538 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ec036070 con 0x7f39f41465b0 2024-04-28T13:08:50.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.254+0000 7f39f2ffd640 1 -- 172.21.15.114:0/1346031538 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39ec031600 con 0x7f39f41465b0 2024-04-28T13:08:50.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.254+0000 7f39f2ffd640 1 -- 172.21.15.114:0/1346031538 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ec0319d0 con 0x7f39f41465b0 2024-04-28T13:08:50.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.254+0000 7f39fa3e7640 1 -- 172.21.15.114:0/1346031538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39f41465b0 msgr2=0x7f39f4073400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:50.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.254+0000 7f39fa3e7640 1 --2- 172.21.15.114:0/1346031538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39f41465b0 0x7f39f4073400 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f39ec009e50 tx=0x7f39ec02a6c0 comp rx=0 tx=0).stop 2024-04-28T13:08:50.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.254+0000 7f39fa3e7640 1 -- 172.21.15.114:0/1346031538 shutdown_connections 2024-04-28T13:08:50.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.254+0000 7f39fa3e7640 1 --2- 172.21.15.114:0/1346031538 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39f406ca60 0x7f39f40d08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:50.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.254+0000 7f39fa3e7640 1 --2- 172.21.15.114:0/1346031538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39f41465b0 0x7f39f4073400 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:50.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.254+0000 7f39fa3e7640 1 -- 172.21.15.114:0/1346031538 >> 172.21.15.114:0/1346031538 conn(0x7f39f40b3c50 msgr2=0x7f39f40b4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:50.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.254+0000 7f39fa3e7640 1 -- 172.21.15.114:0/1346031538 shutdown_connections 2024-04-28T13:08:50.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.254+0000 7f39fa3e7640 1 -- 172.21.15.114:0/1346031538 wait complete. 2024-04-28T13:08:50.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.255+0000 7f39fa3e7640 1 Processor -- start 2024-04-28T13:08:50.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.256+0000 7f39fa3e7640 1 -- start start 2024-04-28T13:08:50.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.256+0000 7f39fa3e7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39f406ca60 0x7f39f4158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:50.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.256+0000 7f39fa3e7640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39f41465b0 0x7f39f40cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:50.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.256+0000 7f39fa3e7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39f41f2d70 0x7f39f4145270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:50.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.256+0000 7f39fa3e7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f39f4073940 con 0x7f39f41f2d70 2024-04-28T13:08:50.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.256+0000 7f39fa3e7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f39f4146d30 con 0x7f39f406ca60 2024-04-28T13:08:50.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.256+0000 7f39fa3e7640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f39f4073ac0 con 0x7f39f41465b0 2024-04-28T13:08:50.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.256+0000 7f39f8984640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39f41f2d70 0x7f39f4145270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:50.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.256+0000 7f39f8984640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39f41f2d70 0x7f39f4145270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44704/0 (socket says 172.21.15.114:44704) 2024-04-28T13:08:50.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.256+0000 7f39f8984640 1 -- 172.21.15.114:0/1381921987 learned_addr learned my addr 172.21.15.114:0/1381921987 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:50.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.256+0000 7f39f37fe640 1 --2- 172.21.15.114:0/1381921987 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39f41465b0 0x7f39f40cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:50.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.256+0000 7f39f3fff640 1 --2- 172.21.15.114:0/1381921987 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39f406ca60 0x7f39f4158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:50.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.257+0000 7f39f8984640 1 -- 172.21.15.114:0/1381921987 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39f41465b0 msgr2=0x7f39f40cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:50.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.257+0000 7f39f8984640 1 --2- 172.21.15.114:0/1381921987 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39f41465b0 0x7f39f40cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:50.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.257+0000 7f39f8984640 1 -- 172.21.15.114:0/1381921987 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39f406ca60 msgr2=0x7f39f4158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:50.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.257+0000 7f39f8984640 1 --2- 172.21.15.114:0/1381921987 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39f406ca60 0x7f39f4158b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:50.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.257+0000 7f39f8984640 1 -- 172.21.15.114:0/1381921987 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f41f32e0 con 0x7f39f41f2d70 2024-04-28T13:08:50.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.257+0000 7f39f8984640 1 --2- 172.21.15.114:0/1381921987 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39f41f2d70 0x7f39f4145270 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f39ec034040 tx=0x7f39ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:50.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.257+0000 7f39f0ff9640 1 -- 172.21.15.114:0/1381921987 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ec041020 con 0x7f39f41f2d70 2024-04-28T13:08:50.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.257+0000 7f39f0ff9640 1 -- 172.21.15.114:0/1381921987 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39ec0077a0 con 0x7f39f41f2d70 2024-04-28T13:08:50.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.257+0000 7f39fa3e7640 1 -- 172.21.15.114:0/1381921987 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39f41f35c0 con 0x7f39f41f2d70 2024-04-28T13:08:50.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.257+0000 7f39f0ff9640 1 -- 172.21.15.114:0/1381921987 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ec036040 con 0x7f39f41f2d70 2024-04-28T13:08:50.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.257+0000 7f39fa3e7640 1 -- 172.21.15.114:0/1381921987 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39f41f3b80 con 0x7f39f41f2d70 2024-04-28T13:08:50.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.258+0000 7f39fa3e7640 1 -- 172.21.15.114:0/1381921987 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39f406a3d0 con 0x7f39f41f2d70 2024-04-28T13:08:50.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.259+0000 7f39f0ff9640 1 -- 172.21.15.114:0/1381921987 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f39ec044020 con 0x7f39f41f2d70 2024-04-28T13:08:50.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.259+0000 7f39f0ff9640 1 --2- 172.21.15.114:0/1381921987 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f39e006c980 0x7f39e006ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:50.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.259+0000 7f39f0ff9640 1 -- 172.21.15.114:0/1381921987 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f39ec0ac920 con 0x7f39f41f2d70 2024-04-28T13:08:50.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.259+0000 7f39f3fff640 1 --2- 172.21.15.114:0/1381921987 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f39e006c980 0x7f39e006ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:50.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.259+0000 7f39f3fff640 1 --2- 172.21.15.114:0/1381921987 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f39e006c980 0x7f39e006ee40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f39f406f480 tx=0x7f39e4007e30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:50.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.263+0000 7f39f0ff9640 1 -- 172.21.15.114:0/1381921987 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f39ec04b030 con 0x7f39f41f2d70 2024-04-28T13:08:50.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.507+0000 7f39fa3e7640 1 -- 172.21.15.114:0/1381921987 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f39f406d0a0 con 0x7f39f41f2d70 2024-04-28T13:08:50.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.507+0000 7f39f0ff9640 1 -- 172.21.15.114:0/1381921987 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1571 (secure 0 0 0) 0x7f39ec07ac50 con 0x7f39f41f2d70 2024-04-28T13:08:50.508 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:50.508 INFO:teuthology.orchestra.run.smithi114.stdout:{"fsid":"0961cca0-69c8-4b26-b89a-621e12152fc4","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":109,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":46,"num_osds":8,"num_up_osds":8,"osd_up_since":1714309632,"num_in_osds":8,"osd_in_since":1714309623,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":226373632,"bytes_avail":772867739648,"bytes_total":773094113280,"unknown_pgs_ratio":0.98969072103500366},"fsmap":{"epoch":20,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"b","status":"up:active","gid":5601}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-04-28T13:08:14.715898+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-28T13:08:50.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.509+0000 7f39fa3e7640 1 -- 172.21.15.114:0/1381921987 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f39e006c980 msgr2=0x7f39e006ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:50.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.509+0000 7f39fa3e7640 1 --2- 172.21.15.114:0/1381921987 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f39e006c980 0x7f39e006ee40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f39f406f480 tx=0x7f39e4007e30 comp rx=0 tx=0).stop 2024-04-28T13:08:50.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.509+0000 7f39fa3e7640 1 -- 172.21.15.114:0/1381921987 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39f41f2d70 msgr2=0x7f39f4145270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:50.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.509+0000 7f39fa3e7640 1 --2- 172.21.15.114:0/1381921987 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39f41f2d70 0x7f39f4145270 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f39ec034040 tx=0x7f39ec004a40 comp rx=0 tx=0).stop 2024-04-28T13:08:50.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.509+0000 7f39fa3e7640 1 -- 172.21.15.114:0/1381921987 shutdown_connections 2024-04-28T13:08:50.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.509+0000 7f39fa3e7640 1 --2- 172.21.15.114:0/1381921987 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39f41f2d70 0x7f39f4145270 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:50.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.509+0000 7f39fa3e7640 1 --2- 172.21.15.114:0/1381921987 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39f41465b0 0x7f39f40cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:50.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.509+0000 7f39fa3e7640 1 --2- 172.21.15.114:0/1381921987 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f39e006c980 0x7f39e006ee40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:50.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.509+0000 7f39fa3e7640 1 --2- 172.21.15.114:0/1381921987 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39f406ca60 0x7f39f4158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:50.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.509+0000 7f39fa3e7640 1 -- 172.21.15.114:0/1381921987 >> 172.21.15.114:0/1381921987 conn(0x7f39f40b3c50 msgr2=0x7f39f4073f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:50.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.510+0000 7f39fa3e7640 1 -- 172.21.15.114:0/1381921987 shutdown_connections 2024-04-28T13:08:50.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.510+0000 7f39fa3e7640 1 -- 172.21.15.114:0/1381921987 wait complete. 2024-04-28T13:08:50.521 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-28T13:08:50.521 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-28T13:08:50.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.616+0000 7fcf745f7640 1 Processor -- start 2024-04-28T13:08:50.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.616+0000 7fcf745f7640 1 -- start start 2024-04-28T13:08:50.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.617+0000 7fcf745f7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcf6c070d60 0x7fcf6c15d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:50.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.617+0000 7fcf745f7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf6c15e380 con 0x7fcf6c1618c0 2024-04-28T13:08:50.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.617+0000 7fcf745f7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf6c160de0 con 0x7fcf6c140120 2024-04-28T13:08:50.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.617+0000 7fcf745f7640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fcf6c15e660 con 0x7fcf6c070d60 2024-04-28T13:08:50.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.617+0000 7fcf71b92640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcf6c070d60 0x7fcf6c15d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:50.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.617+0000 7fcf71b92640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcf6c070d60 0x7fcf6c15d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43884/0 (socket says 172.21.15.114:43884) 2024-04-28T13:08:50.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.617+0000 7fcf71b92640 1 -- 172.21.15.114:0/3908191328 learned_addr learned my addr 172.21.15.114:0/3908191328 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:50.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.618+0000 7fcf71b92640 1 -- 172.21.15.114:0/3908191328 >> v1:172.21.15.134:6789/0 conn(0x7fcf6c140120 legacy=0x7fcf6c070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:50.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.618+0000 7fcf71b92640 1 -- 172.21.15.114:0/3908191328 >> v1:172.21.15.114:6789/0 conn(0x7fcf6c1618c0 legacy=0x7fcf6c15db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:50.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.618+0000 7fcf71b92640 1 -- 172.21.15.114:0/3908191328 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf6c1610c0 con 0x7fcf6c070d60 2024-04-28T13:08:50.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.618+0000 7fcf71b92640 1 --2- 172.21.15.114:0/3908191328 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf6c070d60 0x7fcf6c15d650 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fcf60009870 tx=0x7fcf6002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6887d4b1b9567b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:50.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.618+0000 7fcf71391640 1 -- 172.21.15.114:0/3908191328 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf60037070 con 0x7fcf6c070d60 2024-04-28T13:08:50.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.619+0000 7fcf71391640 1 -- 172.21.15.114:0/3908191328 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf6002ae50 con 0x7fcf6c070d60 2024-04-28T13:08:50.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.619+0000 7fcf71391640 1 -- 172.21.15.114:0/3908191328 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf60032860 con 0x7fcf6c070d60 2024-04-28T13:08:50.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.619+0000 7fcf745f7640 1 -- 172.21.15.114:0/3908191328 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf6c070d60 msgr2=0x7fcf6c15d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:50.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.619+0000 7fcf745f7640 1 --2- 172.21.15.114:0/3908191328 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf6c070d60 0x7fcf6c15d650 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fcf60009870 tx=0x7fcf6002a300 comp rx=0 tx=0).stop 2024-04-28T13:08:50.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.619+0000 7fcf745f7640 1 -- 172.21.15.114:0/3908191328 shutdown_connections 2024-04-28T13:08:50.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.619+0000 7fcf745f7640 1 --2- 172.21.15.114:0/3908191328 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf6c070d60 0x7fcf6c15d650 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:50.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.619+0000 7fcf745f7640 1 -- 172.21.15.114:0/3908191328 >> 172.21.15.114:0/3908191328 conn(0x7fcf6c0b4c60 msgr2=0x7fcf6c0b5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:50.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.619+0000 7fcf745f7640 1 -- 172.21.15.114:0/3908191328 shutdown_connections 2024-04-28T13:08:50.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.619+0000 7fcf745f7640 1 -- 172.21.15.114:0/3908191328 wait complete. 2024-04-28T13:08:50.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.620+0000 7fcf745f7640 1 Processor -- start 2024-04-28T13:08:50.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.620+0000 7fcf745f7640 1 -- start start 2024-04-28T13:08:50.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.621+0000 7fcf745f7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf6c070d60 0x7fcf6c13d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:50.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.621+0000 7fcf745f7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf6c140120 0x7fcf6c13bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:50.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.621+0000 7fcf745f7640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf6c1618c0 0x7fcf6c153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:50.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.621+0000 7fcf745f7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6c161430 con 0x7fcf6c070d60 2024-04-28T13:08:50.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.621+0000 7fcf745f7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6c140500 con 0x7fcf6c140120 2024-04-28T13:08:50.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.621+0000 7fcf745f7640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fcf6c1681e0 con 0x7fcf6c1618c0 2024-04-28T13:08:50.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.621+0000 7fcf72393640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf6c070d60 0x7fcf6c13d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:50.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.621+0000 7fcf72393640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf6c070d60 0x7fcf6c13d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43892/0 (socket says 172.21.15.114:43892) 2024-04-28T13:08:50.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.621+0000 7fcf72393640 1 -- 172.21.15.114:0/3325232852 learned_addr learned my addr 172.21.15.114:0/3325232852 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:50.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.621+0000 7fcf71b92640 1 --2- 172.21.15.114:0/3325232852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf6c140120 0x7fcf6c13bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:50.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.621+0000 7fcf72393640 1 -- 172.21.15.114:0/3325232852 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf6c1618c0 msgr2=0x7fcf6c153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:50.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.621+0000 7fcf72393640 1 --2- 172.21.15.114:0/3325232852 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf6c1618c0 0x7fcf6c153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:50.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.621+0000 7fcf72393640 1 -- 172.21.15.114:0/3325232852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf6c140120 msgr2=0x7fcf6c13bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:50.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.621+0000 7fcf72393640 1 --2- 172.21.15.114:0/3325232852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf6c140120 0x7fcf6c13bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:50.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.621+0000 7fcf72393640 1 -- 172.21.15.114:0/3325232852 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf6c13c920 con 0x7fcf6c070d60 2024-04-28T13:08:50.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.621+0000 7fcf71b92640 1 --2- 172.21.15.114:0/3325232852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf6c140120 0x7fcf6c13bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:50.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.622+0000 7fcf72393640 1 --2- 172.21.15.114:0/3325232852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf6c070d60 0x7fcf6c13d9c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c00c790 tx=0x7fcf5c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:50.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.622+0000 7fcf6affd640 1 -- 172.21.15.114:0/3325232852 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c016020 con 0x7fcf6c070d60 2024-04-28T13:08:50.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.622+0000 7fcf6affd640 1 -- 172.21.15.114:0/3325232852 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf5c006d50 con 0x7fcf6c070d60 2024-04-28T13:08:50.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.622+0000 7fcf745f7640 1 -- 172.21.15.114:0/3325232852 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf6c13cc00 con 0x7fcf6c070d60 2024-04-28T13:08:50.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.622+0000 7fcf6affd640 1 -- 172.21.15.114:0/3325232852 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c003bb0 con 0x7fcf6c070d60 2024-04-28T13:08:50.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.622+0000 7fcf745f7640 1 -- 172.21.15.114:0/3325232852 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf6c13d1c0 con 0x7fcf6c070d60 2024-04-28T13:08:50.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.623+0000 7fcf745f7640 1 -- 172.21.15.114:0/3325232852 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf6c06a3d0 con 0x7fcf6c070d60 2024-04-28T13:08:50.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.623+0000 7fcf6affd640 1 -- 172.21.15.114:0/3325232852 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7fcf5c00a7f0 con 0x7fcf6c070d60 2024-04-28T13:08:50.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.624+0000 7fcf6affd640 1 --2- 172.21.15.114:0/3325232852 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fcf5806c980 0x7fcf5806ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:50.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.624+0000 7fcf71b92640 1 --2- 172.21.15.114:0/3325232852 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fcf5806c980 0x7fcf5806ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:50.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.624+0000 7fcf6affd640 1 -- 172.21.15.114:0/3325232852 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fcf5c08b7c0 con 0x7fcf6c070d60 2024-04-28T13:08:50.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.624+0000 7fcf71b92640 1 --2- 172.21.15.114:0/3325232852 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fcf5806c980 0x7fcf5806ee40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcf60034000 tx=0x7fcf6002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:50.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.628+0000 7fcf6affd640 1 -- 172.21.15.114:0/3325232852 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fcf5c020020 con 0x7fcf6c070d60 2024-04-28T13:08:50.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.800+0000 7fcf745f7640 1 -- 172.21.15.114:0/3325232852 --> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcf6c0b6060 con 0x7fcf5806c980 2024-04-28T13:08:50.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.806+0000 7fcf6affd640 1 -- 172.21.15.114:0/3325232852 <== mgr.4104 v2:172.21.15.114:6832/2240257326 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251956 (secure 0 0 0) 0x7fcf6c0b6060 con 0x7fcf5806c980 2024-04-28T13:08:50.810 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:50.811 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-04-28T13:08:50.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.809+0000 7fcf745f7640 1 -- 172.21.15.114:0/3325232852 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fcf5806c980 msgr2=0x7fcf5806ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:50.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.809+0000 7fcf745f7640 1 --2- 172.21.15.114:0/3325232852 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fcf5806c980 0x7fcf5806ee40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcf60034000 tx=0x7fcf6002e000 comp rx=0 tx=0).stop 2024-04-28T13:08:50.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.809+0000 7fcf745f7640 1 -- 172.21.15.114:0/3325232852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf6c070d60 msgr2=0x7fcf6c13d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:50.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.809+0000 7fcf745f7640 1 --2- 172.21.15.114:0/3325232852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf6c070d60 0x7fcf6c13d9c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c00c790 tx=0x7fcf5c00cc50 comp rx=0 tx=0).stop 2024-04-28T13:08:50.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.809+0000 7fcf745f7640 1 -- 172.21.15.114:0/3325232852 shutdown_connections 2024-04-28T13:08:50.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.809+0000 7fcf745f7640 1 --2- 172.21.15.114:0/3325232852 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf6c1618c0 0x7fcf6c153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:50.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.809+0000 7fcf745f7640 1 --2- 172.21.15.114:0/3325232852 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fcf5806c980 0x7fcf5806ee40 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:50.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.809+0000 7fcf745f7640 1 --2- 172.21.15.114:0/3325232852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf6c140120 0x7fcf6c13bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:50.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.809+0000 7fcf745f7640 1 --2- 172.21.15.114:0/3325232852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf6c070d60 0x7fcf6c13d9c0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:50.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.809+0000 7fcf745f7640 1 -- 172.21.15.114:0/3325232852 >> 172.21.15.114:0/3325232852 conn(0x7fcf6c0b4c60 msgr2=0x7fcf6c0d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:50.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.809+0000 7fcf745f7640 1 -- 172.21.15.114:0/3325232852 shutdown_connections 2024-04-28T13:08:50.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:50.809+0000 7fcf745f7640 1 -- 172.21.15.114:0/3325232852 wait complete. 2024-04-28T13:08:50.821 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2024-04-28T13:08:50.721707+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221600,"kb_used_data":5412,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753120,"statfs":{"total":773094113280,"available":772867194880,"internally_reserved":0,"allocated":5541888,"data_stored":2925008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000897"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009321+0000","last_change":"2024-04-28T13:08:46.486112+0000","last_active":"2024-04-28T13:08:48.009321+0000","last_peered":"2024-04-28T13:08:48.009321+0000","last_clean":"2024-04-28T13:08:48.009321+0000","last_became_active":"2024-04-28T13:08:46.485811+0000","last_became_peered":"2024-04-28T13:08:46.485811+0000","last_unstale":"2024-04-28T13:08:48.009321+0000","last_undegraded":"2024-04-28T13:08:48.009321+0000","last_fullsized":"2024-04-28T13:08:48.009321+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:24:18.784318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.484289+0000","last_change":"2024-04-28T13:08:46.497996+0000","last_active":"2024-04-28T13:08:47.484289+0000","last_peered":"2024-04-28T13:08:47.484289+0000","last_clean":"2024-04-28T13:08:47.484289+0000","last_became_active":"2024-04-28T13:08:46.497698+0000","last_became_peered":"2024-04-28T13:08:46.497698+0000","last_unstale":"2024-04-28T13:08:47.484289+0000","last_undegraded":"2024-04-28T13:08:47.484289+0000","last_fullsized":"2024-04-28T13:08:47.484289+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:32:53.022191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009244+0000","last_change":"2024-04-28T13:08:46.476214+0000","last_active":"2024-04-28T13:08:48.009244+0000","last_peered":"2024-04-28T13:08:48.009244+0000","last_clean":"2024-04-28T13:08:48.009244+0000","last_became_active":"2024-04-28T13:08:46.475942+0000","last_became_peered":"2024-04-28T13:08:46.475942+0000","last_unstale":"2024-04-28T13:08:48.009244+0000","last_undegraded":"2024-04-28T13:08:48.009244+0000","last_fullsized":"2024-04-28T13:08:48.009244+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:59:18.202055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008764+0000","last_change":"2024-04-28T13:08:46.490291+0000","last_active":"2024-04-28T13:08:48.008764+0000","last_peered":"2024-04-28T13:08:48.008764+0000","last_clean":"2024-04-28T13:08:48.008764+0000","last_became_active":"2024-04-28T13:08:46.489687+0000","last_became_peered":"2024-04-28T13:08:46.489687+0000","last_unstale":"2024-04-28T13:08:48.008764+0000","last_undegraded":"2024-04-28T13:08:48.008764+0000","last_fullsized":"2024-04-28T13:08:48.008764+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:59:18.202055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.484408+0000","last_change":"2024-04-28T13:08:46.498986+0000","last_active":"2024-04-28T13:08:47.484408+0000","last_peered":"2024-04-28T13:08:47.484408+0000","last_clean":"2024-04-28T13:08:47.484408+0000","last_became_active":"2024-04-28T13:08:46.498694+0000","last_became_peered":"2024-04-28T13:08:46.498694+0000","last_unstale":"2024-04-28T13:08:47.484408+0000","last_undegraded":"2024-04-28T13:08:47.484408+0000","last_fullsized":"2024-04-28T13:08:47.484408+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T01:00:59.652757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008823+0000","last_change":"2024-04-28T13:08:46.491382+0000","last_active":"2024-04-28T13:08:48.008823+0000","last_peered":"2024-04-28T13:08:48.008823+0000","last_clean":"2024-04-28T13:08:48.008823+0000","last_became_active":"2024-04-28T13:08:46.490674+0000","last_became_peered":"2024-04-28T13:08:46.490674+0000","last_unstale":"2024-04-28T13:08:48.008823+0000","last_undegraded":"2024-04-28T13:08:48.008823+0000","last_fullsized":"2024-04-28T13:08:48.008823+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:25:50.867343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009139+0000","last_change":"2024-04-28T13:08:46.484994+0000","last_active":"2024-04-28T13:08:48.009139+0000","last_peered":"2024-04-28T13:08:48.009139+0000","last_clean":"2024-04-28T13:08:48.009139+0000","last_became_active":"2024-04-28T13:08:46.484702+0000","last_became_peered":"2024-04-28T13:08:46.484702+0000","last_unstale":"2024-04-28T13:08:48.009139+0000","last_undegraded":"2024-04-28T13:08:48.009139+0000","last_fullsized":"2024-04-28T13:08:48.009139+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T01:00:59.652757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008700+0000","last_change":"2024-04-28T13:08:46.493885+0000","last_active":"2024-04-28T13:08:48.008700+0000","last_peered":"2024-04-28T13:08:48.008700+0000","last_clean":"2024-04-28T13:08:48.008700+0000","last_became_active":"2024-04-28T13:08:46.493647+0000","last_became_peered":"2024-04-28T13:08:46.493647+0000","last_unstale":"2024-04-28T13:08:48.008700+0000","last_undegraded":"2024-04-28T13:08:48.008700+0000","last_fullsized":"2024-04-28T13:08:48.008700+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T20:39:23.167661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008709+0000","last_change":"2024-04-28T13:08:46.491793+0000","last_active":"2024-04-28T13:08:48.008709+0000","last_peered":"2024-04-28T13:08:48.008709+0000","last_clean":"2024-04-28T13:08:48.008709+0000","last_became_active":"2024-04-28T13:08:46.490716+0000","last_became_peered":"2024-04-28T13:08:46.490716+0000","last_unstale":"2024-04-28T13:08:48.008709+0000","last_undegraded":"2024-04-28T13:08:48.008709+0000","last_fullsized":"2024-04-28T13:08:48.008709+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:23:18.851988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009569+0000","last_change":"2024-04-28T13:08:46.494213+0000","last_active":"2024-04-28T13:08:48.009569+0000","last_peered":"2024-04-28T13:08:48.009569+0000","last_clean":"2024-04-28T13:08:48.009569+0000","last_became_active":"2024-04-28T13:08:46.493936+0000","last_became_peered":"2024-04-28T13:08:46.493936+0000","last_unstale":"2024-04-28T13:08:48.009569+0000","last_undegraded":"2024-04-28T13:08:48.009569+0000","last_fullsized":"2024-04-28T13:08:48.009569+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T16:18:25.300038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008927+0000","last_change":"2024-04-28T13:08:46.489754+0000","last_active":"2024-04-28T13:08:48.008927+0000","last_peered":"2024-04-28T13:08:48.008927+0000","last_clean":"2024-04-28T13:08:48.008927+0000","last_became_active":"2024-04-28T13:08:46.489253+0000","last_became_peered":"2024-04-28T13:08:46.489253+0000","last_unstale":"2024-04-28T13:08:48.008927+0000","last_undegraded":"2024-04-28T13:08:48.008927+0000","last_fullsized":"2024-04-28T13:08:48.008927+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T01:00:59.652757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.484139+0000","last_change":"2024-04-28T13:08:46.496423+0000","last_active":"2024-04-28T13:08:47.484139+0000","last_peered":"2024-04-28T13:08:47.484139+0000","last_clean":"2024-04-28T13:08:47.484139+0000","last_became_active":"2024-04-28T13:08:46.495899+0000","last_became_peered":"2024-04-28T13:08:46.495899+0000","last_unstale":"2024-04-28T13:08:47.484139+0000","last_undegraded":"2024-04-28T13:08:47.484139+0000","last_fullsized":"2024-04-28T13:08:47.484139+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:23:18.851988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009720+0000","last_change":"2024-04-28T13:08:46.491804+0000","last_active":"2024-04-28T13:08:48.009720+0000","last_peered":"2024-04-28T13:08:48.009720+0000","last_clean":"2024-04-28T13:08:48.009720+0000","last_became_active":"2024-04-28T13:08:46.491574+0000","last_became_peered":"2024-04-28T13:08:46.491574+0000","last_unstale":"2024-04-28T13:08:48.009720+0000","last_undegraded":"2024-04-28T13:08:48.009720+0000","last_fullsized":"2024-04-28T13:08:48.009720+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:45:57.279535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009149+0000","last_change":"2024-04-28T13:08:46.493606+0000","last_active":"2024-04-28T13:08:48.009149+0000","last_peered":"2024-04-28T13:08:48.009149+0000","last_clean":"2024-04-28T13:08:48.009149+0000","last_became_active":"2024-04-28T13:08:46.493167+0000","last_became_peered":"2024-04-28T13:08:46.493167+0000","last_unstale":"2024-04-28T13:08:48.009149+0000","last_undegraded":"2024-04-28T13:08:48.009149+0000","last_fullsized":"2024-04-28T13:08:48.009149+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:38:11.491053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008561+0000","last_change":"2024-04-28T13:08:46.487785+0000","last_active":"2024-04-28T13:08:48.008561+0000","last_peered":"2024-04-28T13:08:48.008561+0000","last_clean":"2024-04-28T13:08:48.008561+0000","last_became_active":"2024-04-28T13:08:46.487478+0000","last_became_peered":"2024-04-28T13:08:46.487478+0000","last_unstale":"2024-04-28T13:08:48.008561+0000","last_undegraded":"2024-04-28T13:08:48.008561+0000","last_fullsized":"2024-04-28T13:08:48.008561+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:12:58.136365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.597475+0000","last_change":"2024-04-28T13:08:46.497501+0000","last_active":"2024-04-28T13:08:47.597475+0000","last_peered":"2024-04-28T13:08:47.597475+0000","last_clean":"2024-04-28T13:08:47.597475+0000","last_became_active":"2024-04-28T13:08:46.497217+0000","last_became_peered":"2024-04-28T13:08:46.497217+0000","last_unstale":"2024-04-28T13:08:47.597475+0000","last_undegraded":"2024-04-28T13:08:47.597475+0000","last_fullsized":"2024-04-28T13:08:47.597475+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T13:39:44.452178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009213+0000","last_change":"2024-04-28T13:08:46.489985+0000","last_active":"2024-04-28T13:08:48.009213+0000","last_peered":"2024-04-28T13:08:48.009213+0000","last_clean":"2024-04-28T13:08:48.009213+0000","last_became_active":"2024-04-28T13:08:46.489663+0000","last_became_peered":"2024-04-28T13:08:46.489663+0000","last_unstale":"2024-04-28T13:08:48.009213+0000","last_undegraded":"2024-04-28T13:08:48.009213+0000","last_fullsized":"2024-04-28T13:08:48.009213+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:23:18.851988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009076+0000","last_change":"2024-04-28T13:08:46.497004+0000","last_active":"2024-04-28T13:08:48.009076+0000","last_peered":"2024-04-28T13:08:48.009076+0000","last_clean":"2024-04-28T13:08:48.009076+0000","last_became_active":"2024-04-28T13:08:46.496249+0000","last_became_peered":"2024-04-28T13:08:46.496249+0000","last_unstale":"2024-04-28T13:08:48.009076+0000","last_undegraded":"2024-04-28T13:08:48.009076+0000","last_fullsized":"2024-04-28T13:08:48.009076+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:54:36.237979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.597988+0000","last_change":"2024-04-28T13:08:46.498004+0000","last_active":"2024-04-28T13:08:47.597988+0000","last_peered":"2024-04-28T13:08:47.597988+0000","last_clean":"2024-04-28T13:08:47.597988+0000","last_became_active":"2024-04-28T13:08:46.497392+0000","last_became_peered":"2024-04-28T13:08:46.497392+0000","last_unstale":"2024-04-28T13:08:47.597988+0000","last_undegraded":"2024-04-28T13:08:47.597988+0000","last_fullsized":"2024-04-28T13:08:47.597988+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T16:48:52.137666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009899+0000","last_change":"2024-04-28T13:08:46.493676+0000","last_active":"2024-04-28T13:08:48.009899+0000","last_peered":"2024-04-28T13:08:48.009899+0000","last_clean":"2024-04-28T13:08:48.009899+0000","last_became_active":"2024-04-28T13:08:46.493412+0000","last_became_peered":"2024-04-28T13:08:46.493412+0000","last_unstale":"2024-04-28T13:08:48.009899+0000","last_undegraded":"2024-04-28T13:08:48.009899+0000","last_fullsized":"2024-04-28T13:08:48.009899+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T13:32:40.138587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008874+0000","last_change":"2024-04-28T13:08:46.489349+0000","last_active":"2024-04-28T13:08:48.008874+0000","last_peered":"2024-04-28T13:08:48.008874+0000","last_clean":"2024-04-28T13:08:48.008874+0000","last_became_active":"2024-04-28T13:08:46.489054+0000","last_became_peered":"2024-04-28T13:08:46.489054+0000","last_unstale":"2024-04-28T13:08:48.008874+0000","last_undegraded":"2024-04-28T13:08:48.008874+0000","last_fullsized":"2024-04-28T13:08:48.008874+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:02:36.948384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009287+0000","last_change":"2024-04-28T13:08:46.492338+0000","last_active":"2024-04-28T13:08:48.009287+0000","last_peered":"2024-04-28T13:08:48.009287+0000","last_clean":"2024-04-28T13:08:48.009287+0000","last_became_active":"2024-04-28T13:08:46.492071+0000","last_became_peered":"2024-04-28T13:08:46.492071+0000","last_unstale":"2024-04-28T13:08:48.009287+0000","last_undegraded":"2024-04-28T13:08:48.009287+0000","last_fullsized":"2024-04-28T13:08:48.009287+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T16:40:18.998184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.597585+0000","last_change":"2024-04-28T13:08:46.493570+0000","last_active":"2024-04-28T13:08:47.597585+0000","last_peered":"2024-04-28T13:08:47.597585+0000","last_clean":"2024-04-28T13:08:47.597585+0000","last_became_active":"2024-04-28T13:08:46.493216+0000","last_became_peered":"2024-04-28T13:08:46.493216+0000","last_unstale":"2024-04-28T13:08:47.597585+0000","last_undegraded":"2024-04-28T13:08:47.597585+0000","last_fullsized":"2024-04-28T13:08:47.597585+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T13:38:28.441808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.597489+0000","last_change":"2024-04-28T13:08:46.493253+0000","last_active":"2024-04-28T13:08:47.597489+0000","last_peered":"2024-04-28T13:08:47.597489+0000","last_clean":"2024-04-28T13:08:47.597489+0000","last_became_active":"2024-04-28T13:08:46.492958+0000","last_became_peered":"2024-04-28T13:08:46.492958+0000","last_unstale":"2024-04-28T13:08:47.597489+0000","last_undegraded":"2024-04-28T13:08:47.597489+0000","last_fullsized":"2024-04-28T13:08:47.597489+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:58:24.253238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.597952+0000","last_change":"2024-04-28T13:08:46.488772+0000","last_active":"2024-04-28T13:08:47.597952+0000","last_peered":"2024-04-28T13:08:47.597952+0000","last_clean":"2024-04-28T13:08:47.597952+0000","last_became_active":"2024-04-28T13:08:46.487745+0000","last_became_peered":"2024-04-28T13:08:46.487745+0000","last_unstale":"2024-04-28T13:08:47.597952+0000","last_undegraded":"2024-04-28T13:08:47.597952+0000","last_fullsized":"2024-04-28T13:08:47.597952+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:22:27.892391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009817+0000","last_change":"2024-04-28T13:08:46.490977+0000","last_active":"2024-04-28T13:08:48.009817+0000","last_peered":"2024-04-28T13:08:48.009817+0000","last_clean":"2024-04-28T13:08:48.009817+0000","last_became_active":"2024-04-28T13:08:46.490674+0000","last_became_peered":"2024-04-28T13:08:46.490674+0000","last_unstale":"2024-04-28T13:08:48.009817+0000","last_undegraded":"2024-04-28T13:08:48.009817+0000","last_fullsized":"2024-04-28T13:08:48.009817+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:24:45.655105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009110+0000","last_change":"2024-04-28T13:08:46.490987+0000","last_active":"2024-04-28T13:08:48.009110+0000","last_peered":"2024-04-28T13:08:48.009110+0000","last_clean":"2024-04-28T13:08:48.009110+0000","last_became_active":"2024-04-28T13:08:46.490680+0000","last_became_peered":"2024-04-28T13:08:46.490680+0000","last_unstale":"2024-04-28T13:08:48.009110+0000","last_undegraded":"2024-04-28T13:08:48.009110+0000","last_fullsized":"2024-04-28T13:08:48.009110+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T20:39:23.167661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.484172+0000","last_change":"2024-04-28T13:08:46.496153+0000","last_active":"2024-04-28T13:08:47.484172+0000","last_peered":"2024-04-28T13:08:47.484172+0000","last_clean":"2024-04-28T13:08:47.484172+0000","last_became_active":"2024-04-28T13:08:46.495544+0000","last_became_peered":"2024-04-28T13:08:46.495544+0000","last_unstale":"2024-04-28T13:08:47.484172+0000","last_undegraded":"2024-04-28T13:08:47.484172+0000","last_fullsized":"2024-04-28T13:08:47.484172+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:59:18.202055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.597694+0000","last_change":"2024-04-28T13:08:46.486512+0000","last_active":"2024-04-28T13:08:47.597694+0000","last_peered":"2024-04-28T13:08:47.597694+0000","last_clean":"2024-04-28T13:08:47.597694+0000","last_became_active":"2024-04-28T13:08:46.485258+0000","last_became_peered":"2024-04-28T13:08:46.485258+0000","last_unstale":"2024-04-28T13:08:47.597694+0000","last_undegraded":"2024-04-28T13:08:47.597694+0000","last_fullsized":"2024-04-28T13:08:47.597694+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:06:15.671991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008471+0000","last_change":"2024-04-28T13:08:46.479202+0000","last_active":"2024-04-28T13:08:48.008471+0000","last_peered":"2024-04-28T13:08:48.008471+0000","last_clean":"2024-04-28T13:08:48.008471+0000","last_became_active":"2024-04-28T13:08:46.478934+0000","last_became_peered":"2024-04-28T13:08:46.478934+0000","last_unstale":"2024-04-28T13:08:48.008471+0000","last_undegraded":"2024-04-28T13:08:48.008471+0000","last_fullsized":"2024-04-28T13:08:48.008471+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T16:48:52.137666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008689+0000","last_change":"2024-04-28T13:08:46.490061+0000","last_active":"2024-04-28T13:08:48.008689+0000","last_peered":"2024-04-28T13:08:48.008689+0000","last_clean":"2024-04-28T13:08:48.008689+0000","last_became_active":"2024-04-28T13:08:46.489818+0000","last_became_peered":"2024-04-28T13:08:46.489818+0000","last_unstale":"2024-04-28T13:08:48.008689+0000","last_undegraded":"2024-04-28T13:08:48.008689+0000","last_fullsized":"2024-04-28T13:08:48.008689+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:03:00.821016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008353+0000","last_change":"2024-04-28T13:08:46.485350+0000","last_active":"2024-04-28T13:08:48.008353+0000","last_peered":"2024-04-28T13:08:48.008353+0000","last_clean":"2024-04-28T13:08:48.008353+0000","last_became_active":"2024-04-28T13:08:46.482918+0000","last_became_peered":"2024-04-28T13:08:46.482918+0000","last_unstale":"2024-04-28T13:08:48.008353+0000","last_undegraded":"2024-04-28T13:08:48.008353+0000","last_fullsized":"2024-04-28T13:08:48.008353+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:00:11.203345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.483267+0000","last_change":"2024-04-28T13:08:46.493313+0000","last_active":"2024-04-28T13:08:47.483267+0000","last_peered":"2024-04-28T13:08:47.483267+0000","last_clean":"2024-04-28T13:08:47.483267+0000","last_became_active":"2024-04-28T13:08:46.493023+0000","last_became_peered":"2024-04-28T13:08:46.493023+0000","last_unstale":"2024-04-28T13:08:47.483267+0000","last_undegraded":"2024-04-28T13:08:47.483267+0000","last_fullsized":"2024-04-28T13:08:47.483267+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:15:46.326519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"45'4","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008746+0000","last_change":"2024-04-28T13:08:45.460747+0000","last_active":"2024-04-28T13:08:48.008746+0000","last_peered":"2024-04-28T13:08:48.008746+0000","last_clean":"2024-04-28T13:08:48.008746+0000","last_became_active":"2024-04-28T13:08:45.460396+0000","last_became_peered":"2024-04-28T13:08:45.460396+0000","last_unstale":"2024-04-28T13:08:48.008746+0000","last_undegraded":"2024-04-28T13:08:48.008746+0000","last_fullsized":"2024-04-28T13:08:48.008746+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:39:02.828220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.598014+0000","last_change":"2024-04-28T13:08:46.488990+0000","last_active":"2024-04-28T13:08:47.598014+0000","last_peered":"2024-04-28T13:08:47.598014+0000","last_clean":"2024-04-28T13:08:47.598014+0000","last_became_active":"2024-04-28T13:08:46.488526+0000","last_became_peered":"2024-04-28T13:08:46.488526+0000","last_unstale":"2024-04-28T13:08:47.598014+0000","last_undegraded":"2024-04-28T13:08:47.598014+0000","last_fullsized":"2024-04-28T13:08:47.598014+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:53:13.029772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009108+0000","last_change":"2024-04-28T13:08:45.465088+0000","last_active":"2024-04-28T13:08:48.009108+0000","last_peered":"2024-04-28T13:08:48.009108+0000","last_clean":"2024-04-28T13:08:48.009108+0000","last_became_active":"2024-04-28T13:08:45.464705+0000","last_became_peered":"2024-04-28T13:08:45.464705+0000","last_unstale":"2024-04-28T13:08:48.009108+0000","last_undegraded":"2024-04-28T13:08:48.009108+0000","last_fullsized":"2024-04-28T13:08:48.009108+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:28:53.722788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.484327+0000","last_change":"2024-04-28T13:08:46.490516+0000","last_active":"2024-04-28T13:08:47.484327+0000","last_peered":"2024-04-28T13:08:47.484327+0000","last_clean":"2024-04-28T13:08:47.484327+0000","last_became_active":"2024-04-28T13:08:46.490232+0000","last_became_peered":"2024-04-28T13:08:46.490232+0000","last_unstale":"2024-04-28T13:08:47.484327+0000","last_undegraded":"2024-04-28T13:08:47.484327+0000","last_fullsized":"2024-04-28T13:08:47.484327+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:39:03.829917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.483411+0000","last_change":"2024-04-28T13:08:45.465502+0000","last_active":"2024-04-28T13:08:47.483411+0000","last_peered":"2024-04-28T13:08:47.483411+0000","last_clean":"2024-04-28T13:08:47.483411+0000","last_became_active":"2024-04-28T13:08:45.465207+0000","last_became_peered":"2024-04-28T13:08:45.465207+0000","last_unstale":"2024-04-28T13:08:47.483411+0000","last_undegraded":"2024-04-28T13:08:47.483411+0000","last_fullsized":"2024-04-28T13:08:47.483411+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:42:42.266586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.483357+0000","last_change":"2024-04-28T13:08:46.488254+0000","last_active":"2024-04-28T13:08:47.483357+0000","last_peered":"2024-04-28T13:08:47.483357+0000","last_clean":"2024-04-28T13:08:47.483357+0000","last_became_active":"2024-04-28T13:08:46.487966+0000","last_became_peered":"2024-04-28T13:08:46.487966+0000","last_unstale":"2024-04-28T13:08:47.483357+0000","last_undegraded":"2024-04-28T13:08:47.483357+0000","last_fullsized":"2024-04-28T13:08:47.483357+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:06:15.671991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008732+0000","last_change":"2024-04-28T13:08:45.467104+0000","last_active":"2024-04-28T13:08:48.008732+0000","last_peered":"2024-04-28T13:08:48.008732+0000","last_clean":"2024-04-28T13:08:48.008732+0000","last_became_active":"2024-04-28T13:08:45.466819+0000","last_became_peered":"2024-04-28T13:08:45.466819+0000","last_unstale":"2024-04-28T13:08:48.008732+0000","last_undegraded":"2024-04-28T13:08:48.008732+0000","last_fullsized":"2024-04-28T13:08:48.008732+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:51:03.462793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008512+0000","last_change":"2024-04-28T13:08:46.485301+0000","last_active":"2024-04-28T13:08:48.008512+0000","last_peered":"2024-04-28T13:08:48.008512+0000","last_clean":"2024-04-28T13:08:48.008512+0000","last_became_active":"2024-04-28T13:08:46.484828+0000","last_became_peered":"2024-04-28T13:08:46.484828+0000","last_unstale":"2024-04-28T13:08:48.008512+0000","last_undegraded":"2024-04-28T13:08:48.008512+0000","last_fullsized":"2024-04-28T13:08:48.008512+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:53:13.029772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009078+0000","last_change":"2024-04-28T13:08:45.459966+0000","last_active":"2024-04-28T13:08:48.009078+0000","last_peered":"2024-04-28T13:08:48.009078+0000","last_clean":"2024-04-28T13:08:48.009078+0000","last_became_active":"2024-04-28T13:08:45.459690+0000","last_became_peered":"2024-04-28T13:08:45.459690+0000","last_unstale":"2024-04-28T13:08:48.009078+0000","last_undegraded":"2024-04-28T13:08:48.009078+0000","last_fullsized":"2024-04-28T13:08:48.009078+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:23:17.850292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009410+0000","last_change":"2024-04-28T13:08:46.490637+0000","last_active":"2024-04-28T13:08:48.009410+0000","last_peered":"2024-04-28T13:08:48.009410+0000","last_clean":"2024-04-28T13:08:48.009410+0000","last_became_active":"2024-04-28T13:08:46.490365+0000","last_became_peered":"2024-04-28T13:08:46.490365+0000","last_unstale":"2024-04-28T13:08:48.009410+0000","last_undegraded":"2024-04-28T13:08:48.009410+0000","last_fullsized":"2024-04-28T13:08:48.009410+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:00:57.373502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008592+0000","last_change":"2024-04-28T13:08:45.465235+0000","last_active":"2024-04-28T13:08:48.008592+0000","last_peered":"2024-04-28T13:08:48.008592+0000","last_clean":"2024-04-28T13:08:48.008592+0000","last_became_active":"2024-04-28T13:08:45.464916+0000","last_became_peered":"2024-04-28T13:08:45.464916+0000","last_unstale":"2024-04-28T13:08:48.008592+0000","last_undegraded":"2024-04-28T13:08:48.008592+0000","last_fullsized":"2024-04-28T13:08:48.008592+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:49:29.788851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008971+0000","last_change":"2024-04-28T13:08:46.493442+0000","last_active":"2024-04-28T13:08:48.008971+0000","last_peered":"2024-04-28T13:08:48.008971+0000","last_clean":"2024-04-28T13:08:48.008971+0000","last_became_active":"2024-04-28T13:08:46.493198+0000","last_became_peered":"2024-04-28T13:08:46.493198+0000","last_unstale":"2024-04-28T13:08:48.008971+0000","last_undegraded":"2024-04-28T13:08:48.008971+0000","last_fullsized":"2024-04-28T13:08:48.008971+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:24:18.784318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.483891+0000","last_change":"2024-04-28T13:08:45.464658+0000","last_active":"2024-04-28T13:08:47.483891+0000","last_peered":"2024-04-28T13:08:47.483891+0000","last_clean":"2024-04-28T13:08:47.483891+0000","last_became_active":"2024-04-28T13:08:45.464321+0000","last_became_peered":"2024-04-28T13:08:45.464321+0000","last_unstale":"2024-04-28T13:08:47.483891+0000","last_undegraded":"2024-04-28T13:08:47.483891+0000","last_fullsized":"2024-04-28T13:08:47.483891+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:06:14.670295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.597449+0000","last_change":"2024-04-28T13:08:46.493896+0000","last_active":"2024-04-28T13:08:47.597449+0000","last_peered":"2024-04-28T13:08:47.597449+0000","last_clean":"2024-04-28T13:08:47.597449+0000","last_became_active":"2024-04-28T13:08:46.493550+0000","last_became_peered":"2024-04-28T13:08:46.493550+0000","last_unstale":"2024-04-28T13:08:47.597449+0000","last_undegraded":"2024-04-28T13:08:47.597449+0000","last_fullsized":"2024-04-28T13:08:47.597449+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:28:54.724484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009054+0000","last_change":"2024-04-28T13:08:45.462963+0000","last_active":"2024-04-28T13:08:48.009054+0000","last_peered":"2024-04-28T13:08:48.009054+0000","last_clean":"2024-04-28T13:08:48.009054+0000","last_became_active":"2024-04-28T13:08:45.462674+0000","last_became_peered":"2024-04-28T13:08:45.462674+0000","last_unstale":"2024-04-28T13:08:48.009054+0000","last_undegraded":"2024-04-28T13:08:48.009054+0000","last_fullsized":"2024-04-28T13:08:48.009054+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:46:50.741397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008773+0000","last_change":"2024-04-28T13:08:46.496482+0000","last_active":"2024-04-28T13:08:48.008773+0000","last_peered":"2024-04-28T13:08:48.008773+0000","last_clean":"2024-04-28T13:08:48.008773+0000","last_became_active":"2024-04-28T13:08:46.494495+0000","last_became_peered":"2024-04-28T13:08:46.494495+0000","last_unstale":"2024-04-28T13:08:48.008773+0000","last_undegraded":"2024-04-28T13:08:48.008773+0000","last_fullsized":"2024-04-28T13:08:48.008773+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:01:20.664192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009296+0000","last_change":"2024-04-28T13:08:45.462792+0000","last_active":"2024-04-28T13:08:48.009296+0000","last_peered":"2024-04-28T13:08:48.009296+0000","last_clean":"2024-04-28T13:08:48.009296+0000","last_became_active":"2024-04-28T13:08:45.462520+0000","last_became_peered":"2024-04-28T13:08:45.462520+0000","last_unstale":"2024-04-28T13:08:48.009296+0000","last_undegraded":"2024-04-28T13:08:48.009296+0000","last_fullsized":"2024-04-28T13:08:48.009296+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:46:47.375362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009382+0000","last_change":"2024-04-28T13:08:46.491734+0000","last_active":"2024-04-28T13:08:48.009382+0000","last_peered":"2024-04-28T13:08:48.009382+0000","last_clean":"2024-04-28T13:08:48.009382+0000","last_became_active":"2024-04-28T13:08:46.491445+0000","last_became_peered":"2024-04-28T13:08:46.491445+0000","last_unstale":"2024-04-28T13:08:48.009382+0000","last_undegraded":"2024-04-28T13:08:48.009382+0000","last_fullsized":"2024-04-28T13:08:48.009382+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:34:46.589932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009644+0000","last_change":"2024-04-28T13:08:45.464689+0000","last_active":"2024-04-28T13:08:48.009644+0000","last_peered":"2024-04-28T13:08:48.009644+0000","last_clean":"2024-04-28T13:08:48.009644+0000","last_became_active":"2024-04-28T13:08:45.464308+0000","last_became_peered":"2024-04-28T13:08:45.464308+0000","last_unstale":"2024-04-28T13:08:48.009644+0000","last_undegraded":"2024-04-28T13:08:48.009644+0000","last_fullsized":"2024-04-28T13:08:48.009644+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:42:42.266586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009504+0000","last_change":"2024-04-28T13:08:46.497034+0000","last_active":"2024-04-28T13:08:48.009504+0000","last_peered":"2024-04-28T13:08:48.009504+0000","last_clean":"2024-04-28T13:08:48.009504+0000","last_became_active":"2024-04-28T13:08:46.496008+0000","last_became_peered":"2024-04-28T13:08:46.496008+0000","last_unstale":"2024-04-28T13:08:48.009504+0000","last_undegraded":"2024-04-28T13:08:48.009504+0000","last_fullsized":"2024-04-28T13:08:48.009504+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:32:40.617152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"45'3","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009149+0000","last_change":"2024-04-28T13:08:45.462799+0000","last_active":"2024-04-28T13:08:48.009149+0000","last_peered":"2024-04-28T13:08:48.009149+0000","last_clean":"2024-04-28T13:08:48.009149+0000","last_became_active":"2024-04-28T13:08:45.462518+0000","last_became_peered":"2024-04-28T13:08:45.462518+0000","last_unstale":"2024-04-28T13:08:48.009149+0000","last_undegraded":"2024-04-28T13:08:48.009149+0000","last_fullsized":"2024-04-28T13:08:48.009149+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T16:48:51.135970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008797+0000","last_change":"2024-04-28T13:08:46.487016+0000","last_active":"2024-04-28T13:08:48.008797+0000","last_peered":"2024-04-28T13:08:48.008797+0000","last_clean":"2024-04-28T13:08:48.008797+0000","last_became_active":"2024-04-28T13:08:46.486703+0000","last_became_peered":"2024-04-28T13:08:46.486703+0000","last_unstale":"2024-04-28T13:08:48.008797+0000","last_undegraded":"2024-04-28T13:08:48.008797+0000","last_fullsized":"2024-04-28T13:08:48.008797+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:32:53.022191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"45'6","reported_seq":20,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009914+0000","last_change":"2024-04-28T13:08:45.459549+0000","last_active":"2024-04-28T13:08:48.009914+0000","last_peered":"2024-04-28T13:08:48.009914+0000","last_clean":"2024-04-28T13:08:48.009914+0000","last_became_active":"2024-04-28T13:08:45.459244+0000","last_became_peered":"2024-04-28T13:08:45.459244+0000","last_unstale":"2024-04-28T13:08:48.009914+0000","last_undegraded":"2024-04-28T13:08:48.009914+0000","last_fullsized":"2024-04-28T13:08:48.009914+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:10:07.647730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.597671+0000","last_change":"2024-04-28T13:08:46.497725+0000","last_active":"2024-04-28T13:08:47.597671+0000","last_peered":"2024-04-28T13:08:47.597671+0000","last_clean":"2024-04-28T13:08:47.597671+0000","last_became_active":"2024-04-28T13:08:46.497241+0000","last_became_peered":"2024-04-28T13:08:46.497241+0000","last_unstale":"2024-04-28T13:08:47.597671+0000","last_undegraded":"2024-04-28T13:08:47.597671+0000","last_fullsized":"2024-04-28T13:08:47.597671+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:15:46.326519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009167+0000","last_change":"2024-04-28T13:08:45.463265+0000","last_active":"2024-04-28T13:08:48.009167+0000","last_peered":"2024-04-28T13:08:48.009167+0000","last_clean":"2024-04-28T13:08:48.009167+0000","last_became_active":"2024-04-28T13:08:45.463003+0000","last_became_peered":"2024-04-28T13:08:45.463003+0000","last_unstale":"2024-04-28T13:08:48.009167+0000","last_undegraded":"2024-04-28T13:08:48.009167+0000","last_fullsized":"2024-04-28T13:08:48.009167+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:59:17.200359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009539+0000","last_change":"2024-04-28T13:08:46.494851+0000","last_active":"2024-04-28T13:08:48.009539+0000","last_peered":"2024-04-28T13:08:48.009539+0000","last_clean":"2024-04-28T13:08:48.009539+0000","last_became_active":"2024-04-28T13:08:46.494558+0000","last_became_peered":"2024-04-28T13:08:46.494558+0000","last_unstale":"2024-04-28T13:08:48.009539+0000","last_undegraded":"2024-04-28T13:08:48.009539+0000","last_fullsized":"2024-04-28T13:08:48.009539+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:02:06.188422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008866+0000","last_change":"2024-04-28T13:08:45.456415+0000","last_active":"2024-04-28T13:08:48.008866+0000","last_peered":"2024-04-28T13:08:48.008866+0000","last_clean":"2024-04-28T13:08:48.008866+0000","last_became_active":"2024-04-28T13:08:45.456131+0000","last_became_peered":"2024-04-28T13:08:45.456131+0000","last_unstale":"2024-04-28T13:08:48.008866+0000","last_undegraded":"2024-04-28T13:08:48.008866+0000","last_fullsized":"2024-04-28T13:08:48.008866+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:08:41.235049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008441+0000","last_change":"2024-04-28T13:08:46.490470+0000","last_active":"2024-04-28T13:08:48.008441+0000","last_peered":"2024-04-28T13:08:48.008441+0000","last_clean":"2024-04-28T13:08:48.008441+0000","last_became_active":"2024-04-28T13:08:46.490183+0000","last_became_peered":"2024-04-28T13:08:46.490183+0000","last_unstale":"2024-04-28T13:08:48.008441+0000","last_undegraded":"2024-04-28T13:08:48.008441+0000","last_fullsized":"2024-04-28T13:08:48.008441+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:54:51.856383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008774+0000","last_change":"2024-04-28T13:08:45.462727+0000","last_active":"2024-04-28T13:08:48.008774+0000","last_peered":"2024-04-28T13:08:48.008774+0000","last_clean":"2024-04-28T13:08:48.008774+0000","last_became_active":"2024-04-28T13:08:45.462419+0000","last_became_peered":"2024-04-28T13:08:45.462419+0000","last_unstale":"2024-04-28T13:08:48.008774+0000","last_undegraded":"2024-04-28T13:08:48.008774+0000","last_fullsized":"2024-04-28T13:08:48.008774+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T20:39:22.165965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009427+0000","last_change":"2024-04-28T13:08:46.490315+0000","last_active":"2024-04-28T13:08:48.009427+0000","last_peered":"2024-04-28T13:08:48.009427+0000","last_clean":"2024-04-28T13:08:48.009427+0000","last_became_active":"2024-04-28T13:08:46.489987+0000","last_became_peered":"2024-04-28T13:08:46.489987+0000","last_unstale":"2024-04-28T13:08:48.009427+0000","last_undegraded":"2024-04-28T13:08:48.009427+0000","last_fullsized":"2024-04-28T13:08:48.009427+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:38:11.491053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"45'8","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009142+0000","last_change":"2024-04-28T13:08:45.464678+0000","last_active":"2024-04-28T13:08:48.009142+0000","last_peered":"2024-04-28T13:08:48.009142+0000","last_clean":"2024-04-28T13:08:48.009142+0000","last_became_active":"2024-04-28T13:08:45.464396+0000","last_became_peered":"2024-04-28T13:08:45.464396+0000","last_unstale":"2024-04-28T13:08:48.009142+0000","last_undegraded":"2024-04-28T13:08:48.009142+0000","last_fullsized":"2024-04-28T13:08:48.009142+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:46:47.375362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009860+0000","last_change":"2024-04-28T13:08:46.490399+0000","last_active":"2024-04-28T13:08:48.009860+0000","last_peered":"2024-04-28T13:08:48.009860+0000","last_clean":"2024-04-28T13:08:48.009860+0000","last_became_active":"2024-04-28T13:08:46.490117+0000","last_became_peered":"2024-04-28T13:08:46.490117+0000","last_unstale":"2024-04-28T13:08:48.009860+0000","last_undegraded":"2024-04-28T13:08:48.009860+0000","last_fullsized":"2024-04-28T13:08:48.009860+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:34:56.224768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009874+0000","last_change":"2024-04-28T13:08:45.458651+0000","last_active":"2024-04-28T13:08:48.009874+0000","last_peered":"2024-04-28T13:08:48.009874+0000","last_clean":"2024-04-28T13:08:48.009874+0000","last_became_active":"2024-04-28T13:08:45.458398+0000","last_became_peered":"2024-04-28T13:08:45.458398+0000","last_unstale":"2024-04-28T13:08:48.009874+0000","last_undegraded":"2024-04-28T13:08:48.009874+0000","last_fullsized":"2024-04-28T13:08:48.009874+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T13:59:11.072514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008838+0000","last_change":"2024-04-28T13:08:46.490467+0000","last_active":"2024-04-28T13:08:48.008838+0000","last_peered":"2024-04-28T13:08:48.008838+0000","last_clean":"2024-04-28T13:08:48.008838+0000","last_became_active":"2024-04-28T13:08:46.490128+0000","last_became_peered":"2024-04-28T13:08:46.490128+0000","last_unstale":"2024-04-28T13:08:48.008838+0000","last_undegraded":"2024-04-28T13:08:48.008838+0000","last_fullsized":"2024-04-28T13:08:48.008838+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:32:53.022191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008968+0000","last_change":"2024-04-28T13:08:45.459595+0000","last_active":"2024-04-28T13:08:48.008968+0000","last_peered":"2024-04-28T13:08:48.008968+0000","last_clean":"2024-04-28T13:08:48.008968+0000","last_became_active":"2024-04-28T13:08:45.458889+0000","last_became_peered":"2024-04-28T13:08:45.458889+0000","last_unstale":"2024-04-28T13:08:48.008968+0000","last_undegraded":"2024-04-28T13:08:48.008968+0000","last_fullsized":"2024-04-28T13:08:48.008968+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:42:42.266586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.597781+0000","last_change":"2024-04-28T13:08:46.491260+0000","last_active":"2024-04-28T13:08:47.597781+0000","last_peered":"2024-04-28T13:08:47.597781+0000","last_clean":"2024-04-28T13:08:47.597781+0000","last_became_active":"2024-04-28T13:08:46.490960+0000","last_became_peered":"2024-04-28T13:08:46.490960+0000","last_unstale":"2024-04-28T13:08:47.597781+0000","last_undegraded":"2024-04-28T13:08:47.597781+0000","last_fullsized":"2024-04-28T13:08:47.597781+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:08:42.236745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.484555+0000","last_change":"2024-04-28T13:08:45.467101+0000","last_active":"2024-04-28T13:08:47.484555+0000","last_peered":"2024-04-28T13:08:47.484555+0000","last_clean":"2024-04-28T13:08:47.484555+0000","last_became_active":"2024-04-28T13:08:45.466852+0000","last_became_peered":"2024-04-28T13:08:45.466852+0000","last_unstale":"2024-04-28T13:08:47.484555+0000","last_undegraded":"2024-04-28T13:08:47.484555+0000","last_fullsized":"2024-04-28T13:08:47.484555+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:51:03.462793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.597916+0000","last_change":"2024-04-28T13:08:46.488246+0000","last_active":"2024-04-28T13:08:47.597916+0000","last_peered":"2024-04-28T13:08:47.597916+0000","last_clean":"2024-04-28T13:08:47.597916+0000","last_became_active":"2024-04-28T13:08:46.487994+0000","last_became_peered":"2024-04-28T13:08:46.487994+0000","last_unstale":"2024-04-28T13:08:47.597916+0000","last_undegraded":"2024-04-28T13:08:47.597916+0000","last_fullsized":"2024-04-28T13:08:47.597916+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:51:04.464490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009499+0000","last_change":"2024-04-28T13:08:45.460888+0000","last_active":"2024-04-28T13:08:48.009499+0000","last_peered":"2024-04-28T13:08:48.009499+0000","last_clean":"2024-04-28T13:08:48.009499+0000","last_became_active":"2024-04-28T13:08:45.460488+0000","last_became_peered":"2024-04-28T13:08:45.460488+0000","last_unstale":"2024-04-28T13:08:48.009499+0000","last_undegraded":"2024-04-28T13:08:48.009499+0000","last_fullsized":"2024-04-28T13:08:48.009499+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T01:00:58.651061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008946+0000","last_change":"2024-04-28T13:08:46.490305+0000","last_active":"2024-04-28T13:08:48.008946+0000","last_peered":"2024-04-28T13:08:48.008946+0000","last_clean":"2024-04-28T13:08:48.008946+0000","last_became_active":"2024-04-28T13:08:46.489603+0000","last_became_peered":"2024-04-28T13:08:46.489603+0000","last_unstale":"2024-04-28T13:08:48.008946+0000","last_undegraded":"2024-04-28T13:08:48.008946+0000","last_fullsized":"2024-04-28T13:08:48.008946+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:32:43.821626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009250+0000","last_change":"2024-04-28T13:08:45.458112+0000","last_active":"2024-04-28T13:08:48.009250+0000","last_peered":"2024-04-28T13:08:48.009250+0000","last_clean":"2024-04-28T13:08:48.009250+0000","last_became_active":"2024-04-28T13:08:45.457628+0000","last_became_peered":"2024-04-28T13:08:45.457628+0000","last_unstale":"2024-04-28T13:08:48.009250+0000","last_undegraded":"2024-04-28T13:08:48.009250+0000","last_fullsized":"2024-04-28T13:08:48.009250+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:32:52.020495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.483211+0000","last_change":"2024-04-28T13:08:46.492710+0000","last_active":"2024-04-28T13:08:47.483211+0000","last_peered":"2024-04-28T13:08:47.483211+0000","last_clean":"2024-04-28T13:08:47.483211+0000","last_became_active":"2024-04-28T13:08:46.492436+0000","last_became_peered":"2024-04-28T13:08:46.492436+0000","last_unstale":"2024-04-28T13:08:47.483211+0000","last_undegraded":"2024-04-28T13:08:47.483211+0000","last_fullsized":"2024-04-28T13:08:47.483211+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T13:38:28.441808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.483989+0000","last_change":"2024-04-28T13:08:45.459675+0000","last_active":"2024-04-28T13:08:47.483989+0000","last_peered":"2024-04-28T13:08:47.483989+0000","last_clean":"2024-04-28T13:08:47.483989+0000","last_became_active":"2024-04-28T13:08:45.459396+0000","last_became_peered":"2024-04-28T13:08:45.459396+0000","last_unstale":"2024-04-28T13:08:47.483989+0000","last_undegraded":"2024-04-28T13:08:47.483989+0000","last_fullsized":"2024-04-28T13:08:47.483989+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:15:45.324823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008495+0000","last_change":"2024-04-28T13:08:46.479922+0000","last_active":"2024-04-28T13:08:48.008495+0000","last_peered":"2024-04-28T13:08:48.008495+0000","last_clean":"2024-04-28T13:08:48.008495+0000","last_became_active":"2024-04-28T13:08:46.479649+0000","last_became_peered":"2024-04-28T13:08:46.479649+0000","last_unstale":"2024-04-28T13:08:48.008495+0000","last_undegraded":"2024-04-28T13:08:48.008495+0000","last_fullsized":"2024-04-28T13:08:48.008495+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T01:04:28.201254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008992+0000","last_change":"2024-04-28T13:08:45.463090+0000","last_active":"2024-04-28T13:08:48.008992+0000","last_peered":"2024-04-28T13:08:48.008992+0000","last_clean":"2024-04-28T13:08:48.008992+0000","last_became_active":"2024-04-28T13:08:45.462815+0000","last_became_peered":"2024-04-28T13:08:45.462815+0000","last_unstale":"2024-04-28T13:08:48.008992+0000","last_undegraded":"2024-04-28T13:08:48.008992+0000","last_fullsized":"2024-04-28T13:08:48.008992+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:45:10.995868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008907+0000","last_change":"2024-04-28T13:08:46.491356+0000","last_active":"2024-04-28T13:08:48.008907+0000","last_peered":"2024-04-28T13:08:48.008907+0000","last_clean":"2024-04-28T13:08:48.008907+0000","last_became_active":"2024-04-28T13:08:46.491088+0000","last_became_peered":"2024-04-28T13:08:46.491088+0000","last_unstale":"2024-04-28T13:08:48.008907+0000","last_undegraded":"2024-04-28T13:08:48.008907+0000","last_fullsized":"2024-04-28T13:08:48.008907+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:39:03.829917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008861+0000","last_change":"2024-04-28T13:08:45.457169+0000","last_active":"2024-04-28T13:08:48.008861+0000","last_peered":"2024-04-28T13:08:48.008861+0000","last_clean":"2024-04-28T13:08:48.008861+0000","last_became_active":"2024-04-28T13:08:45.456274+0000","last_became_peered":"2024-04-28T13:08:45.456274+0000","last_unstale":"2024-04-28T13:08:48.008861+0000","last_undegraded":"2024-04-28T13:08:48.008861+0000","last_fullsized":"2024-04-28T13:08:48.008861+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:06:14.670295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.598053+0000","last_change":"2024-04-28T13:08:46.497708+0000","last_active":"2024-04-28T13:08:47.598053+0000","last_peered":"2024-04-28T13:08:47.598053+0000","last_clean":"2024-04-28T13:08:47.598053+0000","last_became_active":"2024-04-28T13:08:46.497334+0000","last_became_peered":"2024-04-28T13:08:46.497334+0000","last_unstale":"2024-04-28T13:08:47.598053+0000","last_undegraded":"2024-04-28T13:08:47.598053+0000","last_fullsized":"2024-04-28T13:08:47.598053+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:01:20.664192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"46'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.475650+0000","last_change":"2024-04-28T13:08:45.459559+0000","last_active":"2024-04-28T13:08:48.475650+0000","last_peered":"2024-04-28T13:08:48.475650+0000","last_clean":"2024-04-28T13:08:48.475650+0000","last_became_active":"2024-04-28T13:08:45.459291+0000","last_became_peered":"2024-04-28T13:08:45.459291+0000","last_unstale":"2024-04-28T13:08:48.475650+0000","last_undegraded":"2024-04-28T13:08:48.475650+0000","last_fullsized":"2024-04-28T13:08:48.475650+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:54:35.236283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009120+0000","last_change":"2024-04-28T13:08:46.489435+0000","last_active":"2024-04-28T13:08:48.009120+0000","last_peered":"2024-04-28T13:08:48.009120+0000","last_clean":"2024-04-28T13:08:48.009120+0000","last_became_active":"2024-04-28T13:08:46.489162+0000","last_became_peered":"2024-04-28T13:08:46.489162+0000","last_unstale":"2024-04-28T13:08:48.009120+0000","last_undegraded":"2024-04-28T13:08:48.009120+0000","last_fullsized":"2024-04-28T13:08:48.009120+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:34:46.589932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009216+0000","last_change":"2024-04-28T13:08:45.464327+0000","last_active":"2024-04-28T13:08:48.009216+0000","last_peered":"2024-04-28T13:08:48.009216+0000","last_clean":"2024-04-28T13:08:48.009216+0000","last_became_active":"2024-04-28T13:08:45.464045+0000","last_became_peered":"2024-04-28T13:08:45.464045+0000","last_unstale":"2024-04-28T13:08:48.009216+0000","last_undegraded":"2024-04-28T13:08:48.009216+0000","last_fullsized":"2024-04-28T13:08:48.009216+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:53:12.028076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008999+0000","last_change":"2024-04-28T13:08:46.488114+0000","last_active":"2024-04-28T13:08:48.008999+0000","last_peered":"2024-04-28T13:08:48.008999+0000","last_clean":"2024-04-28T13:08:48.008999+0000","last_became_active":"2024-04-28T13:08:46.487877+0000","last_became_peered":"2024-04-28T13:08:46.487877+0000","last_unstale":"2024-04-28T13:08:48.008999+0000","last_undegraded":"2024-04-28T13:08:48.008999+0000","last_fullsized":"2024-04-28T13:08:48.008999+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:39:03.829917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.483099+0000","last_change":"2024-04-28T13:08:45.465479+0000","last_active":"2024-04-28T13:08:47.483099+0000","last_peered":"2024-04-28T13:08:47.483099+0000","last_clean":"2024-04-28T13:08:47.483099+0000","last_became_active":"2024-04-28T13:08:45.465190+0000","last_became_peered":"2024-04-28T13:08:45.465190+0000","last_unstale":"2024-04-28T13:08:47.483099+0000","last_undegraded":"2024-04-28T13:08:47.483099+0000","last_fullsized":"2024-04-28T13:08:47.483099+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:45:10.995868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009070+0000","last_change":"2024-04-28T13:08:46.489506+0000","last_active":"2024-04-28T13:08:48.009070+0000","last_peered":"2024-04-28T13:08:48.009070+0000","last_clean":"2024-04-28T13:08:48.009070+0000","last_became_active":"2024-04-28T13:08:46.489008+0000","last_became_peered":"2024-04-28T13:08:46.489008+0000","last_unstale":"2024-04-28T13:08:48.009070+0000","last_undegraded":"2024-04-28T13:08:48.009070+0000","last_fullsized":"2024-04-28T13:08:48.009070+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:00:07.179157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008891+0000","last_change":"2024-04-28T13:08:45.464188+0000","last_active":"2024-04-28T13:08:48.008891+0000","last_peered":"2024-04-28T13:08:48.008891+0000","last_clean":"2024-04-28T13:08:48.008891+0000","last_became_active":"2024-04-28T13:08:45.463918+0000","last_became_peered":"2024-04-28T13:08:45.463918+0000","last_unstale":"2024-04-28T13:08:48.008891+0000","last_undegraded":"2024-04-28T13:08:48.008891+0000","last_fullsized":"2024-04-28T13:08:48.008891+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:22:26.890695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008992+0000","last_change":"2024-04-28T13:08:46.490857+0000","last_active":"2024-04-28T13:08:48.008992+0000","last_peered":"2024-04-28T13:08:48.008992+0000","last_clean":"2024-04-28T13:08:48.008992+0000","last_became_active":"2024-04-28T13:08:46.490618+0000","last_became_peered":"2024-04-28T13:08:46.490618+0000","last_unstale":"2024-04-28T13:08:48.008992+0000","last_undegraded":"2024-04-28T13:08:48.008992+0000","last_fullsized":"2024-04-28T13:08:48.008992+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:32:51.752623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008623+0000","last_change":"2024-04-28T13:08:45.463525+0000","last_active":"2024-04-28T13:08:48.008623+0000","last_peered":"2024-04-28T13:08:48.008623+0000","last_clean":"2024-04-28T13:08:48.008623+0000","last_became_active":"2024-04-28T13:08:45.463261+0000","last_became_peered":"2024-04-28T13:08:45.463261+0000","last_unstale":"2024-04-28T13:08:48.008623+0000","last_undegraded":"2024-04-28T13:08:48.008623+0000","last_fullsized":"2024-04-28T13:08:48.008623+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:45:10.995868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.483953+0000","last_change":"2024-04-28T13:08:46.489717+0000","last_active":"2024-04-28T13:08:47.483953+0000","last_peered":"2024-04-28T13:08:47.483953+0000","last_clean":"2024-04-28T13:08:47.483953+0000","last_became_active":"2024-04-28T13:08:46.489442+0000","last_became_peered":"2024-04-28T13:08:46.489442+0000","last_unstale":"2024-04-28T13:08:47.483953+0000","last_undegraded":"2024-04-28T13:08:47.483953+0000","last_fullsized":"2024-04-28T13:08:47.483953+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T20:39:23.167661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.483065+0000","last_change":"2024-04-28T13:08:45.460838+0000","last_active":"2024-04-28T13:08:47.483065+0000","last_peered":"2024-04-28T13:08:47.483065+0000","last_clean":"2024-04-28T13:08:47.483065+0000","last_became_active":"2024-04-28T13:08:45.460362+0000","last_became_peered":"2024-04-28T13:08:45.460362+0000","last_unstale":"2024-04-28T13:08:47.483065+0000","last_undegraded":"2024-04-28T13:08:47.483065+0000","last_fullsized":"2024-04-28T13:08:47.483065+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:49:29.788851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008796+0000","last_change":"2024-04-28T13:08:46.487877+0000","last_active":"2024-04-28T13:08:48.008796+0000","last_peered":"2024-04-28T13:08:48.008796+0000","last_clean":"2024-04-28T13:08:48.008796+0000","last_became_active":"2024-04-28T13:08:46.487604+0000","last_became_peered":"2024-04-28T13:08:46.487604+0000","last_unstale":"2024-04-28T13:08:48.008796+0000","last_undegraded":"2024-04-28T13:08:48.008796+0000","last_fullsized":"2024-04-28T13:08:48.008796+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:39:18.770677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009222+0000","last_change":"2024-04-28T13:08:45.464856+0000","last_active":"2024-04-28T13:08:48.009222+0000","last_peered":"2024-04-28T13:08:48.009222+0000","last_clean":"2024-04-28T13:08:48.009222+0000","last_became_active":"2024-04-28T13:08:45.464577+0000","last_became_peered":"2024-04-28T13:08:45.464577+0000","last_unstale":"2024-04-28T13:08:48.009222+0000","last_undegraded":"2024-04-28T13:08:48.009222+0000","last_fullsized":"2024-04-28T13:08:48.009222+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:49:29.788851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009669+0000","last_change":"2024-04-28T13:08:46.495290+0000","last_active":"2024-04-28T13:08:48.009669+0000","last_peered":"2024-04-28T13:08:48.009669+0000","last_clean":"2024-04-28T13:08:48.009669+0000","last_became_active":"2024-04-28T13:08:46.495057+0000","last_became_peered":"2024-04-28T13:08:46.495057+0000","last_unstale":"2024-04-28T13:08:48.009669+0000","last_undegraded":"2024-04-28T13:08:48.009669+0000","last_fullsized":"2024-04-28T13:08:48.009669+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:39:00.309321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.484321+0000","last_change":"2024-04-28T13:08:45.464660+0000","last_active":"2024-04-28T13:08:47.484321+0000","last_peered":"2024-04-28T13:08:47.484321+0000","last_clean":"2024-04-28T13:08:47.484321+0000","last_became_active":"2024-04-28T13:08:45.464380+0000","last_became_peered":"2024-04-28T13:08:45.464380+0000","last_unstale":"2024-04-28T13:08:47.484321+0000","last_undegraded":"2024-04-28T13:08:47.484321+0000","last_fullsized":"2024-04-28T13:08:47.484321+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:08:41.235049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":214,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008881+0000","last_change":"2024-04-28T13:07:16.698740+0000","last_active":"2024-04-28T13:08:48.008881+0000","last_peered":"2024-04-28T13:08:48.008881+0000","last_clean":"2024-04-28T13:08:48.008881+0000","last_became_active":"2024-04-28T13:07:16.696364+0000","last_became_peered":"2024-04-28T13:07:16.696364+0000","last_unstale":"2024-04-28T13:08:48.008881+0000","last_undegraded":"2024-04-28T13:08:48.008881+0000","last_fullsized":"2024-04-28T13:08:48.008881+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:14.770499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:14.770499+0000","last_clean_scrub_stamp":"2024-04-28T13:07:14.770499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:39:38.986133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28124,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343716,"statfs":{"total":96636764160,"available":96607965184,"internally_reserved":0,"allocated":1126400,"data_stored":803952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":548864,"data_stored":220466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":544768,"data_stored":219864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":540672,"data_stored":215106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":552960,"data_stored":220432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":544768,"data_stored":215128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":544768,"data_stored":219864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1138688,"data_stored":810196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-28T13:08:51.721 INFO:tasks.ceph.mds.b.smithi134.stderr:2024-04-28T13:08:51.721+0000 7f94ecb6d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-28T13:08:53.825 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-28T13:08:53.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.933+0000 7fa2fe817640 1 Processor -- start 2024-04-28T13:08:53.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.933+0000 7fa2fe817640 1 -- start start 2024-04-28T13:08:53.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.934+0000 7fa2fe817640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa2f815f410 0x7fa2f80baaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:53.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.934+0000 7fa2fe817640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2f80d0670 0x7fa2f80b8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:53.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.934+0000 7fa2fe817640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2f80d3650 con 0x7fa2f80b4380 2024-04-28T13:08:53.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.934+0000 7fa2fe817640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fa2f80d3f10 con 0x7fa2f815f410 2024-04-28T13:08:53.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.934+0000 7fa2fe817640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fa2f80b8840 con 0x7fa2f80d0670 2024-04-28T13:08:53.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.934+0000 7fa2fcdb4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2f80d0670 0x7fa2f80b8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:53.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.934+0000 7fa2f7fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa2f815f410 0x7fa2f80baaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:53.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.934+0000 7fa2f77fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fa2f80b4380 0x7fa2f80cff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:51442/0 (socket says 172.21.15.114:51442) 2024-04-28T13:08:53.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.934+0000 7fa2fcdb4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2f80d0670 0x7fa2f80b8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:33330/0 (socket says 172.21.15.114:33330) 2024-04-28T13:08:53.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.934+0000 7fa2f7fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa2f815f410 0x7fa2f80baaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:46342/0 (socket says 172.21.15.114:46342) 2024-04-28T13:08:53.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.934+0000 7fa2f77fe640 1 -- 172.21.15.114:0/469034510 learned_addr learned my addr 172.21.15.114:0/469034510 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:53.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.934+0000 7fa2f7fff640 1 -- 172.21.15.114:0/469034510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2f80d0670 msgr2=0x7fa2f80b8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:53.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.934+0000 7fa2f7fff640 1 --2- 172.21.15.114:0/469034510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2f80d0670 0x7fa2f80b8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:53.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.934+0000 7fa2f7fff640 1 -- 172.21.15.114:0/469034510 >> v1:172.21.15.134:6789/0 conn(0x7fa2f80b4380 legacy=0x7fa2f80cff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:53.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.934+0000 7fa2f7fff640 1 -- 172.21.15.114:0/469034510 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f815f7f0 con 0x7fa2f815f410 2024-04-28T13:08:53.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.935+0000 7fa2f7fff640 1 --2- 172.21.15.114:0/469034510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2f815f410 0x7fa2f80baaf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa2e80097a0 tx=0x7fa2e802a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b7c17ab31fd60fc server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:53.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.935+0000 7fa2f6ffd640 1 -- 172.21.15.114:0/469034510 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8037070 con 0x7fa2f815f410 2024-04-28T13:08:53.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.935+0000 7fa2f6ffd640 1 -- 172.21.15.114:0/469034510 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2e8032440 con 0x7fa2f815f410 2024-04-28T13:08:53.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.935+0000 7fa2f6ffd640 1 -- 172.21.15.114:0/469034510 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8032810 con 0x7fa2f815f410 2024-04-28T13:08:53.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.936+0000 7fa2fe817640 1 -- 172.21.15.114:0/469034510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2f815f410 msgr2=0x7fa2f80baaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:53.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.936+0000 7fa2fe817640 1 --2- 172.21.15.114:0/469034510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2f815f410 0x7fa2f80baaf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa2e80097a0 tx=0x7fa2e802a210 comp rx=0 tx=0).stop 2024-04-28T13:08:53.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.936+0000 7fa2fe817640 1 -- 172.21.15.114:0/469034510 shutdown_connections 2024-04-28T13:08:53.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.936+0000 7fa2fe817640 1 --2- 172.21.15.114:0/469034510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2f80d0670 0x7fa2f80b8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:53.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.936+0000 7fa2fe817640 1 --2- 172.21.15.114:0/469034510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2f815f410 0x7fa2f80baaf0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:53.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.936+0000 7fa2fe817640 1 -- 172.21.15.114:0/469034510 >> 172.21.15.114:0/469034510 conn(0x7fa2f80633a0 msgr2=0x7fa2f80d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:53.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.936+0000 7fa2fe817640 1 -- 172.21.15.114:0/469034510 shutdown_connections 2024-04-28T13:08:53.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.936+0000 7fa2fe817640 1 -- 172.21.15.114:0/469034510 wait complete. 2024-04-28T13:08:53.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.937+0000 7fa2fe817640 1 Processor -- start 2024-04-28T13:08:53.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.937+0000 7fa2fe817640 1 -- start start 2024-04-28T13:08:53.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.938+0000 7fa2fe817640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2f80b4380 0x7fa2f814a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:53.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.938+0000 7fa2fe817640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2f80d0670 0x7fa2f80ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:53.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.938+0000 7fa2fe817640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2f815f410 0x7fa2f80d5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:53.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.938+0000 7fa2fe817640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f80d3ba0 con 0x7fa2f80b4380 2024-04-28T13:08:53.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.938+0000 7fa2fe817640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f80d2570 con 0x7fa2f80d0670 2024-04-28T13:08:53.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.938+0000 7fa2fe817640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fa2f80bb180 con 0x7fa2f815f410 2024-04-28T13:08:53.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.938+0000 7fa2f7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2f80b4380 0x7fa2f814a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:53.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.938+0000 7fa2f7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2f80b4380 0x7fa2f814a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43904/0 (socket says 172.21.15.114:43904) 2024-04-28T13:08:53.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.938+0000 7fa2f7fff640 1 -- 172.21.15.114:0/326765191 learned_addr learned my addr 172.21.15.114:0/326765191 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:53.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.938+0000 7fa2fcdb4640 1 --2- 172.21.15.114:0/326765191 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2f815f410 0x7fa2f80d5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:53.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.938+0000 7fa2f77fe640 1 --2- 172.21.15.114:0/326765191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2f80d0670 0x7fa2f80ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:53.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.938+0000 7fa2f7fff640 1 -- 172.21.15.114:0/326765191 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2f815f410 msgr2=0x7fa2f80d5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:53.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.939+0000 7fa2f7fff640 1 --2- 172.21.15.114:0/326765191 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2f815f410 0x7fa2f80d5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:53.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.939+0000 7fa2f7fff640 1 -- 172.21.15.114:0/326765191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2f80d0670 msgr2=0x7fa2f80ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:53.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.939+0000 7fa2f7fff640 1 --2- 172.21.15.114:0/326765191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2f80d0670 0x7fa2f80ccc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:53.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.939+0000 7fa2f7fff640 1 -- 172.21.15.114:0/326765191 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f814b1f0 con 0x7fa2f80b4380 2024-04-28T13:08:53.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.939+0000 7fa2f7fff640 1 --2- 172.21.15.114:0/326765191 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2f80b4380 0x7fa2f814a830 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8035040 tx=0x7fa2e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:53.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.939+0000 7fa2f4ff9640 1 -- 172.21.15.114:0/326765191 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8037040 con 0x7fa2f80b4380 2024-04-28T13:08:53.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.939+0000 7fa2f4ff9640 1 -- 172.21.15.114:0/326765191 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2e8030500 con 0x7fa2f80b4380 2024-04-28T13:08:53.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.939+0000 7fa2f4ff9640 1 -- 172.21.15.114:0/326765191 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8030910 con 0x7fa2f80b4380 2024-04-28T13:08:53.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.939+0000 7fa2fe817640 1 -- 172.21.15.114:0/326765191 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2f814b4d0 con 0x7fa2f80b4380 2024-04-28T13:08:53.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.939+0000 7fa2fe817640 1 -- 172.21.15.114:0/326765191 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2f8158ee0 con 0x7fa2f80b4380 2024-04-28T13:08:53.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.940+0000 7fa2fe817640 1 -- 172.21.15.114:0/326765191 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2f81590b0 con 0x7fa2f80b4380 2024-04-28T13:08:53.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.940+0000 7fa2f4ff9640 1 -- 172.21.15.114:0/326765191 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7fa2e8044020 con 0x7fa2f80b4380 2024-04-28T13:08:53.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.941+0000 7fa2f4ff9640 1 --2- 172.21.15.114:0/326765191 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa2e406c980 0x7fa2e406ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:53.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.941+0000 7fa2f77fe640 1 --2- 172.21.15.114:0/326765191 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa2e406c980 0x7fa2e406ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:53.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.941+0000 7fa2f4ff9640 1 -- 172.21.15.114:0/326765191 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fa2e80abc70 con 0x7fa2f80b4380 2024-04-28T13:08:53.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.941+0000 7fa2f77fe640 1 --2- 172.21.15.114:0/326765191 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa2e406c980 0x7fa2e406ee40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa2f80d28e0 tx=0x7fa2ec007e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:53.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:53.945+0000 7fa2f4ff9640 1 -- 172.21.15.114:0/326765191 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa2e8079af0 con 0x7fa2f80b4380 2024-04-28T13:08:54.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.116+0000 7fa2fe817640 1 -- 172.21.15.114:0/326765191 --> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa2f806a3d0 con 0x7fa2e406c980 2024-04-28T13:08:54.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.122+0000 7fa2f4ff9640 1 -- 172.21.15.114:0/326765191 <== mgr.4104 v2:172.21.15.114:6832/2240257326 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251956 (secure 0 0 0) 0x7fa2f806a3d0 con 0x7fa2e406c980 2024-04-28T13:08:54.125 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:54.127 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-04-28T13:08:54.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.125+0000 7fa2fe817640 1 -- 172.21.15.114:0/326765191 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa2e406c980 msgr2=0x7fa2e406ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:54.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.125+0000 7fa2fe817640 1 --2- 172.21.15.114:0/326765191 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa2e406c980 0x7fa2e406ee40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa2f80d28e0 tx=0x7fa2ec007e80 comp rx=0 tx=0).stop 2024-04-28T13:08:54.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.125+0000 7fa2fe817640 1 -- 172.21.15.114:0/326765191 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2f80b4380 msgr2=0x7fa2f814a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:54.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.125+0000 7fa2fe817640 1 --2- 172.21.15.114:0/326765191 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2f80b4380 0x7fa2f814a830 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8035040 tx=0x7fa2e80046c0 comp rx=0 tx=0).stop 2024-04-28T13:08:54.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.125+0000 7fa2fe817640 1 -- 172.21.15.114:0/326765191 shutdown_connections 2024-04-28T13:08:54.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.125+0000 7fa2fe817640 1 --2- 172.21.15.114:0/326765191 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2f815f410 0x7fa2f80d5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:54.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.125+0000 7fa2fe817640 1 --2- 172.21.15.114:0/326765191 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fa2e406c980 0x7fa2e406ee40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:54.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.125+0000 7fa2fe817640 1 --2- 172.21.15.114:0/326765191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2f80d0670 0x7fa2f80ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:54.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.125+0000 7fa2fe817640 1 --2- 172.21.15.114:0/326765191 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2f80b4380 0x7fa2f814a830 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:54.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.125+0000 7fa2fe817640 1 -- 172.21.15.114:0/326765191 >> 172.21.15.114:0/326765191 conn(0x7fa2f80633a0 msgr2=0x7fa2f80b4cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:54.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.125+0000 7fa2fe817640 1 -- 172.21.15.114:0/326765191 shutdown_connections 2024-04-28T13:08:54.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.125+0000 7fa2fe817640 1 -- 172.21.15.114:0/326765191 wait complete. 2024-04-28T13:08:54.136 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-04-28T13:08:52.722145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221600,"kb_used_data":5412,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753120,"statfs":{"total":773094113280,"available":772867194880,"internally_reserved":0,"allocated":5541888,"data_stored":2925008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.277928"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009321+0000","last_change":"2024-04-28T13:08:46.486112+0000","last_active":"2024-04-28T13:08:48.009321+0000","last_peered":"2024-04-28T13:08:48.009321+0000","last_clean":"2024-04-28T13:08:48.009321+0000","last_became_active":"2024-04-28T13:08:46.485811+0000","last_became_peered":"2024-04-28T13:08:46.485811+0000","last_unstale":"2024-04-28T13:08:48.009321+0000","last_undegraded":"2024-04-28T13:08:48.009321+0000","last_fullsized":"2024-04-28T13:08:48.009321+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:24:18.784318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.484289+0000","last_change":"2024-04-28T13:08:46.497996+0000","last_active":"2024-04-28T13:08:47.484289+0000","last_peered":"2024-04-28T13:08:47.484289+0000","last_clean":"2024-04-28T13:08:47.484289+0000","last_became_active":"2024-04-28T13:08:46.497698+0000","last_became_peered":"2024-04-28T13:08:46.497698+0000","last_unstale":"2024-04-28T13:08:47.484289+0000","last_undegraded":"2024-04-28T13:08:47.484289+0000","last_fullsized":"2024-04-28T13:08:47.484289+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:32:53.022191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009244+0000","last_change":"2024-04-28T13:08:46.476214+0000","last_active":"2024-04-28T13:08:48.009244+0000","last_peered":"2024-04-28T13:08:48.009244+0000","last_clean":"2024-04-28T13:08:48.009244+0000","last_became_active":"2024-04-28T13:08:46.475942+0000","last_became_peered":"2024-04-28T13:08:46.475942+0000","last_unstale":"2024-04-28T13:08:48.009244+0000","last_undegraded":"2024-04-28T13:08:48.009244+0000","last_fullsized":"2024-04-28T13:08:48.009244+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:59:18.202055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008764+0000","last_change":"2024-04-28T13:08:46.490291+0000","last_active":"2024-04-28T13:08:48.008764+0000","last_peered":"2024-04-28T13:08:48.008764+0000","last_clean":"2024-04-28T13:08:48.008764+0000","last_became_active":"2024-04-28T13:08:46.489687+0000","last_became_peered":"2024-04-28T13:08:46.489687+0000","last_unstale":"2024-04-28T13:08:48.008764+0000","last_undegraded":"2024-04-28T13:08:48.008764+0000","last_fullsized":"2024-04-28T13:08:48.008764+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:59:18.202055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.484408+0000","last_change":"2024-04-28T13:08:46.498986+0000","last_active":"2024-04-28T13:08:47.484408+0000","last_peered":"2024-04-28T13:08:47.484408+0000","last_clean":"2024-04-28T13:08:47.484408+0000","last_became_active":"2024-04-28T13:08:46.498694+0000","last_became_peered":"2024-04-28T13:08:46.498694+0000","last_unstale":"2024-04-28T13:08:47.484408+0000","last_undegraded":"2024-04-28T13:08:47.484408+0000","last_fullsized":"2024-04-28T13:08:47.484408+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T01:00:59.652757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008823+0000","last_change":"2024-04-28T13:08:46.491382+0000","last_active":"2024-04-28T13:08:48.008823+0000","last_peered":"2024-04-28T13:08:48.008823+0000","last_clean":"2024-04-28T13:08:48.008823+0000","last_became_active":"2024-04-28T13:08:46.490674+0000","last_became_peered":"2024-04-28T13:08:46.490674+0000","last_unstale":"2024-04-28T13:08:48.008823+0000","last_undegraded":"2024-04-28T13:08:48.008823+0000","last_fullsized":"2024-04-28T13:08:48.008823+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:25:50.867343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009139+0000","last_change":"2024-04-28T13:08:46.484994+0000","last_active":"2024-04-28T13:08:48.009139+0000","last_peered":"2024-04-28T13:08:48.009139+0000","last_clean":"2024-04-28T13:08:48.009139+0000","last_became_active":"2024-04-28T13:08:46.484702+0000","last_became_peered":"2024-04-28T13:08:46.484702+0000","last_unstale":"2024-04-28T13:08:48.009139+0000","last_undegraded":"2024-04-28T13:08:48.009139+0000","last_fullsized":"2024-04-28T13:08:48.009139+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T01:00:59.652757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008700+0000","last_change":"2024-04-28T13:08:46.493885+0000","last_active":"2024-04-28T13:08:48.008700+0000","last_peered":"2024-04-28T13:08:48.008700+0000","last_clean":"2024-04-28T13:08:48.008700+0000","last_became_active":"2024-04-28T13:08:46.493647+0000","last_became_peered":"2024-04-28T13:08:46.493647+0000","last_unstale":"2024-04-28T13:08:48.008700+0000","last_undegraded":"2024-04-28T13:08:48.008700+0000","last_fullsized":"2024-04-28T13:08:48.008700+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T20:39:23.167661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008709+0000","last_change":"2024-04-28T13:08:46.491793+0000","last_active":"2024-04-28T13:08:48.008709+0000","last_peered":"2024-04-28T13:08:48.008709+0000","last_clean":"2024-04-28T13:08:48.008709+0000","last_became_active":"2024-04-28T13:08:46.490716+0000","last_became_peered":"2024-04-28T13:08:46.490716+0000","last_unstale":"2024-04-28T13:08:48.008709+0000","last_undegraded":"2024-04-28T13:08:48.008709+0000","last_fullsized":"2024-04-28T13:08:48.008709+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:23:18.851988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009569+0000","last_change":"2024-04-28T13:08:46.494213+0000","last_active":"2024-04-28T13:08:48.009569+0000","last_peered":"2024-04-28T13:08:48.009569+0000","last_clean":"2024-04-28T13:08:48.009569+0000","last_became_active":"2024-04-28T13:08:46.493936+0000","last_became_peered":"2024-04-28T13:08:46.493936+0000","last_unstale":"2024-04-28T13:08:48.009569+0000","last_undegraded":"2024-04-28T13:08:48.009569+0000","last_fullsized":"2024-04-28T13:08:48.009569+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T16:18:25.300038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008927+0000","last_change":"2024-04-28T13:08:46.489754+0000","last_active":"2024-04-28T13:08:48.008927+0000","last_peered":"2024-04-28T13:08:48.008927+0000","last_clean":"2024-04-28T13:08:48.008927+0000","last_became_active":"2024-04-28T13:08:46.489253+0000","last_became_peered":"2024-04-28T13:08:46.489253+0000","last_unstale":"2024-04-28T13:08:48.008927+0000","last_undegraded":"2024-04-28T13:08:48.008927+0000","last_fullsized":"2024-04-28T13:08:48.008927+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T01:00:59.652757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.484139+0000","last_change":"2024-04-28T13:08:46.496423+0000","last_active":"2024-04-28T13:08:47.484139+0000","last_peered":"2024-04-28T13:08:47.484139+0000","last_clean":"2024-04-28T13:08:47.484139+0000","last_became_active":"2024-04-28T13:08:46.495899+0000","last_became_peered":"2024-04-28T13:08:46.495899+0000","last_unstale":"2024-04-28T13:08:47.484139+0000","last_undegraded":"2024-04-28T13:08:47.484139+0000","last_fullsized":"2024-04-28T13:08:47.484139+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:23:18.851988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009720+0000","last_change":"2024-04-28T13:08:46.491804+0000","last_active":"2024-04-28T13:08:48.009720+0000","last_peered":"2024-04-28T13:08:48.009720+0000","last_clean":"2024-04-28T13:08:48.009720+0000","last_became_active":"2024-04-28T13:08:46.491574+0000","last_became_peered":"2024-04-28T13:08:46.491574+0000","last_unstale":"2024-04-28T13:08:48.009720+0000","last_undegraded":"2024-04-28T13:08:48.009720+0000","last_fullsized":"2024-04-28T13:08:48.009720+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:45:57.279535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009149+0000","last_change":"2024-04-28T13:08:46.493606+0000","last_active":"2024-04-28T13:08:48.009149+0000","last_peered":"2024-04-28T13:08:48.009149+0000","last_clean":"2024-04-28T13:08:48.009149+0000","last_became_active":"2024-04-28T13:08:46.493167+0000","last_became_peered":"2024-04-28T13:08:46.493167+0000","last_unstale":"2024-04-28T13:08:48.009149+0000","last_undegraded":"2024-04-28T13:08:48.009149+0000","last_fullsized":"2024-04-28T13:08:48.009149+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:38:11.491053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008561+0000","last_change":"2024-04-28T13:08:46.487785+0000","last_active":"2024-04-28T13:08:48.008561+0000","last_peered":"2024-04-28T13:08:48.008561+0000","last_clean":"2024-04-28T13:08:48.008561+0000","last_became_active":"2024-04-28T13:08:46.487478+0000","last_became_peered":"2024-04-28T13:08:46.487478+0000","last_unstale":"2024-04-28T13:08:48.008561+0000","last_undegraded":"2024-04-28T13:08:48.008561+0000","last_fullsized":"2024-04-28T13:08:48.008561+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:12:58.136365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.597475+0000","last_change":"2024-04-28T13:08:46.497501+0000","last_active":"2024-04-28T13:08:47.597475+0000","last_peered":"2024-04-28T13:08:47.597475+0000","last_clean":"2024-04-28T13:08:47.597475+0000","last_became_active":"2024-04-28T13:08:46.497217+0000","last_became_peered":"2024-04-28T13:08:46.497217+0000","last_unstale":"2024-04-28T13:08:47.597475+0000","last_undegraded":"2024-04-28T13:08:47.597475+0000","last_fullsized":"2024-04-28T13:08:47.597475+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T13:39:44.452178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009213+0000","last_change":"2024-04-28T13:08:46.489985+0000","last_active":"2024-04-28T13:08:48.009213+0000","last_peered":"2024-04-28T13:08:48.009213+0000","last_clean":"2024-04-28T13:08:48.009213+0000","last_became_active":"2024-04-28T13:08:46.489663+0000","last_became_peered":"2024-04-28T13:08:46.489663+0000","last_unstale":"2024-04-28T13:08:48.009213+0000","last_undegraded":"2024-04-28T13:08:48.009213+0000","last_fullsized":"2024-04-28T13:08:48.009213+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:23:18.851988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009076+0000","last_change":"2024-04-28T13:08:46.497004+0000","last_active":"2024-04-28T13:08:48.009076+0000","last_peered":"2024-04-28T13:08:48.009076+0000","last_clean":"2024-04-28T13:08:48.009076+0000","last_became_active":"2024-04-28T13:08:46.496249+0000","last_became_peered":"2024-04-28T13:08:46.496249+0000","last_unstale":"2024-04-28T13:08:48.009076+0000","last_undegraded":"2024-04-28T13:08:48.009076+0000","last_fullsized":"2024-04-28T13:08:48.009076+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:54:36.237979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.597988+0000","last_change":"2024-04-28T13:08:46.498004+0000","last_active":"2024-04-28T13:08:47.597988+0000","last_peered":"2024-04-28T13:08:47.597988+0000","last_clean":"2024-04-28T13:08:47.597988+0000","last_became_active":"2024-04-28T13:08:46.497392+0000","last_became_peered":"2024-04-28T13:08:46.497392+0000","last_unstale":"2024-04-28T13:08:47.597988+0000","last_undegraded":"2024-04-28T13:08:47.597988+0000","last_fullsized":"2024-04-28T13:08:47.597988+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T16:48:52.137666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009899+0000","last_change":"2024-04-28T13:08:46.493676+0000","last_active":"2024-04-28T13:08:48.009899+0000","last_peered":"2024-04-28T13:08:48.009899+0000","last_clean":"2024-04-28T13:08:48.009899+0000","last_became_active":"2024-04-28T13:08:46.493412+0000","last_became_peered":"2024-04-28T13:08:46.493412+0000","last_unstale":"2024-04-28T13:08:48.009899+0000","last_undegraded":"2024-04-28T13:08:48.009899+0000","last_fullsized":"2024-04-28T13:08:48.009899+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T13:32:40.138587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008874+0000","last_change":"2024-04-28T13:08:46.489349+0000","last_active":"2024-04-28T13:08:48.008874+0000","last_peered":"2024-04-28T13:08:48.008874+0000","last_clean":"2024-04-28T13:08:48.008874+0000","last_became_active":"2024-04-28T13:08:46.489054+0000","last_became_peered":"2024-04-28T13:08:46.489054+0000","last_unstale":"2024-04-28T13:08:48.008874+0000","last_undegraded":"2024-04-28T13:08:48.008874+0000","last_fullsized":"2024-04-28T13:08:48.008874+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:02:36.948384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009287+0000","last_change":"2024-04-28T13:08:46.492338+0000","last_active":"2024-04-28T13:08:48.009287+0000","last_peered":"2024-04-28T13:08:48.009287+0000","last_clean":"2024-04-28T13:08:48.009287+0000","last_became_active":"2024-04-28T13:08:46.492071+0000","last_became_peered":"2024-04-28T13:08:46.492071+0000","last_unstale":"2024-04-28T13:08:48.009287+0000","last_undegraded":"2024-04-28T13:08:48.009287+0000","last_fullsized":"2024-04-28T13:08:48.009287+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T16:40:18.998184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.597585+0000","last_change":"2024-04-28T13:08:46.493570+0000","last_active":"2024-04-28T13:08:47.597585+0000","last_peered":"2024-04-28T13:08:47.597585+0000","last_clean":"2024-04-28T13:08:47.597585+0000","last_became_active":"2024-04-28T13:08:46.493216+0000","last_became_peered":"2024-04-28T13:08:46.493216+0000","last_unstale":"2024-04-28T13:08:47.597585+0000","last_undegraded":"2024-04-28T13:08:47.597585+0000","last_fullsized":"2024-04-28T13:08:47.597585+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T13:38:28.441808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.597489+0000","last_change":"2024-04-28T13:08:46.493253+0000","last_active":"2024-04-28T13:08:47.597489+0000","last_peered":"2024-04-28T13:08:47.597489+0000","last_clean":"2024-04-28T13:08:47.597489+0000","last_became_active":"2024-04-28T13:08:46.492958+0000","last_became_peered":"2024-04-28T13:08:46.492958+0000","last_unstale":"2024-04-28T13:08:47.597489+0000","last_undegraded":"2024-04-28T13:08:47.597489+0000","last_fullsized":"2024-04-28T13:08:47.597489+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:58:24.253238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.597952+0000","last_change":"2024-04-28T13:08:46.488772+0000","last_active":"2024-04-28T13:08:47.597952+0000","last_peered":"2024-04-28T13:08:47.597952+0000","last_clean":"2024-04-28T13:08:47.597952+0000","last_became_active":"2024-04-28T13:08:46.487745+0000","last_became_peered":"2024-04-28T13:08:46.487745+0000","last_unstale":"2024-04-28T13:08:47.597952+0000","last_undegraded":"2024-04-28T13:08:47.597952+0000","last_fullsized":"2024-04-28T13:08:47.597952+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:22:27.892391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009817+0000","last_change":"2024-04-28T13:08:46.490977+0000","last_active":"2024-04-28T13:08:48.009817+0000","last_peered":"2024-04-28T13:08:48.009817+0000","last_clean":"2024-04-28T13:08:48.009817+0000","last_became_active":"2024-04-28T13:08:46.490674+0000","last_became_peered":"2024-04-28T13:08:46.490674+0000","last_unstale":"2024-04-28T13:08:48.009817+0000","last_undegraded":"2024-04-28T13:08:48.009817+0000","last_fullsized":"2024-04-28T13:08:48.009817+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:24:45.655105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009110+0000","last_change":"2024-04-28T13:08:46.490987+0000","last_active":"2024-04-28T13:08:48.009110+0000","last_peered":"2024-04-28T13:08:48.009110+0000","last_clean":"2024-04-28T13:08:48.009110+0000","last_became_active":"2024-04-28T13:08:46.490680+0000","last_became_peered":"2024-04-28T13:08:46.490680+0000","last_unstale":"2024-04-28T13:08:48.009110+0000","last_undegraded":"2024-04-28T13:08:48.009110+0000","last_fullsized":"2024-04-28T13:08:48.009110+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T20:39:23.167661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.484172+0000","last_change":"2024-04-28T13:08:46.496153+0000","last_active":"2024-04-28T13:08:47.484172+0000","last_peered":"2024-04-28T13:08:47.484172+0000","last_clean":"2024-04-28T13:08:47.484172+0000","last_became_active":"2024-04-28T13:08:46.495544+0000","last_became_peered":"2024-04-28T13:08:46.495544+0000","last_unstale":"2024-04-28T13:08:47.484172+0000","last_undegraded":"2024-04-28T13:08:47.484172+0000","last_fullsized":"2024-04-28T13:08:47.484172+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:59:18.202055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.597694+0000","last_change":"2024-04-28T13:08:46.486512+0000","last_active":"2024-04-28T13:08:47.597694+0000","last_peered":"2024-04-28T13:08:47.597694+0000","last_clean":"2024-04-28T13:08:47.597694+0000","last_became_active":"2024-04-28T13:08:46.485258+0000","last_became_peered":"2024-04-28T13:08:46.485258+0000","last_unstale":"2024-04-28T13:08:47.597694+0000","last_undegraded":"2024-04-28T13:08:47.597694+0000","last_fullsized":"2024-04-28T13:08:47.597694+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:06:15.671991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008471+0000","last_change":"2024-04-28T13:08:46.479202+0000","last_active":"2024-04-28T13:08:48.008471+0000","last_peered":"2024-04-28T13:08:48.008471+0000","last_clean":"2024-04-28T13:08:48.008471+0000","last_became_active":"2024-04-28T13:08:46.478934+0000","last_became_peered":"2024-04-28T13:08:46.478934+0000","last_unstale":"2024-04-28T13:08:48.008471+0000","last_undegraded":"2024-04-28T13:08:48.008471+0000","last_fullsized":"2024-04-28T13:08:48.008471+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T16:48:52.137666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008689+0000","last_change":"2024-04-28T13:08:46.490061+0000","last_active":"2024-04-28T13:08:48.008689+0000","last_peered":"2024-04-28T13:08:48.008689+0000","last_clean":"2024-04-28T13:08:48.008689+0000","last_became_active":"2024-04-28T13:08:46.489818+0000","last_became_peered":"2024-04-28T13:08:46.489818+0000","last_unstale":"2024-04-28T13:08:48.008689+0000","last_undegraded":"2024-04-28T13:08:48.008689+0000","last_fullsized":"2024-04-28T13:08:48.008689+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:03:00.821016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008353+0000","last_change":"2024-04-28T13:08:46.485350+0000","last_active":"2024-04-28T13:08:48.008353+0000","last_peered":"2024-04-28T13:08:48.008353+0000","last_clean":"2024-04-28T13:08:48.008353+0000","last_became_active":"2024-04-28T13:08:46.482918+0000","last_became_peered":"2024-04-28T13:08:46.482918+0000","last_unstale":"2024-04-28T13:08:48.008353+0000","last_undegraded":"2024-04-28T13:08:48.008353+0000","last_fullsized":"2024-04-28T13:08:48.008353+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:00:11.203345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.483267+0000","last_change":"2024-04-28T13:08:46.493313+0000","last_active":"2024-04-28T13:08:47.483267+0000","last_peered":"2024-04-28T13:08:47.483267+0000","last_clean":"2024-04-28T13:08:47.483267+0000","last_became_active":"2024-04-28T13:08:46.493023+0000","last_became_peered":"2024-04-28T13:08:46.493023+0000","last_unstale":"2024-04-28T13:08:47.483267+0000","last_undegraded":"2024-04-28T13:08:47.483267+0000","last_fullsized":"2024-04-28T13:08:47.483267+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:15:46.326519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"45'4","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008746+0000","last_change":"2024-04-28T13:08:45.460747+0000","last_active":"2024-04-28T13:08:48.008746+0000","last_peered":"2024-04-28T13:08:48.008746+0000","last_clean":"2024-04-28T13:08:48.008746+0000","last_became_active":"2024-04-28T13:08:45.460396+0000","last_became_peered":"2024-04-28T13:08:45.460396+0000","last_unstale":"2024-04-28T13:08:48.008746+0000","last_undegraded":"2024-04-28T13:08:48.008746+0000","last_fullsized":"2024-04-28T13:08:48.008746+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:39:02.828220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.598014+0000","last_change":"2024-04-28T13:08:46.488990+0000","last_active":"2024-04-28T13:08:47.598014+0000","last_peered":"2024-04-28T13:08:47.598014+0000","last_clean":"2024-04-28T13:08:47.598014+0000","last_became_active":"2024-04-28T13:08:46.488526+0000","last_became_peered":"2024-04-28T13:08:46.488526+0000","last_unstale":"2024-04-28T13:08:47.598014+0000","last_undegraded":"2024-04-28T13:08:47.598014+0000","last_fullsized":"2024-04-28T13:08:47.598014+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:53:13.029772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009108+0000","last_change":"2024-04-28T13:08:45.465088+0000","last_active":"2024-04-28T13:08:48.009108+0000","last_peered":"2024-04-28T13:08:48.009108+0000","last_clean":"2024-04-28T13:08:48.009108+0000","last_became_active":"2024-04-28T13:08:45.464705+0000","last_became_peered":"2024-04-28T13:08:45.464705+0000","last_unstale":"2024-04-28T13:08:48.009108+0000","last_undegraded":"2024-04-28T13:08:48.009108+0000","last_fullsized":"2024-04-28T13:08:48.009108+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:28:53.722788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.484327+0000","last_change":"2024-04-28T13:08:46.490516+0000","last_active":"2024-04-28T13:08:47.484327+0000","last_peered":"2024-04-28T13:08:47.484327+0000","last_clean":"2024-04-28T13:08:47.484327+0000","last_became_active":"2024-04-28T13:08:46.490232+0000","last_became_peered":"2024-04-28T13:08:46.490232+0000","last_unstale":"2024-04-28T13:08:47.484327+0000","last_undegraded":"2024-04-28T13:08:47.484327+0000","last_fullsized":"2024-04-28T13:08:47.484327+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:39:03.829917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.483411+0000","last_change":"2024-04-28T13:08:45.465502+0000","last_active":"2024-04-28T13:08:47.483411+0000","last_peered":"2024-04-28T13:08:47.483411+0000","last_clean":"2024-04-28T13:08:47.483411+0000","last_became_active":"2024-04-28T13:08:45.465207+0000","last_became_peered":"2024-04-28T13:08:45.465207+0000","last_unstale":"2024-04-28T13:08:47.483411+0000","last_undegraded":"2024-04-28T13:08:47.483411+0000","last_fullsized":"2024-04-28T13:08:47.483411+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:42:42.266586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.483357+0000","last_change":"2024-04-28T13:08:46.488254+0000","last_active":"2024-04-28T13:08:47.483357+0000","last_peered":"2024-04-28T13:08:47.483357+0000","last_clean":"2024-04-28T13:08:47.483357+0000","last_became_active":"2024-04-28T13:08:46.487966+0000","last_became_peered":"2024-04-28T13:08:46.487966+0000","last_unstale":"2024-04-28T13:08:47.483357+0000","last_undegraded":"2024-04-28T13:08:47.483357+0000","last_fullsized":"2024-04-28T13:08:47.483357+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:06:15.671991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008732+0000","last_change":"2024-04-28T13:08:45.467104+0000","last_active":"2024-04-28T13:08:48.008732+0000","last_peered":"2024-04-28T13:08:48.008732+0000","last_clean":"2024-04-28T13:08:48.008732+0000","last_became_active":"2024-04-28T13:08:45.466819+0000","last_became_peered":"2024-04-28T13:08:45.466819+0000","last_unstale":"2024-04-28T13:08:48.008732+0000","last_undegraded":"2024-04-28T13:08:48.008732+0000","last_fullsized":"2024-04-28T13:08:48.008732+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:51:03.462793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008512+0000","last_change":"2024-04-28T13:08:46.485301+0000","last_active":"2024-04-28T13:08:48.008512+0000","last_peered":"2024-04-28T13:08:48.008512+0000","last_clean":"2024-04-28T13:08:48.008512+0000","last_became_active":"2024-04-28T13:08:46.484828+0000","last_became_peered":"2024-04-28T13:08:46.484828+0000","last_unstale":"2024-04-28T13:08:48.008512+0000","last_undegraded":"2024-04-28T13:08:48.008512+0000","last_fullsized":"2024-04-28T13:08:48.008512+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:53:13.029772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009078+0000","last_change":"2024-04-28T13:08:45.459966+0000","last_active":"2024-04-28T13:08:48.009078+0000","last_peered":"2024-04-28T13:08:48.009078+0000","last_clean":"2024-04-28T13:08:48.009078+0000","last_became_active":"2024-04-28T13:08:45.459690+0000","last_became_peered":"2024-04-28T13:08:45.459690+0000","last_unstale":"2024-04-28T13:08:48.009078+0000","last_undegraded":"2024-04-28T13:08:48.009078+0000","last_fullsized":"2024-04-28T13:08:48.009078+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:23:17.850292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009410+0000","last_change":"2024-04-28T13:08:46.490637+0000","last_active":"2024-04-28T13:08:48.009410+0000","last_peered":"2024-04-28T13:08:48.009410+0000","last_clean":"2024-04-28T13:08:48.009410+0000","last_became_active":"2024-04-28T13:08:46.490365+0000","last_became_peered":"2024-04-28T13:08:46.490365+0000","last_unstale":"2024-04-28T13:08:48.009410+0000","last_undegraded":"2024-04-28T13:08:48.009410+0000","last_fullsized":"2024-04-28T13:08:48.009410+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:00:57.373502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008592+0000","last_change":"2024-04-28T13:08:45.465235+0000","last_active":"2024-04-28T13:08:48.008592+0000","last_peered":"2024-04-28T13:08:48.008592+0000","last_clean":"2024-04-28T13:08:48.008592+0000","last_became_active":"2024-04-28T13:08:45.464916+0000","last_became_peered":"2024-04-28T13:08:45.464916+0000","last_unstale":"2024-04-28T13:08:48.008592+0000","last_undegraded":"2024-04-28T13:08:48.008592+0000","last_fullsized":"2024-04-28T13:08:48.008592+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:49:29.788851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008971+0000","last_change":"2024-04-28T13:08:46.493442+0000","last_active":"2024-04-28T13:08:48.008971+0000","last_peered":"2024-04-28T13:08:48.008971+0000","last_clean":"2024-04-28T13:08:48.008971+0000","last_became_active":"2024-04-28T13:08:46.493198+0000","last_became_peered":"2024-04-28T13:08:46.493198+0000","last_unstale":"2024-04-28T13:08:48.008971+0000","last_undegraded":"2024-04-28T13:08:48.008971+0000","last_fullsized":"2024-04-28T13:08:48.008971+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:24:18.784318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.483891+0000","last_change":"2024-04-28T13:08:45.464658+0000","last_active":"2024-04-28T13:08:47.483891+0000","last_peered":"2024-04-28T13:08:47.483891+0000","last_clean":"2024-04-28T13:08:47.483891+0000","last_became_active":"2024-04-28T13:08:45.464321+0000","last_became_peered":"2024-04-28T13:08:45.464321+0000","last_unstale":"2024-04-28T13:08:47.483891+0000","last_undegraded":"2024-04-28T13:08:47.483891+0000","last_fullsized":"2024-04-28T13:08:47.483891+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:06:14.670295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.597449+0000","last_change":"2024-04-28T13:08:46.493896+0000","last_active":"2024-04-28T13:08:47.597449+0000","last_peered":"2024-04-28T13:08:47.597449+0000","last_clean":"2024-04-28T13:08:47.597449+0000","last_became_active":"2024-04-28T13:08:46.493550+0000","last_became_peered":"2024-04-28T13:08:46.493550+0000","last_unstale":"2024-04-28T13:08:47.597449+0000","last_undegraded":"2024-04-28T13:08:47.597449+0000","last_fullsized":"2024-04-28T13:08:47.597449+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:28:54.724484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009054+0000","last_change":"2024-04-28T13:08:45.462963+0000","last_active":"2024-04-28T13:08:48.009054+0000","last_peered":"2024-04-28T13:08:48.009054+0000","last_clean":"2024-04-28T13:08:48.009054+0000","last_became_active":"2024-04-28T13:08:45.462674+0000","last_became_peered":"2024-04-28T13:08:45.462674+0000","last_unstale":"2024-04-28T13:08:48.009054+0000","last_undegraded":"2024-04-28T13:08:48.009054+0000","last_fullsized":"2024-04-28T13:08:48.009054+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:46:50.741397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008773+0000","last_change":"2024-04-28T13:08:46.496482+0000","last_active":"2024-04-28T13:08:48.008773+0000","last_peered":"2024-04-28T13:08:48.008773+0000","last_clean":"2024-04-28T13:08:48.008773+0000","last_became_active":"2024-04-28T13:08:46.494495+0000","last_became_peered":"2024-04-28T13:08:46.494495+0000","last_unstale":"2024-04-28T13:08:48.008773+0000","last_undegraded":"2024-04-28T13:08:48.008773+0000","last_fullsized":"2024-04-28T13:08:48.008773+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:01:20.664192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009296+0000","last_change":"2024-04-28T13:08:45.462792+0000","last_active":"2024-04-28T13:08:48.009296+0000","last_peered":"2024-04-28T13:08:48.009296+0000","last_clean":"2024-04-28T13:08:48.009296+0000","last_became_active":"2024-04-28T13:08:45.462520+0000","last_became_peered":"2024-04-28T13:08:45.462520+0000","last_unstale":"2024-04-28T13:08:48.009296+0000","last_undegraded":"2024-04-28T13:08:48.009296+0000","last_fullsized":"2024-04-28T13:08:48.009296+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:46:47.375362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009382+0000","last_change":"2024-04-28T13:08:46.491734+0000","last_active":"2024-04-28T13:08:48.009382+0000","last_peered":"2024-04-28T13:08:48.009382+0000","last_clean":"2024-04-28T13:08:48.009382+0000","last_became_active":"2024-04-28T13:08:46.491445+0000","last_became_peered":"2024-04-28T13:08:46.491445+0000","last_unstale":"2024-04-28T13:08:48.009382+0000","last_undegraded":"2024-04-28T13:08:48.009382+0000","last_fullsized":"2024-04-28T13:08:48.009382+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:34:46.589932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009644+0000","last_change":"2024-04-28T13:08:45.464689+0000","last_active":"2024-04-28T13:08:48.009644+0000","last_peered":"2024-04-28T13:08:48.009644+0000","last_clean":"2024-04-28T13:08:48.009644+0000","last_became_active":"2024-04-28T13:08:45.464308+0000","last_became_peered":"2024-04-28T13:08:45.464308+0000","last_unstale":"2024-04-28T13:08:48.009644+0000","last_undegraded":"2024-04-28T13:08:48.009644+0000","last_fullsized":"2024-04-28T13:08:48.009644+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:42:42.266586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009504+0000","last_change":"2024-04-28T13:08:46.497034+0000","last_active":"2024-04-28T13:08:48.009504+0000","last_peered":"2024-04-28T13:08:48.009504+0000","last_clean":"2024-04-28T13:08:48.009504+0000","last_became_active":"2024-04-28T13:08:46.496008+0000","last_became_peered":"2024-04-28T13:08:46.496008+0000","last_unstale":"2024-04-28T13:08:48.009504+0000","last_undegraded":"2024-04-28T13:08:48.009504+0000","last_fullsized":"2024-04-28T13:08:48.009504+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:32:40.617152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"45'3","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009149+0000","last_change":"2024-04-28T13:08:45.462799+0000","last_active":"2024-04-28T13:08:48.009149+0000","last_peered":"2024-04-28T13:08:48.009149+0000","last_clean":"2024-04-28T13:08:48.009149+0000","last_became_active":"2024-04-28T13:08:45.462518+0000","last_became_peered":"2024-04-28T13:08:45.462518+0000","last_unstale":"2024-04-28T13:08:48.009149+0000","last_undegraded":"2024-04-28T13:08:48.009149+0000","last_fullsized":"2024-04-28T13:08:48.009149+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T16:48:51.135970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008797+0000","last_change":"2024-04-28T13:08:46.487016+0000","last_active":"2024-04-28T13:08:48.008797+0000","last_peered":"2024-04-28T13:08:48.008797+0000","last_clean":"2024-04-28T13:08:48.008797+0000","last_became_active":"2024-04-28T13:08:46.486703+0000","last_became_peered":"2024-04-28T13:08:46.486703+0000","last_unstale":"2024-04-28T13:08:48.008797+0000","last_undegraded":"2024-04-28T13:08:48.008797+0000","last_fullsized":"2024-04-28T13:08:48.008797+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:32:53.022191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"45'6","reported_seq":20,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009914+0000","last_change":"2024-04-28T13:08:45.459549+0000","last_active":"2024-04-28T13:08:48.009914+0000","last_peered":"2024-04-28T13:08:48.009914+0000","last_clean":"2024-04-28T13:08:48.009914+0000","last_became_active":"2024-04-28T13:08:45.459244+0000","last_became_peered":"2024-04-28T13:08:45.459244+0000","last_unstale":"2024-04-28T13:08:48.009914+0000","last_undegraded":"2024-04-28T13:08:48.009914+0000","last_fullsized":"2024-04-28T13:08:48.009914+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:10:07.647730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.597671+0000","last_change":"2024-04-28T13:08:46.497725+0000","last_active":"2024-04-28T13:08:47.597671+0000","last_peered":"2024-04-28T13:08:47.597671+0000","last_clean":"2024-04-28T13:08:47.597671+0000","last_became_active":"2024-04-28T13:08:46.497241+0000","last_became_peered":"2024-04-28T13:08:46.497241+0000","last_unstale":"2024-04-28T13:08:47.597671+0000","last_undegraded":"2024-04-28T13:08:47.597671+0000","last_fullsized":"2024-04-28T13:08:47.597671+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:15:46.326519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009167+0000","last_change":"2024-04-28T13:08:45.463265+0000","last_active":"2024-04-28T13:08:48.009167+0000","last_peered":"2024-04-28T13:08:48.009167+0000","last_clean":"2024-04-28T13:08:48.009167+0000","last_became_active":"2024-04-28T13:08:45.463003+0000","last_became_peered":"2024-04-28T13:08:45.463003+0000","last_unstale":"2024-04-28T13:08:48.009167+0000","last_undegraded":"2024-04-28T13:08:48.009167+0000","last_fullsized":"2024-04-28T13:08:48.009167+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:59:17.200359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009539+0000","last_change":"2024-04-28T13:08:46.494851+0000","last_active":"2024-04-28T13:08:48.009539+0000","last_peered":"2024-04-28T13:08:48.009539+0000","last_clean":"2024-04-28T13:08:48.009539+0000","last_became_active":"2024-04-28T13:08:46.494558+0000","last_became_peered":"2024-04-28T13:08:46.494558+0000","last_unstale":"2024-04-28T13:08:48.009539+0000","last_undegraded":"2024-04-28T13:08:48.009539+0000","last_fullsized":"2024-04-28T13:08:48.009539+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:02:06.188422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008866+0000","last_change":"2024-04-28T13:08:45.456415+0000","last_active":"2024-04-28T13:08:48.008866+0000","last_peered":"2024-04-28T13:08:48.008866+0000","last_clean":"2024-04-28T13:08:48.008866+0000","last_became_active":"2024-04-28T13:08:45.456131+0000","last_became_peered":"2024-04-28T13:08:45.456131+0000","last_unstale":"2024-04-28T13:08:48.008866+0000","last_undegraded":"2024-04-28T13:08:48.008866+0000","last_fullsized":"2024-04-28T13:08:48.008866+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:08:41.235049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008441+0000","last_change":"2024-04-28T13:08:46.490470+0000","last_active":"2024-04-28T13:08:48.008441+0000","last_peered":"2024-04-28T13:08:48.008441+0000","last_clean":"2024-04-28T13:08:48.008441+0000","last_became_active":"2024-04-28T13:08:46.490183+0000","last_became_peered":"2024-04-28T13:08:46.490183+0000","last_unstale":"2024-04-28T13:08:48.008441+0000","last_undegraded":"2024-04-28T13:08:48.008441+0000","last_fullsized":"2024-04-28T13:08:48.008441+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:54:51.856383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008774+0000","last_change":"2024-04-28T13:08:45.462727+0000","last_active":"2024-04-28T13:08:48.008774+0000","last_peered":"2024-04-28T13:08:48.008774+0000","last_clean":"2024-04-28T13:08:48.008774+0000","last_became_active":"2024-04-28T13:08:45.462419+0000","last_became_peered":"2024-04-28T13:08:45.462419+0000","last_unstale":"2024-04-28T13:08:48.008774+0000","last_undegraded":"2024-04-28T13:08:48.008774+0000","last_fullsized":"2024-04-28T13:08:48.008774+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T20:39:22.165965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009427+0000","last_change":"2024-04-28T13:08:46.490315+0000","last_active":"2024-04-28T13:08:48.009427+0000","last_peered":"2024-04-28T13:08:48.009427+0000","last_clean":"2024-04-28T13:08:48.009427+0000","last_became_active":"2024-04-28T13:08:46.489987+0000","last_became_peered":"2024-04-28T13:08:46.489987+0000","last_unstale":"2024-04-28T13:08:48.009427+0000","last_undegraded":"2024-04-28T13:08:48.009427+0000","last_fullsized":"2024-04-28T13:08:48.009427+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:38:11.491053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"45'8","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009142+0000","last_change":"2024-04-28T13:08:45.464678+0000","last_active":"2024-04-28T13:08:48.009142+0000","last_peered":"2024-04-28T13:08:48.009142+0000","last_clean":"2024-04-28T13:08:48.009142+0000","last_became_active":"2024-04-28T13:08:45.464396+0000","last_became_peered":"2024-04-28T13:08:45.464396+0000","last_unstale":"2024-04-28T13:08:48.009142+0000","last_undegraded":"2024-04-28T13:08:48.009142+0000","last_fullsized":"2024-04-28T13:08:48.009142+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:46:47.375362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009860+0000","last_change":"2024-04-28T13:08:46.490399+0000","last_active":"2024-04-28T13:08:48.009860+0000","last_peered":"2024-04-28T13:08:48.009860+0000","last_clean":"2024-04-28T13:08:48.009860+0000","last_became_active":"2024-04-28T13:08:46.490117+0000","last_became_peered":"2024-04-28T13:08:46.490117+0000","last_unstale":"2024-04-28T13:08:48.009860+0000","last_undegraded":"2024-04-28T13:08:48.009860+0000","last_fullsized":"2024-04-28T13:08:48.009860+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:34:56.224768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009874+0000","last_change":"2024-04-28T13:08:45.458651+0000","last_active":"2024-04-28T13:08:48.009874+0000","last_peered":"2024-04-28T13:08:48.009874+0000","last_clean":"2024-04-28T13:08:48.009874+0000","last_became_active":"2024-04-28T13:08:45.458398+0000","last_became_peered":"2024-04-28T13:08:45.458398+0000","last_unstale":"2024-04-28T13:08:48.009874+0000","last_undegraded":"2024-04-28T13:08:48.009874+0000","last_fullsized":"2024-04-28T13:08:48.009874+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T13:59:11.072514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008838+0000","last_change":"2024-04-28T13:08:46.490467+0000","last_active":"2024-04-28T13:08:48.008838+0000","last_peered":"2024-04-28T13:08:48.008838+0000","last_clean":"2024-04-28T13:08:48.008838+0000","last_became_active":"2024-04-28T13:08:46.490128+0000","last_became_peered":"2024-04-28T13:08:46.490128+0000","last_unstale":"2024-04-28T13:08:48.008838+0000","last_undegraded":"2024-04-28T13:08:48.008838+0000","last_fullsized":"2024-04-28T13:08:48.008838+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:32:53.022191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008968+0000","last_change":"2024-04-28T13:08:45.459595+0000","last_active":"2024-04-28T13:08:48.008968+0000","last_peered":"2024-04-28T13:08:48.008968+0000","last_clean":"2024-04-28T13:08:48.008968+0000","last_became_active":"2024-04-28T13:08:45.458889+0000","last_became_peered":"2024-04-28T13:08:45.458889+0000","last_unstale":"2024-04-28T13:08:48.008968+0000","last_undegraded":"2024-04-28T13:08:48.008968+0000","last_fullsized":"2024-04-28T13:08:48.008968+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:42:42.266586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.597781+0000","last_change":"2024-04-28T13:08:46.491260+0000","last_active":"2024-04-28T13:08:47.597781+0000","last_peered":"2024-04-28T13:08:47.597781+0000","last_clean":"2024-04-28T13:08:47.597781+0000","last_became_active":"2024-04-28T13:08:46.490960+0000","last_became_peered":"2024-04-28T13:08:46.490960+0000","last_unstale":"2024-04-28T13:08:47.597781+0000","last_undegraded":"2024-04-28T13:08:47.597781+0000","last_fullsized":"2024-04-28T13:08:47.597781+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:08:42.236745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.484555+0000","last_change":"2024-04-28T13:08:45.467101+0000","last_active":"2024-04-28T13:08:47.484555+0000","last_peered":"2024-04-28T13:08:47.484555+0000","last_clean":"2024-04-28T13:08:47.484555+0000","last_became_active":"2024-04-28T13:08:45.466852+0000","last_became_peered":"2024-04-28T13:08:45.466852+0000","last_unstale":"2024-04-28T13:08:47.484555+0000","last_undegraded":"2024-04-28T13:08:47.484555+0000","last_fullsized":"2024-04-28T13:08:47.484555+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:51:03.462793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.597916+0000","last_change":"2024-04-28T13:08:46.488246+0000","last_active":"2024-04-28T13:08:47.597916+0000","last_peered":"2024-04-28T13:08:47.597916+0000","last_clean":"2024-04-28T13:08:47.597916+0000","last_became_active":"2024-04-28T13:08:46.487994+0000","last_became_peered":"2024-04-28T13:08:46.487994+0000","last_unstale":"2024-04-28T13:08:47.597916+0000","last_undegraded":"2024-04-28T13:08:47.597916+0000","last_fullsized":"2024-04-28T13:08:47.597916+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:51:04.464490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009499+0000","last_change":"2024-04-28T13:08:45.460888+0000","last_active":"2024-04-28T13:08:48.009499+0000","last_peered":"2024-04-28T13:08:48.009499+0000","last_clean":"2024-04-28T13:08:48.009499+0000","last_became_active":"2024-04-28T13:08:45.460488+0000","last_became_peered":"2024-04-28T13:08:45.460488+0000","last_unstale":"2024-04-28T13:08:48.009499+0000","last_undegraded":"2024-04-28T13:08:48.009499+0000","last_fullsized":"2024-04-28T13:08:48.009499+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T01:00:58.651061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008946+0000","last_change":"2024-04-28T13:08:46.490305+0000","last_active":"2024-04-28T13:08:48.008946+0000","last_peered":"2024-04-28T13:08:48.008946+0000","last_clean":"2024-04-28T13:08:48.008946+0000","last_became_active":"2024-04-28T13:08:46.489603+0000","last_became_peered":"2024-04-28T13:08:46.489603+0000","last_unstale":"2024-04-28T13:08:48.008946+0000","last_undegraded":"2024-04-28T13:08:48.008946+0000","last_fullsized":"2024-04-28T13:08:48.008946+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:32:43.821626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009250+0000","last_change":"2024-04-28T13:08:45.458112+0000","last_active":"2024-04-28T13:08:48.009250+0000","last_peered":"2024-04-28T13:08:48.009250+0000","last_clean":"2024-04-28T13:08:48.009250+0000","last_became_active":"2024-04-28T13:08:45.457628+0000","last_became_peered":"2024-04-28T13:08:45.457628+0000","last_unstale":"2024-04-28T13:08:48.009250+0000","last_undegraded":"2024-04-28T13:08:48.009250+0000","last_fullsized":"2024-04-28T13:08:48.009250+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:32:52.020495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.483211+0000","last_change":"2024-04-28T13:08:46.492710+0000","last_active":"2024-04-28T13:08:47.483211+0000","last_peered":"2024-04-28T13:08:47.483211+0000","last_clean":"2024-04-28T13:08:47.483211+0000","last_became_active":"2024-04-28T13:08:46.492436+0000","last_became_peered":"2024-04-28T13:08:46.492436+0000","last_unstale":"2024-04-28T13:08:47.483211+0000","last_undegraded":"2024-04-28T13:08:47.483211+0000","last_fullsized":"2024-04-28T13:08:47.483211+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T13:38:28.441808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.483989+0000","last_change":"2024-04-28T13:08:45.459675+0000","last_active":"2024-04-28T13:08:47.483989+0000","last_peered":"2024-04-28T13:08:47.483989+0000","last_clean":"2024-04-28T13:08:47.483989+0000","last_became_active":"2024-04-28T13:08:45.459396+0000","last_became_peered":"2024-04-28T13:08:45.459396+0000","last_unstale":"2024-04-28T13:08:47.483989+0000","last_undegraded":"2024-04-28T13:08:47.483989+0000","last_fullsized":"2024-04-28T13:08:47.483989+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:15:45.324823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008495+0000","last_change":"2024-04-28T13:08:46.479922+0000","last_active":"2024-04-28T13:08:48.008495+0000","last_peered":"2024-04-28T13:08:48.008495+0000","last_clean":"2024-04-28T13:08:48.008495+0000","last_became_active":"2024-04-28T13:08:46.479649+0000","last_became_peered":"2024-04-28T13:08:46.479649+0000","last_unstale":"2024-04-28T13:08:48.008495+0000","last_undegraded":"2024-04-28T13:08:48.008495+0000","last_fullsized":"2024-04-28T13:08:48.008495+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T01:04:28.201254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008992+0000","last_change":"2024-04-28T13:08:45.463090+0000","last_active":"2024-04-28T13:08:48.008992+0000","last_peered":"2024-04-28T13:08:48.008992+0000","last_clean":"2024-04-28T13:08:48.008992+0000","last_became_active":"2024-04-28T13:08:45.462815+0000","last_became_peered":"2024-04-28T13:08:45.462815+0000","last_unstale":"2024-04-28T13:08:48.008992+0000","last_undegraded":"2024-04-28T13:08:48.008992+0000","last_fullsized":"2024-04-28T13:08:48.008992+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:45:10.995868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008907+0000","last_change":"2024-04-28T13:08:46.491356+0000","last_active":"2024-04-28T13:08:48.008907+0000","last_peered":"2024-04-28T13:08:48.008907+0000","last_clean":"2024-04-28T13:08:48.008907+0000","last_became_active":"2024-04-28T13:08:46.491088+0000","last_became_peered":"2024-04-28T13:08:46.491088+0000","last_unstale":"2024-04-28T13:08:48.008907+0000","last_undegraded":"2024-04-28T13:08:48.008907+0000","last_fullsized":"2024-04-28T13:08:48.008907+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:39:03.829917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008861+0000","last_change":"2024-04-28T13:08:45.457169+0000","last_active":"2024-04-28T13:08:48.008861+0000","last_peered":"2024-04-28T13:08:48.008861+0000","last_clean":"2024-04-28T13:08:48.008861+0000","last_became_active":"2024-04-28T13:08:45.456274+0000","last_became_peered":"2024-04-28T13:08:45.456274+0000","last_unstale":"2024-04-28T13:08:48.008861+0000","last_undegraded":"2024-04-28T13:08:48.008861+0000","last_fullsized":"2024-04-28T13:08:48.008861+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:06:14.670295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.598053+0000","last_change":"2024-04-28T13:08:46.497708+0000","last_active":"2024-04-28T13:08:47.598053+0000","last_peered":"2024-04-28T13:08:47.598053+0000","last_clean":"2024-04-28T13:08:47.598053+0000","last_became_active":"2024-04-28T13:08:46.497334+0000","last_became_peered":"2024-04-28T13:08:46.497334+0000","last_unstale":"2024-04-28T13:08:47.598053+0000","last_undegraded":"2024-04-28T13:08:47.598053+0000","last_fullsized":"2024-04-28T13:08:47.598053+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T18:01:20.664192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"46'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.475650+0000","last_change":"2024-04-28T13:08:45.459559+0000","last_active":"2024-04-28T13:08:48.475650+0000","last_peered":"2024-04-28T13:08:48.475650+0000","last_clean":"2024-04-28T13:08:48.475650+0000","last_became_active":"2024-04-28T13:08:45.459291+0000","last_became_peered":"2024-04-28T13:08:45.459291+0000","last_unstale":"2024-04-28T13:08:48.475650+0000","last_undegraded":"2024-04-28T13:08:48.475650+0000","last_fullsized":"2024-04-28T13:08:48.475650+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-30T00:54:35.236283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009120+0000","last_change":"2024-04-28T13:08:46.489435+0000","last_active":"2024-04-28T13:08:48.009120+0000","last_peered":"2024-04-28T13:08:48.009120+0000","last_clean":"2024-04-28T13:08:48.009120+0000","last_became_active":"2024-04-28T13:08:46.489162+0000","last_became_peered":"2024-04-28T13:08:46.489162+0000","last_unstale":"2024-04-28T13:08:48.009120+0000","last_undegraded":"2024-04-28T13:08:48.009120+0000","last_fullsized":"2024-04-28T13:08:48.009120+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:34:46.589932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009216+0000","last_change":"2024-04-28T13:08:45.464327+0000","last_active":"2024-04-28T13:08:48.009216+0000","last_peered":"2024-04-28T13:08:48.009216+0000","last_clean":"2024-04-28T13:08:48.009216+0000","last_became_active":"2024-04-28T13:08:45.464045+0000","last_became_peered":"2024-04-28T13:08:45.464045+0000","last_unstale":"2024-04-28T13:08:48.009216+0000","last_undegraded":"2024-04-28T13:08:48.009216+0000","last_fullsized":"2024-04-28T13:08:48.009216+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:53:12.028076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008999+0000","last_change":"2024-04-28T13:08:46.488114+0000","last_active":"2024-04-28T13:08:48.008999+0000","last_peered":"2024-04-28T13:08:48.008999+0000","last_clean":"2024-04-28T13:08:48.008999+0000","last_became_active":"2024-04-28T13:08:46.487877+0000","last_became_peered":"2024-04-28T13:08:46.487877+0000","last_unstale":"2024-04-28T13:08:48.008999+0000","last_undegraded":"2024-04-28T13:08:48.008999+0000","last_fullsized":"2024-04-28T13:08:48.008999+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:39:03.829917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.483099+0000","last_change":"2024-04-28T13:08:45.465479+0000","last_active":"2024-04-28T13:08:47.483099+0000","last_peered":"2024-04-28T13:08:47.483099+0000","last_clean":"2024-04-28T13:08:47.483099+0000","last_became_active":"2024-04-28T13:08:45.465190+0000","last_became_peered":"2024-04-28T13:08:45.465190+0000","last_unstale":"2024-04-28T13:08:47.483099+0000","last_undegraded":"2024-04-28T13:08:47.483099+0000","last_fullsized":"2024-04-28T13:08:47.483099+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:45:10.995868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009070+0000","last_change":"2024-04-28T13:08:46.489506+0000","last_active":"2024-04-28T13:08:48.009070+0000","last_peered":"2024-04-28T13:08:48.009070+0000","last_clean":"2024-04-28T13:08:48.009070+0000","last_became_active":"2024-04-28T13:08:46.489008+0000","last_became_peered":"2024-04-28T13:08:46.489008+0000","last_unstale":"2024-04-28T13:08:48.009070+0000","last_undegraded":"2024-04-28T13:08:48.009070+0000","last_fullsized":"2024-04-28T13:08:48.009070+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T23:00:07.179157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008891+0000","last_change":"2024-04-28T13:08:45.464188+0000","last_active":"2024-04-28T13:08:48.008891+0000","last_peered":"2024-04-28T13:08:48.008891+0000","last_clean":"2024-04-28T13:08:48.008891+0000","last_became_active":"2024-04-28T13:08:45.463918+0000","last_became_peered":"2024-04-28T13:08:45.463918+0000","last_unstale":"2024-04-28T13:08:48.008891+0000","last_undegraded":"2024-04-28T13:08:48.008891+0000","last_fullsized":"2024-04-28T13:08:48.008891+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T19:22:26.890695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008992+0000","last_change":"2024-04-28T13:08:46.490857+0000","last_active":"2024-04-28T13:08:48.008992+0000","last_peered":"2024-04-28T13:08:48.008992+0000","last_clean":"2024-04-28T13:08:48.008992+0000","last_became_active":"2024-04-28T13:08:46.490618+0000","last_became_peered":"2024-04-28T13:08:46.490618+0000","last_unstale":"2024-04-28T13:08:48.008992+0000","last_undegraded":"2024-04-28T13:08:48.008992+0000","last_fullsized":"2024-04-28T13:08:48.008992+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T15:32:51.752623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008623+0000","last_change":"2024-04-28T13:08:45.463525+0000","last_active":"2024-04-28T13:08:48.008623+0000","last_peered":"2024-04-28T13:08:48.008623+0000","last_clean":"2024-04-28T13:08:48.008623+0000","last_became_active":"2024-04-28T13:08:45.463261+0000","last_became_peered":"2024-04-28T13:08:45.463261+0000","last_unstale":"2024-04-28T13:08:48.008623+0000","last_undegraded":"2024-04-28T13:08:48.008623+0000","last_fullsized":"2024-04-28T13:08:48.008623+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:45:10.995868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.483953+0000","last_change":"2024-04-28T13:08:46.489717+0000","last_active":"2024-04-28T13:08:47.483953+0000","last_peered":"2024-04-28T13:08:47.483953+0000","last_clean":"2024-04-28T13:08:47.483953+0000","last_became_active":"2024-04-28T13:08:46.489442+0000","last_became_peered":"2024-04-28T13:08:46.489442+0000","last_unstale":"2024-04-28T13:08:47.483953+0000","last_undegraded":"2024-04-28T13:08:47.483953+0000","last_fullsized":"2024-04-28T13:08:47.483953+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T20:39:23.167661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.483065+0000","last_change":"2024-04-28T13:08:45.460838+0000","last_active":"2024-04-28T13:08:47.483065+0000","last_peered":"2024-04-28T13:08:47.483065+0000","last_clean":"2024-04-28T13:08:47.483065+0000","last_became_active":"2024-04-28T13:08:45.460362+0000","last_became_peered":"2024-04-28T13:08:45.460362+0000","last_unstale":"2024-04-28T13:08:47.483065+0000","last_undegraded":"2024-04-28T13:08:47.483065+0000","last_fullsized":"2024-04-28T13:08:47.483065+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:49:29.788851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008796+0000","last_change":"2024-04-28T13:08:46.487877+0000","last_active":"2024-04-28T13:08:48.008796+0000","last_peered":"2024-04-28T13:08:48.008796+0000","last_clean":"2024-04-28T13:08:48.008796+0000","last_became_active":"2024-04-28T13:08:46.487604+0000","last_became_peered":"2024-04-28T13:08:46.487604+0000","last_unstale":"2024-04-28T13:08:48.008796+0000","last_undegraded":"2024-04-28T13:08:48.008796+0000","last_fullsized":"2024-04-28T13:08:48.008796+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:39:18.770677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009222+0000","last_change":"2024-04-28T13:08:45.464856+0000","last_active":"2024-04-28T13:08:48.009222+0000","last_peered":"2024-04-28T13:08:48.009222+0000","last_clean":"2024-04-28T13:08:48.009222+0000","last_became_active":"2024-04-28T13:08:45.464577+0000","last_became_peered":"2024-04-28T13:08:45.464577+0000","last_unstale":"2024-04-28T13:08:48.009222+0000","last_undegraded":"2024-04-28T13:08:48.009222+0000","last_fullsized":"2024-04-28T13:08:48.009222+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T14:49:29.788851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.009669+0000","last_change":"2024-04-28T13:08:46.495290+0000","last_active":"2024-04-28T13:08:48.009669+0000","last_peered":"2024-04-28T13:08:48.009669+0000","last_clean":"2024-04-28T13:08:48.009669+0000","last_became_active":"2024-04-28T13:08:46.495057+0000","last_became_peered":"2024-04-28T13:08:46.495057+0000","last_unstale":"2024-04-28T13:08:48.009669+0000","last_undegraded":"2024-04-28T13:08:48.009669+0000","last_fullsized":"2024-04-28T13:08:48.009669+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:45.441219+0000","last_clean_scrub_stamp":"2024-04-28T13:08:45.441219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T17:39:00.309321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:47.484321+0000","last_change":"2024-04-28T13:08:45.464660+0000","last_active":"2024-04-28T13:08:47.484321+0000","last_peered":"2024-04-28T13:08:47.484321+0000","last_clean":"2024-04-28T13:08:47.484321+0000","last_became_active":"2024-04-28T13:08:45.464380+0000","last_became_peered":"2024-04-28T13:08:45.464380+0000","last_unstale":"2024-04-28T13:08:47.484321+0000","last_undegraded":"2024-04-28T13:08:47.484321+0000","last_fullsized":"2024-04-28T13:08:47.484321+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:08:44.439523+0000","last_clean_scrub_stamp":"2024-04-28T13:08:44.439523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T22:08:41.235049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":214,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-28T13:08:48.008881+0000","last_change":"2024-04-28T13:07:16.698740+0000","last_active":"2024-04-28T13:08:48.008881+0000","last_peered":"2024-04-28T13:08:48.008881+0000","last_clean":"2024-04-28T13:08:48.008881+0000","last_became_active":"2024-04-28T13:07:16.696364+0000","last_became_peered":"2024-04-28T13:07:16.696364+0000","last_unstale":"2024-04-28T13:08:48.008881+0000","last_undegraded":"2024-04-28T13:08:48.008881+0000","last_fullsized":"2024-04-28T13:08:48.008881+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-28T13:07:14.770499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-28T13:07:14.770499+0000","last_clean_scrub_stamp":"2024-04-28T13:07:14.770499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-29T21:39:38.986133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28124,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343716,"statfs":{"total":96636764160,"available":96607965184,"internally_reserved":0,"allocated":1126400,"data_stored":803952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":548864,"data_stored":220466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":544768,"data_stored":219864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":540672,"data_stored":215106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":552960,"data_stored":220432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":544768,"data_stored":215128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":544768,"data_stored":219864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1138688,"data_stored":810196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-28T13:08:54.140 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-28T13:08:54.140 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-28T13:08:54.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.278+0000 7f3aa5a93640 1 Processor -- start 2024-04-28T13:08:54.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.278+0000 7f3aa5a93640 1 -- start start 2024-04-28T13:08:54.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.279+0000 7f3aa5a93640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3aa0148dc0 0x7f3aa00d0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:54.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.279+0000 7f3aa5a93640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3aa00c87e0 0x7f3aa00cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:54.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.279+0000 7f3aa5a93640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3aa00c8e70 con 0x7f3aa00d1270 2024-04-28T13:08:54.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.279+0000 7f3aa5a93640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f3aa00c8c50 con 0x7f3aa00c87e0 2024-04-28T13:08:54.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.279+0000 7f3aa5a93640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3aa00d16d0 con 0x7f3aa0148dc0 2024-04-28T13:08:54.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.279+0000 7f3a9ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3aa00c87e0 0x7f3aa00cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:54.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.279+0000 7f3a9ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3aa00c87e0 0x7f3aa00cdd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43908/0 (socket says 172.21.15.114:43908) 2024-04-28T13:08:54.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.279+0000 7f3a9ffff640 1 -- 172.21.15.114:0/713447377 learned_addr learned my addr 172.21.15.114:0/713447377 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:54.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.279+0000 7f3a9f7fe640 1 --2- 172.21.15.114:0/713447377 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3aa0148dc0 0x7f3aa00d0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:54.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.280+0000 7f3a9ffff640 1 -- 172.21.15.114:0/713447377 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3aa0148dc0 msgr2=0x7f3aa00d0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:54.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.280+0000 7f3a9ffff640 1 --2- 172.21.15.114:0/713447377 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3aa0148dc0 0x7f3aa00d0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:54.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.280+0000 7f3a9ffff640 1 -- 172.21.15.114:0/713447377 >> v1:172.21.15.134:6789/0 conn(0x7f3aa00d1270 legacy=0x7f3aa00c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:54.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.280+0000 7f3a9e7fc640 1 -- 172.21.15.114:0/713447377 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4086744938 0 0) 0x7f3aa00c8e70 con 0x7f3aa00d1270 2024-04-28T13:08:54.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.280+0000 7f3a9ffff640 1 -- 172.21.15.114:0/713447377 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aa00c9150 con 0x7f3aa00c87e0 2024-04-28T13:08:54.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.280+0000 7f3a9ffff640 1 --2- 172.21.15.114:0/713447377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3aa00c87e0 0x7f3aa00cdd70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f3a98009e50 tx=0x7f3a9802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b04ccad2458ebf server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:54.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.281+0000 7f3a9e7fc640 1 -- 172.21.15.114:0/713447377 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a98036070 con 0x7f3aa00c87e0 2024-04-28T13:08:54.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.281+0000 7f3a9e7fc640 1 -- 172.21.15.114:0/713447377 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a98031600 con 0x7f3aa00c87e0 2024-04-28T13:08:54.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.281+0000 7f3a9e7fc640 1 -- 172.21.15.114:0/713447377 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a980319d0 con 0x7f3aa00c87e0 2024-04-28T13:08:54.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.281+0000 7f3aa5a93640 1 -- 172.21.15.114:0/713447377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3aa00c87e0 msgr2=0x7f3aa00cdd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:54.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.281+0000 7f3aa5a93640 1 --2- 172.21.15.114:0/713447377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3aa00c87e0 0x7f3aa00cdd70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f3a98009e50 tx=0x7f3a9802a680 comp rx=0 tx=0).stop 2024-04-28T13:08:54.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.281+0000 7f3aa5a93640 1 -- 172.21.15.114:0/713447377 shutdown_connections 2024-04-28T13:08:54.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.281+0000 7f3aa5a93640 1 --2- 172.21.15.114:0/713447377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3aa00c87e0 0x7f3aa00cdd70 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:54.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.281+0000 7f3aa5a93640 1 --2- 172.21.15.114:0/713447377 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3aa0148dc0 0x7f3aa00d0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:54.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.281+0000 7f3aa5a93640 1 -- 172.21.15.114:0/713447377 >> 172.21.15.114:0/713447377 conn(0x7f3aa00706f0 msgr2=0x7f3aa0070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:54.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.281+0000 7f3aa5a93640 1 -- 172.21.15.114:0/713447377 shutdown_connections 2024-04-28T13:08:54.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.281+0000 7f3aa5a93640 1 -- 172.21.15.114:0/713447377 wait complete. 2024-04-28T13:08:54.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.282+0000 7f3aa5a93640 1 Processor -- start 2024-04-28T13:08:54.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.283+0000 7f3aa5a93640 1 -- start start 2024-04-28T13:08:54.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.283+0000 7f3aa5a93640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3aa00c87e0 0x7f3aa0146080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:54.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.283+0000 7f3aa5a93640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3aa00d1270 0x7f3aa0155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:54.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.283+0000 7f3aa5a93640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3aa0148dc0 0x7f3aa013cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:54.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.283+0000 7f3aa5a93640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa00cd850 con 0x7f3aa00c87e0 2024-04-28T13:08:54.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.283+0000 7f3aa5a93640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa00c9710 con 0x7f3aa00d1270 2024-04-28T13:08:54.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.283+0000 7f3aa5a93640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3aa00ce2b0 con 0x7f3aa0148dc0 2024-04-28T13:08:54.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.283+0000 7f3a9f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3aa00c87e0 0x7f3aa0146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:54.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.283+0000 7f3a9f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3aa00c87e0 0x7f3aa0146080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43918/0 (socket says 172.21.15.114:43918) 2024-04-28T13:08:54.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.283+0000 7f3a9f7fe640 1 -- 172.21.15.114:0/1041415080 learned_addr learned my addr 172.21.15.114:0/1041415080 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:54.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.283+0000 7f3a9effd640 1 --2- 172.21.15.114:0/1041415080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3aa00d1270 0x7f3aa0155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:54.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.283+0000 7f3a9ffff640 1 --2- 172.21.15.114:0/1041415080 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3aa0148dc0 0x7f3aa013cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:54.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.284+0000 7f3a9f7fe640 1 -- 172.21.15.114:0/1041415080 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3aa0148dc0 msgr2=0x7f3aa013cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:54.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.284+0000 7f3a9f7fe640 1 --2- 172.21.15.114:0/1041415080 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3aa0148dc0 0x7f3aa013cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:54.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.284+0000 7f3a9f7fe640 1 -- 172.21.15.114:0/1041415080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3aa00d1270 msgr2=0x7f3aa0155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:54.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.284+0000 7f3a9f7fe640 1 --2- 172.21.15.114:0/1041415080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3aa00d1270 0x7f3aa0155780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:54.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.284+0000 7f3a9f7fe640 1 -- 172.21.15.114:0/1041415080 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aa0146780 con 0x7f3aa00c87e0 2024-04-28T13:08:54.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.284+0000 7f3a9effd640 1 --2- 172.21.15.114:0/1041415080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3aa00d1270 0x7f3aa0155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:54.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.284+0000 7f3a9f7fe640 1 --2- 172.21.15.114:0/1041415080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3aa00c87e0 0x7f3aa0146080 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3a9000e870 tx=0x7f3a9000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:54.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.284+0000 7f3a87fff640 1 -- 172.21.15.114:0/1041415080 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a90017070 con 0x7f3aa00c87e0 2024-04-28T13:08:54.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.284+0000 7f3a87fff640 1 -- 172.21.15.114:0/1041415080 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a9000c940 con 0x7f3aa00c87e0 2024-04-28T13:08:54.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.284+0000 7f3aa5a93640 1 -- 172.21.15.114:0/1041415080 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aa0146a60 con 0x7f3aa00c87e0 2024-04-28T13:08:54.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.284+0000 7f3a87fff640 1 -- 172.21.15.114:0/1041415080 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a9000cd30 con 0x7f3aa00c87e0 2024-04-28T13:08:54.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.284+0000 7f3aa5a93640 1 -- 172.21.15.114:0/1041415080 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3aa0147020 con 0x7f3aa00c87e0 2024-04-28T13:08:54.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.285+0000 7f3aa5a93640 1 -- 172.21.15.114:0/1041415080 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3aa006a3d0 con 0x7f3aa00c87e0 2024-04-28T13:08:54.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.285+0000 7f3a87fff640 1 -- 172.21.15.114:0/1041415080 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f3a9001a070 con 0x7f3aa00c87e0 2024-04-28T13:08:54.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.286+0000 7f3a87fff640 1 --2- 172.21.15.114:0/1041415080 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3a8c06c980 0x7f3a8c06ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:54.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.286+0000 7f3a87fff640 1 -- 172.21.15.114:0/1041415080 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f3a9008bdb0 con 0x7f3aa00c87e0 2024-04-28T13:08:54.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.286+0000 7f3a9effd640 1 --2- 172.21.15.114:0/1041415080 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3a8c06c980 0x7f3a8c06ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:54.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.286+0000 7f3a9effd640 1 --2- 172.21.15.114:0/1041415080 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3a8c06c980 0x7f3a8c06ee40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3aa015eca0 tx=0x7f3a94009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:54.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.290+0000 7f3a87fff640 1 -- 172.21.15.114:0/1041415080 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3a9005a1f0 con 0x7f3aa00c87e0 2024-04-28T13:08:54.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.533+0000 7f3aa5a93640 1 -- 172.21.15.114:0/1041415080 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f3aa00d0c80 con 0x7f3aa00c87e0 2024-04-28T13:08:54.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.535+0000 7f3a87fff640 1 -- 172.21.15.114:0/1041415080 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7f3a90059af0 con 0x7f3aa00c87e0 2024-04-28T13:08:54.536 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2024-04-28T13:08:54.536 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDOSS5mzotvJhAAlis8wXdOL4WCzxzUL8L3qw== 2024-04-28T13:08:54.536 INFO:teuthology.orchestra.run.smithi114.stdout: caps mds = "allow" 2024-04-28T13:08:54.536 INFO:teuthology.orchestra.run.smithi114.stdout: caps mon = "allow r" 2024-04-28T13:08:54.536 INFO:teuthology.orchestra.run.smithi114.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-28T13:08:54.536 INFO:teuthology.orchestra.run.smithi114.stderr:updated caps for client.0 2024-04-28T13:08:54.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.537+0000 7f3aa5a93640 1 -- 172.21.15.114:0/1041415080 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3a8c06c980 msgr2=0x7f3a8c06ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:54.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.537+0000 7f3aa5a93640 1 --2- 172.21.15.114:0/1041415080 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3a8c06c980 0x7f3a8c06ee40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3aa015eca0 tx=0x7f3a94009040 comp rx=0 tx=0).stop 2024-04-28T13:08:54.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.537+0000 7f3aa5a93640 1 -- 172.21.15.114:0/1041415080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3aa00c87e0 msgr2=0x7f3aa0146080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:54.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.537+0000 7f3aa5a93640 1 --2- 172.21.15.114:0/1041415080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3aa00c87e0 0x7f3aa0146080 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3a9000e870 tx=0x7f3a9000ed30 comp rx=0 tx=0).stop 2024-04-28T13:08:54.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.537+0000 7f3aa5a93640 1 -- 172.21.15.114:0/1041415080 shutdown_connections 2024-04-28T13:08:54.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.537+0000 7f3aa5a93640 1 --2- 172.21.15.114:0/1041415080 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3aa0148dc0 0x7f3aa013cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:54.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.537+0000 7f3aa5a93640 1 --2- 172.21.15.114:0/1041415080 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3a8c06c980 0x7f3a8c06ee40 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:54.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.537+0000 7f3aa5a93640 1 --2- 172.21.15.114:0/1041415080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3aa00d1270 0x7f3aa0155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:54.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.537+0000 7f3aa5a93640 1 --2- 172.21.15.114:0/1041415080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3aa00c87e0 0x7f3aa0146080 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:54.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.537+0000 7f3aa5a93640 1 -- 172.21.15.114:0/1041415080 >> 172.21.15.114:0/1041415080 conn(0x7f3aa00706f0 msgr2=0x7f3aa006ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:54.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.537+0000 7f3aa5a93640 1 -- 172.21.15.114:0/1041415080 shutdown_connections 2024-04-28T13:08:54.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.537+0000 7f3aa5a93640 1 -- 172.21.15.114:0/1041415080 wait complete. 2024-04-28T13:08:54.549 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-28T13:08:54.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.644+0000 7ff686966640 1 Processor -- start 2024-04-28T13:08:54.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.644+0000 7ff686966640 1 -- start start 2024-04-28T13:08:54.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.645+0000 7ff686966640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff68015f430 0x7ff6800715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:54.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.645+0000 7ff686966640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff6800b5970 0x7ff6800740e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:54.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.645+0000 7ff686966640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6800746f0 con 0x7ff680073c50 2024-04-28T13:08:54.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.645+0000 7ff686966640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7ff68015f810 con 0x7ff68015f430 2024-04-28T13:08:54.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.645+0000 7ff686966640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ff680070810 con 0x7ff6800b5970 2024-04-28T13:08:54.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.645+0000 7ff67ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff68015f430 0x7ff6800715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:54.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.645+0000 7ff67ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff68015f430 0x7ff6800715d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43930/0 (socket says 172.21.15.114:43930) 2024-04-28T13:08:54.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.645+0000 7ff67ffff640 1 -- 172.21.15.114:0/1880070318 learned_addr learned my addr 172.21.15.114:0/1880070318 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:54.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.645+0000 7ff67ffff640 1 -- 172.21.15.114:0/1880070318 >> v2:172.21.15.134:3300/0 conn(0x7ff6800b5970 msgr2=0x7ff6800740e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:54.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.645+0000 7ff67ffff640 1 --2- 172.21.15.114:0/1880070318 >> v2:172.21.15.134:3300/0 conn(0x7ff6800b5970 0x7ff6800740e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:54.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.645+0000 7ff67ffff640 1 -- 172.21.15.114:0/1880070318 >> v1:172.21.15.134:6789/0 conn(0x7ff680073c50 legacy=0x7ff6800b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:54.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.645+0000 7ff67ffff640 1 -- 172.21.15.114:0/1880070318 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff680070af0 con 0x7ff68015f430 2024-04-28T13:08:54.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.646+0000 7ff67ffff640 1 --2- 172.21.15.114:0/1880070318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff68015f430 0x7ff6800715d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ff6800b73c0 tx=0x7ff67002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f226fc07f262d82 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:54.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.646+0000 7ff67effd640 1 -- 172.21.15.114:0/1880070318 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff670037070 con 0x7ff68015f430 2024-04-28T13:08:54.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.646+0000 7ff67effd640 1 -- 172.21.15.114:0/1880070318 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff670032440 con 0x7ff68015f430 2024-04-28T13:08:54.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.646+0000 7ff67effd640 1 -- 172.21.15.114:0/1880070318 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff670032810 con 0x7ff68015f430 2024-04-28T13:08:54.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.647+0000 7ff686966640 1 -- 172.21.15.114:0/1880070318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff68015f430 msgr2=0x7ff6800715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:54.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.647+0000 7ff686966640 1 --2- 172.21.15.114:0/1880070318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff68015f430 0x7ff6800715d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ff6800b73c0 tx=0x7ff67002a230 comp rx=0 tx=0).stop 2024-04-28T13:08:54.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.647+0000 7ff686966640 1 -- 172.21.15.114:0/1880070318 shutdown_connections 2024-04-28T13:08:54.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.647+0000 7ff686966640 1 --2- 172.21.15.114:0/1880070318 >> v2:172.21.15.134:3300/0 conn(0x7ff6800b5970 0x7ff6800740e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:54.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.647+0000 7ff686966640 1 --2- 172.21.15.114:0/1880070318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff68015f430 0x7ff6800715d0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:54.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.647+0000 7ff686966640 1 -- 172.21.15.114:0/1880070318 >> 172.21.15.114:0/1880070318 conn(0x7ff6800b3c50 msgr2=0x7ff6800b4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:54.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.647+0000 7ff686966640 1 -- 172.21.15.114:0/1880070318 shutdown_connections 2024-04-28T13:08:54.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.647+0000 7ff686966640 1 -- 172.21.15.114:0/1880070318 wait complete. 2024-04-28T13:08:54.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.648+0000 7ff686966640 1 Processor -- start 2024-04-28T13:08:54.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.648+0000 7ff686966640 1 -- start start 2024-04-28T13:08:54.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.649+0000 7ff686966640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff680073c50 0x7ff680155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:54.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.649+0000 7ff686966640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6800b5970 0x7ff680158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:54.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.649+0000 7ff686966640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff68015f430 0x7ff680161890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:54.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.649+0000 7ff686966640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff680071b10 con 0x7ff680073c50 2024-04-28T13:08:54.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.649+0000 7ff686966640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff6800710b0 con 0x7ff6800b5970 2024-04-28T13:08:54.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.649+0000 7ff686966640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff6800b15a0 con 0x7ff68015f430 2024-04-28T13:08:54.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.649+0000 7ff67ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff680073c50 0x7ff680155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:54.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.649+0000 7ff67ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff680073c50 0x7ff680155670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43942/0 (socket says 172.21.15.114:43942) 2024-04-28T13:08:54.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.649+0000 7ff67ffff640 1 -- 172.21.15.114:0/198580666 learned_addr learned my addr 172.21.15.114:0/198580666 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:54.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.649+0000 7ff67ffff640 1 -- 172.21.15.114:0/198580666 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff68015f430 msgr2=0x7ff680161890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:54.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.649+0000 7ff684f03640 1 --2- 172.21.15.114:0/198580666 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff68015f430 0x7ff680161890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:54.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.649+0000 7ff67f7fe640 1 --2- 172.21.15.114:0/198580666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6800b5970 0x7ff680158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:54.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.649+0000 7ff67ffff640 1 --2- 172.21.15.114:0/198580666 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff68015f430 0x7ff680161890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:54.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.649+0000 7ff67ffff640 1 -- 172.21.15.114:0/198580666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6800b5970 msgr2=0x7ff680158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:54.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.649+0000 7ff67ffff640 1 --2- 172.21.15.114:0/198580666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6800b5970 0x7ff680158980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:54.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.649+0000 7ff67ffff640 1 -- 172.21.15.114:0/198580666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff680157060 con 0x7ff680073c50 2024-04-28T13:08:54.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.649+0000 7ff67ffff640 1 --2- 172.21.15.114:0/198580666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff680073c50 0x7ff680155670 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7ff670000c00 tx=0x7ff6700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:54.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.650+0000 7ff67cff9640 1 -- 172.21.15.114:0/198580666 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff670041070 con 0x7ff680073c50 2024-04-28T13:08:54.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.650+0000 7ff67cff9640 1 -- 172.21.15.114:0/198580666 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff67003c870 con 0x7ff680073c50 2024-04-28T13:08:54.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.650+0000 7ff686966640 1 -- 172.21.15.114:0/198580666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff680157340 con 0x7ff680073c50 2024-04-28T13:08:54.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.650+0000 7ff67cff9640 1 -- 172.21.15.114:0/198580666 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff670037040 con 0x7ff680073c50 2024-04-28T13:08:54.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.650+0000 7ff686966640 1 -- 172.21.15.114:0/198580666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff680157900 con 0x7ff680073c50 2024-04-28T13:08:54.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.651+0000 7ff686966640 1 -- 172.21.15.114:0/198580666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff68006a3d0 con 0x7ff680073c50 2024-04-28T13:08:54.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.651+0000 7ff67cff9640 1 -- 172.21.15.114:0/198580666 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7ff670044070 con 0x7ff680073c50 2024-04-28T13:08:54.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.651+0000 7ff67cff9640 1 --2- 172.21.15.114:0/198580666 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff66c06c980 0x7ff66c06ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:54.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.651+0000 7ff67cff9640 1 -- 172.21.15.114:0/198580666 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7ff6700ac6e0 con 0x7ff680073c50 2024-04-28T13:08:54.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.652+0000 7ff67f7fe640 1 --2- 172.21.15.114:0/198580666 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff66c06c980 0x7ff66c06ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:54.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.652+0000 7ff67f7fe640 1 --2- 172.21.15.114:0/198580666 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff66c06c980 0x7ff66c06ee40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff68015dda0 tx=0x7ff674008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:54.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.656+0000 7ff67cff9640 1 -- 172.21.15.114:0/198580666 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff67007abb0 con 0x7ff680073c50 2024-04-28T13:08:54.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.869+0000 7ff686966640 1 -- 172.21.15.114:0/198580666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff680155bb0 con 0x7ff680073c50 2024-04-28T13:08:54.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.869+0000 7ff67cff9640 1 -- 172.21.15.114:0/198580666 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5190 (secure 0 0 0) 0x7ff67007a4b0 con 0x7ff680073c50 2024-04-28T13:08:54.870 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-28T13:08:54.870 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4946,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/3532702893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3532702893},{"type":"v1","addr":"172.21.15.114:6836","nonce":3532702893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":4955,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/819388915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":819388915},{"type":"v1","addr":"172.21.15.134:6834","nonce":819388915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5215,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2410765352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2410765352},{"type":"v1","addr":"172.21.15.114:6837","nonce":2410765352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-28T13:08:45.794409+0000","modified":"2024-04-28T13:08:47.816406+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5601":{"gid":5601,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/3334515618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":3334515618},{"type":"v1","addr":"172.21.15.134:6835","nonce":3334515618}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5601,"qdb_cluster":[5601]},"id":3}]} 2024-04-28T13:08:54.871 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 20 2024-04-28T13:08:54.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.871+0000 7ff686966640 1 -- 172.21.15.114:0/198580666 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff66c06c980 msgr2=0x7ff66c06ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:54.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.871+0000 7ff686966640 1 --2- 172.21.15.114:0/198580666 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff66c06c980 0x7ff66c06ee40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff68015dda0 tx=0x7ff674008040 comp rx=0 tx=0).stop 2024-04-28T13:08:54.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.871+0000 7ff686966640 1 -- 172.21.15.114:0/198580666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff680073c50 msgr2=0x7ff680155670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:54.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.871+0000 7ff686966640 1 --2- 172.21.15.114:0/198580666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff680073c50 0x7ff680155670 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7ff670000c00 tx=0x7ff6700046c0 comp rx=0 tx=0).stop 2024-04-28T13:08:54.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.871+0000 7ff686966640 1 -- 172.21.15.114:0/198580666 shutdown_connections 2024-04-28T13:08:54.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.871+0000 7ff686966640 1 --2- 172.21.15.114:0/198580666 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff68015f430 0x7ff680161890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:54.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.871+0000 7ff686966640 1 --2- 172.21.15.114:0/198580666 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7ff66c06c980 0x7ff66c06ee40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:54.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.871+0000 7ff686966640 1 --2- 172.21.15.114:0/198580666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6800b5970 0x7ff680158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:54.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.871+0000 7ff686966640 1 --2- 172.21.15.114:0/198580666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff680073c50 0x7ff680155670 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:54.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.871+0000 7ff686966640 1 -- 172.21.15.114:0/198580666 >> 172.21.15.114:0/198580666 conn(0x7ff6800b3c50 msgr2=0x7ff6800b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:54.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.871+0000 7ff686966640 1 -- 172.21.15.114:0/198580666 shutdown_connections 2024-04-28T13:08:54.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:54.871+0000 7ff686966640 1 -- 172.21.15.114:0/198580666 wait complete. 2024-04-28T13:08:55.286 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-28T13:08:45.794409+0000', 'modified': '2024-04-28T13:08:47.816406+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5601}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5601': {'gid': 5601, 'name': 'b', 'rank': 0, 'incarnation': 18, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.134:6835/3334515618', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6833', 'nonce': 3334515618}, {'type': 'v1', 'addr': '172.21.15.134:6835', 'nonce': 3334515618}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5601, 'qdb_cluster': [5601]} 2024-04-28T13:08:55.286 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-28T13:08:55.287 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-28T13:08:55.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.384+0000 7f2a940c4640 1 Processor -- start 2024-04-28T13:08:55.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.384+0000 7f2a940c4640 1 -- start start 2024-04-28T13:08:55.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.385+0000 7f2a940c4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2a8c147e50 0x7f2a8c06faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:55.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.385+0000 7f2a940c4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a8c0b58a0 con 0x7f2a8c073c30 2024-04-28T13:08:55.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.385+0000 7f2a940c4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a8c0b5b80 con 0x7f2a8c148230 2024-04-28T13:08:55.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.385+0000 7f2a940c4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f2a8c06ffe0 con 0x7f2a8c147e50 2024-04-28T13:08:55.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.385+0000 7f2a92661640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2a8c073c30 0x7f2a8c06c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:43972/0 (socket says 172.21.15.114:43972) 2024-04-28T13:08:55.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.385+0000 7f2a92661640 1 -- 172.21.15.114:0/909786795 learned_addr learned my addr 172.21.15.114:0/909786795 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:55.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.385+0000 7f2a91e60640 1 --2- 172.21.15.114:0/909786795 >> v2:172.21.15.134:3300/0 conn(0x7f2a8c147e50 0x7f2a8c06faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:55.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.385+0000 7f2a90e5e640 1 -- 172.21.15.114:0/909786795 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2092348171 0 0) 0x7f2a8c0b58a0 con 0x7f2a8c073c30 2024-04-28T13:08:55.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.385+0000 7f2a90e5e640 1 -- 172.21.15.114:0/909786795 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a78003520 con 0x7f2a8c073c30 2024-04-28T13:08:55.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.385+0000 7f2a90e5e640 1 -- 172.21.15.114:0/909786795 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2826027645 0 0) 0x7f2a78003520 con 0x7f2a8c073c30 2024-04-28T13:08:55.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.385+0000 7f2a90e5e640 1 -- 172.21.15.114:0/909786795 >> v2:172.21.15.134:3300/0 conn(0x7f2a8c147e50 msgr2=0x7f2a8c06faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:55.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.385+0000 7f2a90e5e640 1 --2- 172.21.15.114:0/909786795 >> v2:172.21.15.134:3300/0 conn(0x7f2a8c147e50 0x7f2a8c06faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.385+0000 7f2a90e5e640 1 -- 172.21.15.114:0/909786795 >> v1:172.21.15.134:6789/0 conn(0x7f2a8c148230 legacy=0x7f2a8c0b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:55.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.385+0000 7f2a90e5e640 1 -- 172.21.15.114:0/909786795 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a8c06f2a0 con 0x7f2a8c073c30 2024-04-28T13:08:55.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.385+0000 7f2a90e5e640 1 -- 172.21.15.114:0/909786795 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f2a840019f0 con 0x7f2a8c073c30 2024-04-28T13:08:55.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.385+0000 7f2a90e5e640 1 -- 172.21.15.114:0/909786795 >> v1:172.21.15.114:6789/0 conn(0x7f2a8c073c30 legacy=0x7f2a8c06c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:55.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.385+0000 7f2a90e5e640 1 --2- 172.21.15.114:0/909786795 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a780039b0 0x7f2a78003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:55.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.385+0000 7f2a90e5e640 1 --2- 172.21.15.114:0/909786795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a78004800 0x7f2a78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:55.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.385+0000 7f2a90e5e640 1 --2- 172.21.15.114:0/909786795 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a780051c0 0x7f2a7800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:55.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.385+0000 7f2a90e5e640 1 -- 172.21.15.114:0/909786795 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2a8c06ffe0 con 0x7f2a780051c0 2024-04-28T13:08:55.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.385+0000 7f2a90e5e640 1 -- 172.21.15.114:0/909786795 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7800c060 con 0x7f2a78004800 2024-04-28T13:08:55.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.385+0000 7f2a90e5e640 1 -- 172.21.15.114:0/909786795 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2a7800c260 con 0x7f2a780039b0 2024-04-28T13:08:55.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.386+0000 7f2a92661640 1 --2- 172.21.15.114:0/909786795 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a780051c0 0x7f2a7800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:55.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.386+0000 7f2a91e60640 1 --2- 172.21.15.114:0/909786795 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a780039b0 0x7f2a78003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:55.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.386+0000 7f2a9165f640 1 --2- 172.21.15.114:0/909786795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a78004800 0x7f2a78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:55.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.386+0000 7f2a92661640 1 -- 172.21.15.114:0/909786795 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a780039b0 msgr2=0x7f2a78003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:55.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.386+0000 7f2a92661640 1 --2- 172.21.15.114:0/909786795 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a780039b0 0x7f2a78003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.386+0000 7f2a92661640 1 -- 172.21.15.114:0/909786795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a78004800 msgr2=0x7f2a78004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:55.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.386+0000 7f2a92661640 1 --2- 172.21.15.114:0/909786795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a78004800 0x7f2a78004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.386+0000 7f2a92661640 1 -- 172.21.15.114:0/909786795 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a78003520 con 0x7f2a780051c0 2024-04-28T13:08:55.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.386+0000 7f2a92661640 1 -- 172.21.15.114:0/909786795 reap_dead start 2024-04-28T13:08:55.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.386+0000 7f2a92661640 1 --2- 172.21.15.114:0/909786795 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a780051c0 0x7f2a7800b9c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2a8400a840 tx=0x7f2a78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f0af59574ff11a server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:55.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.387+0000 7f2a90e5e640 1 -- 172.21.15.114:0/909786795 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8400a460 con 0x7f2a780051c0 2024-04-28T13:08:55.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.387+0000 7f2a90e5e640 1 -- 172.21.15.114:0/909786795 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a8402f070 con 0x7f2a780051c0 2024-04-28T13:08:55.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.387+0000 7f2a90e5e640 1 -- 172.21.15.114:0/909786795 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8402bcb0 con 0x7f2a780051c0 2024-04-28T13:08:55.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.387+0000 7f2a940c4640 1 -- 172.21.15.114:0/909786795 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a780051c0 msgr2=0x7f2a7800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:55.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.387+0000 7f2a940c4640 1 --2- 172.21.15.114:0/909786795 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a780051c0 0x7f2a7800b9c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2a8400a840 tx=0x7f2a78005830 comp rx=0 tx=0).stop 2024-04-28T13:08:55.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.387+0000 7f2a940c4640 1 -- 172.21.15.114:0/909786795 shutdown_connections 2024-04-28T13:08:55.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.387+0000 7f2a940c4640 1 --2- 172.21.15.114:0/909786795 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a780051c0 0x7f2a7800b9c0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.387+0000 7f2a940c4640 1 -- 172.21.15.114:0/909786795 >> 172.21.15.114:0/909786795 conn(0x7f2a8c0b3cc0 msgr2=0x7f2a8c0b40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:55.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.387+0000 7f2a940c4640 1 -- 172.21.15.114:0/909786795 shutdown_connections 2024-04-28T13:08:55.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.387+0000 7f2a940c4640 1 -- 172.21.15.114:0/909786795 wait complete. 2024-04-28T13:08:55.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.388+0000 7f2a940c4640 1 Processor -- start 2024-04-28T13:08:55.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.388+0000 7f2a940c4640 1 -- start start 2024-04-28T13:08:55.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.389+0000 7f2a940c4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a780051c0 0x7f2a8c158550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:55.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.389+0000 7f2a940c4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a8c15ddd0 0x7f2a8c15e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:55.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.389+0000 7f2a940c4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a8c1e8ee0 0x7f2a8c1e9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:55.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.389+0000 7f2a940c4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2a8c06fc20 con 0x7f2a8c15ddd0 2024-04-28T13:08:55.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.389+0000 7f2a940c4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2a8c06faa0 con 0x7f2a780051c0 2024-04-28T13:08:55.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.389+0000 7f2a940c4640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2a8c06fda0 con 0x7f2a8c1e8ee0 2024-04-28T13:08:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.389+0000 7f2a9165f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a8c15ddd0 0x7f2a8c15e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.389+0000 7f2a9165f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a8c15ddd0 0x7f2a8c15e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43954/0 (socket says 172.21.15.114:43954) 2024-04-28T13:08:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.389+0000 7f2a9165f640 1 -- 172.21.15.114:0/3836022411 learned_addr learned my addr 172.21.15.114:0/3836022411 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.389+0000 7f2a91e60640 1 --2- 172.21.15.114:0/3836022411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a780051c0 0x7f2a8c158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.389+0000 7f2a92661640 1 --2- 172.21.15.114:0/3836022411 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a8c1e8ee0 0x7f2a8c1e9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.389+0000 7f2a9165f640 1 -- 172.21.15.114:0/3836022411 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a8c1e8ee0 msgr2=0x7f2a8c1e9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.389+0000 7f2a9165f640 1 --2- 172.21.15.114:0/3836022411 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a8c1e8ee0 0x7f2a8c1e9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.389+0000 7f2a9165f640 1 -- 172.21.15.114:0/3836022411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a780051c0 msgr2=0x7f2a8c158550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.389+0000 7f2a9165f640 1 --2- 172.21.15.114:0/3836022411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a780051c0 0x7f2a8c158550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.389+0000 7f2a9165f640 1 -- 172.21.15.114:0/3836022411 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a8c1e9c50 con 0x7f2a8c15ddd0 2024-04-28T13:08:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.390+0000 7f2a9165f640 1 --2- 172.21.15.114:0/3836022411 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a8c15ddd0 0x7f2a8c15e250 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c00f5f0 tx=0x7f2a7c00f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:55.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.390+0000 7f2a827fc640 1 -- 172.21.15.114:0/3836022411 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c0052e0 con 0x7f2a8c15ddd0 2024-04-28T13:08:55.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.390+0000 7f2a827fc640 1 -- 172.21.15.114:0/3836022411 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a7c018070 con 0x7f2a8c15ddd0 2024-04-28T13:08:55.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.390+0000 7f2a940c4640 1 -- 172.21.15.114:0/3836022411 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a8c1e9f30 con 0x7f2a8c15ddd0 2024-04-28T13:08:55.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.390+0000 7f2a827fc640 1 -- 172.21.15.114:0/3836022411 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c003830 con 0x7f2a8c15ddd0 2024-04-28T13:08:55.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.390+0000 7f2a940c4640 1 -- 172.21.15.114:0/3836022411 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a8c1ea4f0 con 0x7f2a8c15ddd0 2024-04-28T13:08:55.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.391+0000 7f2a827fc640 1 -- 172.21.15.114:0/3836022411 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f2a7c0039d0 con 0x7f2a8c15ddd0 2024-04-28T13:08:55.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.392+0000 7f2a827fc640 1 --2- 172.21.15.114:0/3836022411 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2a7006c980 0x7f2a7006ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:55.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.392+0000 7f2a91e60640 1 --2- 172.21.15.114:0/3836022411 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2a7006c980 0x7f2a7006ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:55.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.392+0000 7f2a827fc640 1 -- 172.21.15.114:0/3836022411 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f2a7c08b840 con 0x7f2a8c15ddd0 2024-04-28T13:08:55.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.392+0000 7f2a91e60640 1 --2- 172.21.15.114:0/3836022411 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2a7006c980 0x7f2a7006ee40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c15b270 tx=0x7f2a88009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:55.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.393+0000 7f2a96ddb740 1 Processor -- start 2024-04-28T13:08:55.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.393+0000 7f2a96ddb740 1 -- start start 2024-04-28T13:08:55.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.394+0000 7f2a96ddb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fab9142440 0x55fab9142820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:55.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.394+0000 7f2a96ddb740 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fab915fce0 0x55fab9160230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:55.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.394+0000 7f2a96ddb740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fab9118120 0x55fab915e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:55.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.394+0000 7f2a96ddb740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55fab907c740 con 0x55fab9118120 2024-04-28T13:08:55.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.394+0000 7f2a96ddb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55fab90183a0 con 0x55fab9142440 2024-04-28T13:08:55.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.394+0000 7f2a96ddb740 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55fab9078700 con 0x55fab915fce0 2024-04-28T13:08:55.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.394+0000 7f2a92661640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fab9118120 0x55fab915e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:55.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.394+0000 7f2a92661640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fab9118120 0x55fab915e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43960/0 (socket says 172.21.15.114:43960) 2024-04-28T13:08:55.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.394+0000 7f2a92661640 1 -- 172.21.15.114:0/3133872282 learned_addr learned my addr 172.21.15.114:0/3133872282 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:55.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.394+0000 7f2a91e60640 1 --2- 172.21.15.114:0/3133872282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fab9142440 0x55fab9142820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:55.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.394+0000 7f2a9165f640 1 --2- 172.21.15.114:0/3133872282 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fab915fce0 0x55fab9160230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:55.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.394+0000 7f2a92661640 1 -- 172.21.15.114:0/3133872282 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fab915fce0 msgr2=0x55fab9160230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:55.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.394+0000 7f2a92661640 1 --2- 172.21.15.114:0/3133872282 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fab915fce0 0x55fab9160230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.394+0000 7f2a92661640 1 -- 172.21.15.114:0/3133872282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fab9142440 msgr2=0x55fab9142820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:55.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.394+0000 7f2a92661640 1 --2- 172.21.15.114:0/3133872282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fab9142440 0x55fab9142820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.394+0000 7f2a92661640 1 -- 172.21.15.114:0/3133872282 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fab9034750 con 0x55fab9118120 2024-04-28T13:08:55.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.394+0000 7f2a92661640 1 --2- 172.21.15.114:0/3133872282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fab9118120 0x55fab915e3a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2a8400a960 tx=0x7f2a8402d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe820bf61dba6ff4 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:55.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.394+0000 7f2a6f7fe640 1 -- 172.21.15.114:0/3133872282 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a840019b0 con 0x55fab9118120 2024-04-28T13:08:55.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.395+0000 7f2a6f7fe640 1 -- 172.21.15.114:0/3133872282 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a8402f040 con 0x55fab9118120 2024-04-28T13:08:55.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.395+0000 7f2a6f7fe640 1 -- 172.21.15.114:0/3133872282 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a84004d80 con 0x55fab9118120 2024-04-28T13:08:55.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.395+0000 7f2a96ddb740 1 -- 172.21.15.114:0/3133872282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fab9118120 msgr2=0x55fab915e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:55.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.395+0000 7f2a96ddb740 1 --2- 172.21.15.114:0/3133872282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fab9118120 0x55fab915e3a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2a8400a960 tx=0x7f2a8402d000 comp rx=0 tx=0).stop 2024-04-28T13:08:55.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.395+0000 7f2a96ddb740 1 -- 172.21.15.114:0/3133872282 shutdown_connections 2024-04-28T13:08:55.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.395+0000 7f2a96ddb740 1 --2- 172.21.15.114:0/3133872282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fab9118120 0x55fab915e3a0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.395+0000 7f2a96ddb740 1 --2- 172.21.15.114:0/3133872282 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fab915fce0 0x55fab9160230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.395+0000 7f2a96ddb740 1 --2- 172.21.15.114:0/3133872282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fab9142440 0x55fab9142820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.395+0000 7f2a96ddb740 1 -- 172.21.15.114:0/3133872282 >> 172.21.15.114:0/3133872282 conn(0x55fab9114a50 msgr2=0x55fab915d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:55.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.395+0000 7f2a96ddb740 1 -- 172.21.15.114:0/3133872282 shutdown_connections 2024-04-28T13:08:55.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.395+0000 7f2a96ddb740 1 -- 172.21.15.114:0/3133872282 wait complete. 2024-04-28T13:08:55.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.396+0000 7f2a96ddb740 1 -- start start 2024-04-28T13:08:55.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.396+0000 7f2a96ddb740 1 Processor -- start 2024-04-28T13:08:55.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.397+0000 7f2a96ddb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fab9142440 0x55fab913ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:55.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.397+0000 7f2a96ddb740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fab915fce0 0x55fab916e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:55.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.397+0000 7f2a96ddb740 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fab9163c40 0x55fab91640a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:55.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.397+0000 7f2a96ddb740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55fab9118ec0 con 0x55fab915fce0 2024-04-28T13:08:55.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.397+0000 7f2a96ddb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55fab9003fe0 con 0x55fab9142440 2024-04-28T13:08:55.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.397+0000 7f2a96ddb740 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55fab9112980 con 0x55fab9163c40 2024-04-28T13:08:55.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.397+0000 7f2a96ddb740 10 client.0 _ll_register_callbacks cb 0x55fab901a150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-28T13:08:55.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.397+0000 7f2a9165f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fab915fce0 0x55fab916e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:55.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.397+0000 7f2a9165f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fab915fce0 0x55fab916e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43964/0 (socket says 172.21.15.114:43964) 2024-04-28T13:08:55.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.397+0000 7f2a9165f640 1 -- 172.21.15.114:0/2344790290 learned_addr learned my addr 172.21.15.114:0/2344790290 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:55.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.397+0000 7f2a92661640 1 --2- 172.21.15.114:0/2344790290 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fab9163c40 0x55fab91640a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:55.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.397+0000 7f2a91e60640 1 --2- 172.21.15.114:0/2344790290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fab9142440 0x55fab913ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:55.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.397+0000 7f2a9165f640 1 -- 172.21.15.114:0/2344790290 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fab9163c40 msgr2=0x55fab91640a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:55.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.397+0000 7f2a9165f640 1 --2- 172.21.15.114:0/2344790290 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fab9163c40 0x55fab91640a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.397+0000 7f2a9165f640 1 -- 172.21.15.114:0/2344790290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fab9142440 msgr2=0x55fab913ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:55.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.397+0000 7f2a9165f640 1 --2- 172.21.15.114:0/2344790290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fab9142440 0x55fab913ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.397+0000 7f2a9165f640 1 -- 172.21.15.114:0/2344790290 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fab8d8e2d0 con 0x55fab915fce0 2024-04-28T13:08:55.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.397+0000 7f2a91e60640 1 --2- 172.21.15.114:0/2344790290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fab9142440 0x55fab913ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:55.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.397+0000 7f2a9165f640 1 --2- 172.21.15.114:0/2344790290 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fab915fce0 0x55fab916e4e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c055970 tx=0x7f2a7c059d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa1c305a98e70557 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:55.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.397+0000 7f2a6cff9640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-04-28T13:08:55.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.397+0000 7f2a6cff9640 1 -- 172.21.15.114:0/2344790290 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c0620f0 con 0x55fab915fce0 2024-04-28T13:08:55.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.397+0000 7f2a6cff9640 1 -- 172.21.15.114:0/2344790290 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f2a7c089910 con 0x55fab915fce0 2024-04-28T13:08:55.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.397+0000 7f2a96ddb740 1 -- 172.21.15.114:0/2344790290 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a8402f040 con 0x55fab915fce0 2024-04-28T13:08:55.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.398+0000 7f2a6cff9640 1 -- 172.21.15.114:0/2344790290 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2a7c076050 con 0x55fab915fce0 2024-04-28T13:08:55.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.398+0000 7f2a96ddb740 10 client.5751 fetch_fsmap learned FSMap version 20 2024-04-28T13:08:55.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.398+0000 7f2a96ddb740 1 -- 172.21.15.114:0/2344790290 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55fab8e586b0 con 0x55fab915fce0 2024-04-28T13:08:55.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.398+0000 7f2a6cff9640 1 -- 172.21.15.114:0/2344790290 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a8402f040 con 0x55fab915fce0 2024-04-28T13:08:55.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.398+0000 7f2a6cff9640 1 -- 172.21.15.114:0/2344790290 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f2a7c003cc0 con 0x55fab915fce0 2024-04-28T13:08:55.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.398+0000 7f2a96ddb740 10 client.5751 fetch_fsmap finished waiting for FSMap version 20 2024-04-28T13:08:55.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.398+0000 7f2a96ddb740 10 client.5751 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-28T13:08:55.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.398+0000 7f2a96ddb740 20 client.5751 populate_metadata read hostname 'smithi114' 2024-04-28T13:08:55.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.398+0000 7f2a96ddb740 1 --2- 172.21.15.114:0/2344790290 >> [v2:172.21.15.134:6833/3334515618,v1:172.21.15.134:6835/3334515618] conn(0x55fab9145660 0x55fab9145a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:55.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.398+0000 7f2a96ddb740 4 client.5751 mds_command: new command op to 5601 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-28T13:08:55.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.398+0000 7f2a96ddb740 1 -- 172.21.15.114:0/2344790290 --> [v2:172.21.15.134:6833/3334515618,v1:172.21.15.134:6835/3334515618] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fab908a350 con 0x55fab9145660 2024-04-28T13:08:55.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.398+0000 7f2a91e60640 1 --2- 172.21.15.114:0/2344790290 >> [v2:172.21.15.134:6833/3334515618,v1:172.21.15.134:6835/3334515618] conn(0x55fab9145660 0x55fab9145a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:55.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.398+0000 7f2a6cff9640 10 client.5751 ms_handle_connect on v2:172.21.15.134:6833/3334515618 2024-04-28T13:08:55.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.398+0000 7f2a91e60640 1 --2- 172.21.15.114:0/2344790290 >> [v2:172.21.15.134:6833/3334515618,v1:172.21.15.134:6835/3334515618] conn(0x55fab9145660 0x55fab9145a40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30861110a17d1557 server_cookie=e39840d133316b01 in_seq=0 out_seq=0 2024-04-28T13:08:55.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.399+0000 7f2a6cff9640 1 -- 172.21.15.114:0/2344790290 <== mds.0 v2:172.21.15.134:6833/3334515618 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55fab908a350 con 0x55fab9145660 2024-04-28T13:08:55.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.399+0000 7f2a6cff9640 10 client.5751 handle_command_reply: tid=0 2024-04-28T13:08:55.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.399+0000 7f2a96ddb740 1 client.5751 shutdown 2024-04-28T13:08:55.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.399+0000 7f2a96ddb740 1 -- 172.21.15.114:0/2344790290 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fab915fce0 msgr2=0x55fab916e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:55.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.399+0000 7f2a96ddb740 1 --2- 172.21.15.114:0/2344790290 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fab915fce0 0x55fab916e4e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c055970 tx=0x7f2a7c059d50 comp rx=0 tx=0).stop 2024-04-28T13:08:55.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.399+0000 7f2a96ddb740 1 -- 172.21.15.114:0/2344790290 shutdown_connections 2024-04-28T13:08:55.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.399+0000 7f2a96ddb740 1 --2- 172.21.15.114:0/2344790290 >> [v2:172.21.15.134:6833/3334515618,v1:172.21.15.134:6835/3334515618] conn(0x55fab9145660 0x55fab9145a40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.399+0000 7f2a96ddb740 1 --2- 172.21.15.114:0/2344790290 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fab9163c40 0x55fab91640a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.399+0000 7f2a96ddb740 1 --2- 172.21.15.114:0/2344790290 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fab915fce0 0x55fab916e4e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.399+0000 7f2a6cff9640 0 client.5751 ms_handle_reset on v2:172.21.15.134:6833/3334515618 2024-04-28T13:08:55.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.399+0000 7f2a96ddb740 1 --2- 172.21.15.114:0/2344790290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fab9142440 0x55fab913ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.399+0000 7f2a96ddb740 1 -- 172.21.15.114:0/2344790290 >> 172.21.15.114:0/2344790290 conn(0x55fab9118120 msgr2=0x55fab91607d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:55.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.400+0000 7f2a96ddb740 1 -- 172.21.15.114:0/2344790290 shutdown_connections 2024-04-28T13:08:55.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.400+0000 7f2a96ddb740 1 -- 172.21.15.114:0/2344790290 wait complete. 2024-04-28T13:08:55.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.400+0000 7f2a96ddb740 20 client.5751 trim_cache size 0 max 16384 2024-04-28T13:08:55.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.417+0000 7f2a96ddb740 1 Processor -- start 2024-04-28T13:08:55.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.418+0000 7f2a96ddb740 1 -- start start 2024-04-28T13:08:55.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.418+0000 7f2a96ddb740 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fab9142440 0x55fab916d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:55.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.418+0000 7f2a96ddb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fab915fce0 0x55fab9118600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:55.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.418+0000 7f2a96ddb740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fab9163c40 0x55fab9118b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:55.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.418+0000 7f2a96ddb740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2a8c200f70 con 0x55fab9163c40 2024-04-28T13:08:55.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.418+0000 7f2a96ddb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2a8c13d660 con 0x55fab915fce0 2024-04-28T13:08:55.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.418+0000 7f2a96ddb740 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2a8c13dcb0 con 0x55fab9142440 2024-04-28T13:08:55.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.418+0000 7f2a92661640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fab9163c40 0x55fab9118b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:55.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.418+0000 7f2a92661640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fab9163c40 0x55fab9118b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43970/0 (socket says 172.21.15.114:43970) 2024-04-28T13:08:55.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.418+0000 7f2a92661640 1 -- 172.21.15.114:0/2718710318 learned_addr learned my addr 172.21.15.114:0/2718710318 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:55.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.419+0000 7f2a91e60640 1 --2- 172.21.15.114:0/2718710318 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fab9142440 0x55fab916d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:55.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.419+0000 7f2a9165f640 1 --2- 172.21.15.114:0/2718710318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fab915fce0 0x55fab9118600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:55.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.419+0000 7f2a92661640 1 -- 172.21.15.114:0/2718710318 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fab9142440 msgr2=0x55fab916d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:55.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.419+0000 7f2a92661640 1 --2- 172.21.15.114:0/2718710318 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fab9142440 0x55fab916d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.419+0000 7f2a92661640 1 -- 172.21.15.114:0/2718710318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fab915fce0 msgr2=0x55fab9118600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:55.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.419+0000 7f2a92661640 1 --2- 172.21.15.114:0/2718710318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fab915fce0 0x55fab9118600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.419+0000 7f2a92661640 1 -- 172.21.15.114:0/2718710318 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fab9145fb0 con 0x55fab9163c40 2024-04-28T13:08:55.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.419+0000 7f2a91e60640 1 --2- 172.21.15.114:0/2718710318 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fab9142440 0x55fab916d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:55.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.419+0000 7f2a92661640 1 --2- 172.21.15.114:0/2718710318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fab9163c40 0x55fab9118b40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2a84001940 tx=0x7f2a84009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=799773f626206db9 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:55.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.419+0000 7f2a6effd640 1 -- 172.21.15.114:0/2718710318 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a84004d60 con 0x55fab9163c40 2024-04-28T13:08:55.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.419+0000 7f2a6effd640 1 -- 172.21.15.114:0/2718710318 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a8402f070 con 0x55fab9163c40 2024-04-28T13:08:55.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.419+0000 7f2a6effd640 1 -- 172.21.15.114:0/2718710318 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8402ba50 con 0x55fab9163c40 2024-04-28T13:08:55.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.420+0000 7f2a96ddb740 1 -- 172.21.15.114:0/2718710318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fab9163c40 msgr2=0x55fab9118b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:55.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.420+0000 7f2a96ddb740 1 --2- 172.21.15.114:0/2718710318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fab9163c40 0x55fab9118b40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2a84001940 tx=0x7f2a84009030 comp rx=0 tx=0).stop 2024-04-28T13:08:55.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.420+0000 7f2a96ddb740 1 -- 172.21.15.114:0/2718710318 shutdown_connections 2024-04-28T13:08:55.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.420+0000 7f2a96ddb740 1 --2- 172.21.15.114:0/2718710318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fab9163c40 0x55fab9118b40 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.420+0000 7f2a96ddb740 1 --2- 172.21.15.114:0/2718710318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fab915fce0 0x55fab9118600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.420+0000 7f2a96ddb740 1 --2- 172.21.15.114:0/2718710318 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fab9142440 0x55fab916d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.420+0000 7f2a96ddb740 1 -- 172.21.15.114:0/2718710318 >> 172.21.15.114:0/2718710318 conn(0x55fab9118120 msgr2=0x55fab9140c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:55.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.420+0000 7f2a96ddb740 1 -- 172.21.15.114:0/2718710318 shutdown_connections 2024-04-28T13:08:55.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.420+0000 7f2a96ddb740 1 -- 172.21.15.114:0/2718710318 wait complete. 2024-04-28T13:08:55.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.420+0000 7f2a96ddb740 1 -- start start 2024-04-28T13:08:55.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.420+0000 7f2a96ddb740 1 Processor -- start 2024-04-28T13:08:55.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.421+0000 7f2a96ddb740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fab9142440 0x55fab91da320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:55.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.421+0000 7f2a96ddb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fab915fce0 0x55fab915b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:55.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.421+0000 7f2a96ddb740 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fab9163c40 0x55fab91803c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:55.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.421+0000 7f2a96ddb740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55fab91121c0 con 0x55fab9142440 2024-04-28T13:08:55.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.421+0000 7f2a96ddb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55fab9144230 con 0x55fab915fce0 2024-04-28T13:08:55.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.421+0000 7f2a96ddb740 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55fab915e980 con 0x55fab9163c40 2024-04-28T13:08:55.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.421+0000 7f2a96ddb740 10 client.0 _ll_register_callbacks cb 0x7f2a7c001120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-28T13:08:55.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.421+0000 7f2a91e60640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fab9142440 0x55fab91da320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:55.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.421+0000 7f2a91e60640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fab9142440 0x55fab91da320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43982/0 (socket says 172.21.15.114:43982) 2024-04-28T13:08:55.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.421+0000 7f2a91e60640 1 -- 172.21.15.114:0/1254947511 learned_addr learned my addr 172.21.15.114:0/1254947511 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:55.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.421+0000 7f2a92661640 1 --2- 172.21.15.114:0/1254947511 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fab9163c40 0x55fab91803c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:55.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.421+0000 7f2a9165f640 1 --2- 172.21.15.114:0/1254947511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fab915fce0 0x55fab915b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:55.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.421+0000 7f2a91e60640 1 -- 172.21.15.114:0/1254947511 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fab9163c40 msgr2=0x55fab91803c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:55.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.421+0000 7f2a91e60640 1 --2- 172.21.15.114:0/1254947511 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fab9163c40 0x55fab91803c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.421+0000 7f2a91e60640 1 -- 172.21.15.114:0/1254947511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fab915fce0 msgr2=0x55fab915b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:55.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.421+0000 7f2a91e60640 1 --2- 172.21.15.114:0/1254947511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fab915fce0 0x55fab915b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.421+0000 7f2a91e60640 1 -- 172.21.15.114:0/1254947511 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fab915b970 con 0x55fab9142440 2024-04-28T13:08:55.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.421+0000 7f2a92661640 1 --2- 172.21.15.114:0/1254947511 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fab9163c40 0x55fab91803c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:55.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.421+0000 7f2a9165f640 1 --2- 172.21.15.114:0/1254947511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fab915fce0 0x55fab915b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:55.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.422+0000 7f2a91e60640 1 --2- 172.21.15.114:0/1254947511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fab9142440 0x55fab91da320 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x55fab9112590 tx=0x7f2a880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6236f3f602bb1419 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:55.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.422+0000 7f2a6cff9640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-04-28T13:08:55.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.422+0000 7f2a6cff9640 1 -- 172.21.15.114:0/1254947511 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8801b070 con 0x55fab9142440 2024-04-28T13:08:55.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.422+0000 7f2a6cff9640 1 -- 172.21.15.114:0/1254947511 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f2a88039ae0 con 0x55fab9142440 2024-04-28T13:08:55.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.422+0000 7f2a96ddb740 1 -- 172.21.15.114:0/1254947511 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a8402f070 con 0x55fab9142440 2024-04-28T13:08:55.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.422+0000 7f2a6cff9640 1 -- 172.21.15.114:0/1254947511 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2a88039ce0 con 0x55fab9142440 2024-04-28T13:08:55.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.422+0000 7f2a96ddb740 10 client.5757 fetch_fsmap learned FSMap version 20 2024-04-28T13:08:55.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.422+0000 7f2a96ddb740 1 -- 172.21.15.114:0/1254947511 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55fab915bb80 con 0x55fab9142440 2024-04-28T13:08:55.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.422+0000 7f2a6cff9640 1 -- 172.21.15.114:0/1254947511 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a8402f070 con 0x55fab9142440 2024-04-28T13:08:55.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.422+0000 7f2a6cff9640 1 -- 172.21.15.114:0/1254947511 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f2a88040050 con 0x55fab9142440 2024-04-28T13:08:55.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.422+0000 7f2a96ddb740 10 client.5757 fetch_fsmap finished waiting for FSMap version 20 2024-04-28T13:08:55.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.422+0000 7f2a96ddb740 10 client.5757 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-28T13:08:55.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.422+0000 7f2a96ddb740 20 client.5757 populate_metadata read hostname 'smithi114' 2024-04-28T13:08:55.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.422+0000 7f2a96ddb740 1 --2- 172.21.15.114:0/1254947511 >> [v2:172.21.15.134:6833/3334515618,v1:172.21.15.134:6835/3334515618] conn(0x55fab9152df0 0x55fab91531d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:55.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.422+0000 7f2a96ddb740 4 client.5757 mds_command: new command op to 5601 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-28T13:08:55.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.422+0000 7f2a96ddb740 1 -- 172.21.15.114:0/1254947511 --> [v2:172.21.15.134:6833/3334515618,v1:172.21.15.134:6835/3334515618] -- command(tid 0: {"prefix": "status"}) -- 0x55fab90841c0 con 0x55fab9152df0 2024-04-28T13:08:55.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.423+0000 7f2a9165f640 1 --2- 172.21.15.114:0/1254947511 >> [v2:172.21.15.134:6833/3334515618,v1:172.21.15.134:6835/3334515618] conn(0x55fab9152df0 0x55fab91531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:55.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.423+0000 7f2a9165f640 1 --2- 172.21.15.114:0/1254947511 >> [v2:172.21.15.134:6833/3334515618,v1:172.21.15.134:6835/3334515618] conn(0x55fab9152df0 0x55fab91531d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf9ba9d58aea6b98 server_cookie=45fa0b712e23700a in_seq=0 out_seq=0 2024-04-28T13:08:55.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.423+0000 7f2a6cff9640 10 client.5757 ms_handle_connect on v2:172.21.15.134:6833/3334515618 2024-04-28T13:08:55.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.423+0000 7f2a6cff9640 1 -- 172.21.15.114:0/1254947511 <== mds.0 v2:172.21.15.134:6833/3334515618 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55fab90841c0 con 0x55fab9152df0 2024-04-28T13:08:55.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.423+0000 7f2a6cff9640 10 client.5757 handle_command_reply: tid=0 2024-04-28T13:08:55.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.423+0000 7f2a96ddb740 1 client.5757 shutdown 2024-04-28T13:08:55.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.423+0000 7f2a96ddb740 1 -- 172.21.15.114:0/1254947511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fab9142440 msgr2=0x55fab91da320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:55.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.423+0000 7f2a96ddb740 1 --2- 172.21.15.114:0/1254947511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fab9142440 0x55fab91da320 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x55fab9112590 tx=0x7f2a880046c0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.423+0000 7f2a96ddb740 1 -- 172.21.15.114:0/1254947511 shutdown_connections 2024-04-28T13:08:55.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.423+0000 7f2a96ddb740 1 --2- 172.21.15.114:0/1254947511 >> [v2:172.21.15.134:6833/3334515618,v1:172.21.15.134:6835/3334515618] conn(0x55fab9152df0 0x55fab91531d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.423+0000 7f2a96ddb740 1 --2- 172.21.15.114:0/1254947511 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fab9163c40 0x55fab91803c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.423+0000 7f2a96ddb740 1 --2- 172.21.15.114:0/1254947511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fab915fce0 0x55fab915b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.423+0000 7f2a6cff9640 0 client.5757 ms_handle_reset on v2:172.21.15.134:6833/3334515618 2024-04-28T13:08:55.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.423+0000 7f2a96ddb740 1 --2- 172.21.15.114:0/1254947511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fab9142440 0x55fab91da320 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.423+0000 7f2a96ddb740 1 -- 172.21.15.114:0/1254947511 >> 172.21.15.114:0/1254947511 conn(0x55fab9118120 msgr2=0x55fab91443b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:55.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.423+0000 7f2a96ddb740 1 -- 172.21.15.114:0/1254947511 shutdown_connections 2024-04-28T13:08:55.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.423+0000 7f2a96ddb740 1 -- 172.21.15.114:0/1254947511 wait complete. 2024-04-28T13:08:55.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.424+0000 7f2a96ddb740 20 client.5757 trim_cache size 0 max 16384 2024-04-28T13:08:55.433 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-04-28T13:08:55.433 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "0961cca0-69c8-4b26-b89a-621e12152fc4", 2024-04-28T13:08:55.433 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2024-04-28T13:08:55.433 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 5601, 2024-04-28T13:08:55.433 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2024-04-28T13:08:55.433 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2024-04-28T13:08:55.433 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2024-04-28T13:08:55.433 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 8.9558751099999991, 2024-04-28T13:08:55.433 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 20, 2024-04-28T13:08:55.433 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 46, 2024-04-28T13:08:55.434 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 46, 2024-04-28T13:08:55.434 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 14.029200656 2024-04-28T13:08:55.434 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-04-28T13:08:55.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.424+0000 7f2a940c4640 1 -- 172.21.15.114:0/3836022411 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2a7006c980 msgr2=0x7f2a7006ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:55.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.424+0000 7f2a940c4640 1 --2- 172.21.15.114:0/3836022411 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2a7006c980 0x7f2a7006ee40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c15b270 tx=0x7f2a88009190 comp rx=0 tx=0).stop 2024-04-28T13:08:55.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.424+0000 7f2a940c4640 1 -- 172.21.15.114:0/3836022411 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a8c15ddd0 msgr2=0x7f2a8c15e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:55.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.424+0000 7f2a940c4640 1 --2- 172.21.15.114:0/3836022411 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a8c15ddd0 0x7f2a8c15e250 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c00f5f0 tx=0x7f2a7c00f9f0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.424+0000 7f2a940c4640 1 -- 172.21.15.114:0/3836022411 shutdown_connections 2024-04-28T13:08:55.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.424+0000 7f2a940c4640 1 --2- 172.21.15.114:0/3836022411 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a8c1e8ee0 0x7f2a8c1e9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.424+0000 7f2a940c4640 1 --2- 172.21.15.114:0/3836022411 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a8c15ddd0 0x7f2a8c15e250 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.424+0000 7f2a940c4640 1 --2- 172.21.15.114:0/3836022411 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f2a7006c980 0x7f2a7006ee40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.424+0000 7f2a940c4640 1 --2- 172.21.15.114:0/3836022411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a780051c0 0x7f2a8c158550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.424+0000 7f2a940c4640 1 -- 172.21.15.114:0/3836022411 >> 172.21.15.114:0/3836022411 conn(0x7f2a8c0b3cc0 msgr2=0x7f2a8c0af2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:55.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.424+0000 7f2a940c4640 1 -- 172.21.15.114:0/3836022411 shutdown_connections 2024-04-28T13:08:55.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.424+0000 7f2a940c4640 1 -- 172.21.15.114:0/3836022411 wait complete. 2024-04-28T13:08:55.436 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-28T13:08:55.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.532+0000 7f6d14b46640 1 Processor -- start 2024-04-28T13:08:55.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.532+0000 7f6d14b46640 1 -- start start 2024-04-28T13:08:55.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.533+0000 7f6d14b46640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6d1015f410 0x7f6d100baaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:55.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.533+0000 7f6d14b46640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6d100b4380 0x7f6d100b8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:55.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.533+0000 7f6d14b46640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d100d3650 con 0x7f6d100cff60 2024-04-28T13:08:55.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.533+0000 7f6d14b46640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f6d100d3f10 con 0x7f6d100b4380 2024-04-28T13:08:55.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.533+0000 7f6d14b46640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f6d100b8840 con 0x7f6d1015f410 2024-04-28T13:08:55.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.533+0000 7f6d0dd9b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6d100b4380 0x7f6d100b8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:55.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.533+0000 7f6d0dd9b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6d100b4380 0x7f6d100b8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43986/0 (socket says 172.21.15.114:43986) 2024-04-28T13:08:55.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.533+0000 7f6d0dd9b640 1 -- 172.21.15.114:0/584885516 learned_addr learned my addr 172.21.15.114:0/584885516 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:55.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.533+0000 7f6d0e59c640 1 --2- 172.21.15.114:0/584885516 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6d1015f410 0x7f6d100baaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:55.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.534+0000 7f6d0dd9b640 1 -- 172.21.15.114:0/584885516 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6d1015f410 msgr2=0x7f6d100baaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:55.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.534+0000 7f6d0dd9b640 1 --2- 172.21.15.114:0/584885516 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6d1015f410 0x7f6d100baaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.534+0000 7f6d0dd9b640 1 -- 172.21.15.114:0/584885516 >> v1:172.21.15.114:6789/0 conn(0x7f6d100cff60 legacy=0x7f6d100d03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:55.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.534+0000 7f6d0dd9b640 1 -- 172.21.15.114:0/584885516 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d1015f7f0 con 0x7f6d100b4380 2024-04-28T13:08:55.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.534+0000 7f6d0e59c640 1 --2- 172.21.15.114:0/584885516 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6d1015f410 0x7f6d100baaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:55.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.534+0000 7f6d0dd9b640 1 --2- 172.21.15.114:0/584885516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d100b4380 0x7f6d100b8300 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6d04009870 tx=0x7f6d0402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25da3a1a9cd10549 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:55.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.534+0000 7f6d0d59a640 1 -- 172.21.15.114:0/584885516 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d04037070 con 0x7f6d100b4380 2024-04-28T13:08:55.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.535+0000 7f6d0d59a640 1 -- 172.21.15.114:0/584885516 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d0402ae50 con 0x7f6d100b4380 2024-04-28T13:08:55.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.535+0000 7f6d0d59a640 1 -- 172.21.15.114:0/584885516 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d04032860 con 0x7f6d100b4380 2024-04-28T13:08:55.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.535+0000 7f6d14b46640 1 -- 172.21.15.114:0/584885516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d100b4380 msgr2=0x7f6d100b8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:55.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.535+0000 7f6d14b46640 1 --2- 172.21.15.114:0/584885516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d100b4380 0x7f6d100b8300 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6d04009870 tx=0x7f6d0402a300 comp rx=0 tx=0).stop 2024-04-28T13:08:55.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.535+0000 7f6d14b46640 1 -- 172.21.15.114:0/584885516 shutdown_connections 2024-04-28T13:08:55.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.535+0000 7f6d14b46640 1 --2- 172.21.15.114:0/584885516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d100b4380 0x7f6d100b8300 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.535+0000 7f6d14b46640 1 --2- 172.21.15.114:0/584885516 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6d1015f410 0x7f6d100baaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.535+0000 7f6d14b46640 1 -- 172.21.15.114:0/584885516 >> 172.21.15.114:0/584885516 conn(0x7f6d100633a0 msgr2=0x7f6d100d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:55.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.535+0000 7f6d14b46640 1 -- 172.21.15.114:0/584885516 shutdown_connections 2024-04-28T13:08:55.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.535+0000 7f6d14b46640 1 -- 172.21.15.114:0/584885516 wait complete. 2024-04-28T13:08:55.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.537+0000 7f6d14b46640 1 Processor -- start 2024-04-28T13:08:55.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.537+0000 7f6d14b46640 1 -- start start 2024-04-28T13:08:55.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.537+0000 7f6d14b46640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6d100b4380 0x7f6d10155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:55.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.537+0000 7f6d14b46640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d100cff60 0x7f6d101f5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:55.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.537+0000 7f6d14b46640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d1015f410 0x7f6d100d52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:55.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.537+0000 7f6d14b46640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6d100d3ba0 con 0x7f6d100cff60 2024-04-28T13:08:55.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.537+0000 7f6d14b46640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6d100d2570 con 0x7f6d1015f410 2024-04-28T13:08:55.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.537+0000 7f6d14b46640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f6d100bb180 con 0x7f6d100b4380 2024-04-28T13:08:55.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.537+0000 7f6d0dd9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d100cff60 0x7f6d101f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:55.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.537+0000 7f6d0dd9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d100cff60 0x7f6d101f5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44002/0 (socket says 172.21.15.114:44002) 2024-04-28T13:08:55.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.537+0000 7f6d0dd9b640 1 -- 172.21.15.114:0/2118195525 learned_addr learned my addr 172.21.15.114:0/2118195525 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:55.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.538+0000 7f6d0e59c640 1 --2- 172.21.15.114:0/2118195525 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6d100b4380 0x7f6d10155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:55.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.538+0000 7f6d0ed9d640 1 --2- 172.21.15.114:0/2118195525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d1015f410 0x7f6d100d52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:55.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.538+0000 7f6d0dd9b640 1 -- 172.21.15.114:0/2118195525 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6d100b4380 msgr2=0x7f6d10155830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:55.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.538+0000 7f6d0dd9b640 1 --2- 172.21.15.114:0/2118195525 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6d100b4380 0x7f6d10155830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.538+0000 7f6d0dd9b640 1 -- 172.21.15.114:0/2118195525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d1015f410 msgr2=0x7f6d100d52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:55.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.538+0000 7f6d0dd9b640 1 --2- 172.21.15.114:0/2118195525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d1015f410 0x7f6d100d52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.538+0000 7f6d0dd9b640 1 -- 172.21.15.114:0/2118195525 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d1015fb20 con 0x7f6d100cff60 2024-04-28T13:08:55.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.538+0000 7f6d0dd9b640 1 --2- 172.21.15.114:0/2118195525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d100cff60 0x7f6d101f5f10 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f6d0402a340 tx=0x7f6d040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:55.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.538+0000 7f6cfeffd640 1 -- 172.21.15.114:0/2118195525 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d04041020 con 0x7f6d100cff60 2024-04-28T13:08:55.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.538+0000 7f6d14b46640 1 -- 172.21.15.114:0/2118195525 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d1015fe00 con 0x7f6d100cff60 2024-04-28T13:08:55.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.538+0000 7f6cfeffd640 1 -- 172.21.15.114:0/2118195525 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d0403c670 con 0x7f6d100cff60 2024-04-28T13:08:55.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.538+0000 7f6cfeffd640 1 -- 172.21.15.114:0/2118195525 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d04037040 con 0x7f6d100cff60 2024-04-28T13:08:55.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.538+0000 7f6d14b46640 1 -- 172.21.15.114:0/2118195525 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d101603c0 con 0x7f6d100cff60 2024-04-28T13:08:55.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.539+0000 7f6d14b46640 1 -- 172.21.15.114:0/2118195525 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d1006a3d0 con 0x7f6d100cff60 2024-04-28T13:08:55.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.540+0000 7f6cfeffd640 1 -- 172.21.15.114:0/2118195525 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f6d04044020 con 0x7f6d100cff60 2024-04-28T13:08:55.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.540+0000 7f6cfeffd640 1 --2- 172.21.15.114:0/2118195525 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6cf006c980 0x7f6cf006ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:55.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.540+0000 7f6cfeffd640 1 -- 172.21.15.114:0/2118195525 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f6d040ac2e0 con 0x7f6d100cff60 2024-04-28T13:08:55.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.540+0000 7f6d0e59c640 1 --2- 172.21.15.114:0/2118195525 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6cf006c980 0x7f6cf006ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:55.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.540+0000 7f6d0e59c640 1 --2- 172.21.15.114:0/2118195525 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6cf006c980 0x7f6cf006ee40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6d00003fd0 tx=0x7f6d000039f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:55.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.544+0000 7f6cfeffd640 1 -- 172.21.15.114:0/2118195525 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6d0404b030 con 0x7f6d100cff60 2024-04-28T13:08:55.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.758+0000 7f6d14b46640 1 -- 172.21.15.114:0/2118195525 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6d100d4540 con 0x7f6d100cff60 2024-04-28T13:08:55.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.759+0000 7f6cfeffd640 1 -- 172.21.15.114:0/2118195525 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) ==== 53+0+73 (secure 0 0 0) 0x7f6d0407a730 con 0x7f6d100cff60 2024-04-28T13:08:55.759 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-28T13:08:55.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.760+0000 7f6d14b46640 1 -- 172.21.15.114:0/2118195525 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6cf006c980 msgr2=0x7f6cf006ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:55.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.760+0000 7f6d14b46640 1 --2- 172.21.15.114:0/2118195525 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6cf006c980 0x7f6cf006ee40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6d00003fd0 tx=0x7f6d000039f0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.760+0000 7f6d14b46640 1 -- 172.21.15.114:0/2118195525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d100cff60 msgr2=0x7f6d101f5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:55.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.760+0000 7f6d14b46640 1 --2- 172.21.15.114:0/2118195525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d100cff60 0x7f6d101f5f10 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f6d0402a340 tx=0x7f6d040046c0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.761+0000 7f6d14b46640 1 -- 172.21.15.114:0/2118195525 shutdown_connections 2024-04-28T13:08:55.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.761+0000 7f6d14b46640 1 --2- 172.21.15.114:0/2118195525 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6cf006c980 0x7f6cf006ee40 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.761+0000 7f6d14b46640 1 --2- 172.21.15.114:0/2118195525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d1015f410 0x7f6d100d52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.761+0000 7f6d14b46640 1 --2- 172.21.15.114:0/2118195525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d100cff60 0x7f6d101f5f10 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.761+0000 7f6d14b46640 1 --2- 172.21.15.114:0/2118195525 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6d100b4380 0x7f6d10155830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:55.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.761+0000 7f6d14b46640 1 -- 172.21.15.114:0/2118195525 >> 172.21.15.114:0/2118195525 conn(0x7f6d100633a0 msgr2=0x7f6d100b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:55.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.761+0000 7f6d14b46640 1 -- 172.21.15.114:0/2118195525 shutdown_connections 2024-04-28T13:08:55.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55.761+0000 7f6d14b46640 1 -- 172.21.15.114:0/2118195525 wait complete. 2024-04-28T13:08:55.772 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-28T13:08:55.772 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-28T13:08:55.772 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-04-28T13:08:55.772 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-28T13:08:55.772 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-28T13:08:55.772 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-28T13:08:55.773 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-28T13:08:55.773 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-28T13:08:55.773 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-28T13:08:55.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:55.773 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-04-28T13:08:55.788 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-28T13:08:55.788 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-28T13:08:55.788 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-04-28T13:08:55.788 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:08:55.788 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-04-28T13:08:55.788 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:08:55.789 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-28T13:08:55.789 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:08:55.789 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-04-28T13:08:55.789 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-28T13:08:55.789 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:08:55.789 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-04-28T13:08:55.789 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-28T13:08:55.789 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:08:55.789 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-28T13:08:55.789 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:08:55.789 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-28T13:08:55.789 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42677sec preferred_lft 42677sec 2024-04-28T13:08:55.789 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::cd74:6bbf:5a:b4fa/64 scope link noprefixroute 2024-04-28T13:08:55.789 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:08:55.789 INFO:teuthology.orchestra.run.smithi114.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-28T13:08:55.790 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 32:1c:a9:6d:0c:94 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:08:55.790 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-28T13:08:55.790 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:08:55.790 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::e4ef:19ff:fecc:cecc/64 scope link 2024-04-28T13:08:55.790 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:08:55.790 INFO:teuthology.orchestra.run.smithi114.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-28T13:08:55.790 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether d2:4c:d3:d0:70:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-28T13:08:55.790 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::d04c:d3ff:fed0:70bf/64 scope link 2024-04-28T13:08:55.790 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:08:55.790 INFO:teuthology.orchestra.run.smithi114.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-28T13:08:55.790 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 32:1c:a9:6d:0c:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-28T13:08:55.790 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::301c:a9ff:fe6d:c94/64 scope link 2024-04-28T13:08:55.791 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:08:55.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:55.791 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-28T13:08:55.850 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-04-28T13:08:55.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:55.851 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-04-28T13:08:55.907 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-04-28T13:08:55.907 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-28T13:08:55.908 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-28T13:08:55.908 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-28T13:08:55.908 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-28T13:08:55.908 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-28T13:08:55.908 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-04-28T13:08:55.908 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-28T13:08:55.908 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-28T13:08:55.908 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-28T13:08:55.908 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-04-28T13:08:55.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-28T13:08:56.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:08:56.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:56.031 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-04-28T13:08:56.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-28T13:08:56.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-28T13:08:56.046 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-28T13:08:56.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:56.046 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-04-28T13:08:56.109 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-28T13:08:56.109 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-28T13:08:56.164 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-28T13:08:56.164 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-28T13:08:56.164 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-28T13:08:56.219 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-28T13:08:56.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:56.219 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-28T13:08:56.300 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-28T13:08:56.301 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-28T13:08:56.301 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-04-28T13:08:56.310 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-28T13:08:56.310 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-28T13:08:56.310 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-04-28T13:08:56.310 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.134:3300,172.21.15.134:3301" 2024-04-28T13:08:56.310 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-28T13:08:56.326 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-28T13:08:56.326 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-28T13:08:56.326 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-04-28T13:08:56.326 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.134:3300,172.21.15.134:3301" 2024-04-28T13:08:56.326 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-28T13:08:56.326 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.134:6789,172.21.15.134:6790" 2024-04-28T13:08:56.327 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.134:6789,172.21.15.134:6790:/ 2024-04-28T13:08:56.327 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=0961cca0-69c8-4b26-b89a-621e12152fc4" will pass to kernel 2024-04-28T13:08:56.327 INFO:teuthology.orchestra.run.smithi114.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-28T13:08:56.327 INFO:teuthology.orchestra.run.smithi114.stdout: You just mounted a file system that supports labels which does not 2024-04-28T13:08:56.327 INFO:teuthology.orchestra.run.smithi114.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-28T13:08:56.327 INFO:teuthology.orchestra.run.smithi114.stdout: applications will generate AVC messages and not be allowed access to 2024-04-28T13:08:56.327 INFO:teuthology.orchestra.run.smithi114.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-28T13:08:56.328 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-28T13:08:56.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:56.328 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-28T13:08:56.392 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-28T13:08:56.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-28T13:08:56.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:08:56.488 INFO:teuthology.orchestra.run.smithi114.stdout:client5344 2024-04-28T13:08:56.489 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-28T13:08:56.489 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-28T13:08:56.504 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-28T13:08:56.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.639+0000 7f5d53647640 1 Processor -- start 2024-04-28T13:08:56.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.639+0000 7f5d53647640 1 -- start start 2024-04-28T13:08:56.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.640+0000 7f5d53647640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5d4c0cda00 0x7f5d4c0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:56.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.640+0000 7f5d53647640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d4c0d07b0 0x7f5d4c15fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:56.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.640+0000 7f5d53647640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d4c0d2be0 con 0x7f5d4c0cdde0 2024-04-28T13:08:56.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.640+0000 7f5d53647640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f5d4c160980 con 0x7f5d4c0cda00 2024-04-28T13:08:56.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.640+0000 7f5d53647640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f5d4c1606a0 con 0x7f5d4c0d07b0 2024-04-28T13:08:56.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.640+0000 7f5d513e3640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5d4c0cda00 0x7f5d4c0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:56.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.640+0000 7f5d50be2640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d4c0d07b0 0x7f5d4c15fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:56.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.640+0000 7f5d51be4640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f5d4c0cdde0 0x7f5d4c155fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:51480/0 (socket says 172.21.15.114:51480) 2024-04-28T13:08:56.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.640+0000 7f5d51be4640 1 -- 172.21.15.114:0/4085572708 learned_addr learned my addr 172.21.15.114:0/4085572708 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:56.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.641+0000 7f5d50be2640 1 -- 172.21.15.114:0/4085572708 >> v2:172.21.15.134:3300/0 conn(0x7f5d4c0cda00 msgr2=0x7f5d4c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:56.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.641+0000 7f5d50be2640 1 --2- 172.21.15.114:0/4085572708 >> v2:172.21.15.134:3300/0 conn(0x7f5d4c0cda00 0x7f5d4c0d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:56.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.641+0000 7f5d50be2640 1 -- 172.21.15.114:0/4085572708 >> v1:172.21.15.134:6789/0 conn(0x7f5d4c0cdde0 legacy=0x7f5d4c155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:56.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.641+0000 7f5d50be2640 1 -- 172.21.15.114:0/4085572708 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d4c0cf7b0 con 0x7f5d4c0d07b0 2024-04-28T13:08:56.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.641+0000 7f5d513e3640 1 --2- 172.21.15.114:0/4085572708 >> v2:172.21.15.134:3300/0 conn(0x7f5d4c0cda00 0x7f5d4c0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-28T13:08:56.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.641+0000 7f5d50be2640 1 --2- 172.21.15.114:0/4085572708 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d4c0d07b0 0x7f5d4c15fac0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0097a0 tx=0x7f5d3c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ae273060653abbd server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:56.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.641+0000 7f5d43fff640 1 -- 172.21.15.114:0/4085572708 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c037070 con 0x7f5d4c0d07b0 2024-04-28T13:08:56.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.641+0000 7f5d43fff640 1 -- 172.21.15.114:0/4085572708 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d3c032440 con 0x7f5d4c0d07b0 2024-04-28T13:08:56.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.641+0000 7f5d43fff640 1 -- 172.21.15.114:0/4085572708 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c032810 con 0x7f5d4c0d07b0 2024-04-28T13:08:56.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.642+0000 7f5d53647640 1 -- 172.21.15.114:0/4085572708 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d4c0d07b0 msgr2=0x7f5d4c15fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:56.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.642+0000 7f5d53647640 1 --2- 172.21.15.114:0/4085572708 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d4c0d07b0 0x7f5d4c15fac0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0097a0 tx=0x7f5d3c02a180 comp rx=0 tx=0).stop 2024-04-28T13:08:56.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.642+0000 7f5d53647640 1 -- 172.21.15.114:0/4085572708 shutdown_connections 2024-04-28T13:08:56.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.642+0000 7f5d53647640 1 --2- 172.21.15.114:0/4085572708 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d4c0d07b0 0x7f5d4c15fac0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:56.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.642+0000 7f5d53647640 1 --2- 172.21.15.114:0/4085572708 >> v2:172.21.15.134:3300/0 conn(0x7f5d4c0cda00 0x7f5d4c0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:56.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.642+0000 7f5d53647640 1 -- 172.21.15.114:0/4085572708 >> 172.21.15.114:0/4085572708 conn(0x7f5d4c0706f0 msgr2=0x7f5d4c070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:56.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.642+0000 7f5d53647640 1 -- 172.21.15.114:0/4085572708 shutdown_connections 2024-04-28T13:08:56.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.642+0000 7f5d53647640 1 -- 172.21.15.114:0/4085572708 wait complete. 2024-04-28T13:08:56.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.643+0000 7f5d53647640 1 Processor -- start 2024-04-28T13:08:56.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.643+0000 7f5d53647640 1 -- start start 2024-04-28T13:08:56.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.644+0000 7f5d53647640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d4c0cda00 0x7f5d4c151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:56.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.644+0000 7f5d53647640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d4c0cdde0 0x7f5d4c0b6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:56.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.644+0000 7f5d53647640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d4c0d07b0 0x7f5d4c0b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:56.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.644+0000 7f5d53647640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4c1566d0 con 0x7f5d4c0cda00 2024-04-28T13:08:56.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.644+0000 7f5d53647640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4c0cfd70 con 0x7f5d4c0d07b0 2024-04-28T13:08:56.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.644+0000 7f5d53647640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f5d4c156850 con 0x7f5d4c0cdde0 2024-04-28T13:08:56.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.644+0000 7f5d513e3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d4c0cda00 0x7f5d4c151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:56.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.644+0000 7f5d513e3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d4c0cda00 0x7f5d4c151650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44008/0 (socket says 172.21.15.114:44008) 2024-04-28T13:08:56.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.644+0000 7f5d513e3640 1 -- 172.21.15.114:0/145848204 learned_addr learned my addr 172.21.15.114:0/145848204 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:56.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.644+0000 7f5d50be2640 1 --2- 172.21.15.114:0/145848204 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d4c0cdde0 0x7f5d4c0b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:56.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.644+0000 7f5d51be4640 1 --2- 172.21.15.114:0/145848204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d4c0d07b0 0x7f5d4c0b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:56.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.645+0000 7f5d513e3640 1 -- 172.21.15.114:0/145848204 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d4c0cdde0 msgr2=0x7f5d4c0b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:56.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.645+0000 7f5d513e3640 1 --2- 172.21.15.114:0/145848204 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d4c0cdde0 0x7f5d4c0b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:56.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.645+0000 7f5d513e3640 1 -- 172.21.15.114:0/145848204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d4c0d07b0 msgr2=0x7f5d4c0b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:56.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.645+0000 7f5d513e3640 1 --2- 172.21.15.114:0/145848204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d4c0d07b0 0x7f5d4c0b4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:56.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.645+0000 7f5d513e3640 1 -- 172.21.15.114:0/145848204 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d4c161d10 con 0x7f5d4c0cda00 2024-04-28T13:08:56.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.645+0000 7f5d513e3640 1 --2- 172.21.15.114:0/145848204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d4c0cda00 0x7f5d4c151650 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f5d4800e990 tx=0x7f5d4800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:56.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.645+0000 7f5d41ffb640 1 -- 172.21.15.114:0/145848204 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d48017070 con 0x7f5d4c0cda00 2024-04-28T13:08:56.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.645+0000 7f5d41ffb640 1 -- 172.21.15.114:0/145848204 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d4800c9e0 con 0x7f5d4c0cda00 2024-04-28T13:08:56.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.645+0000 7f5d53647640 1 -- 172.21.15.114:0/145848204 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d4c0b8390 con 0x7f5d4c0cda00 2024-04-28T13:08:56.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.645+0000 7f5d41ffb640 1 -- 172.21.15.114:0/145848204 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d4800cdb0 con 0x7f5d4c0cda00 2024-04-28T13:08:56.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.645+0000 7f5d53647640 1 -- 172.21.15.114:0/145848204 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d4c0b8950 con 0x7f5d4c0cda00 2024-04-28T13:08:56.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.646+0000 7f5d53647640 1 -- 172.21.15.114:0/145848204 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d4c06a3d0 con 0x7f5d4c0cda00 2024-04-28T13:08:56.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.646+0000 7f5d41ffb640 1 -- 172.21.15.114:0/145848204 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f5d4801a070 con 0x7f5d4c0cda00 2024-04-28T13:08:56.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.647+0000 7f5d41ffb640 1 --2- 172.21.15.114:0/145848204 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5d3006c980 0x7f5d3006ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:56.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.647+0000 7f5d41ffb640 1 -- 172.21.15.114:0/145848204 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f5d4808bcc0 con 0x7f5d4c0cda00 2024-04-28T13:08:56.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.647+0000 7f5d50be2640 1 --2- 172.21.15.114:0/145848204 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5d3006c980 0x7f5d3006ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:56.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.647+0000 7f5d50be2640 1 --2- 172.21.15.114:0/145848204 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5d3006c980 0x7f5d3006ee40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c034000 tx=0x7f5d3c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:56.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.651+0000 7f5d41ffb640 1 -- 172.21.15.114:0/145848204 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5d48059b40 con 0x7f5d4c0cda00 2024-04-28T13:08:56.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.864+0000 7f5d53647640 1 -- 172.21.15.114:0/145848204 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5d4c0b4ab0 con 0x7f5d4c0cda00 2024-04-28T13:08:56.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.864+0000 7f5d41ffb640 1 -- 172.21.15.114:0/145848204 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) ==== 53+0+73 (secure 0 0 0) 0x7f5d4805de40 con 0x7f5d4c0cda00 2024-04-28T13:08:56.865 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-28T13:08:56.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.866+0000 7f5d53647640 1 -- 172.21.15.114:0/145848204 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5d3006c980 msgr2=0x7f5d3006ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:56.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.866+0000 7f5d53647640 1 --2- 172.21.15.114:0/145848204 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5d3006c980 0x7f5d3006ee40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c034000 tx=0x7f5d3c02e000 comp rx=0 tx=0).stop 2024-04-28T13:08:56.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.866+0000 7f5d53647640 1 -- 172.21.15.114:0/145848204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d4c0cda00 msgr2=0x7f5d4c151650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:56.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.866+0000 7f5d53647640 1 --2- 172.21.15.114:0/145848204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d4c0cda00 0x7f5d4c151650 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f5d4800e990 tx=0x7f5d4800ee50 comp rx=0 tx=0).stop 2024-04-28T13:08:56.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.866+0000 7f5d53647640 1 -- 172.21.15.114:0/145848204 shutdown_connections 2024-04-28T13:08:56.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.866+0000 7f5d53647640 1 --2- 172.21.15.114:0/145848204 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f5d3006c980 0x7f5d3006ee40 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:56.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.866+0000 7f5d53647640 1 --2- 172.21.15.114:0/145848204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d4c0d07b0 0x7f5d4c0b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:56.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.866+0000 7f5d53647640 1 --2- 172.21.15.114:0/145848204 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d4c0cdde0 0x7f5d4c0b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:56.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.866+0000 7f5d53647640 1 --2- 172.21.15.114:0/145848204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d4c0cda00 0x7f5d4c151650 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:56.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.866+0000 7f5d53647640 1 -- 172.21.15.114:0/145848204 >> 172.21.15.114:0/145848204 conn(0x7f5d4c0706f0 msgr2=0x7f5d4c0b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:56.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.866+0000 7f5d53647640 1 -- 172.21.15.114:0/145848204 shutdown_connections 2024-04-28T13:08:56.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:56.866+0000 7f5d53647640 1 -- 172.21.15.114:0/145848204 wait complete. 2024-04-28T13:08:56.878 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-28T13:08:56.878 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-28T13:08:56.878 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2024-04-28T13:08:56.878 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-28T13:08:56.878 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-28T13:08:56.878 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-28T13:08:56.878 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-28T13:08:56.878 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-28T13:08:56.878 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-28T13:08:56.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:56.878 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2024-04-28T13:08:56.898 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-28T13:08:56.898 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-28T13:08:56.898 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-04-28T13:08:56.898 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:08:56.898 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-04-28T13:08:56.898 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:08:56.898 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-28T13:08:56.898 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:08:56.898 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2024-04-28T13:08:56.898 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-28T13:08:56.898 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:08:56.898 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2024-04-28T13:08:56.898 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-28T13:08:56.899 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:08:56.899 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-28T13:08:56.899 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:08:56.899 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-28T13:08:56.899 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42672sec preferred_lft 42672sec 2024-04-28T13:08:56.899 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::26cd:4a7a:1eab:e9e4/64 scope link noprefixroute 2024-04-28T13:08:56.899 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:08:56.899 INFO:teuthology.orchestra.run.smithi134.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-28T13:08:56.899 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 56:6a:3a:53:27:30 brd ff:ff:ff:ff:ff:ff 2024-04-28T13:08:56.899 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-28T13:08:56.899 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:08:56.899 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ccad:f6ff:feeb:4c86/64 scope link 2024-04-28T13:08:56.899 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:08:56.899 INFO:teuthology.orchestra.run.smithi134.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-28T13:08:56.899 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 56:6a:3a:53:27:30 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-28T13:08:56.899 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::546a:3aff:fe53:2730/64 scope link 2024-04-28T13:08:56.899 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:08:56.900 INFO:teuthology.orchestra.run.smithi134.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-28T13:08:56.900 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 9a:0b:b6:24:57:5a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-28T13:08:56.900 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::980b:b6ff:fe24:575a/64 scope link 2024-04-28T13:08:56.900 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-28T13:08:56.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:56.900 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-28T13:08:56.965 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-04-28T13:08:56.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:56.966 DEBUG:teuthology.orchestra.run.smithi134:> route 2024-04-28T13:08:57.025 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2024-04-28T13:08:57.025 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-28T13:08:57.025 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-28T13:08:57.025 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-28T13:08:57.025 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-28T13:08:57.026 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-28T13:08:57.026 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-04-28T13:08:57.026 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-28T13:08:57.026 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-28T13:08:57.026 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-28T13:08:57.026 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-04-28T13:08:57.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:08:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-28T13:08:57.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:08:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:08:57.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:57.159 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-04-28T13:08:57.175 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-28T13:08:57.175 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-28T13:08:57.175 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-28T13:08:57.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:57.175 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2024-04-28T13:08:57.239 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-28T13:08:57.239 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-28T13:08:57.295 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-28T13:08:57.295 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-28T13:08:57.295 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-28T13:08:57.349 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-28T13:08:57.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:57.350 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-28T13:08:57.430 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-28T13:08:57.430 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-28T13:08:57.430 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-04-28T13:08:57.439 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-28T13:08:57.439 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-28T13:08:57.439 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-04-28T13:08:57.439 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.134:3300,172.21.15.134:3301" 2024-04-28T13:08:57.439 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-28T13:08:57.447 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-28T13:08:57.447 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-28T13:08:57.447 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-04-28T13:08:57.447 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.134:3300,172.21.15.134:3301" 2024-04-28T13:08:57.447 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-28T13:08:57.447 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.134:6789,172.21.15.134:6790" 2024-04-28T13:08:57.447 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.134:6789,172.21.15.134:6790:/ 2024-04-28T13:08:57.448 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=0961cca0-69c8-4b26-b89a-621e12152fc4" will pass to kernel 2024-04-28T13:08:57.448 INFO:teuthology.orchestra.run.smithi134.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-28T13:08:57.448 INFO:teuthology.orchestra.run.smithi134.stdout: You just mounted a file system that supports labels which does not 2024-04-28T13:08:57.448 INFO:teuthology.orchestra.run.smithi134.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-28T13:08:57.448 INFO:teuthology.orchestra.run.smithi134.stdout: applications will generate AVC messages and not be allowed access to 2024-04-28T13:08:57.448 INFO:teuthology.orchestra.run.smithi134.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-28T13:08:57.449 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-28T13:08:57.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:08:57.449 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-28T13:08:57.512 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-28T13:08:57.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:08:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-28T13:08:57.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-28T13:08:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-28T13:08:57.608 INFO:teuthology.orchestra.run.smithi134.stdout:client5060 2024-04-28T13:08:57.608 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-28T13:08:57.608 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-28T13:08:57.623 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-04-28T13:08:57.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.727+0000 7f3a25946640 1 Processor -- start 2024-04-28T13:08:57.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.727+0000 7f3a25946640 1 -- start start 2024-04-28T13:08:57.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.728+0000 7f3a25946640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a20159a70 0x7f3a200b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:57.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.728+0000 7f3a25946640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3a200735e0 0x7f3a20073a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:57.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.728+0000 7f3a25946640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a20160270 con 0x7f3a200b0f90 2024-04-28T13:08:57.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.728+0000 7f3a25946640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f3a20160010 con 0x7f3a200735e0 2024-04-28T13:08:57.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.728+0000 7f3a25946640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3a20073f50 con 0x7f3a20159a70 2024-04-28T13:08:57.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.728+0000 7f3a1f7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3a200735e0 0x7f3a20073a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:57.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.728+0000 7f3a1f7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3a200735e0 0x7f3a20073a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44012/0 (socket says 172.21.15.114:44012) 2024-04-28T13:08:57.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.728+0000 7f3a1f7fe640 1 -- 172.21.15.114:0/116387939 learned_addr learned my addr 172.21.15.114:0/116387939 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:57.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.728+0000 7f3a1effd640 1 --2- 172.21.15.114:0/116387939 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a20159a70 0x7f3a200b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:57.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.729+0000 7f3a1f7fe640 1 -- 172.21.15.114:0/116387939 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a20159a70 msgr2=0x7f3a200b50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:57.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.729+0000 7f3a1f7fe640 1 --2- 172.21.15.114:0/116387939 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a20159a70 0x7f3a200b50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:57.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.729+0000 7f3a1f7fe640 1 -- 172.21.15.114:0/116387939 >> v1:172.21.15.114:6789/0 conn(0x7f3a200b0f90 legacy=0x7f3a2015f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:57.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.729+0000 7f3a1f7fe640 1 -- 172.21.15.114:0/116387939 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a20160550 con 0x7f3a200735e0 2024-04-28T13:08:57.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.729+0000 7f3a1f7fe640 1 --2- 172.21.15.114:0/116387939 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a200735e0 0x7f3a20073a10 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009870 tx=0x7f3a1802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c2f961c3fbb3f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:57.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.729+0000 7f3a1dffb640 1 -- 172.21.15.114:0/116387939 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a18037070 con 0x7f3a200735e0 2024-04-28T13:08:57.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.729+0000 7f3a1dffb640 1 -- 172.21.15.114:0/116387939 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a18032440 con 0x7f3a200735e0 2024-04-28T13:08:57.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.729+0000 7f3a1dffb640 1 -- 172.21.15.114:0/116387939 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a18032810 con 0x7f3a200735e0 2024-04-28T13:08:57.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.730+0000 7f3a25946640 1 -- 172.21.15.114:0/116387939 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a200735e0 msgr2=0x7f3a20073a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:57.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.730+0000 7f3a25946640 1 --2- 172.21.15.114:0/116387939 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a200735e0 0x7f3a20073a10 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009870 tx=0x7f3a1802a270 comp rx=0 tx=0).stop 2024-04-28T13:08:57.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.730+0000 7f3a25946640 1 -- 172.21.15.114:0/116387939 shutdown_connections 2024-04-28T13:08:57.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.730+0000 7f3a25946640 1 --2- 172.21.15.114:0/116387939 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a200735e0 0x7f3a20073a10 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:57.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.730+0000 7f3a25946640 1 --2- 172.21.15.114:0/116387939 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a20159a70 0x7f3a200b50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:57.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.730+0000 7f3a25946640 1 -- 172.21.15.114:0/116387939 >> 172.21.15.114:0/116387939 conn(0x7f3a2006d460 msgr2=0x7f3a2006d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:57.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.730+0000 7f3a25946640 1 -- 172.21.15.114:0/116387939 shutdown_connections 2024-04-28T13:08:57.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.730+0000 7f3a25946640 1 -- 172.21.15.114:0/116387939 wait complete. 2024-04-28T13:08:57.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.731+0000 7f3a25946640 1 Processor -- start 2024-04-28T13:08:57.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.731+0000 7f3a25946640 1 -- start start 2024-04-28T13:08:57.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.732+0000 7f3a25946640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a200735e0 0x7f3a201479c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:57.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.732+0000 7f3a25946640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a200b0f90 0x7f3a201544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:57.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.732+0000 7f3a25946640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a20159a70 0x7f3a20152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:57.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.732+0000 7f3a25946640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3a20160830 con 0x7f3a20159a70 2024-04-28T13:08:57.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.732+0000 7f3a25946640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3a200afb30 con 0x7f3a200b0f90 2024-04-28T13:08:57.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.732+0000 7f3a25946640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3a200b5600 con 0x7f3a200735e0 2024-04-28T13:08:57.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.732+0000 7f3a1f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a20159a70 0x7f3a20152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:57.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.732+0000 7f3a1f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a20159a70 0x7f3a20152ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44016/0 (socket says 172.21.15.114:44016) 2024-04-28T13:08:57.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.732+0000 7f3a1f7fe640 1 -- 172.21.15.114:0/2989523918 learned_addr learned my addr 172.21.15.114:0/2989523918 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:57.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.732+0000 7f3a1effd640 1 --2- 172.21.15.114:0/2989523918 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a200735e0 0x7f3a201479c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:57.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.732+0000 7f3a1f7fe640 1 -- 172.21.15.114:0/2989523918 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a200735e0 msgr2=0x7f3a201479c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:57.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.732+0000 7f3a1f7fe640 1 --2- 172.21.15.114:0/2989523918 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a200735e0 0x7f3a201479c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:57.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.732+0000 7f3a1f7fe640 1 -- 172.21.15.114:0/2989523918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a200b0f90 msgr2=0x7f3a201544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:57.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.732+0000 7f3a1f7fe640 1 --2- 172.21.15.114:0/2989523918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a200b0f90 0x7f3a201544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:57.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.732+0000 7f3a1f7fe640 1 -- 172.21.15.114:0/2989523918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a20153420 con 0x7f3a20159a70 2024-04-28T13:08:57.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.733+0000 7f3a1f7fe640 1 --2- 172.21.15.114:0/2989523918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a20159a70 0x7f3a20152ab0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009870 tx=0x7f3a180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:57.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.733+0000 7f3a07fff640 1 -- 172.21.15.114:0/2989523918 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a18037040 con 0x7f3a20159a70 2024-04-28T13:08:57.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.733+0000 7f3a07fff640 1 -- 172.21.15.114:0/2989523918 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a18042070 con 0x7f3a20159a70 2024-04-28T13:08:57.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.733+0000 7f3a25946640 1 -- 172.21.15.114:0/2989523918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a20153700 con 0x7f3a20159a70 2024-04-28T13:08:57.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.733+0000 7f3a07fff640 1 -- 172.21.15.114:0/2989523918 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a18030920 con 0x7f3a20159a70 2024-04-28T13:08:57.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.733+0000 7f3a25946640 1 -- 172.21.15.114:0/2989523918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a20153cc0 con 0x7f3a20159a70 2024-04-28T13:08:57.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.734+0000 7f3a25946640 1 -- 172.21.15.114:0/2989523918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a2006a440 con 0x7f3a20159a70 2024-04-28T13:08:57.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.734+0000 7f3a07fff640 1 -- 172.21.15.114:0/2989523918 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f3a18030ac0 con 0x7f3a20159a70 2024-04-28T13:08:57.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.735+0000 7f3a07fff640 1 --2- 172.21.15.114:0/2989523918 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3a0c06c980 0x7f3a0c06ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:57.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.735+0000 7f3a1effd640 1 --2- 172.21.15.114:0/2989523918 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3a0c06c980 0x7f3a0c06ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:57.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.735+0000 7f3a07fff640 1 -- 172.21.15.114:0/2989523918 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f3a180ac480 con 0x7f3a20159a70 2024-04-28T13:08:57.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.735+0000 7f3a1effd640 1 --2- 172.21.15.114:0/2989523918 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3a0c06c980 0x7f3a0c06ee40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3a10009e90 tx=0x7f3a1000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:57.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.739+0000 7f3a07fff640 1 -- 172.21.15.114:0/2989523918 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3a1807a270 con 0x7f3a20159a70 2024-04-28T13:08:57.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:57.954+0000 7f3a25946640 1 -- 172.21.15.114:0/2989523918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f3a2015faa0 con 0x7f3a20159a70 2024-04-28T13:08:58.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.543+0000 7f3a07fff640 1 -- 172.21.15.114:0/2989523918 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v21) ==== 136+0+0 (secure 0 0 0) 0x7f3a1807e570 con 0x7f3a20159a70 2024-04-28T13:08:58.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.545+0000 7f3a25946640 1 -- 172.21.15.114:0/2989523918 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3a0c06c980 msgr2=0x7f3a0c06ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:58.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.545+0000 7f3a25946640 1 --2- 172.21.15.114:0/2989523918 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3a0c06c980 0x7f3a0c06ee40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3a10009e90 tx=0x7f3a1000b040 comp rx=0 tx=0).stop 2024-04-28T13:08:58.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.545+0000 7f3a25946640 1 -- 172.21.15.114:0/2989523918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a20159a70 msgr2=0x7f3a20152ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:58.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.545+0000 7f3a25946640 1 --2- 172.21.15.114:0/2989523918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a20159a70 0x7f3a20152ab0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009870 tx=0x7f3a180046c0 comp rx=0 tx=0).stop 2024-04-28T13:08:58.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.546+0000 7f3a25946640 1 -- 172.21.15.114:0/2989523918 shutdown_connections 2024-04-28T13:08:58.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.546+0000 7f3a25946640 1 --2- 172.21.15.114:0/2989523918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a20159a70 0x7f3a20152ab0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:58.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.546+0000 7f3a25946640 1 --2- 172.21.15.114:0/2989523918 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f3a0c06c980 0x7f3a0c06ee40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:58.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.546+0000 7f3a25946640 1 --2- 172.21.15.114:0/2989523918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a200b0f90 0x7f3a201544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:58.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.546+0000 7f3a25946640 1 --2- 172.21.15.114:0/2989523918 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a200735e0 0x7f3a201479c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:58.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.546+0000 7f3a25946640 1 -- 172.21.15.114:0/2989523918 >> 172.21.15.114:0/2989523918 conn(0x7f3a2006d460 msgr2=0x7f3a2015eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:58.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.546+0000 7f3a25946640 1 -- 172.21.15.114:0/2989523918 shutdown_connections 2024-04-28T13:08:58.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.546+0000 7f3a25946640 1 -- 172.21.15.114:0/2989523918 wait complete. 2024-04-28T13:08:58.558 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-04-28T13:08:58.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.656+0000 7f1c9de62640 1 Processor -- start 2024-04-28T13:08:58.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.657+0000 7f1c9de62640 1 -- start start 2024-04-28T13:08:58.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.657+0000 7f1c9de62640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1c9815d010 0x7f1c980d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:58.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.657+0000 7f1c9de62640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c980d12c0 0x7f1c9815fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:58.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.657+0000 7f1c9de62640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1c981603c0 0x7f1c9806f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:58.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.657+0000 7f1c9de62640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f1c98072ac0 con 0x7f1c981603c0 2024-04-28T13:08:58.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.657+0000 7f1c9de62640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f1c98072d10 con 0x7f1c9815d010 2024-04-28T13:08:58.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.657+0000 7f1c9de62640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1c98072ff0 con 0x7f1c980d12c0 2024-04-28T13:08:58.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.658+0000 7f1c97fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1c981603c0 0x7f1c9806f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:58.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.658+0000 7f1c97fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1c981603c0 0x7f1c9806f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44022/0 (socket says 172.21.15.114:44022) 2024-04-28T13:08:58.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.658+0000 7f1c97fff640 1 -- 172.21.15.114:0/2308972619 learned_addr learned my addr 172.21.15.114:0/2308972619 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:58.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.658+0000 7f1c8ffff640 1 --2- 172.21.15.114:0/2308972619 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c980d12c0 0x7f1c9815fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:58.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.658+0000 7f1c97fff640 1 -- 172.21.15.114:0/2308972619 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c980d12c0 msgr2=0x7f1c9815fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:58.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.658+0000 7f1c97fff640 1 --2- 172.21.15.114:0/2308972619 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c980d12c0 0x7f1c9815fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:58.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.658+0000 7f1c977fe640 1 --2- 172.21.15.114:0/2308972619 >> v2:172.21.15.134:3300/0 conn(0x7f1c9815d010 0x7f1c980d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:58.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.658+0000 7f1c97fff640 1 -- 172.21.15.114:0/2308972619 >> v2:172.21.15.134:3300/0 conn(0x7f1c9815d010 msgr2=0x7f1c980d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:58.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.658+0000 7f1c97fff640 1 --2- 172.21.15.114:0/2308972619 >> v2:172.21.15.134:3300/0 conn(0x7f1c9815d010 0x7f1c980d0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:58.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.658+0000 7f1c97fff640 1 -- 172.21.15.114:0/2308972619 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c980732d0 con 0x7f1c981603c0 2024-04-28T13:08:58.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.659+0000 7f1c97fff640 1 --2- 172.21.15.114:0/2308972619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c981603c0 0x7f1c9806f4b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1c980d1a30 tx=0x7f1c9002c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58bcc1aa3dad680 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:58.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.659+0000 7f1c96ffd640 1 -- 172.21.15.114:0/2308972619 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c90039070 con 0x7f1c981603c0 2024-04-28T13:08:58.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.659+0000 7f1c96ffd640 1 -- 172.21.15.114:0/2308972619 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c90009600 con 0x7f1c981603c0 2024-04-28T13:08:58.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.659+0000 7f1c96ffd640 1 -- 172.21.15.114:0/2308972619 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c900099f0 con 0x7f1c981603c0 2024-04-28T13:08:58.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.659+0000 7f1c9de62640 1 -- 172.21.15.114:0/2308972619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c981603c0 msgr2=0x7f1c9806f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:58.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.659+0000 7f1c9de62640 1 --2- 172.21.15.114:0/2308972619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c981603c0 0x7f1c9806f4b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1c980d1a30 tx=0x7f1c9002c810 comp rx=0 tx=0).stop 2024-04-28T13:08:58.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.659+0000 7f1c9de62640 1 -- 172.21.15.114:0/2308972619 shutdown_connections 2024-04-28T13:08:58.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.659+0000 7f1c9de62640 1 --2- 172.21.15.114:0/2308972619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c981603c0 0x7f1c9806f4b0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:58.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.659+0000 7f1c9de62640 1 --2- 172.21.15.114:0/2308972619 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c980d12c0 0x7f1c9815fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:58.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.659+0000 7f1c9de62640 1 --2- 172.21.15.114:0/2308972619 >> v2:172.21.15.134:3300/0 conn(0x7f1c9815d010 0x7f1c980d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:58.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.659+0000 7f1c9de62640 1 -- 172.21.15.114:0/2308972619 >> 172.21.15.114:0/2308972619 conn(0x7f1c980cd8b0 msgr2=0x7f1c980cdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:58.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.659+0000 7f1c9de62640 1 -- 172.21.15.114:0/2308972619 shutdown_connections 2024-04-28T13:08:58.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.659+0000 7f1c9de62640 1 -- 172.21.15.114:0/2308972619 wait complete. 2024-04-28T13:08:58.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.661+0000 7f1c9de62640 1 Processor -- start 2024-04-28T13:08:58.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.661+0000 7f1c9de62640 1 -- start start 2024-04-28T13:08:58.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.661+0000 7f1c9de62640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c980d12c0 0x7f1c98134e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:58.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.661+0000 7f1c9de62640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c9815d010 0x7f1c9815e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:58.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.661+0000 7f1c9de62640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c981603c0 0x7f1c9815eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:58.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.661+0000 7f1c9de62640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1c981607f0 con 0x7f1c9815d010 2024-04-28T13:08:58.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.661+0000 7f1c9de62640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1c98073ad0 con 0x7f1c981603c0 2024-04-28T13:08:58.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.661+0000 7f1c9de62640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1c98160970 con 0x7f1c980d12c0 2024-04-28T13:08:58.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.661+0000 7f1c8ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c9815d010 0x7f1c9815e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:58.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.661+0000 7f1c8ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c9815d010 0x7f1c9815e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44028/0 (socket says 172.21.15.114:44028) 2024-04-28T13:08:58.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.661+0000 7f1c8ffff640 1 -- 172.21.15.114:0/398084994 learned_addr learned my addr 172.21.15.114:0/398084994 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:58.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.662+0000 7f1c977fe640 1 --2- 172.21.15.114:0/398084994 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c980d12c0 0x7f1c98134e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:58.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.662+0000 7f1c97fff640 1 --2- 172.21.15.114:0/398084994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c981603c0 0x7f1c9815eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:58.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.662+0000 7f1c8ffff640 1 -- 172.21.15.114:0/398084994 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c980d12c0 msgr2=0x7f1c98134e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:58.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.662+0000 7f1c8ffff640 1 --2- 172.21.15.114:0/398084994 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c980d12c0 0x7f1c98134e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:58.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.662+0000 7f1c8ffff640 1 -- 172.21.15.114:0/398084994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c981603c0 msgr2=0x7f1c9815eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:58.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.662+0000 7f1c8ffff640 1 --2- 172.21.15.114:0/398084994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c981603c0 0x7f1c9815eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:58.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.662+0000 7f1c8ffff640 1 -- 172.21.15.114:0/398084994 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c980b28e0 con 0x7f1c9815d010 2024-04-28T13:08:58.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.662+0000 7f1c8ffff640 1 --2- 172.21.15.114:0/398084994 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c9815d010 0x7f1c9815e570 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1c8000c7f0 tx=0x7f1c8000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:58.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.662+0000 7f1c94ff9640 1 -- 172.21.15.114:0/398084994 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c80015070 con 0x7f1c9815d010 2024-04-28T13:08:58.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.662+0000 7f1c94ff9640 1 -- 172.21.15.114:0/398084994 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c80004220 con 0x7f1c9815d010 2024-04-28T13:08:58.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.662+0000 7f1c9de62640 1 -- 172.21.15.114:0/398084994 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c98138560 con 0x7f1c9815d010 2024-04-28T13:08:58.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.662+0000 7f1c94ff9640 1 -- 172.21.15.114:0/398084994 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c80007620 con 0x7f1c9815d010 2024-04-28T13:08:58.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.662+0000 7f1c9de62640 1 -- 172.21.15.114:0/398084994 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c980b2e60 con 0x7f1c9815d010 2024-04-28T13:08:58.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.663+0000 7f1c9de62640 1 -- 172.21.15.114:0/398084994 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c9806a3d0 con 0x7f1c9815d010 2024-04-28T13:08:58.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.663+0000 7f1c94ff9640 1 -- 172.21.15.114:0/398084994 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f1c800077c0 con 0x7f1c9815d010 2024-04-28T13:08:58.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.664+0000 7f1c94ff9640 1 --2- 172.21.15.114:0/398084994 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1c7806c980 0x7f1c7806ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:58.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.664+0000 7f1c94ff9640 1 -- 172.21.15.114:0/398084994 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f1c8008be50 con 0x7f1c9815d010 2024-04-28T13:08:58.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.664+0000 7f1c977fe640 1 --2- 172.21.15.114:0/398084994 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1c7806c980 0x7f1c7806ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:58.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.664+0000 7f1c977fe640 1 --2- 172.21.15.114:0/398084994 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1c7806c980 0x7f1c7806ee40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1c8800a8f0 tx=0x7f1c88008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:58.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.668+0000 7f1c94ff9640 1 -- 172.21.15.114:0/398084994 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1c8005a190 con 0x7f1c9815d010 2024-04-28T13:08:58.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.869+0000 7f1c9de62640 1 -- 172.21.15.114:0/398084994 --> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f1c9815fc60 con 0x7f1c7806c980 2024-04-28T13:08:58.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.871+0000 7f1c94ff9640 1 -- 172.21.15.114:0/398084994 <== mgr.4104 v2:172.21.15.114:6832/2240257326 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f1c9815fc60 con 0x7f1c7806c980 2024-04-28T13:08:58.871 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-04-28T13:08:58.871 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-28T13:08:58.871 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cephfs" 2024-04-28T13:08:58.872 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-28T13:08:58.872 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-04-28T13:08:58.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.872+0000 7f1c9de62640 1 -- 172.21.15.114:0/398084994 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1c7806c980 msgr2=0x7f1c7806ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:58.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.872+0000 7f1c9de62640 1 --2- 172.21.15.114:0/398084994 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1c7806c980 0x7f1c7806ee40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1c8800a8f0 tx=0x7f1c88008040 comp rx=0 tx=0).stop 2024-04-28T13:08:58.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.872+0000 7f1c9de62640 1 -- 172.21.15.114:0/398084994 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c9815d010 msgr2=0x7f1c9815e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:58.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.872+0000 7f1c9de62640 1 --2- 172.21.15.114:0/398084994 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c9815d010 0x7f1c9815e570 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1c8000c7f0 tx=0x7f1c8000ccb0 comp rx=0 tx=0).stop 2024-04-28T13:08:58.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.872+0000 7f1c9de62640 1 -- 172.21.15.114:0/398084994 shutdown_connections 2024-04-28T13:08:58.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.872+0000 7f1c9de62640 1 --2- 172.21.15.114:0/398084994 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f1c7806c980 0x7f1c7806ee40 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:58.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.872+0000 7f1c9de62640 1 --2- 172.21.15.114:0/398084994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c981603c0 0x7f1c9815eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:58.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.872+0000 7f1c9de62640 1 --2- 172.21.15.114:0/398084994 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c9815d010 0x7f1c9815e570 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:58.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.872+0000 7f1c9de62640 1 --2- 172.21.15.114:0/398084994 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c980d12c0 0x7f1c98134e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:58.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.873+0000 7f1c9de62640 1 -- 172.21.15.114:0/398084994 >> 172.21.15.114:0/398084994 conn(0x7f1c980cd8b0 msgr2=0x7f1c98156440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:58.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.873+0000 7f1c9de62640 1 -- 172.21.15.114:0/398084994 shutdown_connections 2024-04-28T13:08:58.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.873+0000 7f1c9de62640 1 -- 172.21.15.114:0/398084994 wait complete. 2024-04-28T13:08:58.884 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-28T13:08:58.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.983+0000 7f88da02a640 1 Processor -- start 2024-04-28T13:08:58.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.983+0000 7f88da02a640 1 -- start start 2024-04-28T13:08:58.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.983+0000 7f88da02a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f88d40b3ed0 0x7f88d415c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:58.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.983+0000 7f88da02a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88d415cb80 0x7f88d406f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:58.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.983+0000 7f88da02a640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88d4141800 con 0x7f88d40ce2f0 2024-04-28T13:08:58.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.983+0000 7f88da02a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f88d415c1b0 con 0x7f88d40b3ed0 2024-04-28T13:08:58.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.983+0000 7f88da02a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f88d4141ae0 con 0x7f88d415cb80 2024-04-28T13:08:58.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.984+0000 7f88d37fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f88d40ce2f0 0x7f88d4140fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:43996/0 (socket says 172.21.15.114:43996) 2024-04-28T13:08:58.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.984+0000 7f88d37fe640 1 -- 172.21.15.114:0/1147767681 learned_addr learned my addr 172.21.15.114:0/1147767681 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-28T13:08:58.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.984+0000 7f88caffd640 1 --2- 172.21.15.114:0/1147767681 >> v2:172.21.15.134:3300/0 conn(0x7f88d40b3ed0 0x7f88d415c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:58.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.984+0000 7f88d3fff640 1 --2- 172.21.15.114:0/1147767681 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88d415cb80 0x7f88d406f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:58.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.984+0000 7f88d2ffd640 1 -- 172.21.15.114:0/1147767681 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3349876020 0 0) 0x7f88d4141800 con 0x7f88d40ce2f0 2024-04-28T13:08:58.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.984+0000 7f88d2ffd640 1 -- 172.21.15.114:0/1147767681 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88c0003520 con 0x7f88d40ce2f0 2024-04-28T13:08:58.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.984+0000 7f88d2ffd640 1 -- 172.21.15.114:0/1147767681 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 458133833 0 0) 0x7f88c0003520 con 0x7f88d40ce2f0 2024-04-28T13:08:58.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.984+0000 7f88d2ffd640 1 -- 172.21.15.114:0/1147767681 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88d415cb80 msgr2=0x7f88d406f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:58.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.984+0000 7f88d2ffd640 1 --2- 172.21.15.114:0/1147767681 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88d415cb80 0x7f88d406f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:58.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.984+0000 7f88d2ffd640 1 -- 172.21.15.114:0/1147767681 >> v2:172.21.15.134:3300/0 conn(0x7f88d40b3ed0 msgr2=0x7f88d415c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:58.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.984+0000 7f88d2ffd640 1 --2- 172.21.15.114:0/1147767681 >> v2:172.21.15.134:3300/0 conn(0x7f88d40b3ed0 0x7f88d415c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:58.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.984+0000 7f88d2ffd640 1 -- 172.21.15.114:0/1147767681 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d4141dc0 con 0x7f88d40ce2f0 2024-04-28T13:08:58.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.984+0000 7f88d2ffd640 1 -- 172.21.15.114:0/1147767681 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1045397236 0 0) 0x7f88c4001670 con 0x7f88d40ce2f0 2024-04-28T13:08:58.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.984+0000 7f88d2ffd640 1 -- 172.21.15.114:0/1147767681 >> v1:172.21.15.114:6789/0 conn(0x7f88d40ce2f0 legacy=0x7f88d4140fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:58.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.984+0000 7f88d2ffd640 1 --2- 172.21.15.114:0/1147767681 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88c00039b0 0x7f88c0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:58.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.984+0000 7f88d2ffd640 1 --2- 172.21.15.114:0/1147767681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88c0004310 0x7f88c0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:58.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.984+0000 7f88d2ffd640 1 --2- 172.21.15.114:0/1147767681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88c0004e50 0x7f88c00052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:58.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.984+0000 7f88d2ffd640 1 -- 172.21.15.114:0/1147767681 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f88d415c1b0 con 0x7f88c0004e50 2024-04-28T13:08:58.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.984+0000 7f88d2ffd640 1 -- 172.21.15.114:0/1147767681 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f88d4141ae0 con 0x7f88c0004310 2024-04-28T13:08:58.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.984+0000 7f88d2ffd640 1 -- 172.21.15.114:0/1147767681 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f88c000df50 con 0x7f88c00039b0 2024-04-28T13:08:58.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.984+0000 7f88d3fff640 1 --2- 172.21.15.114:0/1147767681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88c0004e50 0x7f88c00052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:58.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.984+0000 7f88caffd640 1 --2- 172.21.15.114:0/1147767681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88c0004310 0x7f88c0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:58.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.984+0000 7f88d37fe640 1 --2- 172.21.15.114:0/1147767681 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88c00039b0 0x7f88c0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:58.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.985+0000 7f88d3fff640 1 -- 172.21.15.114:0/1147767681 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88c00039b0 msgr2=0x7f88c0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:58.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.985+0000 7f88d3fff640 1 --2- 172.21.15.114:0/1147767681 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88c00039b0 0x7f88c0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:58.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.985+0000 7f88d3fff640 1 -- 172.21.15.114:0/1147767681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88c0004310 msgr2=0x7f88c0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:58.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.985+0000 7f88d3fff640 1 --2- 172.21.15.114:0/1147767681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88c0004310 0x7f88c0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:58.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.985+0000 7f88d3fff640 1 -- 172.21.15.114:0/1147767681 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c0003520 con 0x7f88c0004e50 2024-04-28T13:08:58.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.985+0000 7f88d3fff640 1 --2- 172.21.15.114:0/1147767681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88c0004e50 0x7f88c00052d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f88cc009fc0 tx=0x7f88c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d03a9e0bafd4f7e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:58.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.985+0000 7f88d2ffd640 1 -- 172.21.15.114:0/1147767681 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc009c10 con 0x7f88c0004e50 2024-04-28T13:08:58.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.985+0000 7f88d2ffd640 1 -- 172.21.15.114:0/1147767681 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88cc036070 con 0x7f88c0004e50 2024-04-28T13:08:58.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.985+0000 7f88d2ffd640 1 -- 172.21.15.114:0/1147767681 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc031880 con 0x7f88c0004e50 2024-04-28T13:08:58.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.986+0000 7f88da02a640 1 -- 172.21.15.114:0/1147767681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88c0004e50 msgr2=0x7f88c00052d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:58.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.986+0000 7f88da02a640 1 --2- 172.21.15.114:0/1147767681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88c0004e50 0x7f88c00052d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f88cc009fc0 tx=0x7f88c0005830 comp rx=0 tx=0).stop 2024-04-28T13:08:58.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.986+0000 7f88d3fff640 1 -- 172.21.15.114:0/1147767681 reap_dead start 2024-04-28T13:08:58.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.986+0000 7f88da02a640 1 -- 172.21.15.114:0/1147767681 shutdown_connections 2024-04-28T13:08:58.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.986+0000 7f88da02a640 1 -- 172.21.15.114:0/1147767681 >> 172.21.15.114:0/1147767681 conn(0x7f88d406c980 msgr2=0x7f88d40b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:58.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.986+0000 7f88da02a640 1 -- 172.21.15.114:0/1147767681 shutdown_connections 2024-04-28T13:08:58.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.986+0000 7f88da02a640 1 -- 172.21.15.114:0/1147767681 wait complete. 2024-04-28T13:08:58.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.987+0000 7f88da02a640 1 Processor -- start 2024-04-28T13:08:58.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.987+0000 7f88da02a640 1 -- start start 2024-04-28T13:08:58.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.988+0000 7f88da02a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88d4154fd0 0x7f88d40ced20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:58.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.988+0000 7f88da02a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88d40cf260 0x7f88d41e6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:58.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.988+0000 7f88da02a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88d41e6770 0x7f88d41582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:58.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.988+0000 7f88da02a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f88d40b3460 con 0x7f88d40cf260 2024-04-28T13:08:58.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.988+0000 7f88da02a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f88d40b32e0 con 0x7f88d41e6770 2024-04-28T13:08:58.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.988+0000 7f88da02a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f88d40b35e0 con 0x7f88d4154fd0 2024-04-28T13:08:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.988+0000 7f88caffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88d40cf260 0x7f88d41e6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.988+0000 7f88caffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88d40cf260 0x7f88d41e6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44048/0 (socket says 172.21.15.114:44048) 2024-04-28T13:08:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.988+0000 7f88caffd640 1 -- 172.21.15.114:0/204853995 learned_addr learned my addr 172.21.15.114:0/204853995 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.988+0000 7f88d37fe640 1 --2- 172.21.15.114:0/204853995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88d4154fd0 0x7f88d40ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.988+0000 7f88d3fff640 1 --2- 172.21.15.114:0/204853995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88d41e6770 0x7f88d41582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.988+0000 7f88caffd640 1 -- 172.21.15.114:0/204853995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88d4154fd0 msgr2=0x7f88d40ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.988+0000 7f88caffd640 1 --2- 172.21.15.114:0/204853995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88d4154fd0 0x7f88d40ced20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.988+0000 7f88caffd640 1 -- 172.21.15.114:0/204853995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88d41e6770 msgr2=0x7f88d41582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.988+0000 7f88caffd640 1 --2- 172.21.15.114:0/204853995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88d41e6770 0x7f88d41582d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.988+0000 7f88caffd640 1 -- 172.21.15.114:0/204853995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d40cf7e0 con 0x7f88d40cf260 2024-04-28T13:08:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.988+0000 7f88d3fff640 1 --2- 172.21.15.114:0/204853995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88d41e6770 0x7f88d41582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.989+0000 7f88caffd640 1 --2- 172.21.15.114:0/204853995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88d40cf260 0x7f88d41e6230 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f88bc0119b0 tx=0x7f88bc011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.989+0000 7f88d0ff9640 1 -- 172.21.15.114:0/204853995 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88bc00faf0 con 0x7f88d40cf260 2024-04-28T13:08:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.989+0000 7f88d0ff9640 1 -- 172.21.15.114:0/204853995 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88bc00fc90 con 0x7f88d40cf260 2024-04-28T13:08:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.989+0000 7f88da02a640 1 -- 172.21.15.114:0/204853995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88d40cfac0 con 0x7f88d40cf260 2024-04-28T13:08:58.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.989+0000 7f88d0ff9640 1 -- 172.21.15.114:0/204853995 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88bc014440 con 0x7f88d40cf260 2024-04-28T13:08:58.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.989+0000 7f88da02a640 1 -- 172.21.15.114:0/204853995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88d40d0080 con 0x7f88d40cf260 2024-04-28T13:08:58.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.990+0000 7f88da02a640 1 -- 172.21.15.114:0/204853995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88d406a3d0 con 0x7f88d40cf260 2024-04-28T13:08:58.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.990+0000 7f88d0ff9640 1 -- 172.21.15.114:0/204853995 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f88bc012040 con 0x7f88d40cf260 2024-04-28T13:08:58.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.991+0000 7f88d0ff9640 1 --2- 172.21.15.114:0/204853995 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f88b406c9b0 0x7f88b406ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:58.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.991+0000 7f88d0ff9640 1 -- 172.21.15.114:0/204853995 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f88bc08c200 con 0x7f88d40cf260 2024-04-28T13:08:58.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.991+0000 7f88d37fe640 1 --2- 172.21.15.114:0/204853995 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f88b406c9b0 0x7f88b406ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:58.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.991+0000 7f88d37fe640 1 --2- 172.21.15.114:0/204853995 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f88b406c9b0 0x7f88b406ee70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f88c4001d30 tx=0x7f88c4007970 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:58.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:58.995+0000 7f88d0ff9640 1 -- 172.21.15.114:0/204853995 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f88bc019030 con 0x7f88d40cf260 2024-04-28T13:08:59.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.168+0000 7f88da02a640 1 -- 172.21.15.114:0/204853995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f88d415a710 con 0x7f88d40cf260 2024-04-28T13:08:59.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.169+0000 7f88d0ff9640 1 -- 172.21.15.114:0/204853995 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f88bc05a640 con 0x7f88d40cf260 2024-04-28T13:08:59.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.171+0000 7f88da02a640 1 -- 172.21.15.114:0/204853995 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f88b406c9b0 msgr2=0x7f88b406ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:59.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.171+0000 7f88da02a640 1 --2- 172.21.15.114:0/204853995 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f88b406c9b0 0x7f88b406ee70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f88c4001d30 tx=0x7f88c4007970 comp rx=0 tx=0).stop 2024-04-28T13:08:59.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.171+0000 7f88da02a640 1 -- 172.21.15.114:0/204853995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88d40cf260 msgr2=0x7f88d41e6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:59.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.171+0000 7f88da02a640 1 --2- 172.21.15.114:0/204853995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88d40cf260 0x7f88d41e6230 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f88bc0119b0 tx=0x7f88bc011e70 comp rx=0 tx=0).stop 2024-04-28T13:08:59.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.171+0000 7f88da02a640 1 -- 172.21.15.114:0/204853995 shutdown_connections 2024-04-28T13:08:59.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.171+0000 7f88da02a640 1 --2- 172.21.15.114:0/204853995 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f88b406c9b0 0x7f88b406ee70 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.171+0000 7f88da02a640 1 --2- 172.21.15.114:0/204853995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88d41e6770 0x7f88d41582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.171+0000 7f88da02a640 1 --2- 172.21.15.114:0/204853995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88d40cf260 0x7f88d41e6230 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.171+0000 7f88da02a640 1 --2- 172.21.15.114:0/204853995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88d4154fd0 0x7f88d40ced20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.171+0000 7f88da02a640 1 -- 172.21.15.114:0/204853995 >> 172.21.15.114:0/204853995 conn(0x7f88d406c980 msgr2=0x7f88d4159860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:59.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.171+0000 7f88da02a640 1 -- 172.21.15.114:0/204853995 shutdown_connections 2024-04-28T13:08:59.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.171+0000 7f88da02a640 1 -- 172.21.15.114:0/204853995 wait complete. 2024-04-28T13:08:59.183 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs subvol_grp35980 2024-04-28T13:08:59.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.282+0000 7f004522a640 1 Processor -- start 2024-04-28T13:08:59.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.282+0000 7f004522a640 1 -- start start 2024-04-28T13:08:59.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.283+0000 7f004522a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f00400b4850 0x7f00400b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:59.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.283+0000 7f004522a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f00400732b0 0x7f00400cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:59.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.283+0000 7f004522a640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00400cedc0 con 0x7f0040072e30 2024-04-28T13:08:59.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.283+0000 7f004522a640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f00400b5170 con 0x7f00400732b0 2024-04-28T13:08:59.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.283+0000 7f004522a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f0040073cc0 con 0x7f00400b4850 2024-04-28T13:08:59.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.283+0000 7f003f59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f00400732b0 0x7f00400cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:59.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.283+0000 7f003f59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f00400732b0 0x7f00400cf9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44058/0 (socket says 172.21.15.114:44058) 2024-04-28T13:08:59.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.283+0000 7f003f59e640 1 -- 172.21.15.114:0/1960135321 learned_addr learned my addr 172.21.15.114:0/1960135321 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:59.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.283+0000 7f003ed9d640 1 --2- 172.21.15.114:0/1960135321 >> v2:172.21.15.134:3300/0 conn(0x7f00400b4850 0x7f00400b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:59.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.283+0000 7f003f59e640 1 -- 172.21.15.114:0/1960135321 >> v2:172.21.15.134:3300/0 conn(0x7f00400b4850 msgr2=0x7f00400b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:59.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.283+0000 7f003f59e640 1 --2- 172.21.15.114:0/1960135321 >> v2:172.21.15.134:3300/0 conn(0x7f00400b4850 0x7f00400b4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.283+0000 7f003f59e640 1 -- 172.21.15.114:0/1960135321 >> v1:172.21.15.114:6789/0 conn(0x7f0040072e30 legacy=0x7f00400cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:59.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.283+0000 7f003f59e640 1 -- 172.21.15.114:0/1960135321 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0040073fa0 con 0x7f00400732b0 2024-04-28T13:08:59.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.284+0000 7f003f59e640 1 --2- 172.21.15.114:0/1960135321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00400732b0 0x7f00400cf9b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f004006d2f0 tx=0x7f003802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c345a97518011a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:59.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.284+0000 7f003e59c640 1 -- 172.21.15.114:0/1960135321 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0038036070 con 0x7f00400732b0 2024-04-28T13:08:59.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.284+0000 7f003e59c640 1 -- 172.21.15.114:0/1960135321 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0038031600 con 0x7f00400732b0 2024-04-28T13:08:59.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.284+0000 7f003e59c640 1 -- 172.21.15.114:0/1960135321 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00380319d0 con 0x7f00400732b0 2024-04-28T13:08:59.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.284+0000 7f004522a640 1 -- 172.21.15.114:0/1960135321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00400732b0 msgr2=0x7f00400cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:59.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.284+0000 7f004522a640 1 --2- 172.21.15.114:0/1960135321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00400732b0 0x7f00400cf9b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f004006d2f0 tx=0x7f003802a6a0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.284+0000 7f004522a640 1 -- 172.21.15.114:0/1960135321 shutdown_connections 2024-04-28T13:08:59.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.284+0000 7f004522a640 1 --2- 172.21.15.114:0/1960135321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00400732b0 0x7f00400cf9b0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.285+0000 7f004522a640 1 --2- 172.21.15.114:0/1960135321 >> v2:172.21.15.134:3300/0 conn(0x7f00400b4850 0x7f00400b4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.285+0000 7f004522a640 1 -- 172.21.15.114:0/1960135321 >> 172.21.15.114:0/1960135321 conn(0x7f004006c980 msgr2=0x7f00400b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:59.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.285+0000 7f004522a640 1 -- 172.21.15.114:0/1960135321 shutdown_connections 2024-04-28T13:08:59.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.285+0000 7f004522a640 1 -- 172.21.15.114:0/1960135321 wait complete. 2024-04-28T13:08:59.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.286+0000 7f004522a640 1 Processor -- start 2024-04-28T13:08:59.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.286+0000 7f004522a640 1 -- start start 2024-04-28T13:08:59.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.287+0000 7f004522a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0040072e30 0x7f0040152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:59.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.287+0000 7f004522a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00400732b0 0x7f0040143c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:59.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.287+0000 7f004522a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00400b4850 0x7f0040154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:59.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.287+0000 7f004522a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f00400736c0 con 0x7f0040072e30 2024-04-28T13:08:59.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.287+0000 7f004522a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0040074560 con 0x7f00400b4850 2024-04-28T13:08:59.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.287+0000 7f004522a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f004006e3e0 con 0x7f00400732b0 2024-04-28T13:08:59.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.287+0000 7f003ed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0040072e30 0x7f0040152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:59.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.287+0000 7f003ed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0040072e30 0x7f0040152170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44072/0 (socket says 172.21.15.114:44072) 2024-04-28T13:08:59.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.287+0000 7f003ed9d640 1 -- 172.21.15.114:0/1032580203 learned_addr learned my addr 172.21.15.114:0/1032580203 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:59.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.287+0000 7f003f59e640 1 --2- 172.21.15.114:0/1032580203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00400b4850 0x7f0040154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:59.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.287+0000 7f0037fff640 1 --2- 172.21.15.114:0/1032580203 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00400732b0 0x7f0040143c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:59.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.287+0000 7f003ed9d640 1 -- 172.21.15.114:0/1032580203 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00400732b0 msgr2=0x7f0040143c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:59.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.287+0000 7f003ed9d640 1 --2- 172.21.15.114:0/1032580203 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00400732b0 0x7f0040143c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.287+0000 7f003ed9d640 1 -- 172.21.15.114:0/1032580203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00400b4850 msgr2=0x7f0040154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:59.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.287+0000 7f003ed9d640 1 --2- 172.21.15.114:0/1032580203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00400b4850 0x7f0040154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.287+0000 7f003ed9d640 1 -- 172.21.15.114:0/1032580203 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00401f6e80 con 0x7f0040072e30 2024-04-28T13:08:59.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.287+0000 7f0037fff640 1 --2- 172.21.15.114:0/1032580203 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00400732b0 0x7f0040143c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:59.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.287+0000 7f003ed9d640 1 --2- 172.21.15.114:0/1032580203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0040072e30 0x7f0040152170 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f003000d5f0 tx=0x7f003000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:59.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.287+0000 7f00377fe640 1 -- 172.21.15.114:0/1032580203 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00300125f0 con 0x7f0040072e30 2024-04-28T13:08:59.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.287+0000 7f00377fe640 1 -- 172.21.15.114:0/1032580203 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0030019070 con 0x7f0040072e30 2024-04-28T13:08:59.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.287+0000 7f004522a640 1 -- 172.21.15.114:0/1032580203 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f004015d560 con 0x7f0040072e30 2024-04-28T13:08:59.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.287+0000 7f00377fe640 1 -- 172.21.15.114:0/1032580203 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00300129d0 con 0x7f0040072e30 2024-04-28T13:08:59.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.287+0000 7f004522a640 1 -- 172.21.15.114:0/1032580203 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00401549b0 con 0x7f0040072e30 2024-04-28T13:08:59.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.289+0000 7f004522a640 1 -- 172.21.15.114:0/1032580203 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f004006a3d0 con 0x7f0040072e30 2024-04-28T13:08:59.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.289+0000 7f00377fe640 1 -- 172.21.15.114:0/1032580203 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f0030012b70 con 0x7f0040072e30 2024-04-28T13:08:59.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.289+0000 7f00377fe640 1 --2- 172.21.15.114:0/1032580203 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f002006c9b0 0x7f002006ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:59.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.289+0000 7f00377fe640 1 -- 172.21.15.114:0/1032580203 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f003008bf60 con 0x7f0040072e30 2024-04-28T13:08:59.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.289+0000 7f0037fff640 1 --2- 172.21.15.114:0/1032580203 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f002006c9b0 0x7f002006ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:59.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.290+0000 7f0037fff640 1 --2- 172.21.15.114:0/1032580203 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f002006c9b0 0x7f002006ee70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0040154340 tx=0x7f0028009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:59.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.294+0000 7f00377fe640 1 -- 172.21.15.114:0/1032580203 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f003005a3a0 con 0x7f0040072e30 2024-04-28T13:08:59.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.491+0000 7f004522a640 1 -- 172.21.15.114:0/1032580203 --> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "subvol_grp35980", "target": ["mon-mgr", ""]}) -- 0x7f004006d360 con 0x7f002006c9b0 2024-04-28T13:08:59.496 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:08:59.496+0000 7f7e30768640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-28T13:08:59.496 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:08:59.496+0000 7f7e30768640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-28T13:08:59.496 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:08:59.496+0000 7f7e30768640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-28T13:08:59.496 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:08:59.496+0000 7f7e30768640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-28T13:08:59.497 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-28T13:08:59.496+0000 7f7e30768640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-28T13:08:59.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.510+0000 7f00377fe640 1 -- 172.21.15.114:0/1032580203 <== mgr.4104 v2:172.21.15.114:6832/2240257326 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f004006d360 con 0x7f002006c9b0 2024-04-28T13:08:59.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.512+0000 7f004522a640 1 -- 172.21.15.114:0/1032580203 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f002006c9b0 msgr2=0x7f002006ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:59.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.512+0000 7f004522a640 1 --2- 172.21.15.114:0/1032580203 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f002006c9b0 0x7f002006ee70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0040154340 tx=0x7f0028009040 comp rx=0 tx=0).stop 2024-04-28T13:08:59.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.512+0000 7f004522a640 1 -- 172.21.15.114:0/1032580203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0040072e30 msgr2=0x7f0040152170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:59.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.512+0000 7f004522a640 1 --2- 172.21.15.114:0/1032580203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0040072e30 0x7f0040152170 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f003000d5f0 tx=0x7f003000dab0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.512+0000 7f004522a640 1 -- 172.21.15.114:0/1032580203 shutdown_connections 2024-04-28T13:08:59.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.512+0000 7f004522a640 1 --2- 172.21.15.114:0/1032580203 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f002006c9b0 0x7f002006ee70 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.512+0000 7f004522a640 1 --2- 172.21.15.114:0/1032580203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00400b4850 0x7f0040154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.512+0000 7f004522a640 1 --2- 172.21.15.114:0/1032580203 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00400732b0 0x7f0040143c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.512+0000 7f004522a640 1 --2- 172.21.15.114:0/1032580203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0040072e30 0x7f0040152170 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.512+0000 7f004522a640 1 -- 172.21.15.114:0/1032580203 >> 172.21.15.114:0/1032580203 conn(0x7f004006c980 msgr2=0x7f004006e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:59.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.512+0000 7f004522a640 1 -- 172.21.15.114:0/1032580203 shutdown_connections 2024-04-28T13:08:59.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.512+0000 7f004522a640 1 -- 172.21.15.114:0/1032580203 wait complete. 2024-04-28T13:08:59.523 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol11940 subvol_grp35980 2024-04-28T13:08:59.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.625+0000 7fb5618c4640 1 Processor -- start 2024-04-28T13:08:59.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.625+0000 7fb5618c4640 1 -- start start 2024-04-28T13:08:59.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.626+0000 7fb5618c4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb55c15f4c0 0x7fb55c0d3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:59.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.626+0000 7fb5618c4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb55c0d4cb0 0x7fb55c0bacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:59.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.626+0000 7fb5618c4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb55c0b6c30 0x7fb55c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:59.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.626+0000 7fb5618c4640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fb55c0b7580 con 0x7fb55c15f4c0 2024-04-28T13:08:59.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.626+0000 7fb5618c4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb55c0d3c10 con 0x7fb55c0d4cb0 2024-04-28T13:08:59.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.626+0000 7fb5618c4640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb55c0d3ef0 con 0x7fb55c0b6c30 2024-04-28T13:08:59.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.626+0000 7fb55affd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb55c15f4c0 0x7fb55c0d3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:59.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.626+0000 7fb55affd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb55c15f4c0 0x7fb55c0d3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44116/0 (socket says 172.21.15.114:44116) 2024-04-28T13:08:59.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.626+0000 7fb55affd640 1 -- 172.21.15.114:0/3453943774 learned_addr learned my addr 172.21.15.114:0/3453943774 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:59.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.626+0000 7fb55b7fe640 1 --2- 172.21.15.114:0/3453943774 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb55c0b6c30 0x7fb55c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:59.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.626+0000 7fb553fff640 1 --2- 172.21.15.114:0/3453943774 >> v2:172.21.15.134:3300/0 conn(0x7fb55c0d4cb0 0x7fb55c0bacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:59.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.626+0000 7fb55affd640 1 -- 172.21.15.114:0/3453943774 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb55c0b6c30 msgr2=0x7fb55c0b7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:59.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.626+0000 7fb55affd640 1 --2- 172.21.15.114:0/3453943774 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb55c0b6c30 0x7fb55c0b7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.626+0000 7fb55affd640 1 -- 172.21.15.114:0/3453943774 >> v2:172.21.15.134:3300/0 conn(0x7fb55c0d4cb0 msgr2=0x7fb55c0bacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:59.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.626+0000 7fb55affd640 1 --2- 172.21.15.114:0/3453943774 >> v2:172.21.15.134:3300/0 conn(0x7fb55c0d4cb0 0x7fb55c0bacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.626+0000 7fb55affd640 1 -- 172.21.15.114:0/3453943774 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb55c0d41d0 con 0x7fb55c15f4c0 2024-04-28T13:08:59.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.627+0000 7fb55affd640 1 --2- 172.21.15.114:0/3453943774 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb55c15f4c0 0x7fb55c0d3510 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fb55c0d1b70 tx=0x7fb54c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6acf0108d1c32 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:59.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.627+0000 7fb55a7fc640 1 -- 172.21.15.114:0/3453943774 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c037070 con 0x7fb55c15f4c0 2024-04-28T13:08:59.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.627+0000 7fb55a7fc640 1 -- 172.21.15.114:0/3453943774 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb54c032440 con 0x7fb55c15f4c0 2024-04-28T13:08:59.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.627+0000 7fb55a7fc640 1 -- 172.21.15.114:0/3453943774 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c032810 con 0x7fb55c15f4c0 2024-04-28T13:08:59.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.627+0000 7fb5618c4640 1 -- 172.21.15.114:0/3453943774 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb55c15f4c0 msgr2=0x7fb55c0d3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:59.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.627+0000 7fb5618c4640 1 --2- 172.21.15.114:0/3453943774 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb55c15f4c0 0x7fb55c0d3510 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fb55c0d1b70 tx=0x7fb54c02a270 comp rx=0 tx=0).stop 2024-04-28T13:08:59.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.628+0000 7fb5618c4640 1 -- 172.21.15.114:0/3453943774 shutdown_connections 2024-04-28T13:08:59.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.628+0000 7fb5618c4640 1 --2- 172.21.15.114:0/3453943774 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb55c0b6c30 0x7fb55c0b7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.628+0000 7fb5618c4640 1 --2- 172.21.15.114:0/3453943774 >> v2:172.21.15.134:3300/0 conn(0x7fb55c0d4cb0 0x7fb55c0bacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.628+0000 7fb5618c4640 1 --2- 172.21.15.114:0/3453943774 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb55c15f4c0 0x7fb55c0d3510 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.628+0000 7fb5618c4640 1 -- 172.21.15.114:0/3453943774 >> 172.21.15.114:0/3453943774 conn(0x7fb55c0633a0 msgr2=0x7fb55c0d1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:59.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.628+0000 7fb5618c4640 1 -- 172.21.15.114:0/3453943774 shutdown_connections 2024-04-28T13:08:59.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.628+0000 7fb5618c4640 1 -- 172.21.15.114:0/3453943774 wait complete. 2024-04-28T13:08:59.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.629+0000 7fb5618c4640 1 Processor -- start 2024-04-28T13:08:59.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.629+0000 7fb5618c4640 1 -- start start 2024-04-28T13:08:59.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.629+0000 7fb5618c4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb55c0b6c30 0x7fb55c0cec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:59.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.629+0000 7fb5618c4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb55c0d4cb0 0x7fb55c0d0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:59.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.629+0000 7fb5618c4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb55c15f4c0 0x7fb55c0d06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:59.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.629+0000 7fb5618c4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb55c06d350 con 0x7fb55c0b6c30 2024-04-28T13:08:59.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.629+0000 7fb5618c4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb55c0d4790 con 0x7fb55c15f4c0 2024-04-28T13:08:59.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.629+0000 7fb5618c4640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb55c06d4d0 con 0x7fb55c0d4cb0 2024-04-28T13:08:59.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.629+0000 7fb55affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb55c0b6c30 0x7fb55c0cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:59.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.629+0000 7fb55affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb55c0b6c30 0x7fb55c0cec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44122/0 (socket says 172.21.15.114:44122) 2024-04-28T13:08:59.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.629+0000 7fb55affd640 1 -- 172.21.15.114:0/113043629 learned_addr learned my addr 172.21.15.114:0/113043629 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:59.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.630+0000 7fb55affd640 1 -- 172.21.15.114:0/113043629 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb55c0d4cb0 msgr2=0x7fb55c0d0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:59.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.630+0000 7fb553fff640 1 --2- 172.21.15.114:0/113043629 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb55c0d4cb0 0x7fb55c0d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:59.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.630+0000 7fb55affd640 1 --2- 172.21.15.114:0/113043629 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb55c0d4cb0 0x7fb55c0d0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.630+0000 7fb55b7fe640 1 --2- 172.21.15.114:0/113043629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb55c15f4c0 0x7fb55c0d06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:59.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.630+0000 7fb55affd640 1 -- 172.21.15.114:0/113043629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb55c15f4c0 msgr2=0x7fb55c0d06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:59.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.630+0000 7fb55affd640 1 --2- 172.21.15.114:0/113043629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb55c15f4c0 0x7fb55c0d06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.630+0000 7fb55affd640 1 -- 172.21.15.114:0/113043629 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb55c0cd1b0 con 0x7fb55c0b6c30 2024-04-28T13:08:59.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.630+0000 7fb553fff640 1 --2- 172.21.15.114:0/113043629 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb55c0d4cb0 0x7fb55c0d0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:59.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.630+0000 7fb55b7fe640 1 --2- 172.21.15.114:0/113043629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb55c15f4c0 0x7fb55c0d06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:08:59.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.630+0000 7fb55affd640 1 --2- 172.21.15.114:0/113043629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb55c0b6c30 0x7fb55c0cec70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fb54c02a2b0 tx=0x7fb54c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:59.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.630+0000 7fb558ff9640 1 -- 172.21.15.114:0/113043629 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c041020 con 0x7fb55c0b6c30 2024-04-28T13:08:59.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.630+0000 7fb558ff9640 1 -- 172.21.15.114:0/113043629 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb54c0306c0 con 0x7fb55c0b6c30 2024-04-28T13:08:59.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.630+0000 7fb5618c4640 1 -- 172.21.15.114:0/113043629 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb55c0cdeb0 con 0x7fb55c0b6c30 2024-04-28T13:08:59.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.630+0000 7fb558ff9640 1 -- 172.21.15.114:0/113043629 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c037040 con 0x7fb55c0b6c30 2024-04-28T13:08:59.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.630+0000 7fb5618c4640 1 -- 172.21.15.114:0/113043629 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb55c0ce470 con 0x7fb55c0b6c30 2024-04-28T13:08:59.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.631+0000 7fb5618c4640 1 -- 172.21.15.114:0/113043629 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb55c06a440 con 0x7fb55c0b6c30 2024-04-28T13:08:59.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.631+0000 7fb558ff9640 1 -- 172.21.15.114:0/113043629 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7fb54c044020 con 0x7fb55c0b6c30 2024-04-28T13:08:59.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.632+0000 7fb558ff9640 1 --2- 172.21.15.114:0/113043629 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb53c06c980 0x7fb53c06ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:59.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.632+0000 7fb558ff9640 1 -- 172.21.15.114:0/113043629 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fb54c0ac370 con 0x7fb55c0b6c30 2024-04-28T13:08:59.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.632+0000 7fb553fff640 1 --2- 172.21.15.114:0/113043629 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb53c06c980 0x7fb53c06ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:59.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.632+0000 7fb553fff640 1 --2- 172.21.15.114:0/113043629 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb53c06c980 0x7fb53c06ee40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb55c0b3df0 tx=0x7fb544008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:59.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.636+0000 7fb558ff9640 1 -- 172.21.15.114:0/113043629 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb54c04b030 con 0x7fb55c0b6c30 2024-04-28T13:08:59.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.837+0000 7fb5618c4640 1 -- 172.21.15.114:0/113043629 --> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol11940", "group_name": "subvol_grp35980", "target": ["mon-mgr", ""]}) -- 0x7fb55c0cfc60 con 0x7fb53c06c980 2024-04-28T13:08:59.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.859+0000 7fb558ff9640 1 -- 172.21.15.114:0/113043629 <== mgr.4104 v2:172.21.15.114:6832/2240257326 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb55c0cfc60 con 0x7fb53c06c980 2024-04-28T13:08:59.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.861+0000 7fb5618c4640 1 -- 172.21.15.114:0/113043629 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb53c06c980 msgr2=0x7fb53c06ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:59.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.861+0000 7fb5618c4640 1 --2- 172.21.15.114:0/113043629 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb53c06c980 0x7fb53c06ee40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb55c0b3df0 tx=0x7fb544008040 comp rx=0 tx=0).stop 2024-04-28T13:08:59.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.861+0000 7fb5618c4640 1 -- 172.21.15.114:0/113043629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb55c0b6c30 msgr2=0x7fb55c0cec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:59.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.861+0000 7fb5618c4640 1 --2- 172.21.15.114:0/113043629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb55c0b6c30 0x7fb55c0cec70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fb54c02a2b0 tx=0x7fb54c0046c0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.861+0000 7fb5618c4640 1 -- 172.21.15.114:0/113043629 shutdown_connections 2024-04-28T13:08:59.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.861+0000 7fb5618c4640 1 --2- 172.21.15.114:0/113043629 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fb53c06c980 0x7fb53c06ee40 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.861+0000 7fb5618c4640 1 --2- 172.21.15.114:0/113043629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb55c15f4c0 0x7fb55c0d06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.861+0000 7fb5618c4640 1 --2- 172.21.15.114:0/113043629 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb55c0d4cb0 0x7fb55c0d0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.861+0000 7fb5618c4640 1 --2- 172.21.15.114:0/113043629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb55c0b6c30 0x7fb55c0cec70 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.861+0000 7fb5618c4640 1 -- 172.21.15.114:0/113043629 >> 172.21.15.114:0/113043629 conn(0x7fb55c0633a0 msgr2=0x7fb55c0d2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:59.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.861+0000 7fb5618c4640 1 -- 172.21.15.114:0/113043629 shutdown_connections 2024-04-28T13:08:59.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.861+0000 7fb5618c4640 1 -- 172.21.15.114:0/113043629 wait complete. 2024-04-28T13:08:59.873 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvol11940 subvol_snap68980 subvol_grp35980 2024-04-28T13:08:59.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.975+0000 7f70b46b8640 1 Processor -- start 2024-04-28T13:08:59.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.975+0000 7f70b46b8640 1 -- start start 2024-04-28T13:08:59.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.976+0000 7f70b46b8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f70ac0b4850 0x7f70ac0b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:59.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.976+0000 7f70b46b8640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f70ac072e30 0x7f70ac0732b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:59.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.976+0000 7f70b46b8640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70ac0cedc0 con 0x7f70ac0cf2a0 2024-04-28T13:08:59.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.976+0000 7f70b46b8640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f70ac0b5170 con 0x7f70ac072e30 2024-04-28T13:08:59.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.976+0000 7f70b46b8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f70ac073cc0 con 0x7f70ac0b4850 2024-04-28T13:08:59.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.976+0000 7f70b1c53640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f70ac072e30 0x7f70ac0732b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:59.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.976+0000 7f70b1c53640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f70ac072e30 0x7f70ac0732b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44134/0 (socket says 172.21.15.114:44134) 2024-04-28T13:08:59.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.976+0000 7f70b2c55640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f70ac0cf2a0 0x7f70ac0cf6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44016/0 (socket says 172.21.15.114:44016) 2024-04-28T13:08:59.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.976+0000 7f70b1c53640 1 -- 172.21.15.114:0/3357372736 learned_addr learned my addr 172.21.15.114:0/3357372736 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:59.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.976+0000 7f70b2454640 1 --2- 172.21.15.114:0/3357372736 >> v2:172.21.15.134:3300/0 conn(0x7f70ac0b4850 0x7f70ac0b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:59.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.976+0000 7f70b1c53640 1 -- 172.21.15.114:0/3357372736 >> v2:172.21.15.134:3300/0 conn(0x7f70ac0b4850 msgr2=0x7f70ac0b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:08:59.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.976+0000 7f70b1c53640 1 --2- 172.21.15.114:0/3357372736 >> v2:172.21.15.134:3300/0 conn(0x7f70ac0b4850 0x7f70ac0b4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.976+0000 7f70b1c53640 1 -- 172.21.15.114:0/3357372736 >> v1:172.21.15.114:6789/0 conn(0x7f70ac0cf2a0 legacy=0x7f70ac0cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:59.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.976+0000 7f70b1452640 1 -- 172.21.15.114:0/3357372736 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4244108140 0 0) 0x7f70ac0cedc0 con 0x7f70ac0cf2a0 2024-04-28T13:08:59.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.976+0000 7f70b1c53640 1 -- 172.21.15.114:0/3357372736 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70ac073fa0 con 0x7f70ac072e30 2024-04-28T13:08:59.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.976+0000 7f70b2454640 1 --2- 172.21.15.114:0/3357372736 >> v2:172.21.15.134:3300/0 conn(0x7f70ac0b4850 0x7f70ac0b4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-28T13:08:59.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.977+0000 7f70b1c53640 1 --2- 172.21.15.114:0/3357372736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70ac072e30 0x7f70ac0732b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f70ac06d2f0 tx=0x7f709c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4603c8792caf2c64 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:59.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.977+0000 7f70b1452640 1 -- 172.21.15.114:0/3357372736 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709c037070 con 0x7f70ac072e30 2024-04-28T13:08:59.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.977+0000 7f70b1452640 1 -- 172.21.15.114:0/3357372736 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f709c032440 con 0x7f70ac072e30 2024-04-28T13:08:59.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.977+0000 7f70b1452640 1 -- 172.21.15.114:0/3357372736 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709c032810 con 0x7f70ac072e30 2024-04-28T13:08:59.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.978+0000 7f70b46b8640 1 -- 172.21.15.114:0/3357372736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70ac072e30 msgr2=0x7f70ac0732b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:59.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.978+0000 7f70b46b8640 1 --2- 172.21.15.114:0/3357372736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70ac072e30 0x7f70ac0732b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f70ac06d2f0 tx=0x7f709c02a1e0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.978+0000 7f70b46b8640 1 -- 172.21.15.114:0/3357372736 shutdown_connections 2024-04-28T13:08:59.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.978+0000 7f70b46b8640 1 --2- 172.21.15.114:0/3357372736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70ac072e30 0x7f70ac0732b0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.978+0000 7f70b46b8640 1 --2- 172.21.15.114:0/3357372736 >> v2:172.21.15.134:3300/0 conn(0x7f70ac0b4850 0x7f70ac0b4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.978+0000 7f70b46b8640 1 -- 172.21.15.114:0/3357372736 >> 172.21.15.114:0/3357372736 conn(0x7f70ac06c980 msgr2=0x7f70ac0b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:08:59.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.978+0000 7f70b46b8640 1 -- 172.21.15.114:0/3357372736 shutdown_connections 2024-04-28T13:08:59.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.978+0000 7f70b46b8640 1 -- 172.21.15.114:0/3357372736 wait complete. 2024-04-28T13:08:59.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.979+0000 7f70b46b8640 1 Processor -- start 2024-04-28T13:08:59.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.979+0000 7f70b46b8640 1 -- start start 2024-04-28T13:08:59.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.980+0000 7f70b46b8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70ac072e30 0x7f70ac1438c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:59.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.980+0000 7f70b46b8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70ac0b4850 0x7f70ac0b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:59.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.980+0000 7f70b46b8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70ac0cf2a0 0x7f70ac151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:59.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.980+0000 7f70b46b8640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac06e3e0 con 0x7f70ac072e30 2024-04-28T13:08:59.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.980+0000 7f70b46b8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac074560 con 0x7f70ac0cf2a0 2024-04-28T13:08:59.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.980+0000 7f70b46b8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f70ac15d380 con 0x7f70ac0b4850 2024-04-28T13:08:59.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.980+0000 7f70b2454640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70ac072e30 0x7f70ac1438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:59.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.980+0000 7f70b2454640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70ac072e30 0x7f70ac1438c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44142/0 (socket says 172.21.15.114:44142) 2024-04-28T13:08:59.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.980+0000 7f70b2454640 1 -- 172.21.15.114:0/1341883029 learned_addr learned my addr 172.21.15.114:0/1341883029 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:08:59.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.980+0000 7f70b2c55640 1 --2- 172.21.15.114:0/1341883029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70ac0cf2a0 0x7f70ac151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:59.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.980+0000 7f70b1c53640 1 --2- 172.21.15.114:0/1341883029 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70ac0b4850 0x7f70ac0b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:59.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.980+0000 7f70b2454640 1 -- 172.21.15.114:0/1341883029 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70ac0b4850 msgr2=0x7f70ac0b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:59.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.980+0000 7f70b2454640 1 --2- 172.21.15.114:0/1341883029 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70ac0b4850 0x7f70ac0b1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.980+0000 7f70b2454640 1 -- 172.21.15.114:0/1341883029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70ac0cf2a0 msgr2=0x7f70ac151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:08:59.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.980+0000 7f70b2454640 1 --2- 172.21.15.114:0/1341883029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70ac0cf2a0 0x7f70ac151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:08:59.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.980+0000 7f70b2454640 1 -- 172.21.15.114:0/1341883029 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70ac0b1a60 con 0x7f70ac072e30 2024-04-28T13:08:59.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.980+0000 7f70b2454640 1 --2- 172.21.15.114:0/1341883029 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70ac072e30 0x7f70ac1438c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f70a800e7e0 tx=0x7f70a800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:59.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.980+0000 7f70a2ffd640 1 -- 172.21.15.114:0/1341883029 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a800f040 con 0x7f70ac072e30 2024-04-28T13:08:59.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.981+0000 7f70a2ffd640 1 -- 172.21.15.114:0/1341883029 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70a8004030 con 0x7f70ac072e30 2024-04-28T13:08:59.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.981+0000 7f70b46b8640 1 -- 172.21.15.114:0/1341883029 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70ac15d940 con 0x7f70ac072e30 2024-04-28T13:08:59.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.981+0000 7f70a2ffd640 1 -- 172.21.15.114:0/1341883029 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a8004400 con 0x7f70ac072e30 2024-04-28T13:08:59.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.981+0000 7f70b46b8640 1 -- 172.21.15.114:0/1341883029 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70ac15df00 con 0x7f70ac072e30 2024-04-28T13:08:59.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.982+0000 7f70b46b8640 1 -- 172.21.15.114:0/1341883029 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70ac06a3d0 con 0x7f70ac072e30 2024-04-28T13:08:59.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.982+0000 7f70a2ffd640 1 -- 172.21.15.114:0/1341883029 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f70a800c6d0 con 0x7f70ac072e30 2024-04-28T13:08:59.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.982+0000 7f70a2ffd640 1 --2- 172.21.15.114:0/1341883029 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f709006c980 0x7f709006ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:08:59.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.983+0000 7f70a2ffd640 1 -- 172.21.15.114:0/1341883029 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f70a808ba10 con 0x7f70ac072e30 2024-04-28T13:08:59.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.983+0000 7f70b1c53640 1 --2- 172.21.15.114:0/1341883029 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f709006c980 0x7f709006ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:08:59.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.983+0000 7f70b1c53640 1 --2- 172.21.15.114:0/1341883029 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f709006c980 0x7f709006ee40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f709c034000 tx=0x7f709c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:08:59.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:08:59.987+0000 7f70a2ffd640 1 -- 172.21.15.114:0/1341883029 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f70a8017020 con 0x7f70ac072e30 2024-04-28T13:09:00.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.191+0000 7f70b46b8640 1 -- 172.21.15.114:0/1341883029 --> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvol11940", "snap_name": "subvol_snap68980", "group_name": "subvol_grp35980", "target": ["mon-mgr", ""]}) -- 0x7f70ac156e80 con 0x7f709006c980 2024-04-28T13:09:00.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.207+0000 7f70a2ffd640 1 -- 172.21.15.114:0/1341883029 <== mgr.4104 v2:172.21.15.114:6832/2240257326 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f70ac156e80 con 0x7f709006c980 2024-04-28T13:09:00.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.209+0000 7f70b46b8640 1 -- 172.21.15.114:0/1341883029 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f709006c980 msgr2=0x7f709006ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:09:00.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.209+0000 7f70b46b8640 1 --2- 172.21.15.114:0/1341883029 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f709006c980 0x7f709006ee40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f709c034000 tx=0x7f709c02e000 comp rx=0 tx=0).stop 2024-04-28T13:09:00.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.209+0000 7f70b46b8640 1 -- 172.21.15.114:0/1341883029 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70ac072e30 msgr2=0x7f70ac1438c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:09:00.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.209+0000 7f70b46b8640 1 --2- 172.21.15.114:0/1341883029 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70ac072e30 0x7f70ac1438c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f70a800e7e0 tx=0x7f70a800eca0 comp rx=0 tx=0).stop 2024-04-28T13:09:00.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.209+0000 7f70b46b8640 1 -- 172.21.15.114:0/1341883029 shutdown_connections 2024-04-28T13:09:00.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.209+0000 7f70b46b8640 1 --2- 172.21.15.114:0/1341883029 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f709006c980 0x7f709006ee40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:09:00.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.209+0000 7f70b46b8640 1 --2- 172.21.15.114:0/1341883029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70ac0cf2a0 0x7f70ac151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:09:00.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.209+0000 7f70b46b8640 1 --2- 172.21.15.114:0/1341883029 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70ac0b4850 0x7f70ac0b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:09:00.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.209+0000 7f70b46b8640 1 --2- 172.21.15.114:0/1341883029 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70ac072e30 0x7f70ac1438c0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:09:00.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.209+0000 7f70b46b8640 1 -- 172.21.15.114:0/1341883029 >> 172.21.15.114:0/1341883029 conn(0x7f70ac06c980 msgr2=0x7f70ac15ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:09:00.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.209+0000 7f70b46b8640 1 -- 172.21.15.114:0/1341883029 shutdown_connections 2024-04-28T13:09:00.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.209+0000 7f70b46b8640 1 -- 172.21.15.114:0/1341883029 wait complete. 2024-04-28T13:09:00.220 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot metadata set cephfs subvol11940 subvol_snap68980 key value subvol_grp35980 2024-04-28T13:09:00.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.325+0000 7fdd19967640 1 Processor -- start 2024-04-28T13:09:00.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.325+0000 7fdd19967640 1 -- start start 2024-04-28T13:09:00.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.326+0000 7fdd19967640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdd1415f3b0 0x7fdd140babe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:09:00.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.326+0000 7fdd19967640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdd140b4570 0x7fdd140b83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:09:00.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.326+0000 7fdd19967640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdd140b6d40 0x7fdd140b7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:09:00.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.326+0000 7fdd19967640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fdd140b76d0 con 0x7fdd140b6d40 2024-04-28T13:09:00.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.326+0000 7fdd19967640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fdd140d3470 con 0x7fdd1415f3b0 2024-04-28T13:09:00.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.326+0000 7fdd19967640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fdd140d3710 con 0x7fdd140b4570 2024-04-28T13:09:00.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.326+0000 7fdd137fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdd140b6d40 0x7fdd140b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:09:00.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.326+0000 7fdd137fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdd140b6d40 0x7fdd140b7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44150/0 (socket says 172.21.15.114:44150) 2024-04-28T13:09:00.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.326+0000 7fdd137fe640 1 -- 172.21.15.114:0/2272016637 learned_addr learned my addr 172.21.15.114:0/2272016637 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:09:00.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.326+0000 7fdd137fe640 1 -- 172.21.15.114:0/2272016637 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdd140b4570 msgr2=0x7fdd140b83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:09:00.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.326+0000 7fdd12ffd640 1 --2- 172.21.15.114:0/2272016637 >> v2:172.21.15.134:3300/0 conn(0x7fdd1415f3b0 0x7fdd140babe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:09:00.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.326+0000 7fdd137fe640 1 --2- 172.21.15.114:0/2272016637 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdd140b4570 0x7fdd140b83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:09:00.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.326+0000 7fdd137fe640 1 -- 172.21.15.114:0/2272016637 >> v2:172.21.15.134:3300/0 conn(0x7fdd1415f3b0 msgr2=0x7fdd140babe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:09:00.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.326+0000 7fdd137fe640 1 --2- 172.21.15.114:0/2272016637 >> v2:172.21.15.134:3300/0 conn(0x7fdd1415f3b0 0x7fdd140babe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:09:00.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.326+0000 7fdd137fe640 1 -- 172.21.15.114:0/2272016637 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd140d39f0 con 0x7fdd140b6d40 2024-04-28T13:09:00.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.327+0000 7fdd137fe640 1 --2- 172.21.15.114:0/2272016637 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd140b6d40 0x7fdd140b7190 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fdd140d29e0 tx=0x7fdd0c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c386772853ddd32 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:09:00.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.327+0000 7fdd11ffb640 1 -- 172.21.15.114:0/2272016637 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c036070 con 0x7fdd140b6d40 2024-04-28T13:09:00.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.327+0000 7fdd11ffb640 1 -- 172.21.15.114:0/2272016637 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd0c031600 con 0x7fdd140b6d40 2024-04-28T13:09:00.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.327+0000 7fdd11ffb640 1 -- 172.21.15.114:0/2272016637 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c0319d0 con 0x7fdd140b6d40 2024-04-28T13:09:00.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.328+0000 7fdd19967640 1 -- 172.21.15.114:0/2272016637 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd140b6d40 msgr2=0x7fdd140b7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:09:00.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.328+0000 7fdd19967640 1 --2- 172.21.15.114:0/2272016637 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd140b6d40 0x7fdd140b7190 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fdd140d29e0 tx=0x7fdd0c02a6a0 comp rx=0 tx=0).stop 2024-04-28T13:09:00.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.328+0000 7fdd19967640 1 -- 172.21.15.114:0/2272016637 shutdown_connections 2024-04-28T13:09:00.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.328+0000 7fdd19967640 1 --2- 172.21.15.114:0/2272016637 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd140b6d40 0x7fdd140b7190 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:09:00.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.328+0000 7fdd19967640 1 --2- 172.21.15.114:0/2272016637 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdd140b4570 0x7fdd140b83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:09:00.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.328+0000 7fdd19967640 1 --2- 172.21.15.114:0/2272016637 >> v2:172.21.15.134:3300/0 conn(0x7fdd1415f3b0 0x7fdd140babe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:09:00.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.328+0000 7fdd19967640 1 -- 172.21.15.114:0/2272016637 >> 172.21.15.114:0/2272016637 conn(0x7fdd140633a0 msgr2=0x7fdd140d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:09:00.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.328+0000 7fdd19967640 1 -- 172.21.15.114:0/2272016637 shutdown_connections 2024-04-28T13:09:00.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.328+0000 7fdd19967640 1 -- 172.21.15.114:0/2272016637 wait complete. 2024-04-28T13:09:00.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.329+0000 7fdd19967640 1 Processor -- start 2024-04-28T13:09:00.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.329+0000 7fdd19967640 1 -- start start 2024-04-28T13:09:00.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.330+0000 7fdd19967640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdd140b4570 0x7fdd1414b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:09:00.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.330+0000 7fdd19967640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd140b6d40 0x7fdd1414dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:09:00.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.330+0000 7fdd19967640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd1415f3b0 0x7fdd1414e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:09:00.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.330+0000 7fdd19967640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1415f790 con 0x7fdd140b6d40 2024-04-28T13:09:00.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.330+0000 7fdd19967640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdd140d3fb0 con 0x7fdd1415f3b0 2024-04-28T13:09:00.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.330+0000 7fdd19967640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fdd1415f910 con 0x7fdd140b4570 2024-04-28T13:09:00.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.330+0000 7fdd127fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd140b6d40 0x7fdd1414dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:09:00.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.330+0000 7fdd127fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd140b6d40 0x7fdd1414dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44152/0 (socket says 172.21.15.114:44152) 2024-04-28T13:09:00.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.330+0000 7fdd127fc640 1 -- 172.21.15.114:0/1023936597 learned_addr learned my addr 172.21.15.114:0/1023936597 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:09:00.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.330+0000 7fdd127fc640 1 -- 172.21.15.114:0/1023936597 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdd140b4570 msgr2=0x7fdd1414b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:09:00.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.330+0000 7fdd127fc640 1 --2- 172.21.15.114:0/1023936597 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdd140b4570 0x7fdd1414b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:09:00.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.330+0000 7fdd127fc640 1 -- 172.21.15.114:0/1023936597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd1415f3b0 msgr2=0x7fdd1414e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:09:00.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.330+0000 7fdd127fc640 1 --2- 172.21.15.114:0/1023936597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd1415f3b0 0x7fdd1414e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:09:00.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.330+0000 7fdd127fc640 1 -- 172.21.15.114:0/1023936597 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd1414bff0 con 0x7fdd140b6d40 2024-04-28T13:09:00.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.330+0000 7fdd127fc640 1 --2- 172.21.15.114:0/1023936597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd140b6d40 0x7fdd1414dee0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fdd0800b3f0 tx=0x7fdd0800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:09:00.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.330+0000 7fdcfbfff640 1 -- 172.21.15.114:0/1023936597 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd08015030 con 0x7fdd140b6d40 2024-04-28T13:09:00.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.330+0000 7fdcfbfff640 1 -- 172.21.15.114:0/1023936597 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd08005970 con 0x7fdd140b6d40 2024-04-28T13:09:00.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.330+0000 7fdcfbfff640 1 -- 172.21.15.114:0/1023936597 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd08005d60 con 0x7fdd140b6d40 2024-04-28T13:09:00.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.330+0000 7fdd19967640 1 -- 172.21.15.114:0/1023936597 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd1414c2d0 con 0x7fdd140b6d40 2024-04-28T13:09:00.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.330+0000 7fdd19967640 1 -- 172.21.15.114:0/1023936597 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd1414c890 con 0x7fdd140b6d40 2024-04-28T13:09:00.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.331+0000 7fdd19967640 1 -- 172.21.15.114:0/1023936597 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd1406a3d0 con 0x7fdd140b6d40 2024-04-28T13:09:00.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.332+0000 7fdcfbfff640 1 -- 172.21.15.114:0/1023936597 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7fdd08018070 con 0x7fdd140b6d40 2024-04-28T13:09:00.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.332+0000 7fdcfbfff640 1 --2- 172.21.15.114:0/1023936597 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fdd0006c980 0x7fdd0006ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:09:00.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.332+0000 7fdd12ffd640 1 --2- 172.21.15.114:0/1023936597 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fdd0006c980 0x7fdd0006ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:09:00.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.332+0000 7fdcfbfff640 1 -- 172.21.15.114:0/1023936597 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fdd0808b640 con 0x7fdd140b6d40 2024-04-28T13:09:00.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.333+0000 7fdd12ffd640 1 --2- 172.21.15.114:0/1023936597 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fdd0006c980 0x7fdd0006ee40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdd04006fd0 tx=0x7fdd04008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:09:00.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.337+0000 7fdcfbfff640 1 -- 172.21.15.114:0/1023936597 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fdd08059b10 con 0x7fdd140b6d40 2024-04-28T13:09:00.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.542+0000 7fdd19967640 1 -- 172.21.15.114:0/1023936597 --> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot metadata set", "vol_name": "cephfs", "sub_name": "subvol11940", "snap_name": "subvol_snap68980", "key_name": "key", "value": "value", "group_name": "subvol_grp35980", "target": ["mon-mgr", ""]}) -- 0x7fdd140bb240 con 0x7fdd0006c980 2024-04-28T13:09:00.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.558+0000 7fdcfbfff640 1 -- 172.21.15.114:0/1023936597 <== mgr.4104 v2:172.21.15.114:6832/2240257326 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fdd140bb240 con 0x7fdd0006c980 2024-04-28T13:09:00.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.560+0000 7fdd19967640 1 -- 172.21.15.114:0/1023936597 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fdd0006c980 msgr2=0x7fdd0006ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:09:00.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.560+0000 7fdd19967640 1 --2- 172.21.15.114:0/1023936597 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fdd0006c980 0x7fdd0006ee40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdd04006fd0 tx=0x7fdd04008040 comp rx=0 tx=0).stop 2024-04-28T13:09:00.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.560+0000 7fdd19967640 1 -- 172.21.15.114:0/1023936597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd140b6d40 msgr2=0x7fdd1414dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:09:00.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.560+0000 7fdd19967640 1 --2- 172.21.15.114:0/1023936597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd140b6d40 0x7fdd1414dee0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fdd0800b3f0 tx=0x7fdd0800b8b0 comp rx=0 tx=0).stop 2024-04-28T13:09:00.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.560+0000 7fdd19967640 1 -- 172.21.15.114:0/1023936597 shutdown_connections 2024-04-28T13:09:00.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.560+0000 7fdd19967640 1 --2- 172.21.15.114:0/1023936597 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7fdd0006c980 0x7fdd0006ee40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:09:00.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.560+0000 7fdd19967640 1 --2- 172.21.15.114:0/1023936597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd1415f3b0 0x7fdd1414e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:09:00.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.560+0000 7fdd19967640 1 --2- 172.21.15.114:0/1023936597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd140b6d40 0x7fdd1414dee0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:09:00.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.560+0000 7fdd19967640 1 --2- 172.21.15.114:0/1023936597 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdd140b4570 0x7fdd1414b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:09:00.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.560+0000 7fdd19967640 1 -- 172.21.15.114:0/1023936597 >> 172.21.15.114:0/1023936597 conn(0x7fdd140633a0 msgr2=0x7fdd140cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:09:00.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.561+0000 7fdd19967640 1 -- 172.21.15.114:0/1023936597 shutdown_connections 2024-04-28T13:09:00.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:00.561+0000 7fdd19967640 1 -- 172.21.15.114:0/1023936597 wait complete. 2024-04-28T13:09:00.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:09:00.572 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp -p ./volumes/subvol_grp35980/subvol11940/.meta ./volumes/subvol_grp35980/subvol11940/.meta.stale_snap_section) 2024-04-28T13:09:01.408 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol11940 subvol_snap68980 subvol_grp35980 2024-04-28T13:09:01.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.520+0000 7f6e2ac47640 1 Processor -- start 2024-04-28T13:09:01.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.520+0000 7f6e2ac47640 1 -- start start 2024-04-28T13:09:01.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.521+0000 7f6e2ac47640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6e24072e30 0x7f6e240732b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:09:01.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.521+0000 7f6e2ac47640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e2415c370 0x7f6e2415c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:09:01.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.521+0000 7f6e2ac47640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e240d02b0 con 0x7f6e240b4850 2024-04-28T13:09:01.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.521+0000 7f6e2ac47640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f6e240cedc0 con 0x7f6e24072e30 2024-04-28T13:09:01.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.521+0000 7f6e2ac47640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f6e24073cc0 con 0x7f6e2415c370 2024-04-28T13:09:01.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.521+0000 7f6e23fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6e24072e30 0x7f6e240732b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:09:01.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.521+0000 7f6e23fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6e24072e30 0x7f6e240732b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60378/0 (socket says 172.21.15.114:60378) 2024-04-28T13:09:01.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.521+0000 7f6e23fff640 1 -- 172.21.15.114:0/2533071674 learned_addr learned my addr 172.21.15.114:0/2533071674 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:09:01.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.521+0000 7f6e291e4640 1 --2- 172.21.15.114:0/2533071674 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e2415c370 0x7f6e2415c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:09:01.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.521+0000 7f6e23fff640 1 -- 172.21.15.114:0/2533071674 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e2415c370 msgr2=0x7f6e2415c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-28T13:09:01.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.521+0000 7f6e23fff640 1 --2- 172.21.15.114:0/2533071674 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e2415c370 0x7f6e2415c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:09:01.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.521+0000 7f6e23fff640 1 -- 172.21.15.114:0/2533071674 >> v1:172.21.15.114:6789/0 conn(0x7f6e240b4850 legacy=0x7f6e240b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:09:01.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.521+0000 7f6e23fff640 1 -- 172.21.15.114:0/2533071674 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e24073fa0 con 0x7f6e24072e30 2024-04-28T13:09:01.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.521+0000 7f6e291e4640 1 --2- 172.21.15.114:0/2533071674 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e2415c370 0x7f6e2415c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-28T13:09:01.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.522+0000 7f6e23fff640 1 --2- 172.21.15.114:0/2533071674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e24072e30 0x7f6e240732b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000bb10 tx=0x7f6e1002c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f7ae6a99dc42c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:09:01.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.522+0000 7f6e237fe640 1 -- 172.21.15.114:0/2533071674 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e10032790 con 0x7f6e24072e30 2024-04-28T13:09:01.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.522+0000 7f6e237fe640 1 -- 172.21.15.114:0/2533071674 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e10038070 con 0x7f6e24072e30 2024-04-28T13:09:01.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.522+0000 7f6e237fe640 1 -- 172.21.15.114:0/2533071674 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e10032b50 con 0x7f6e24072e30 2024-04-28T13:09:01.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.523+0000 7f6e2ac47640 1 -- 172.21.15.114:0/2533071674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e24072e30 msgr2=0x7f6e240732b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:09:01.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.523+0000 7f6e2ac47640 1 --2- 172.21.15.114:0/2533071674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e24072e30 0x7f6e240732b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000bb10 tx=0x7f6e1002c890 comp rx=0 tx=0).stop 2024-04-28T13:09:01.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.523+0000 7f6e2ac47640 1 -- 172.21.15.114:0/2533071674 shutdown_connections 2024-04-28T13:09:01.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.523+0000 7f6e2ac47640 1 --2- 172.21.15.114:0/2533071674 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e2415c370 0x7f6e2415c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:09:01.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.523+0000 7f6e2ac47640 1 --2- 172.21.15.114:0/2533071674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e24072e30 0x7f6e240732b0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:09:01.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.523+0000 7f6e2ac47640 1 -- 172.21.15.114:0/2533071674 >> 172.21.15.114:0/2533071674 conn(0x7f6e2406c980 msgr2=0x7f6e240b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:09:01.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.523+0000 7f6e2ac47640 1 -- 172.21.15.114:0/2533071674 shutdown_connections 2024-04-28T13:09:01.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.523+0000 7f6e2ac47640 1 -- 172.21.15.114:0/2533071674 wait complete. 2024-04-28T13:09:01.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.524+0000 7f6e2ac47640 1 Processor -- start 2024-04-28T13:09:01.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.524+0000 7f6e2ac47640 1 -- start start 2024-04-28T13:09:01.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.525+0000 7f6e2ac47640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e24072e30 0x7f6e240af280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:09:01.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.525+0000 7f6e2ac47640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e240b4850 0x7f6e240afff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:09:01.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.525+0000 7f6e2ac47640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e2415c370 0x7f6e2414f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:09:01.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.525+0000 7f6e2ac47640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2406e3e0 con 0x7f6e24072e30 2024-04-28T13:09:01.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.525+0000 7f6e2ac47640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6e24074560 con 0x7f6e2415c370 2024-04-28T13:09:01.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.525+0000 7f6e2ac47640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f6e2415cd20 con 0x7f6e240b4850 2024-04-28T13:09:01.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.525+0000 7f6e289e3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e24072e30 0x7f6e240af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:09:01.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.525+0000 7f6e289e3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e24072e30 0x7f6e240af280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60384/0 (socket says 172.21.15.114:60384) 2024-04-28T13:09:01.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.525+0000 7f6e289e3640 1 -- 172.21.15.114:0/2333552197 learned_addr learned my addr 172.21.15.114:0/2333552197 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-28T13:09:01.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.525+0000 7f6e289e3640 1 -- 172.21.15.114:0/2333552197 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e240b4850 msgr2=0x7f6e240afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:09:01.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.525+0000 7f6e289e3640 1 --2- 172.21.15.114:0/2333552197 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e240b4850 0x7f6e240afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:09:01.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.525+0000 7f6e289e3640 1 -- 172.21.15.114:0/2333552197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e2415c370 msgr2=0x7f6e2414f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:09:01.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.525+0000 7f6e289e3640 1 --2- 172.21.15.114:0/2333552197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e2415c370 0x7f6e2414f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:09:01.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.525+0000 7f6e289e3640 1 -- 172.21.15.114:0/2333552197 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e2414fe30 con 0x7f6e24072e30 2024-04-28T13:09:01.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.525+0000 7f6e289e3640 1 --2- 172.21.15.114:0/2333552197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e24072e30 0x7f6e240af280 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f6e1800c400 tx=0x7f6e1800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:09:01.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.525+0000 7f6e217fa640 1 -- 172.21.15.114:0/2333552197 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e180052d0 con 0x7f6e24072e30 2024-04-28T13:09:01.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.525+0000 7f6e217fa640 1 -- 172.21.15.114:0/2333552197 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e18005470 con 0x7f6e24072e30 2024-04-28T13:09:01.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.525+0000 7f6e217fa640 1 -- 172.21.15.114:0/2333552197 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e18007260 con 0x7f6e24072e30 2024-04-28T13:09:01.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.525+0000 7f6e2ac47640 1 -- 172.21.15.114:0/2333552197 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e241e4c30 con 0x7f6e24072e30 2024-04-28T13:09:01.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.526+0000 7f6e2ac47640 1 -- 172.21.15.114:0/2333552197 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e241e51f0 con 0x7f6e24072e30 2024-04-28T13:09:01.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.527+0000 7f6e2ac47640 1 -- 172.21.15.114:0/2333552197 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e2406a3d0 con 0x7f6e24072e30 2024-04-28T13:09:01.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.527+0000 7f6e217fa640 1 -- 172.21.15.114:0/2333552197 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f6e18007400 con 0x7f6e24072e30 2024-04-28T13:09:01.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.527+0000 7f6e217fa640 1 --2- 172.21.15.114:0/2333552197 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6e0806c9b0 0x7f6e0806ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-28T13:09:01.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.527+0000 7f6e23fff640 1 --2- 172.21.15.114:0/2333552197 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6e0806c9b0 0x7f6e0806ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-28T13:09:01.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.527+0000 7f6e217fa640 1 -- 172.21.15.114:0/2333552197 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f6e1808b0f0 con 0x7f6e24072e30 2024-04-28T13:09:01.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.528+0000 7f6e23fff640 1 --2- 172.21.15.114:0/2333552197 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6e0806c9b0 0x7f6e0806ee70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6e10037000 tx=0x7f6e10008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-28T13:09:01.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.532+0000 7f6e217fa640 1 -- 172.21.15.114:0/2333552197 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6e18059530 con 0x7f6e24072e30 2024-04-28T13:09:01.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.565+0000 7f6e217fa640 1 -- 172.21.15.114:0/2333552197 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mgrmap(e 7) ==== 91142+0+0 (secure 0 0 0) 0x7f6e180554a0 con 0x7f6e24072e30 2024-04-28T13:09:01.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.744+0000 7f6e2ac47640 1 -- 172.21.15.114:0/2333552197 --> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol11940", "snap_name": "subvol_snap68980", "group_name": "subvol_grp35980", "target": ["mon-mgr", ""]}) -- 0x7f6e240729f0 con 0x7f6e0806c9b0 2024-04-28T13:09:01.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.771+0000 7f6e217fa640 1 -- 172.21.15.114:0/2333552197 <== mgr.4104 v2:172.21.15.114:6832/2240257326 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6e240729f0 con 0x7f6e0806c9b0 2024-04-28T13:09:01.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.774+0000 7f6e2ac47640 1 -- 172.21.15.114:0/2333552197 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6e0806c9b0 msgr2=0x7f6e0806ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:09:01.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.774+0000 7f6e2ac47640 1 --2- 172.21.15.114:0/2333552197 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6e0806c9b0 0x7f6e0806ee70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6e10037000 tx=0x7f6e10008040 comp rx=0 tx=0).stop 2024-04-28T13:09:01.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.774+0000 7f6e2ac47640 1 -- 172.21.15.114:0/2333552197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e24072e30 msgr2=0x7f6e240af280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-28T13:09:01.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.774+0000 7f6e2ac47640 1 --2- 172.21.15.114:0/2333552197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e24072e30 0x7f6e240af280 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f6e1800c400 tx=0x7f6e1800c8c0 comp rx=0 tx=0).stop 2024-04-28T13:09:01.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.774+0000 7f6e2ac47640 1 -- 172.21.15.114:0/2333552197 shutdown_connections 2024-04-28T13:09:01.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.774+0000 7f6e2ac47640 1 --2- 172.21.15.114:0/2333552197 >> [v2:172.21.15.114:6832/2240257326,v1:172.21.15.114:6833/2240257326] conn(0x7f6e0806c9b0 0x7f6e0806ee70 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:09:01.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.774+0000 7f6e2ac47640 1 --2- 172.21.15.114:0/2333552197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e2415c370 0x7f6e2414f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:09:01.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.774+0000 7f6e2ac47640 1 --2- 172.21.15.114:0/2333552197 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e240b4850 0x7f6e240afff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:09:01.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.774+0000 7f6e2ac47640 1 --2- 172.21.15.114:0/2333552197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e24072e30 0x7f6e240af280 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-28T13:09:01.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.774+0000 7f6e2ac47640 1 -- 172.21.15.114:0/2333552197 >> 172.21.15.114:0/2333552197 conn(0x7f6e2406c980 msgr2=0x7f6e240b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-28T13:09:01.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.774+0000 7f6e2ac47640 1 -- 172.21.15.114:0/2333552197 shutdown_connections 2024-04-28T13:09:01.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-28T13:09:01.774+0000 7f6e2ac47640 1 -- 172.21.15.114:0/2333552197 wait complete. 2024-04-28T13:09:01.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-28T13:09:01.785 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp -p ./volumes/subvol_grp35980/subvol11940/.meta.stale_snap_section ./volumes/subvol_grp35980/subvol11940/.meta) 2024-04-28T13:09:20.149 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:09:20.153 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:09:50.279 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:09:50.283 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:10:20.432 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:10:20.435 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:10:50.789 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:10:50.793 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:11:20.919 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:11:20.923 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:11:50.984 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:11:50.987 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:12:21.155 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:12:21.158 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:12:51.251 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:12:51.254 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:13:21.381 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:13:21.385 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:13:51.447 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:13:51.451 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:14:01.788 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 745, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 154, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 109, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 275, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1374, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr raise socket.timeout() socket.timeout 2024-04-28T13:14:01.790 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 697, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 154, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 109, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 275, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1359, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 699, in recv raise socket.timeout() socket.timeout 2024-04-28T13:14:21.595 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:14:21.599 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:14:51.788 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:14:51.791 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:15:21.936 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:15:21.940 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:15:52.066 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:15:52.069 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:16:22.212 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:16:22.216 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:16:52.368 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:16:52.371 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:17:22.473 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:17:22.477 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:17:52.687 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:17:52.691 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:18:22.793 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:18:22.797 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:18:52.898 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:18:52.901 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:19:22.969 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:19:22.973 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:19:53.101 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:19:53.104 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:20:23.413 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:20:23.417 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:20:53.538 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:20:53.541 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:21:23.874 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:21:23.877 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:21:53.937 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:21:53.941 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:22:24.079 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:22:24.083 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:22:54.232 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:22:54.235 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:23:24.371 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:23:24.375 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:23:54.521 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:23:54.525 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:24:24.664 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:24:24.668 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:24:54.745 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:24:54.748 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:25:24.867 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:25:24.871 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:25:54.940 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:25:54.943 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:26:25.086 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:26:25.089 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:26:55.241 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:26:55.244 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:27:25.357 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:27:25.361 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:27:55.487 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:27:55.490 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:28:25.628 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:28:25.631 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:28:55.732 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:28:55.735 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:29:25.919 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:29:25.922 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:29:56.057 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:29:56.060 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:30:26.202 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:30:26.205 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:30:56.313 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:30:56.317 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:31:26.389 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:31:26.392 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:31:56.529 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:31:56.532 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:32:26.600 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:32:26.603 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:32:56.755 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:32:56.758 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:33:26.944 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:33:26.948 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:33:57.006 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:33:57.010 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:34:27.178 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:34:27.182 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:34:57.326 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:34:57.330 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:35:27.448 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:35:27.451 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:35:57.595 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:35:57.598 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:36:27.734 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:36:27.737 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:36:57.882 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:36:57.885 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:37:28.011 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:37:28.015 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:37:58.113 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:37:58.116 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:38:28.244 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:38:28.247 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:38:58.566 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:38:58.569 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:39:28.652 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:39:28.655 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:39:58.784 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:39:58.787 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:40:28.872 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:40:28.875 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:40:59.010 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:40:59.013 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:41:29.132 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:41:29.136 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:41:59.256 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:41:59.259 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:42:29.402 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:42:29.406 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:42:59.541 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:42:59.544 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:43:29.638 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:43:29.642 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:43:59.783 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:43:59.787 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:44:29.847 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:44:29.850 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:44:59.977 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:44:59.980 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:45:30.240 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:45:30.243 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:46:00.375 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:46:00.378 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:46:30.650 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:46:30.653 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:47:00.738 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:47:00.742 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:47:30.877 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:47:30.880 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:48:01.057 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:48:01.060 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:48:31.196 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:48:31.199 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:49:01.342 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:49:01.345 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:49:31.479 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:49:31.483 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:50:01.534 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:50:01.537 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:50:31.668 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:50:31.671 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:51:01.753 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:51:01.756 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:51:31.874 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:51:31.877 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:52:01.963 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:52:01.967 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:52:32.110 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:52:32.114 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:53:02.305 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:53:02.309 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:53:32.436 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:53:32.440 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:54:02.583 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:54:02.587 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:54:32.730 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:54:32.734 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:55:02.878 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:55:02.881 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:55:33.052 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:55:33.055 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:56:03.192 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:56:03.195 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:56:33.245 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:56:33.248 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:57:03.384 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:57:03.387 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:57:33.705 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:57:33.709 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:58:03.861 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:58:03.864 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:58:34.065 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:58:34.068 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:59:04.213 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:59:04.217 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:59:34.319 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T13:59:34.322 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:00:04.482 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:00:04.485 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:00:34.637 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:00:34.641 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:01:04.813 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:01:04.816 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:01:34.956 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:01:34.959 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:02:05.019 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:02:05.024 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:02:35.160 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:02:35.163 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:03:05.220 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:03:05.224 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:03:35.351 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:03:35.354 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:04:05.506 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:04:05.509 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:04:35.654 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:04:35.659 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:05:05.811 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:05:05.814 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:05:35.866 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:05:35.869 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:06:06.012 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:06:06.015 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:06:36.154 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:06:36.184 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:07:06.336 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:07:06.340 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:07:36.486 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:07:36.490 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:08:06.624 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:08:06.628 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:08:36.692 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:08:36.695 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:09:06.826 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:09:06.830 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:09:37.180 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:09:37.186 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:10:07.303 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:10:07.306 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:10:37.523 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:10:37.526 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:11:07.670 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:11:07.673 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:11:37.820 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:11:37.824 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:12:07.958 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:12:07.961 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:12:38.138 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:12:38.141 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:13:08.301 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:13:08.304 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:13:38.457 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:13:38.461 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:14:08.519 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:14:08.523 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:14:38.651 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:14:38.655 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:15:08.947 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:15:08.951 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:15:39.018 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:15:39.021 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:16:09.302 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:16:09.306 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:16:39.416 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:16:39.420 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:17:09.555 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:17:09.558 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:17:39.696 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:17:39.700 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:18:09.852 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:18:09.855 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:18:40.007 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:18:40.010 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:19:10.139 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:19:10.142 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:19:40.219 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:19:40.222 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:20:10.334 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:20:10.337 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:20:40.424 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:20:40.427 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:21:10.546 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:21:10.550 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:21:40.715 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:21:40.719 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:22:10.920 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:22:10.924 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:22:41.001 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:22:41.005 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:23:11.116 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:23:11.120 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:23:41.247 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:23:41.250 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:24:11.393 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:24:11.398 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:24:41.523 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:24:41.527 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:25:11.603 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:25:11.606 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:25:41.733 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:25:41.737 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:26:11.831 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:26:11.835 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:26:42.131 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:26:42.134 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:27:12.235 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:27:12.238 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:27:42.362 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:27:42.365 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:28:12.484 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:28:12.487 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:28:42.623 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:28:42.627 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:29:12.751 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:29:12.754 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:29:42.883 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:29:42.887 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:30:13.014 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:30:13.018 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:30:43.152 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:30:43.155 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:31:13.292 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:31:13.295 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:31:43.538 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:31:43.542 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:32:13.662 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:32:13.665 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:32:43.732 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:32:43.736 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:33:13.871 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:33:13.877 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:33:44.077 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:33:44.083 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:34:14.206 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:34:14.210 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:34:44.457 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:34:44.462 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:35:14.600 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:35:14.604 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:35:44.680 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:35:44.683 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:36:14.851 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:36:14.855 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:36:44.995 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:36:44.998 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:37:15.159 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:37:15.162 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:37:45.281 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:37:45.285 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:38:15.372 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:38:15.375 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:38:45.502 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:38:45.506 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:39:15.583 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:39:15.586 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:39:45.721 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:39:45.725 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:40:15.885 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:40:15.888 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:40:46.006 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:40:46.010 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:41:16.191 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:41:16.194 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:41:46.312 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:41:46.318 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:42:16.409 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:42:16.413 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:42:46.585 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:42:46.589 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:43:16.741 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:43:16.744 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:43:46.844 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:43:46.848 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:44:16.992 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:44:16.996 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:44:47.064 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:44:47.067 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:45:17.336 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:45:17.339 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:45:47.515 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:45:47.519 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:46:17.654 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:46:17.658 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:46:47.937 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:46:47.943 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:47:18.101 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:47:18.105 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:47:48.247 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:47:48.250 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:48:18.553 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:48:18.556 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:48:48.621 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:48:48.625 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:49:18.755 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:49:18.759 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:49:48.815 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:49:48.819 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:50:18.871 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:50:18.875 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:50:48.998 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:50:49.003 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:51:19.062 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:51:19.065 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:51:49.202 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:51:49.206 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:52:19.358 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:52:19.362 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:52:49.495 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:52:49.498 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:53:19.635 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:53:19.638 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:53:49.783 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:53:49.787 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:54:20.062 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:54:20.066 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:54:50.193 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:54:50.196 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:55:20.315 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:55:20.321 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:55:50.376 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:55:50.379 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:56:20.506 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:56:20.509 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:56:50.591 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:56:50.594 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:57:20.725 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:57:20.728 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:57:50.960 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:57:50.963 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:58:21.019 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:58:21.022 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:58:51.331 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:58:51.335 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:59:21.487 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:59:21.491 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:59:51.627 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T14:59:51.630 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:00:21.766 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:00:21.771 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:00:51.921 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:00:51.925 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:01:22.069 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:01:22.072 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:01:52.183 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:01:52.186 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:02:22.269 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:02:22.273 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:02:52.395 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:02:52.398 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:03:22.463 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:03:22.466 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:03:52.609 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:03:52.612 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:04:22.690 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:04:22.693 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:04:52.828 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:04:52.832 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:05:23.043 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:05:23.047 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:05:53.191 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:05:53.197 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:06:23.460 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:06:23.464 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:06:53.592 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:06:53.596 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:07:23.739 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:07:23.748 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:07:53.828 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:07:53.831 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:08:23.955 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:08:23.959 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:08:54.026 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:08:54.030 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:09:24.165 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:09:24.169 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:09:54.504 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:09:54.509 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:10:24.634 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:10:24.638 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:10:54.765 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:10:54.768 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:11:24.854 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:11:24.859 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:11:55.000 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:11:55.004 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:12:25.123 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:12:25.126 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:12:55.270 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:12:55.277 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:13:25.400 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:13:25.404 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:13:55.647 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:13:55.650 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:14:25.718 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:14:25.722 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:14:55.866 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:14:55.869 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:15:25.924 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:15:25.927 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:15:56.068 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:15:56.071 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:16:26.179 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:16:26.182 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:16:56.318 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:16:56.321 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:17:26.489 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:17:26.493 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:17:56.653 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:17:56.657 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:18:26.775 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:18:26.778 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:18:56.941 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:18:56.944 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:19:27.111 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:19:27.114 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:19:57.275 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:19:57.278 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:20:27.412 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:20:27.415 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:20:57.503 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:20:57.509 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:21:27.633 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:21:27.636 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:21:57.724 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:21:57.728 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:22:27.862 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:22:27.866 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:22:57.957 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:22:57.961 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:23:28.107 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:23:28.111 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:23:58.272 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:23:58.275 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:24:28.407 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:24:28.411 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:24:58.550 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:24:58.553 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:25:28.673 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:25:28.677 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:25:58.739 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:25:58.743 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:26:28.910 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:26:28.913 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:26:59.024 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:26:59.027 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:27:29.096 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:27:29.163 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:27:59.302 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:27:59.305 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:28:29.599 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:28:29.602 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:28:59.713 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:28:59.716 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:29:29.845 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:29:29.849 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:29:59.999 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:30:00.003 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:30:30.155 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:30:30.159 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:31:00.268 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:31:00.271 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:31:30.407 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:31:30.411 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:32:00.530 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:32:00.533 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:32:30.666 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:32:30.670 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:33:00.741 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:33:00.744 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:33:30.886 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:33:30.890 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:34:00.944 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:34:00.948 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:34:31.079 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:34:31.082 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:35:01.135 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:35:01.138 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:35:31.253 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:35:31.256 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:36:01.334 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:36:01.339 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:36:31.493 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:36:31.496 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:37:01.648 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:37:01.651 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:37:31.776 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:37:31.780 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:38:01.850 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:38:01.854 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:38:31.980 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:38:31.984 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:39:02.119 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:39:02.123 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:39:32.282 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:39:32.286 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:40:02.413 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:40:02.416 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:40:32.478 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:40:32.481 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:41:02.617 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:41:02.621 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:41:32.963 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:41:32.966 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:42:03.111 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:42:03.115 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:42:33.293 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:42:33.297 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:43:03.430 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:43:03.434 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:43:33.569 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:43:33.573 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:44:03.693 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:44:03.697 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:44:33.832 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:44:33.836 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:45:03.896 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:45:03.900 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:45:34.022 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:45:34.026 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:46:04.085 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:46:04.089 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:46:34.300 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:46:34.304 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:47:04.363 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:47:04.367 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:47:34.502 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:47:34.505 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:48:04.631 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:48:04.635 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:48:34.780 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:48:34.784 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:49:04.869 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:49:04.874 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:49:35.017 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:49:35.020 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:50:05.145 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:50:05.149 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:50:35.288 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:50:35.291 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:51:05.406 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:51:05.410 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:51:35.557 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:51:35.561 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:52:05.701 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:52:05.705 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:52:35.789 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:52:35.792 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:53:05.944 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:53:05.948 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:53:36.023 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:53:36.026 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:54:06.171 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:54:06.175 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:54:36.286 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:54:36.289 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:55:06.382 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:55:06.385 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:55:36.529 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:55:36.532 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:56:06.668 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:56:06.671 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:56:36.816 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:56:36.819 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:57:06.878 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:57:06.882 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:57:37.011 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:57:37.015 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:58:07.143 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:58:07.148 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:58:37.273 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:58:37.277 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:59:07.371 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:59:07.375 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:59:37.519 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T15:59:37.522 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:00:07.587 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:00:07.590 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:00:37.658 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:00:37.662 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:01:07.760 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:01:07.763 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:01:37.820 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:01:37.823 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:02:07.889 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:02:07.893 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:02:38.030 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:02:38.033 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:03:08.235 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:03:08.239 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:03:38.375 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:03:38.380 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:04:08.513 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:04:08.516 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:04:38.672 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:04:38.675 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:05:08.815 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:05:08.819 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:05:38.997 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:05:39.000 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:06:09.111 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:06:09.115 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:06:39.181 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:06:39.185 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:07:09.328 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:07:09.331 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:07:39.691 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:07:39.695 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:08:09.751 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:08:09.755 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:08:40.090 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:08:40.094 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:09:10.155 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:09:10.159 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:09:40.288 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:09:40.292 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:10:10.424 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:10:10.428 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:10:40.592 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:10:40.595 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:11:10.655 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:11:10.659 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:11:40.803 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:11:40.807 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:12:10.882 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:12:10.886 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:12:41.021 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:12:41.026 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:13:11.094 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:13:11.098 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:13:41.266 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:13:41.270 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:14:11.437 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:14:11.442 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:14:41.553 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:14:41.557 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:15:11.617 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:15:11.621 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:15:41.770 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:15:41.776 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:16:11.834 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:16:11.838 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:16:42.014 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:16:42.017 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:17:12.153 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:17:12.157 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:17:42.303 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:17:42.306 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:18:12.428 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:18:12.431 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:18:42.500 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:18:42.503 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:19:12.623 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:19:12.627 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:19:42.686 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:19:42.689 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:20:12.834 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:20:12.838 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:20:43.030 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:20:43.033 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:21:13.168 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:21:13.171 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:21:43.432 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:21:43.436 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:22:13.538 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:22:13.541 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:22:43.659 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:22:43.662 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:23:13.823 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:23:13.827 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:23:43.886 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:23:43.890 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:24:13.952 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:24:13.956 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:24:44.113 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:24:44.116 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:25:14.176 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:25:14.180 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:25:44.324 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:25:44.327 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:26:14.400 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:26:14.404 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:26:44.535 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:26:44.538 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:27:14.606 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:27:14.610 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:27:44.675 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:27:44.679 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:28:14.900 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:28:14.902 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:28:45.047 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:28:45.051 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:29:15.218 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:29:15.221 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:29:45.376 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:29:45.379 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:30:15.513 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:30:15.517 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:30:45.659 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:30:45.662 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:31:15.724 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:31:15.728 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:31:45.780 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:31:45.784 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:32:15.934 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:32:15.938 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:32:46.006 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:32:46.011 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:33:16.153 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:33:16.156 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:33:46.383 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:33:46.386 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:34:16.505 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:34:16.509 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:34:46.773 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:34:46.777 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:35:16.857 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:35:16.861 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:35:47.010 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:35:47.013 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:36:17.155 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:36:17.160 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:36:47.304 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:36:47.308 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:37:17.379 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:37:17.382 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:37:47.516 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:37:47.520 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:38:17.614 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:38:17.619 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:38:47.761 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:38:47.764 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:39:17.816 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:39:17.820 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:39:47.955 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:39:47.959 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:40:18.062 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:40:18.065 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:40:48.175 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:40:48.179 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:41:18.457 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:41:18.461 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:41:48.612 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:41:48.615 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:42:18.668 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:42:18.671 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:42:48.863 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:42:48.866 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:43:18.935 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:43:18.938 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:43:49.044 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:43:49.047 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:44:19.171 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:44:19.175 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:44:49.264 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:44:49.267 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:45:19.394 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:45:19.397 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:45:49.461 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:45:49.464 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:46:19.599 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:46:19.603 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:46:49.788 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:46:49.790 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:47:19.876 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:47:19.879 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:47:50.154 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:47:50.158 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:48:20.287 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:48:20.290 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:48:50.416 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:48:50.419 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:49:20.547 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:49:20.551 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:49:50.694 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:49:50.698 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:50:20.760 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:50:20.765 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:50:50.922 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:50:50.926 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:51:20.983 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:51:20.986 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:51:51.113 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:51:51.117 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:52:21.185 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:52:21.190 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:52:51.333 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:52:51.336 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:53:21.480 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:53:21.484 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:53:51.635 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:53:51.639 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:54:21.814 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:54:21.818 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:54:51.897 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:54:51.900 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:55:22.044 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:55:22.047 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:55:52.099 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:55:52.103 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:56:22.238 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:56:22.241 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:56:52.385 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:56:52.389 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:57:22.518 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:57:22.521 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:57:52.629 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:57:52.633 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:58:22.760 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:58:22.764 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:58:52.831 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:58:52.834 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:59:22.986 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:59:22.990 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:59:53.184 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T16:59:53.188 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:00:23.326 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:00:23.329 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:00:53.515 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:00:53.519 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:01:23.635 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:01:23.638 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:01:53.747 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:01:53.750 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:02:23.898 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:02:23.901 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:02:53.958 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:02:53.962 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:03:24.076 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:03:24.079 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:03:54.215 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:03:54.218 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:04:24.284 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:04:24.287 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:04:54.422 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:04:54.426 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:05:24.494 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:05:24.497 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:05:54.642 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:05:54.645 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:06:24.805 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:06:24.808 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:06:54.943 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:06:54.946 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:07:25.090 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:07:25.093 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:07:55.195 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:07:55.198 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:08:25.333 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:08:25.336 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:08:55.515 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:08:55.519 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:09:25.679 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:09:25.683 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:09:55.801 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:09:55.804 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:10:25.930 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:10:25.933 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:10:56.010 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:10:56.013 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:11:26.073 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:11:26.077 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:11:56.223 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:11:56.227 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:12:26.301 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:12:26.304 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:12:56.472 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:12:56.475 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:13:26.594 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:13:26.598 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:13:56.772 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:13:56.777 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:14:26.920 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:14:26.924 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:14:57.067 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:14:57.071 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:15:27.197 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:15:27.201 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:15:57.328 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:15:57.332 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:16:27.443 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:16:27.447 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:16:57.573 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:16:57.577 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:17:27.636 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:17:27.640 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:17:57.774 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:17:57.779 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:18:27.848 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:18:27.852 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:18:57.986 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:18:57.989 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:19:28.149 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:19:28.152 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:19:58.282 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:19:58.290 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:20:28.418 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:20:28.423 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:20:58.574 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:20:58.577 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:21:28.708 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:21:28.711 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:21:58.880 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:21:58.883 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:22:29.020 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:22:29.024 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:22:59.134 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:22:59.138 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:23:29.266 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:23:29.270 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:23:59.428 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:23:59.433 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:24:29.492 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:24:29.496 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:24:59.582 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:24:59.586 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:25:29.716 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:25:29.719 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:25:59.868 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:25:59.872 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:26:30.007 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:26:30.012 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:27:00.159 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:27:00.163 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:27:30.302 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:27:30.306 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:28:00.417 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:28:00.421 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:28:30.602 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:28:30.606 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:29:00.737 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:29:00.740 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:29:30.916 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:29:30.919 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:30:01.049 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:30:01.053 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:30:31.130 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:30:31.134 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:31:01.260 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:31:01.264 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:31:31.608 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:31:31.612 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:32:01.671 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:32:01.675 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:32:31.937 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:32:31.940 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:33:01.998 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:33:02.001 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:33:32.124 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:33:32.128 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:34:02.302 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:34:02.305 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:34:32.431 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:34:32.434 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:35:02.495 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:35:02.499 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:35:32.631 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:35:32.634 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:36:02.697 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:36:02.701 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:36:32.827 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:36:32.830 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:37:02.892 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:37:02.895 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:37:33.062 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:37:33.065 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:38:03.297 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:38:03.300 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:38:33.410 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:38:33.414 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:39:03.638 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:39:03.642 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:39:33.797 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:39:33.800 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:40:03.890 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:40:03.894 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:40:34.043 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:40:34.046 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:41:04.185 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:41:04.188 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:41:34.307 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:41:34.310 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:42:04.438 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:42:04.442 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:42:34.500 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:42:34.503 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:43:04.626 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:43:04.629 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:43:34.710 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:43:34.713 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:44:04.840 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:44:04.843 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:44:34.964 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:44:34.968 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:45:05.104 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:45:05.109 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:45:35.326 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:45:35.330 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:46:05.439 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:46:05.443 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:46:35.577 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:46:35.581 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:47:05.749 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:47:05.754 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:47:35.874 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:47:35.878 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:48:05.996 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:48:06.000 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:48:36.123 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:48:36.127 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:49:06.187 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:49:06.191 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:49:36.343 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:49:36.346 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:50:06.406 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:50:06.411 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:50:36.470 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:50:36.474 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:51:06.534 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:51:06.538 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:51:36.589 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:51:36.594 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:52:06.653 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:52:06.657 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:52:36.792 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:52:36.797 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:53:06.914 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:53:06.918 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:53:37.053 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:53:37.057 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:54:07.191 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:54:07.195 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:54:37.357 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:54:37.360 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:55:07.453 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:55:07.457 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:55:37.517 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:55:37.520 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:56:07.690 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:56:07.694 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:56:37.755 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:56:37.759 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:57:07.878 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:57:07.882 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:57:37.947 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:57:37.951 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:58:08.081 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:58:08.085 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:58:38.207 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:58:38.211 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:59:08.363 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:59:08.367 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:59:38.574 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T17:59:38.578 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:00:08.731 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:00:08.736 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:00:38.970 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:00:38.974 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:01:09.084 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:01:09.087 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:01:39.231 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:01:39.234 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:02:09.420 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:02:09.424 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:02:39.534 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:02:39.537 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:03:09.596 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:03:09.601 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:03:39.730 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:03:39.734 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:04:09.818 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:04:09.822 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:04:39.946 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:04:39.949 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:05:10.102 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:05:10.105 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:05:40.232 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:05:40.235 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:06:10.358 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:06:10.360 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:06:40.473 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:06:40.476 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:07:10.595 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:07:10.598 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:07:40.709 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:07:40.712 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:08:10.865 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:08:10.869 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:08:40.931 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:08:40.933 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:09:11.053 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:09:11.057 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:09:41.125 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:09:41.129 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:10:11.247 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:10:11.251 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:10:41.319 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:10:41.323 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:11:11.458 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:11:11.462 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:11:41.581 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:11:41.585 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:12:11.720 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:12:11.724 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:12:41.860 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:12:41.864 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:13:12.009 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:13:12.013 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:13:42.122 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:13:42.127 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:14:12.261 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:14:12.264 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:14:42.433 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:14:42.435 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:15:12.572 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:15:12.576 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:15:42.712 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:15:42.715 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:16:12.776 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:16:12.778 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:16:42.891 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:16:42.894 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:17:13.016 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:17:13.019 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:17:43.107 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:17:43.111 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:18:13.247 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:18:13.251 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:18:43.387 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:18:43.390 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:19:13.533 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:19:13.536 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:19:43.597 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:19:43.601 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:20:13.661 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:20:13.666 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:20:43.754 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:20:43.760 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:21:13.823 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:21:13.826 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:21:43.970 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:21:43.974 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:22:14.114 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:22:14.118 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:22:44.299 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:22:44.302 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:23:14.442 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:23:14.445 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:23:44.519 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:23:44.522 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:24:14.670 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:24:14.673 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:24:44.735 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:24:44.738 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:25:14.809 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:25:14.813 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:25:44.940 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:25:44.944 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:26:14.996 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:26:15.001 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:26:45.183 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:26:45.186 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:27:15.305 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:27:15.309 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:27:45.444 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:27:45.448 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:28:15.600 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:28:15.603 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:28:45.746 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:28:45.750 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:29:15.871 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:29:15.875 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:29:46.018 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:29:46.021 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:30:16.108 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:30:16.112 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:30:46.247 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:30:46.250 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:31:16.324 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:31:16.327 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:31:46.477 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:31:46.480 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:32:16.544 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:32:16.548 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:32:46.674 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:32:46.678 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:33:16.895 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:33:16.898 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:33:47.026 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:33:47.029 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:34:17.147 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:34:17.150 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:34:47.303 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:34:47.306 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:35:17.437 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:35:17.441 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:35:47.576 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:35:47.579 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:36:17.743 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:36:17.746 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:36:47.806 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:36:47.810 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:37:17.950 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:37:17.956 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:37:48.284 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:37:48.288 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:38:18.340 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:38:18.344 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:38:48.478 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:38:48.482 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:39:18.625 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:39:18.629 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:39:48.756 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:39:48.759 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:40:18.888 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:40:18.891 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:40:49.027 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:40:49.030 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:41:19.080 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:41:19.083 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:41:49.227 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:41:49.231 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:42:19.361 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:42:19.365 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:42:49.509 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:42:49.512 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:43:19.574 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:43:19.577 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:43:49.724 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:43:49.732 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:44:19.795 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:44:19.799 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:44:49.925 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:44:49.929 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:45:20.058 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:45:20.062 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:45:50.187 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:45:50.191 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:46:20.342 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:46:20.345 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:46:50.488 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:46:50.492 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:47:20.628 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:47:20.631 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:47:50.767 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:47:50.771 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:48:20.915 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:48:20.919 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:48:51.055 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:48:51.058 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:49:21.202 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:49:21.206 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:49:51.263 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:49:51.266 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:50:21.405 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:50:21.409 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:50:51.641 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:50:51.645 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:51:21.772 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:51:21.775 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:51:52.032 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:51:52.035 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:52:22.154 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:52:22.157 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:52:52.302 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:52:52.306 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:53:22.462 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:53:22.466 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:53:52.613 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:53:52.616 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:54:22.791 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:54:22.794 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:54:52.948 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:54:52.951 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:55:23.015 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:55:23.018 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:55:53.137 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:55:53.141 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:56:23.440 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:56:23.443 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:56:53.499 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:56:53.503 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:57:23.566 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:57:23.569 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:57:53.704 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:57:53.708 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:58:23.852 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:58:23.855 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:58:53.914 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:58:53.918 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:59:24.087 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:59:24.091 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:59:54.219 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T18:59:54.223 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:00:24.280 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:00:24.284 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:00:54.455 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:00:54.459 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:01:24.584 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:01:24.587 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:01:54.656 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:01:54.660 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:02:24.786 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:02:24.790 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:02:55.093 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:02:55.097 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:03:25.255 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:03:25.258 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:03:55.484 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:03:55.488 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:04:25.624 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:04:25.628 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:04:55.773 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:04:55.779 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:05:25.910 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:05:25.915 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:05:56.073 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:05:56.076 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:06:26.229 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:06:26.232 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:06:56.377 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:06:56.381 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:07:26.439 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:07:26.443 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:07:56.594 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:07:56.598 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:08:26.908 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:08:26.911 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:08:57.012 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:08:57.016 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:09:27.151 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:09:27.156 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:09:57.281 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:09:57.284 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:10:27.348 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:10:27.354 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:10:57.485 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:10:57.488 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:11:27.622 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:11:27.626 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:11:57.715 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:11:57.720 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:12:27.845 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:12:27.848 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:12:57.911 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:12:57.915 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:13:28.053 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:13:28.057 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:13:58.117 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:13:58.122 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:14:28.271 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:14:28.275 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:14:58.344 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:14:58.347 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:15:28.520 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:15:28.524 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:15:58.662 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:15:58.666 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:16:28.806 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:16:28.809 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:16:58.951 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:16:58.954 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:17:29.089 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:17:29.094 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:17:59.234 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:17:59.238 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:18:29.301 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:18:29.305 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:18:59.386 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:18:59.390 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:19:29.513 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:19:29.517 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:19:59.571 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:19:59.575 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:20:29.652 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:20:29.655 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:20:59.791 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:20:59.795 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:21:29.862 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:21:29.865 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:22:00.001 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:22:00.004 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:22:30.165 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:22:30.168 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:23:00.379 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:23:00.383 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:23:30.527 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:23:30.532 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:24:00.656 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:24:00.661 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:24:30.803 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:24:30.806 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:25:00.924 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:25:00.928 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:25:31.037 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:25:31.041 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:26:01.104 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:26:01.108 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:26:31.206 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:26:31.209 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:27:01.270 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:27:01.275 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:27:31.413 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:27:31.417 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:28:01.472 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:28:01.476 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:28:31.624 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:28:31.628 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:29:01.858 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:29:01.861 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:29:31.996 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:29:32.000 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:30:02.174 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:30:02.178 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:30:32.305 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:30:32.308 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:31:02.438 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:31:02.442 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:31:32.615 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:31:32.621 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:32:02.748 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:32:02.751 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:32:32.913 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:32:32.918 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:33:03.035 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:33:03.039 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:33:33.100 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:33:33.104 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:34:03.255 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:34:03.259 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:34:33.386 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:34:33.391 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:35:03.517 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:35:03.521 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:35:33.645 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:35:33.649 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:36:03.708 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:36:03.712 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:36:33.859 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:36:33.863 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:37:03.976 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:37:03.979 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:37:34.120 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:37:34.124 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:38:04.269 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:38:04.273 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:38:34.343 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:38:34.347 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:39:04.497 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:39:04.501 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:39:34.644 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:39:34.648 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:40:04.707 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:40:04.710 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:40:34.855 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:40:34.858 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:41:04.919 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:41:04.922 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:41:35.066 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:41:35.069 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:42:05.188 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:42:05.191 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:42:35.337 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:42:35.341 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:43:05.543 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:43:05.547 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:43:35.622 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:43:35.626 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:44:05.761 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:44:05.765 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:44:35.824 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:44:35.828 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:45:05.950 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:45:05.954 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:45:36.009 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:45:36.013 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:46:06.154 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:46:06.157 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:46:36.259 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:46:36.263 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:47:06.398 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:47:06.402 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:47:36.480 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:47:36.482 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:48:06.627 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:48:06.631 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:48:36.842 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:48:36.846 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:49:06.906 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:49:06.911 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:49:37.219 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:49:37.222 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:50:07.367 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:50:07.371 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:50:37.498 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:50:37.501 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:51:07.620 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:51:07.623 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:51:37.733 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:51:37.736 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:52:07.800 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:52:07.810 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:52:37.929 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:52:37.933 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:53:08.004 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:53:08.009 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:53:38.149 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:53:38.153 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:54:08.213 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:54:08.217 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:54:38.357 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:54:38.362 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:55:08.425 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:55:08.429 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:55:38.556 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:55:38.560 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:56:08.653 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:56:08.657 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:56:38.775 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:56:38.778 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:57:08.889 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:57:08.893 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:57:39.002 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:57:39.007 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:58:09.133 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:58:09.137 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:58:39.273 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:58:39.278 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:59:09.430 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:59:09.434 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:59:39.625 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T19:59:39.629 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:00:09.758 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:00:09.761 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:00:39.817 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:00:39.821 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:01:09.962 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:01:09.966 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:01:40.243 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:01:40.247 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:02:10.390 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:02:10.394 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:02:40.579 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:02:40.582 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:03:10.695 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:03:10.699 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:03:40.834 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:03:40.837 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:04:11.015 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:04:11.018 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:04:41.073 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:04:41.076 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:05:11.193 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:05:11.197 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:05:41.333 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:05:41.336 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:06:11.397 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:06:11.400 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:06:41.528 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:06:41.531 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:07:11.584 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:07:11.587 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:07:41.731 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:07:41.734 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:08:11.917 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:08:11.921 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:08:42.073 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:08:42.076 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:09:12.282 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:09:12.285 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:09:42.416 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:09:42.420 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:10:12.560 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:10:12.562 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:10:42.691 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:10:42.694 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:11:12.815 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:11:12.835 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:11:42.920 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:11:42.923 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:12:13.087 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:12:13.090 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:12:43.151 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:12:43.155 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:13:13.269 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:13:13.272 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:13:43.343 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:13:43.346 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:14:13.480 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:14:13.484 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:14:43.619 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:14:43.622 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:15:13.685 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:15:13.691 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:15:43.820 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:15:43.824 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:16:13.934 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:16:13.938 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:16:44.072 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:16:44.077 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:17:14.175 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:17:14.179 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:17:44.333 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:17:44.337 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:18:14.454 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:18:14.458 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:18:44.600 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:18:44.604 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:19:14.673 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:19:14.677 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:19:44.829 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:19:44.833 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:20:14.905 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:20:14.908 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:20:45.059 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:20:45.062 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:21:15.278 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:21:15.282 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:21:45.337 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:21:45.341 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:22:15.619 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:22:15.623 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:22:45.757 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:22:45.761 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:23:15.881 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:23:15.885 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:23:46.059 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:23:46.062 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:24:16.119 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:24:16.123 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:24:46.197 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:24:46.200 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:25:16.320 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:25:16.323 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:25:46.400 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:25:46.403 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:26:16.531 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:26:16.535 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:26:46.601 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:26:46.605 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:27:16.750 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:27:16.753 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:27:46.810 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:27:46.813 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:28:16.940 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:28:16.943 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:28:47.005 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:28:47.008 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:29:17.144 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:29:17.147 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:29:47.224 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:29:47.227 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:30:17.339 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:30:17.342 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:30:47.587 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:30:47.590 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:31:17.676 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:31:17.679 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:31:47.740 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:31:47.744 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:32:17.809 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:32:17.812 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:32:47.952 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:32:47.956 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:33:18.027 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:33:18.031 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:33:48.172 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:33:48.177 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:34:18.233 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:34:18.236 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:34:48.372 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:34:48.376 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:35:18.503 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:35:18.507 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:35:48.651 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:35:48.654 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:36:18.910 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:36:18.914 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:36:49.048 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:36:49.051 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:37:19.180 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:37:19.183 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:37:49.345 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:37:49.349 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:38:19.477 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:38:19.480 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:38:49.626 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:38:49.631 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:39:19.761 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:39:19.765 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:39:49.875 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:39:49.879 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:40:20.007 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:40:20.010 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:40:50.346 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:40:50.350 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:41:20.460 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:41:20.464 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:41:50.657 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:41:50.661 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:42:20.797 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:42:20.800 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:42:50.933 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:42:50.937 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:43:21.042 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:43:21.046 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:43:51.169 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:43:51.173 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:44:21.241 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:44:21.245 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:44:51.480 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:44:51.484 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:45:21.552 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:45:21.556 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:45:51.699 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:45:51.703 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:46:21.762 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:46:21.766 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:46:51.900 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:46:51.904 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:47:21.998 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:47:22.003 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:47:52.129 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:47:52.132 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:48:22.375 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:48:22.379 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:48:52.506 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:48:52.509 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:49:22.812 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:49:22.815 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:49:52.884 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:49:52.888 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:50:23.040 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:50:23.043 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:50:53.137 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:50:53.141 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:51:23.267 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:51:23.271 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:51:53.356 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:51:53.359 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:52:23.470 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:52:23.475 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:52:53.783 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:52:53.787 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:53:23.874 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:53:23.878 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:53:54.105 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:53:54.109 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:54:24.249 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:54:24.252 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:54:54.375 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:54:54.379 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:55:24.514 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:55:24.517 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:55:54.645 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:55:54.650 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:56:24.784 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:56:24.788 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:56:54.915 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:56:54.919 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:57:24.979 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:57:24.983 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:57:55.112 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:57:55.115 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:58:25.175 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:58:25.180 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:58:55.246 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:58:55.251 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:59:25.311 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:59:25.315 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:59:55.434 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T20:59:55.437 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:00:25.555 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:00:25.566 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:00:55.694 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:00:55.697 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:01:25.817 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:01:25.821 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:01:55.956 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:01:55.959 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:02:26.171 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:02:26.175 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:02:56.243 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:02:56.247 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:03:26.399 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:03:26.402 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:03:56.533 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:03:56.537 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:04:26.696 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:04:26.700 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:04:56.760 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:04:56.764 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:05:26.887 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:05:26.891 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:05:57.092 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:05:57.096 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:06:27.155 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:06:27.158 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:06:57.468 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:06:57.472 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:07:27.548 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:07:27.551 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:07:57.680 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:07:57.684 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:08:27.743 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:08:27.746 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:08:57.890 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:08:57.894 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:09:28.023 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:09:28.026 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:09:58.169 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:09:58.172 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:10:28.408 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:10:28.412 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:10:58.531 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:10:58.535 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:11:28.591 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:11:28.595 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:11:58.722 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:11:58.725 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:12:28.827 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:12:28.831 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:12:58.949 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:12:58.953 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:13:29.194 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:13:29.201 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:13:59.349 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:13:59.353 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:14:29.498 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:14:29.502 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:14:59.571 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:14:59.574 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:15:29.684 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:15:29.687 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:15:59.789 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:15:59.792 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:16:29.930 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:16:29.933 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:17:00.000 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:17:00.004 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:17:30.140 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:17:30.144 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:18:00.220 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:18:00.224 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:18:30.367 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:18:30.370 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:19:00.465 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:19:00.469 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:19:30.631 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:19:30.635 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:20:00.852 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:20:00.856 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:20:30.986 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:20:30.990 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:21:01.121 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:21:01.124 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:21:31.285 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:21:31.289 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:22:01.418 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:22:01.422 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:22:31.604 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:22:31.608 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:23:01.754 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:23:01.758 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:23:31.814 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:23:31.818 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:24:01.954 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:24:01.957 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:24:32.284 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:24:32.287 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:25:02.345 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:25:02.348 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:25:32.453 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:25:32.456 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:26:02.542 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:26:02.546 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:26:32.614 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:26:32.618 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:27:02.753 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:27:02.758 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:27:32.816 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:27:32.819 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:28:02.956 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:28:02.959 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:28:33.078 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:28:33.082 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:29:03.159 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:29:03.162 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:29:33.323 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:29:33.327 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:30:03.388 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:30:03.391 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:30:33.551 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:30:33.555 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:31:03.618 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:31:03.621 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:31:33.753 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:31:33.758 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:32:03.883 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:32:03.886 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:32:34.006 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:32:34.010 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:33:04.068 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:33:04.072 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:33:34.283 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:33:34.287 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:34:04.411 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:34:04.415 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:34:34.581 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:34:34.585 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:35:04.716 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:35:04.721 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:35:34.787 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:35:34.790 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:36:04.892 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:36:04.896 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:36:34.949 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:36:34.953 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:37:05.088 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:37:05.091 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:37:35.152 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:37:35.156 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:38:05.281 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:38:05.285 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:38:35.528 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:38:35.531 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:39:05.651 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:39:05.654 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:39:35.876 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:39:35.879 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:40:05.935 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:40:05.939 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:40:36.082 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:40:36.086 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:41:06.180 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:41:06.183 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:41:36.258 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:41:36.264 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:42:06.381 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:42:06.385 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:42:36.521 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:42:36.525 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:43:06.609 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:43:06.613 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:43:36.740 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:43:36.744 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:44:06.828 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:44:06.832 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:44:36.976 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:44:36.980 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:45:07.207 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:45:07.210 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:45:37.364 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:45:37.367 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:46:07.540 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:46:07.543 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:46:37.683 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:46:37.686 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:47:07.808 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:47:07.812 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:47:37.895 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:47:37.898 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:48:07.951 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:48:07.955 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:48:38.073 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:48:38.077 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:49:08.143 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:49:08.146 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:49:38.294 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:49:38.297 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:50:08.412 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:50:08.415 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:50:38.493 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:50:38.497 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:51:08.627 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:51:08.630 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:51:38.903 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:51:38.906 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:52:08.974 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:52:08.979 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:52:39.270 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:52:39.274 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:53:09.417 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:53:09.420 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:53:39.557 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:53:39.625 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:54:09.754 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:54:09.757 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:54:39.901 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:54:39.905 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:55:10.065 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:55:10.069 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:55:40.179 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:55:40.183 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:56:10.248 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:56:10.252 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:56:40.363 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:56:40.366 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:57:10.650 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:57:10.654 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:57:40.711 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:57:40.714 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:58:11.000 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:58:11.004 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:58:41.125 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:58:41.132 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:59:11.221 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:59:11.225 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:59:41.343 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T21:59:41.346 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:00:11.508 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:00:11.512 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:00:41.579 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:00:41.583 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:01:11.719 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:01:11.723 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:01:41.840 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:01:41.843 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:02:11.970 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:02:11.974 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:02:42.025 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:02:42.029 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:03:12.165 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:03:12.169 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:03:42.344 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:03:42.351 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:04:12.474 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:04:12.477 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:04:42.676 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:04:42.680 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:05:12.832 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:05:12.835 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:05:42.965 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:05:42.969 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:06:13.163 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:06:13.166 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:06:43.284 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:06:43.288 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:07:13.340 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:07:13.344 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:07:43.479 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:07:43.483 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:08:13.543 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:08:13.547 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:08:43.655 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:08:43.659 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:09:13.722 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:09:13.725 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:09:43.856 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:09:43.860 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:10:14.054 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:10:14.058 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:10:44.177 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:10:44.181 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:11:14.371 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:11:14.374 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:11:44.594 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:11:44.598 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:12:14.842 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:12:14.845 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:12:44.972 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:12:44.976 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:13:15.111 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:13:15.114 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:13:45.234 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:13:45.238 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:14:15.357 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:14:15.360 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:14:45.412 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:14:45.416 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:15:15.558 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:15:15.561 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:15:45.814 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:15:45.819 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:16:15.944 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:16:15.947 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:16:46.179 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:16:46.182 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:17:16.310 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:17:16.313 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:17:46.392 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:17:46.396 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:18:16.589 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:18:16.593 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:18:46.752 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:18:46.755 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:19:16.910 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:19:16.913 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:19:47.049 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:19:47.052 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:20:17.120 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:20:17.123 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:20:47.302 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:20:47.305 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:21:17.357 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:21:17.360 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:21:47.505 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:21:47.509 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:22:17.576 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:22:17.580 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:22:47.700 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:22:47.703 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:23:17.830 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:23:17.834 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:23:47.970 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:23:47.974 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:24:18.118 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:24:18.121 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:24:48.344 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:24:48.347 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:25:18.655 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:25:18.658 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:25:48.712 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:25:48.722 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:26:18.843 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:26:18.846 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:26:48.906 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:26:48.910 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:27:19.035 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:27:19.038 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:27:49.274 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:27:49.278 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:28:19.406 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:28:19.409 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:28:49.571 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:28:49.575 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:29:19.634 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:29:19.638 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:29:49.968 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:29:49.971 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:30:20.096 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:30:20.099 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:30:50.220 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:30:50.225 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:31:20.378 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:31:20.382 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:31:50.465 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:31:50.477 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:32:20.612 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:32:20.616 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:32:50.758 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:32:50.761 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:33:20.872 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:33:20.876 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:33:51.029 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:33:51.033 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:34:21.168 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:34:21.171 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:34:51.290 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:34:51.293 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:35:21.353 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:35:21.357 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:35:51.474 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:35:51.478 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:36:21.531 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:36:21.535 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:36:51.651 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:36:51.655 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:37:21.798 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:37:21.802 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:37:51.920 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:37:51.924 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:38:22.067 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:38:22.070 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:38:52.305 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:38:52.309 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:39:22.385 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:39:22.388 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:39:52.532 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:39:52.535 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:40:22.644 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:40:22.647 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:40:52.793 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:40:52.796 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:41:22.931 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:41:22.934 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:41:53.053 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:41:53.057 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:42:23.199 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:42:23.203 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:42:53.346 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:42:53.350 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:43:23.435 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:43:23.441 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:43:53.506 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:43:53.510 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:44:23.587 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:44:23.592 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:44:53.721 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:44:53.724 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:45:23.848 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:45:23.855 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:45:53.944 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:45:53.947 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:46:24.084 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:46:24.087 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:46:54.229 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:46:54.233 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:47:24.377 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:47:24.381 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:47:54.507 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:47:54.510 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:48:24.629 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:48:24.633 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:48:54.776 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:48:54.779 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:49:24.839 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:49:24.842 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:49:54.987 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:49:54.991 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:50:25.111 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:50:25.114 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:50:55.256 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:50:55.259 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:51:25.404 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:51:25.408 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:51:55.560 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:51:55.563 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:52:25.697 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:52:25.700 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:52:55.845 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:52:55.919 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:53:26.032 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:53:26.036 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:53:56.171 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:53:56.175 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:54:26.301 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:54:26.304 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:54:56.440 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:54:56.443 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:55:26.570 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:55:26.573 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:55:56.833 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:55:56.837 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:56:26.956 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:56:26.960 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:56:57.043 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:56:57.047 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:57:27.173 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:57:27.177 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:57:57.321 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:57:57.325 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:58:27.470 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:58:27.473 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:58:57.632 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:58:57.635 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:59:27.762 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:59:27.765 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:59:57.918 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T22:59:57.922 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:00:28.065 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:00:28.068 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:00:58.119 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:00:58.122 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:01:28.285 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:01:28.288 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:01:58.439 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:01:58.442 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:02:28.568 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:02:28.572 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:02:58.682 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:02:58.685 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:03:28.787 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:03:28.791 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:03:58.925 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:03:58.928 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:04:29.048 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:04:29.051 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:04:59.170 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:04:59.174 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:05:29.233 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:05:29.237 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:05:59.381 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:05:59.385 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:06:29.437 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:06:29.443 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:06:59.500 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:06:59.504 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:07:29.556 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:07:29.562 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:07:59.712 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:07:59.716 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:08:29.867 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:08:29.871 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:09:00.198 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:09:00.201 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:09:30.320 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:09:30.324 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:10:00.451 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:10:00.454 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:10:30.582 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:10:30.585 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:11:00.720 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:11:00.723 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:11:30.866 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:11:30.870 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:12:00.999 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:12:01.002 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:12:31.060 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:12:31.063 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:13:01.207 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:13:01.210 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:13:31.338 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:13:31.341 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:14:01.451 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:14:01.455 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:14:31.602 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:14:31.605 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:15:01.733 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:15:01.737 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:15:31.863 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:15:31.867 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:16:02.015 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:16:02.019 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:16:32.075 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:16:32.078 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:17:02.222 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:17:02.226 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:17:32.386 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:17:32.390 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:18:02.452 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:18:02.457 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:18:32.583 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:18:32.586 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:19:02.722 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:19:02.726 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:19:32.867 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:19:32.871 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:20:02.931 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:20:02.934 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:20:33.071 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:20:33.075 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:21:03.210 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:21:03.213 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:21:33.298 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:21:33.302 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:22:03.504 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:22:03.507 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:22:33.642 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:22:33.646 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:23:03.764 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:23:03.767 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:23:33.879 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:23:33.883 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:24:04.017 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:24:04.056 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:24:34.155 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:24:34.158 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:25:04.270 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:25:04.274 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:25:34.393 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:25:34.397 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:26:04.532 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:26:04.535 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:26:34.677 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:26:34.681 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:27:04.751 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:27:04.755 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:27:34.904 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:27:34.907 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:28:05.026 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:28:05.030 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:28:35.173 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:28:35.176 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:29:05.312 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:29:05.315 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:29:35.450 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:29:35.453 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:30:05.621 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:30:05.625 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:30:35.676 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:30:35.680 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:31:05.816 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:31:05.819 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:31:35.945 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:31:35.949 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:32:06.042 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:32:06.048 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:32:36.181 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:32:36.185 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:33:06.253 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:33:06.257 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:33:36.392 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:33:36.396 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:34:06.540 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:34:06.544 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:34:36.702 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:34:36.706 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:35:06.832 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:35:06.836 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:35:36.962 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:35:36.966 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:36:07.084 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:36:07.088 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:36:37.219 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:36:37.222 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:37:07.278 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:37:07.281 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:37:37.401 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:37:37.409 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:38:07.565 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:38:07.568 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:38:37.696 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:38:37.699 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:39:08.025 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:39:08.028 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:39:38.160 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:39:38.164 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:40:08.269 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:40:08.273 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:40:38.408 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:40:38.412 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:41:08.553 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:41:08.557 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:41:38.702 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:41:38.706 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:42:08.857 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:42:08.860 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:42:39.004 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:42:39.008 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:43:09.125 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:43:09.133 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:43:39.192 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:43:39.196 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:44:09.306 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:44:09.310 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:44:39.462 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:44:39.465 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:45:09.590 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:45:09.731 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:45:39.887 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:45:39.890 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:46:10.036 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:46:10.041 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:46:40.183 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:46:40.186 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:47:10.254 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:47:10.257 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:47:40.393 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:47:40.396 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:48:10.450 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:48:10.454 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:48:40.530 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:48:40.533 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:49:10.668 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:49:10.671 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:49:40.806 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:49:40.810 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:50:10.937 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:50:10.941 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:50:41.051 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:50:41.055 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:51:11.131 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:51:11.134 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:51:41.270 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:51:41.274 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:52:11.366 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:52:11.369 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:52:41.471 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:52:41.474 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:53:11.527 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:53:11.530 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:53:41.683 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:53:41.687 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:54:11.819 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:54:11.822 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:54:41.969 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:54:41.972 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:55:12.107 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:55:12.111 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:55:42.236 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:55:42.240 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:56:12.342 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:56:12.345 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:56:42.481 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:56:42.484 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:57:12.545 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:57:12.549 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:57:42.684 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:57:42.687 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:58:12.839 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:58:13.182 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:58:43.244 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:58:43.247 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:59:13.349 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:59:13.352 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:59:43.474 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-28T23:59:43.478 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:00:13.610 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:00:13.614 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:00:43.753 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:00:43.757 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:01:13.876 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:01:13.880 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:01:43.938 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:01:43.943 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:02:14.039 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:02:14.042 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:02:44.185 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:02:44.191 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:03:14.307 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:03:14.311 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:03:44.435 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:03:44.439 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:04:14.515 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:04:14.519 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:04:44.642 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:04:44.646 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:05:14.776 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:05:14.780 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:05:44.911 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:05:44.915 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:06:15.062 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:06:15.066 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:06:45.218 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:06:45.222 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:07:15.357 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:07:15.361 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:07:45.454 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:07:45.458 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:08:15.593 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:08:15.596 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:08:45.724 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:08:45.730 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:09:15.852 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:09:15.856 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:09:45.986 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:09:45.993 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:10:16.147 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:10:16.151 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:10:46.300 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:10:46.303 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:11:16.381 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:11:16.384 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:11:46.504 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:11:46.508 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:12:16.601 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:12:16.605 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:12:46.744 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:12:46.748 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:13:16.879 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:13:16.883 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:13:47.022 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:13:47.026 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:14:17.155 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:14:17.159 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:14:47.308 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:14:47.312 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:15:17.450 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:15:17.454 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:15:47.572 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:15:47.575 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:16:17.645 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:16:17.648 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:16:47.758 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:16:47.763 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:17:17.822 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:17:17.825 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:17:47.960 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:17:47.964 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:18:18.107 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:18:18.110 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:18:48.246 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:18:48.251 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:19:18.385 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:19:18.389 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:19:48.439 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:19:48.443 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:20:18.552 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:20:18.556 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:20:48.694 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:20:48.700 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:21:18.816 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:21:18.820 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:21:48.955 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:21:48.959 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:22:19.061 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:22:19.065 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:22:49.195 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:22:49.200 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:23:19.331 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:23:19.334 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:23:49.437 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:23:49.465 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:24:19.602 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:24:19.606 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:24:49.725 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:24:49.728 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:25:19.864 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:25:19.868 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:25:49.986 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:25:49.990 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:26:20.100 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:26:20.103 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:26:50.196 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:26:50.200 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:27:20.319 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:27:20.322 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:27:50.392 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:27:50.396 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:28:20.529 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:28:20.536 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:28:50.627 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:28:50.630 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:29:20.766 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:29:20.769 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:29:50.825 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:29:50.829 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:30:20.943 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:30:20.946 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:30:51.088 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:30:51.092 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:31:21.218 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:31:21.222 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:31:51.369 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:31:51.373 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:32:21.505 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:32:21.508 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:32:51.628 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:32:51.631 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:33:21.701 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:33:21.705 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:33:51.824 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:33:51.829 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:34:21.954 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:34:21.976 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:34:52.135 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:34:52.139 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:35:22.258 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:35:22.261 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:35:52.413 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:35:52.417 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:36:22.493 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:36:22.497 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:36:52.614 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:36:52.617 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:37:22.703 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:37:22.706 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:37:52.816 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:37:52.820 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:38:22.946 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:38:22.950 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:38:53.094 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:38:53.098 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:39:23.240 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:39:23.244 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:39:53.387 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:39:53.390 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:40:23.504 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:40:23.510 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:40:53.665 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:40:53.669 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:41:23.787 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:41:23.790 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:41:53.956 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:41:53.960 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:42:24.023 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:42:24.027 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:42:54.170 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:42:54.174 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:43:24.309 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:43:24.313 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:43:54.465 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:43:54.469 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:44:24.612 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:44:24.615 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:44:54.751 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:44:54.754 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:45:24.813 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:45:24.817 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:45:54.969 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:45:54.973 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:46:25.117 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:46:25.121 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:46:55.248 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:46:55.251 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:47:25.404 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:47:25.408 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:47:55.525 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:47:55.529 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:48:25.672 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:48:25.676 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:48:55.810 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:48:55.814 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:49:25.868 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:49:25.872 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:49:55.996 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:49:55.999 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:50:26.152 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:50:26.156 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:50:56.306 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:50:56.310 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:51:26.453 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:51:26.457 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:51:56.595 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:51:56.600 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:52:26.734 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:52:26.738 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:52:56.899 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:52:56.903 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:53:27.038 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:53:27.041 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:53:57.160 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:53:57.164 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:54:27.315 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:54:27.318 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:54:57.438 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:54:57.442 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:55:27.582 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:55:27.586 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:55:57.709 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:55:57.713 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:56:27.772 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:56:27.775 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:56:57.844 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:56:57.848 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:57:27.902 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:57:27.907 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:57:58.049 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:57:58.053 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:58:28.095 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:58:28.099 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:58:58.234 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:58:58.239 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:59:28.390 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:59:28.394 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:59:58.504 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T00:59:58.508 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T01:00:28.651 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T01:00:28.655 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T01:00:58.891 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T01:00:58.896 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T01:01:29.023 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T01:01:29.027 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-29T01:01:46.319 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2024-04-29T01:01:46.320 DEBUG:teuthology.task.console_log:Killing console logger for smithi114 2024-04-29T01:01:46.320 DEBUG:teuthology.task.console_log:Killing console logger for smithi134 2024-04-29T01:01:46.321 DEBUG:teuthology.exit:Finished running handlers